Level 2

Solved

Current Method for Exporting Adobe Target Catalog?

Forum|Forum|3 years ago
July 3, 2022
3 replies
2066 views

Hey Target community.

I'm following up on a post from @brendanjaffary a few years ago.

https://experienceleaguecommunities.adobe.com/t5/adobe-target-ideas/ui-feature-to-export-all-products-from-a-catalog-collection/idi-p/339648

I manage a catalog of 200,000+ products and am looking for a way to mass-remove products that are no longer available and have thus 404d.

If I could simply export our entire Target catalog and compare it against our Target feed in something like Excel, then I could easily identify products that are no longer available, and run a Delete Entities API call on them.

http://developers.adobetarget.com/api/recommendations/#operation/deleteEntities

@rhornick has noted that there is a Catalog Search API that's close to what I'm looking for. But unfortunately, it's limited to 500 products.

http://developers.adobetarget.com/api/recommendations/#tag/Searching-Entities

To be honest, it seems like even the Delete Entities API call has a limit of 100 or so entities at a time.

Does anybody have any updated suggestions on cleaning up Target catalogs with entities in the hundreds of thousands?

Would it be possible to do something like the following?

Remove all entities from the development catalog if there are any.
Import a clean feed in the development catalog.
Point the production site to use the development catalog temporarily.
Remove all entities from the production catalog.
Import a clean feed in the production catalog.
Point the production site back to the production catalog.

Thanks in advance.

This post is no longer active and is closed to new replies. Need help? Start a new post to ask your question.

Best answer by Gaureshk_Kodag

Hi @nicholasdrzewiecki

Target imposes a 50-MB post limit at the application level; however, that is only when you pass the application/x-www-form-urlencoded content-type header.

You could certainly try to send 50,000 products in a single call. If it fails, you can break it up into batches. Adobe recommends that customers break their calls into 5,000 or 10,000 product batches to decrease the likelihood of a timeout due to system load

I guess there is no way to delete an entire catalog. However, you can reach out to client care to get this done.

You can go through the following documentation for more information on the same.

https://experienceleague.adobe.com/docs/target/using/recommendations/recommendations-faq/recommendations-faq.html?lang=en

Gaureshk_Kodag

Accepted solution

Adobe Employee

Hi @nicholasdrzewiecki

Target imposes a 50-MB post limit at the application level; however, that is only when you pass the application/x-www-form-urlencoded content-type header.

You could certainly try to send 50,000 products in a single call. If it fails, you can break it up into batches. Adobe recommends that customers break their calls into 5,000 or 10,000 product batches to decrease the likelihood of a timeout due to system load

I guess there is no way to delete an entire catalog. However, you can reach out to client care to get this done.

You can go through the following documentation for more information on the same.

https://experienceleague.adobe.com/docs/target/using/recommendations/recommendations-faq/recommendations-faq.html?lang=en

N

NicholasDrzewieckiAuthor

Level 2

Thanks for the reply @gaureshk_kodag

I've contacted Adobe Client Care to see if they can help me clean up our catalog.

We have approximately 200,000 entities coming into our catalog daily and our catalog has almost 600,000 entities. So it would take me a very long time to remove the 400,000 unavailable entities (404) with the limits to the Catalog Search and Delete Entities API calls.

I'll leave this thread open for a bit in case somebody comes along with a clever solution that's more autonomous than reaching out to Adobe. If I don't hear anything I'll look to mark your reply as the solution.

Thanks!

N

NicholasDrzewieckiAuthor

Level 2

I know this is late, but after reaching out to Adobe Customer Care quite some time ago, they were able to help with removing expired entities by re-indexing our catalog. Apparently, entities are supposed to automatically be purged from a catalog after not being updated for some time (I forget how long, either 30 or 60 days). It's possible the catalog will still show them in which case you may be able to reach out to Adobe Customer Care to re-index the catalog. There is no harm in these expired entities existing in the catalog, although I still think it would be nice if there was a way for us to purge them ourselves in mass given the limitations with deleting entities via API.

Amelia_Waliany

Adobe Employee

[8.31.22 Adobe Target Community Q&A Coffee Break Answer provided by @mosesmaxen:

----------------------------

Hi @NicholasDrzewiecki, thank you for your question. By default, any entities that are not updated via API or through the Target request in 61 days will be automatically purged from the catalog. If you are doing a manually deletion of entities via API, the recommendation is to delete the corresponding entities and work with our support team to refresh the catalog in the back end.

----------------------------

Check out the entire 8.31.22 Adobe Target Community Q&A Coffee Break discussion thread for more insights on related topics 🙂

N

NicholasDrzewieckiAuthor

Level 2

Thank you @amelia_waliany for the additional information! I'm sure it will be helpful to whoever comes across this thread in the future.

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded