AEM Assets - Smart Tagging

[chandra_s_gupta]

I have been working on a POC for  smart tagging, and the use case is –

1. Create a training model for group of images for two scenarios –
1. Tag the training images having a head shots of a person
2. Tag the training images having a company logo
2. Upload test images for both the scenarios with –
1. Images of same person and few with different person head shots
2. Image of same person in a group pic
3. Images of same company logo and few other company logos

For both the scenarios, it’s not able to recognize the correct person or logo to apply the respective tag. Is the face recognition not supported by adobe sensei ? is there any limitation here?  

Appreciate your help on this !

Thanks

[tusharbias · Accepted solution]

As far as I remember, facial recognition is not supported for smart tagging. 

Enhanced smart tagging is based on learning models of images and their tags. These models are not always perfect at identifying tags. The current version of the Smart Tags has the following limitations:

• Inability to recognize subtle differences in images. For example, slim-fit versus regular-fit shirts.

• Inability to identify tags based on tiny patterns or parts of an image. For example, logos on shirts.

• Tagging is supported in the languages that Experience Manager supports. For a list of languages, see Smart Content Service release notes.

• The tags that are not handled relate to:

  • Non-visual, abstract aspects. For example, the year or season of release of a product, mood of or emotion evoked by an image, and a subjective connotation of a video.
  • Fine visual differences in products such as shirts with and without collars or small product logos embedded on products.

To train the model, use the most appropriate images. The training cannot be reverted or training model cannot be removed. Your tagging accuracy depends on the current training, so do it carefully.

To search for files with smart tags (regular or enhanced), use the Assets search (full-text search). There is no separate search predicate for smart tags.

Refer for more details- https://experienceleague.adobe.com/docs/experience-manager-cloud-service/content/assets/manage/smart...