Expand my Community achievements bar.

Dive into Adobe Summit 2024! Explore curated list of AEM sessions & labs, register, connect with experts, ask questions, engage, and share insights. Don't miss the excitement.
SOLVED

Adobe Search & Promote crawling issue

Avatar

Level 3

Hi,

We are using Adobe Search & Promote to crawl our pages There is a search field on the  page component which is including the top Navigation links as well in the Search crawling and giving results that are not expected, We are handling the crawl entry point to noindex which ideally should not crawl the navigation links text, still we have the issue, Please let me know if there is a way to avoid the Top Navigation from the search scope

Thanks,

Ganesh

1 Accepted Solution

Avatar

Correct answer by
Level 1

Hi,

You can filter out some parts of a webpage if you insert a noindex to a DIV class, so Adobe is not indexing the content of that portion.

Menu item:  Settings - Filtering - Filtering script

Here you can insert a small Perl script that is run for each page you are crawling. What it does is to search-replace a DIV class and insert a noindex to the class.

undef $/;

my $doc = <>;

$doc =~ s{<div class="top-bar">}{<div class="top-bar noindex">}is;

print $doc;

The trick I read here:

https://stackoverflow.com/questions/25630482/adobe-searchpromote-non-standard-noindex-tag

View solution in original post

1 Reply

Avatar

Correct answer by
Level 1

Hi,

You can filter out some parts of a webpage if you insert a noindex to a DIV class, so Adobe is not indexing the content of that portion.

Menu item:  Settings - Filtering - Filtering script

Here you can insert a small Perl script that is run for each page you are crawling. What it does is to search-replace a DIV class and insert a noindex to the class.

undef $/;

my $doc = <>;

$doc =~ s{<div class="top-bar">}{<div class="top-bar noindex">}is;

print $doc;

The trick I read here:

https://stackoverflow.com/questions/25630482/adobe-searchpromote-non-standard-noindex-tag