Expand my Community achievements bar.

Dive into Adobe Summit 2024! Explore curated list of AEM sessions & labs, register, connect with experts, ask questions, engage, and share insights. Don't miss the excitement.
SOLVED

Google indexing issue duplicate url , how to prevent this?

Avatar

Community Advisor

Currently I have noticed multiple urls like this in Google Search Console (which means Google is indexing them)

https://www.test.com/mypage.2.html

https://www.test.com/mypage.3.html

where it should have only https://www.test.com/mypage.html indexed.

Because of this, ‘a duplicate url exists’ and ‘page indexed without content’ issue is being raised by Google and which has resulted a significant drop in rankings.

 

Any Suggestion?

1 Accepted Solution

Avatar

Correct answer by
Level 10

Hi @Manu_Mathew_ 

 

Do you see these pages with the selectors in your dispatcher cache ? If not, one of the way to avoid is to configure your dispatcher to not allow anyone to access the pages with the selector.

 

Also, here is a tip to delete them from the google index if needed : https://developers.google.com/search/docs/advanced/crawling/remove-information

 

View solution in original post

7 Replies

Avatar

Community Advisor

@Manu_Mathew_  Are you using selectors to access pages? if yes will the content differ based on the selector passed? will it also differ the metadata of the page? Based on the above questions, we can guide you better

Avatar

Community Advisor

Hi 

 

No for this particular page we don't use any selectors, but the page seem to be accepting selectors.  The contents however is same for all the request when any number of selectors are added.

Avatar

Correct answer by
Level 10

Hi @Manu_Mathew_ 

 

Do you see these pages with the selectors in your dispatcher cache ? If not, one of the way to avoid is to configure your dispatcher to not allow anyone to access the pages with the selector.

 

Also, here is a tip to delete them from the google index if needed : https://developers.google.com/search/docs/advanced/crawling/remove-information

 

Avatar

Level 2

Hi @Manu_Mathew_  - Assuming the pages are not supposed to access by using selectors, you could write re-write rule at apache redirect module to the original URL without selector.

Canonical URL is another option that you can try implementing and give the self page URL, this way it would force the selector pages to adhere canonical functionality, However if pages are already indexed on google - you might raise a google re-crawler request after implementing the required changes.

Thank you.