Multiple links may exist on my site that result in the same content being returned, despite the URLs being different. Can I instruct FusionBot to only index a single instance of the page?

Yes. If your site has identical or vastly similar content that's accessible through multiple URLs, you can control which URL is returned in search results.

For example, your site, from one page to another, may structure links to the same content using varying syntax, such as:

https://www.yoursite.com/store
https://www.yoursite.com/store/
https://www.yoursite.com/store/default.php

In all three instances, the EXACT same page / content is returned, despite the URL/pages being different in structure. The problem is, however, that spiders "see" these pages as different, and end up indexing and including all three pages in your search results, resulting in duplicate content.

Under the assumption that the URL:

https://www.yoursite.com/store

is the preferred version of the page you wish to have indexed, you can simply add the following <link> tag to specify your preferred version:

<link rel="canonical" href="https://www.yoursite.com/store" />

inside the <head> section of the duplicate content URLs:

https://www.yoursite.com/store/
https://www.yoursite.com/store/default.php

By doing so, FusionBot will understand that the duplicates all refer to the canonical URL:

https://www.yoursite.com/store

and thus preventing the duplicate URLs from being included in your index / search results.

<< Previous FAQBack to FAQ ListNext FAQ >>