Can FusionBot index password protected content within my site?

FusionBot can index sections of your site that are password protected via HTTP Basic Authentication, or sites that require the entry of login information via an HTML <FORM> using either the GET or POST Methods.

This feature is available starting with our Bronze Package.

To configure the FusionBot crawler to enter sections of your site protected via HTTP Basic Authentication, you may provide the username & password for our spider to use when indexing your site by clicking on the 'Spider' tab, then clicking the Secure Page Indexing link.

Enter the username and password the FusionBot spider should use when accessing your secure content, and click the Save button.

After making the desired changes, you must request a spider for FusionBot to begin indexing your secure content.

Additionally, it should be noted that even though FusionBot is able to index your secure content when provided a username & password, you can customize / create multiple search boxes for your site, whereby the search box placed within your public area, will only search your public content, while the search box placed in your private / restricted area can search your public content, your private content, or both. For more information on customizing your search box, please reference our search partitions FAQ.

In addition, even when choosing to include links in your search results to both public and private content, when a link is clicked on the search results that is contained with a secure directory, if a user has not logged in, via your site, they will be prompted for a username and password at that time.

For sites that require the use of an entry FORM for accessing protected content, similar to how you login to your FusionBot account, you must enter your validation page and all if its querystring parameters within your starting page for your accout, or as a second Entry Point in your FusionBot mini-portal. In either case, the Entry Point must be the page which actually process / validates the information entered in the FORM as opposed the FORM page itself. More specifically, the page entered as your Entry Point should be equivalent to name of the page pointed to within the "ACTION=" attribute of your <FORM> tag.

Therefore, if you have a FORM page which validates the value of two input fields, user AND pass, and this FORM POSTS this information to a page named "validate.cfm", you would add as a mini-portal entry the following:

SITE="https://www.mysite.com/validate.cfm?user=johndoe&pass=letmein" METHOD="POST"

If you do not supply a value for the METHOD attribute, the default method is GET.

For more information on configuring your mini-portal entries, please reference the following FAQ.

<< Previous FAQBack to FAQ ListNext FAQ >>