What is this?
This tool will show you where search engine spiders can go when they visit your Website.

Why should I use it?
One of the biggest problems that you will face when promoting your Website is that pages, scripts or text files that you wish to keep private can and are indexed by the spiders. To prevent this you can install the Robots.txt file which will stop access to directories or the Meta Robot Tag which will prevent indexing of specific Web pages.

Tip
Try two tests on your Website so you can see the results.
1. Test a Web page with a Robot Meta Tag set to 'NOINDEX'.
2. Test a file in a directory forbidden by your Robots.txt file.

Instructions
To start simply enter your Web page URL into the form below and click on 'Submit'.