|
What is this?
This script will check your Web site to see if you have a
Robots.txt file installed and if the file is setup correctly. To
learn more about search engine robots and how to control where
they go in your Web site
click
here. Why should I use it?
It is important to
ensure that you control where search engine spiders go within
your website so that directories that you wish to keep
private are not displayed on the search engine results
screen.
Instructions
To start simply enter the full URL to your Web site and
click on 'Submit'.
|