MK19.Com

Home >> Website Promotion >> Search Engine Spider Analyzer

Navigation:
  • affiliate networks
  • money faq's
  • jargon buster
  • ratings explained
  • tips and tricks

  • Search:


    Site Navigation:
  • development tools
  • games room
  • graphics
  • javascripts
  • sound files
  • web search
  • website advertisement
  • website directory
  • website money
  • website promotion
  • website scripts
  • website software
  • website tools

  • advertisement




    What is this?
    This tool will show you where search engine spiders can go when they visit your Website.

    Why should I use it?
    One of the biggest problems that you will face when promoting your Website is that pages, scripts or text files that you wish to keep private can and are indexed by the spiders. To prevent this you can install the Robots.txt file which will stop access to directories or the Meta Robot Tag which will prevent indexing of specific Web pages.

    Tip
    Try two tests on your Website so you can see the results.
    1. Test a Web page with a Robot Meta Tag set to 'NOINDEX'.
    2. Test a file in a directory forbidden by your Robots.txt file.

    Instructions
    To start simply enter your Web page URL into the form below and click on 'Submit'.

    URL: 


    Advertisement

     

     

    Copyright © 2000-2010 MK19.com, All right reserved
    Last Updated Friday 30/07/2010