Home >> Website Promotion >> Robot Exclusion File Generator

Navigation:
  • Doorway Generator
  • Head Tag Generator
  • Keyword Analyzer
  • Keyword Generator
  • Keyword Harvester
  • Link Analyzer
  • Meta Tag Anayser
  • Meta Tag Extractor
  • Meta Tag Generator
  • Popularity Analyzer
  • Position Analyzer
  • Robots Analyzer
  • Robots Generator
  • Search Simulator
  • Search Spider
  • Submission Classifieds
  • Submission Directories
  • Submission FFA's
  • Submission Manual
  • Submision Usenet
  •   
    Advertisement:
     
    Site Navigation:
  • Website Promotion

  • What is this?
    This script will create a Robot Exclusion file from the information you provide.

    Why should I use it?
    Often there are directories in your Website that you do not want to be indexed e.g. CGI-BIN. This file will be read by any indexing spiders and those that are legitimate will then not index any files within the directories you wish to keep private.

    Warning
    This file can if used improperly deny access to all search engine spiders. If you do not know what 'User Agents' are then please leave it set to 'All Agents Default'

    Instructions
    To start simply add a directory per line into the form below that you wish to keep way from the indexing spiders and click on 'Create Robot File'.

    User Agents:
     Line 1:
     Line 2:
     Line 3:
     Line 4:
     Line 5:
     Line 6:
     Line 7:
     Line 8:
     Line 9:
     Line 10:
    a
     


    Advertisement

     

     

    HOME     SEARCH     PRIVACY POLICY     TERMS & CONDITIONS     ABOUT US     CONTACT US     FAQ Copyright © 2000-2008 MK19.com, All right reserved