Knowledgebase

What is the purpose of the robots file?

This file tells search engines what they should and should not index (make available as links).

You can simply create a blank file and name it robots.txt. (This will reduce site errors and allow all search engines to rank you if they want.)

If you want to stop search engines from ranking you, use this code:

See more codes here:
http://www.robotstxt.org/robotstxt.html

Add to Favourites

Print this Article