Keep the robots happy
13th August 2008
By Chris Rand
Here’s a tip you can have for free. Does your website have a robots.txt file? It really should do. Check by typing in /robots.txt after your sitename - for example, our file would be http://www.bmon.co.uk/robots.txt (and yes, we do have one).
If you want to know what one of these is, and how to create one, let me push you in the direction of the robots.txt Tutorial on SEObook, which should tell you far more thanyou ever need to know. If you don’t have a robots.txt file, it’s time to ask your web designer why not.
- How to get An Article A Day by email
- For serious, structured improvements to your Online Marketing in 2009, find out more about our Insider Programme today
- List of all articles from SEObook mentioned here
- Previous article: Ever filled in your own forms?
- Next article: “One more layer of distracting crud”
