# Robots limiting file. # for help or more info see www.robotstxt.org User-agent: * Disallow: /uploads Disallow: /cgi-bin Disallow: /errorpages Disallow: /images Disallow: /includes Disallow: /javascript Disallow: /bloj Disallow: /ecards Disallow: /fileman Disallow: /logs Disallow: /phpMyAdmin Disallow: /test Disallow: /fanfic Disallow: /erotica Disallow: /jessie Disallow: wtf.php # Sometimes you cannot make a /robots.txt file, because you don't administer the entire server. All is not lost: there is a new standard for using HTML META tags to keep robots out of your documents. #The basic idea is that if you include a tag like: # #in your HTML document, that document won't be indexed. #If you do: # #the links in that document will not be parsed by the robot.