# 27.1.2009 # # This is an empty robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # User-agent: Mediapartners-Google* Disallow: # 1. Uncomment following two lines by removing "#" at the beginning to # indicate that all robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /pictures/ Disallow: /images/ Disallow: /images2/ Disallow: /KimImages/ Disallow: /corkpictures/ Disallow: /Coats/ Disallow: /Test/ Disallow: /vbulletin/admincp/ Disallow: /vbulletin/cgi-bin/ Disallow: /vbulletin/clientscript/ Disallow: /vbulletin/includes/ Disallow: /vbulletin/install/ Disallow: /vbulletin/modcp/ Disallow: /vbulletin/printthread.php Disallow: /vbulletin/subscription.php Disallow: /vbulletin/payments.php Disallow: /vbulletin/profile.php Disallow: /vbulletin/private.php Disallow: /vbulletin/memberlist.php Disallow: /vbulletin/sendmessage.php Disallow: /vbulletin/sendmessage.php?do= Disallow: /vbulletin/showgroups.php Disallow: /vbulletin/reputation.php Disallow: /vbulletin/report.php Disallow: /vbulletin/threadrate.php Disallow: /vbulletin/postings.php Disallow: /vbulletin/newthread.php Disallow: /vbulletin/newreply.php Disallow: /vbulletin/register.php Disallow: /vbulletin/login.php Disallow: /vbulletin/image.php Disallow: /vbulletin/cron.php Disallow: /vbulletin/joinrequests.php Disallow: /vbulletin/usercp.php Disallow: /cgi-bin/ Disallow: /cgi-sys/ # 2. Following two lines indicate that robots named "WWW_Robot_Name" # should stay away from this site. #User-agent: Alexa #Disallow: /vbulletin/ #Disallow: /scgi-bin/ # 3. Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Disallow: /private/ User-agent: Slurp Crawl-delay: 30