# robots.txt for http://www.archive.long-eaton.com/ # Entire site designed, built and maintained by Jonathan Thorpe ©2001 # Any queries, questions, corrections or correspondence, please email: archive@long-eaton.com # for more information, use FTP to get the file moreinfo.txt # Search engines and web crawlers that follow the SRE (Standard Robot Exclusion) protocol. # Access Permissions # Allow any robot to index the site User-agent: * # Exclusions # Prevent robots from indexing the executable content in the CGI-BIN Disallow: /cgi-bin/