# Robots.txt file from /bbs/index.asp # All robots will spider the domain User-agent: * Disallow: