# robots.txt for http://www.scout.co.kr/ User-agent: * # directed to all spiders, not just Scooter Disallow: /company/resumedb/ # Rover is a bad dog User-agent: Roverbot Disallow: / # Rover is a bad dog User-agent: W3CRobot Disallow: /