# robots.txt for toyshop.com # "Any empty [Disallow] value, indicates that all URLs can be retrieved. # At least one Disallow field needs to be present in a record." User-agent: * Crawl-delay: 100 Visit-time: 0000-0600 Disallow: /toyshop/checkout/ Disallow: /toyshop/ncheckout/ Disallow: /toyshop/youraccount/ Disallow: /toyshop/email/ Disallow: /monitoring/ Disallow: /affiliates/ Disallow: /errors/