# robots.txt adjustment done by Mike Willson User-agent: Googlebot Disallow: / User-agent: googlebot-image Disallow: / User-agent: googlebot-mobile Disallow: / User-agent: MSNBot Disallow: / User-agent: Slurp Disallow: / User-agent: Teoma Disallow: / User-agent: ia_archiver Disallow: / User-agent: yahoo-mmcrawler Disallow: / User-agent: psbot Disallow: / User-agent: asterias Disallow: / User-agent: yahoo-blogs/v3.9 Disallow: / User-agent: * Disallow: / Crawl-delay: 60 Disallow: /cgi-bin/ Disallow: /OldSite/ Disallow: /images/ Disallow:/*.jpg$ Disallow:/*.gif$ Disallow:/*.png$ Disallow:/*.swf$ Disallow:/*.css$ Sitemap: http://www.couriersbydemand.com.au/sitemap.xml