# Newly revised 29-7-2007. # should allow access to good bots # and slow down access times # (bad are excluded in htaccess) User-agent: * Sitemap: /sitemap.xml Disallow: /ads/ Disallow: /errorfiles/ Disallow: /gfx/ Disallow: /googlerep/ Disallow: /images/ Disallow: /inc/ Crawl-delay: 10