# Directions for robots. See this URL: # http://info.webcrawler.com/mak/projects/robots/norobots.html # for a description of the file format. # Some areas aren't worth crawling User-agent: * Disallow: /cgi-bin/ Disallow: /user/ Disallow: /feedback/ Disallow: /restricted/ Disallow: /my/ Disallow: /production/ Disallow: /coupon/ Disallow: /client/