# DC created this file on 7.8.05 # Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # user-agent: Googlebot is for the google robot # Disallow: if this matches first part of requested path, # forget it User-agent: * # applies to all robots Disallow: /cgi-bin Disallow: /images Disallow: /new Disallow:/UI Disallow:/dev Disallow:/ecommerce Disallow:/admin Disallow:/personal Disallow:/Template_Library Disallow:/test Disallow:/CORE Disallow:/personal/europe Disallow:/personal/cats_2006