# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /user_sessions/ Disallow: /users/ Disallow: /venues/ Disallow: /locations/ Disallow: /artists/ Disallow: /affiliates/ Disallow: /events/new Disallow: /events/*/edit Disallow: /register/ Disallow: /preferences/ Disallow: /myartists/ Disallow: /myevents/ Disallow: /signup Disallow: /login Disallow: /logout Disallow: /error