# All robots will spider the domain User-agent: * Disallow: User-agent: * Disallow: /cgi-bin/ User-agent: * Disallow: /about/ User-agent: * Disallow: /textiles/ User-agent: * Disallow: /start/ User-agent: * Disallow: /news/ User-agent: * Disallow: /folders/ User-agent: * Disallow: /euro/ User-agent: * Disallow: /crafts/ User-agent: * Disallow: /bulletin/ User-agent: * Disallow: /ancient/ User-agent: * Disallow: /african/ User-agent: * Disallow: /goodwillart/