# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /temp/ Disallow: /Calendar/ Disallow: /Committees/ Disallow: /email/ Disallow: /fpdb/ Disallow: /Jurist-L/ Disallow: /Lawyers/ Disallow: /Logs/ Disallow: /Opinions/ Disallow: /Resource/ Disallow: /Rules/ Disallow: /Samples/ Disallow: /search/ Disallow: /srchamn/ Disallow: /WordPerfect/ Disallow: /Wp/ Disallow: /lawyers/WP/ Disallow: /lawyers/Word/ Disallow: /Lawyers/Firms/ Disallow: /Transcripts/ Disallow: /PDA/ Disallow: /lawyers/ Disallow: /calendar/ Disallow: /committees/ Disallow: /opinions/ Disallow: /resource/ Disallow: /rules/ Disallow: /WP/ Disallow: /wp/ Disallow: /PublicSearch/