# MUST be in root dir of server name .com/robots.txt # noindex, noarchive, nofollow # googlebot follows HREF and SRC links # # This file lists local URLs that well-behaved robots should ignore #User-agent: Googlebot #Disallow: /*.gif$ User-agent: * Disallow: /www2/ Disallow: /LLLteamsite/ Disallow: /SE_WEBSITE/ Disallow: /socialtest/