# robots.txt for http://eng-2k-web.engineering.cornell.edu/ User-agent: * Disallow: /intranet/ # This is http://intranet.engr.cornell.edu and should be indexed as such Disallow: /it/