# Based on Robots.txt file from http://www.searchengineworld.com User-agent: htdig from 143.117.54.5 Disallow: User-agent: * Disallow: /cgi-bin/ Disallow: /idl_html_html/ Disallow: /apt/ Disallow: /ultracam/ Disallow: /stats/ Disallow: /help/unixhelp/ Disallow: /help/condor_manual/