#-------------------------------------------------------------------- User-agent: * Disallow: /honey/ #-------------------------------------------------------------------- # Undesirable bots that obey robots.txt... User-agent: baiduspider User-agent: http://www.almaden.ibm.com/cs/crawler User-agent: Larbin User-agent: MSIECrawler User-agent: NaverBot User-agent: NPBot User-agent: psbot User-agent: QuepasaCreep User-agent: SurveyBot User-agent: TurnitinBot User-agent: Wget Disallow: /