User-agent: TurnitinBot User-agent: LinkWalker User-Agent: sitecheck.internetseer.com User-Agent: http://www.almaden.ibm.com/cs/crawler User-Agent: pompos User-Agent: NPBot User-Agent: Jetbot/1.0 User-Agent: obot User-Agent: Faxobot/1.0 User-agent: e-SocietyRobot User-agent: MSIECrawler User-agent: ConveraCrawler User-Agent: NetResearchServer User-Agent: Snapbot user-agent: spbot user-agent: AhrefsBot User-Agent: Twiceler-0.9 User-agent: AboutUsBot User-agent: sistrix User-agent: BLEXBot Disallow: / User-agent: * Disallow: /?s= Disallow: /wp-login.php Disallow: /wp-comments-post.php