User-agent: Googlebot-Image Disallow: / User-agent: Googlebot Disallow: /bip/ Disallow: /css/ Disallow: /files/ Disallow: /images/ Disallow: /js/ Disallow: /swf/ Crawl-delay: 5 User-agent: ia_archiver Disallow: / User-agent: baiduspider Disallow: / User-agent: baiduspider+ Disallow: / User-Agent: Charlotte Disallow: / User-agent: CydralSpider/1.9 Disallow: / User-agent: envolk/1.7 Disallow: / User-agent: holmes/3.12.2 Disallow: / User-agent: Infoseek SideWinder Disallow: / User-agent: INGRID/2.0 Disallow: / User-agent: Inktomi Disallow: / User-agent: Jyxobot/1 Disallow: / User-agent: gigabot Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: Gulliver Disallow: / User-agent: Knight Disallow: / User-agent: larbin_2.6.3 (larbin2.6.3@unspecified.mail) Disallow: / User-agent: LinkAider Disallow: / User-Agent: MJ12bot Disallow: / User-agent: MLBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: msnbot/1.1 Disallow: / User-agent: msnbot-media/1.0 Disallow: / User-agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm) Disallow: / User-agent: NaverBot Disallow: / User-Agent: NetResearchServer Disallow: / User-agent: NG/2.0 Disallow: / User-agent: noxtrumbot/1.0/ Disallow: / User-agent: Nutch Disallow: / User-agent: oBot Disallow: / User-agent: psbot Disallow: / User-agent: REAP-crawler Disallow: / User-agent: Scooter Disallow: / User-agent: Speedy Disallow: / User-agent: Teoma Disallow: / User-agent: Toplistbot Disallow: / User-agent: TravelSpyder/locust www.travelspyder.com Disallow: / User-agent: Twiceler Disallow: / User-agent: VoilaBot Disallow: / User-agent: WebAlta Crawler/2.0 Disallow: / User-agent: Slurp Disallow: / User-Agent: Yahoo! Slurp China Disallow: / User-Agent: StackRambler Disallow: / User-Agent: Yandex Disallow: / User-Agent: Yandex/1.01.001 Disallow: / User-Agent: Yeti/1.0 Disallow: / User-Agent: zibber-v0.1(www.zibb.com/crawler/) Disallow: /