# # Please note: There are a lot of pages on this site, and # some misbehaved spiders go_way_too fast. If you're # irresponsible, your access may be blocked. # We also ask you to comply with robots meta tag directions on the pages. # Thank you http://www.diseasesdatabase.com # # advertising-related: User-agent: Mediapartners-Google* Disallow: / # Misc crawlers and offline readers User-agent: OmniExplorer_Bot Disallow: / User-agent: sdcresearchlabs-testbot Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: aipbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Charlotte Disallow: / User-agent: fyberspider Disallow: / User-agent: MLBot Disallow: / User-agent: Exabot Disallow: / User-agent: kalooga Disallow: / User-agent: 80bot Disallow: / User-agent: yetibot Disallow: / User-agent: ACONTBOT Disallow: / User-agent: msiecrawler Disallow: / User-agent: ScoutJet Disallow: / User-agent: ccbot Disallow: / User-agent: voyager/1.0 Disallow: / User-agent: seekbot Disallow: / User-agent: Yandex Disallow: / User-agent: GingerCrawler Disallow: / User-agent: BecomeBot Disallow: / User-agent: ShopWiki Disallow: / User-agent: Speedy Disallow: / User-agent: Accelobot Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: twiceler Disallow: / User-agent: psbot Disallow: / User-agent: wget Disallow: / User-agent: Fasterfox Disallow: / User-agent: VoilaBot Disallow: / User-agent: discobot Disallow: / User-agent: msnbot Disallow: /madin.asp Crawl-delay: 10 User-agent: Teoma Disallow: /madin.asp Crawl-delay: 10 User-agent: Slurp Disallow: /madin.asp Crawl-delay: 10 User-agent: Googlebot Disallow: /madin.asp User-agent: * Disallow: /madin.asp