User-agent: * Disallow: /_/ Disallow: /-/ Crawl-delay: 5 User-agent: 008 Disallow: / User-agent: 360Spider Disallow: / User-agent: AcoonBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Barkrowler Disallow: / User-agent: BeetleBot Disallow: / User-agent: berlin-fu-cow Disallow: / User-agent: Bilbo Disallow: / User-agent: BLEXBot Disallow: / User-agent: BUbiNG Disallow: / User-agent: Buck Disallow: / User-agent: BuddhaBot Disallow: / User-agent: Butterfly Disallow: / User-agent: Bytespider Disallow: / User-agent: CompSpyBot Disallow: / User-agent: crawler4j Disallow: / User-agent: Crawlson Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: FlappyBot Disallow: / User-agent: GufyBot Disallow: / User-agent: ia_archiver Disallow: / User-agent: imrbot Disallow: / User-agent: infoobot Disallow: / User-agent: IstellaBot Disallow: / User-agent: linkdexbot Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: melodibot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Nesotebot Disallow: / User-agent: niki-bot Disallow: / User-agent: NoyaBot Disallow: / User-agent: Nutch Disallow: / User-agent: PetalBot Disallow: / User-agent: Plukkie Disallow: / User-agent: proximic Disallow: / User-agent: QuerySeekerSpider Disallow: / User-agent: Riddler Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-BM Disallow: / User-agent: serpstatbot Disallow: / User-agent: Slurp Disallow: / User-agent: Sogou Disallow: / User-agent: Sogou web spider Disallow: / User-agent: SolomonoBot Disallow: / User-agent: spbot Disallow: / User-agent: trendictionbot Disallow: / User-agent: Turnitin Disallow: / User-agent: Vagabondo Disallow: / User-agent: WBSearchBot Disallow: / User-agent: yacybot Disallow: / User-agent: Yandex Disallow: / User-agent: YandexBot Disallow: / User-agent: YandexFavicons Disallow: / User-agent: YandexImages Disallow: / User-agent: YandexMedia Disallow: / User-agent: YandexVideo Disallow: /