# Googlebot User-agent: Googlebot Allow: / # Bing User-agent: bingbot Allow: / # YandexBot User-agent: YandexBot Allow: / # Yahoo User-agent: Slurp Allow: / # AhrefsBot User-agent: AhrefsBot Disallow: / # Barkrowler User-agent: Barkrowler Disallow: / # Clickagy Intelligence Bot User-agent: Clickagy Intelligence Bot v2 Disallow: / # Cloudfind User-agent: Cloudfind/1.0 Disallow: / # DotBot User-agent: dotbot Disallow: / # Dorkbot User-agent: UT-Dorkbot/1.0 Disallow: / # Grapeshot User-agent: GrapeshotCrawler Disallow: / # LTX71 User-agent: ltx71 Disallow: / # MegaIndex User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: megaIndex.ru Disallow: / # mj12bot User-Agent: MJ12bot Disallow: / # SemrushBot User-Agent: SemrushBot Disallow: / # All other bots User-agent: * Disallow: /