User-agent: * Allow: /edit/wp-includes/js/ Disallow: /edit/ User-agent: MegaIndex.ru/2.0 User-agent: MegaIndex.ru User-agent: megaIndex.ru User-agent: MauiBot (crawler.feedback+wc@gmail.com) User-agent: Seekport Crawler User-agent: BLEXBot User-agent: Baiduspider User-agent: Barkrowler User-agent: Gigabot User-agent: Go-http-client User-agent: Nuclei User-agent: Riddler User-agent: SeznamBot User-agent: WikiDo User-agent: Yandex User-agent: Zoominfobot User-agent: magpie-crawler Disallow: / Sitemap: https://www.edinburghtourguide.com/sitemap.xml Disallow: /fhbr-console/ Disallow: /cdn-cgi/