User-agent: * Allow: / Disallow: /adminhub/ Disallow: /controlcenter/ Disallow: /careers/manage/ Disallow: /accounts/ Disallow: /i18n/ Disallow: /onlinestore/set-preferences/ Disallow: /onlinestore/set-currency/ # Commercial SEO crawlers. They consume bandwidth and send no visitors. User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: PetalBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / Sitemap: https://tarsah.com/sitemap.xml