# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: /xadmin Crawl-delay: 10 # Disallow Ahref #User-agent: AhrefsBot #Disallow: / #User-agent: SiteCheckerBot #Disallow: / Sitemap: https://xspartner.com/en/sitemap.xml Sitemap: https://xspartner.com/fr/sitemap.xml