User-agent: * Allow: / Disallow: /rc/ Disallow: /rm/ Disallow: /auth/ Disallow: /c/ Disallow: /cdn-cgi/ # Specific rule for Microsoft AdIdxBot User-agent: AdIdxBot Crawl-delay: 10 # Host (optional, used by some search engines like Yandex) Host: https://www.discountcodes.com # Sitemap Sitemap: https://www.discountcodes.com/sitemap.xml