User-agent: * Allow: /$ Allow: /fr/ Allow: /pt/ Allow: /ar/ Allow: /countries/ Allow: /tools/ Disallow: /tools/api/ Allow: /docs Allow: /terms Allow: /privacy Disallow: /v1/ Disallow: /mcp Sitemap: https://africacompliancedata.com/sitemap.xml # AI training crawlers: no User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: /