User-agent: * Allow: / Allow: /verifier Allow: /docs Allow: /mcp Allow: /privacy Allow: /legal Allow: /security Allow: /subprocessors Allow: /openapi.json Allow: /llms.txt Allow: /llms-fr.txt Allow: /llms-es.txt Allow: /llms-pt.txt Allow: /llms-ja.txt Allow: /llms-ru.txt Allow: /llms-ar.txt Allow: /llms-zh.txt Allow: /llms-hi.txt Disallow: /app Disallow: /api/ Allow: /static/og-card.png Disallow: /static/ # AI/LLM crawlers — bots d'ENTRAÎNEMENT (alimentent les modèles) User-agent: GPTBot Allow: / Allow: /llms.txt Allow: /llms-fr.txt Allow: /llms-es.txt Allow: /llms-pt.txt Allow: /llms-ja.txt Allow: /llms-ru.txt Allow: /llms-ar.txt Allow: /llms-zh.txt Allow: /llms-hi.txt Allow: /docs Allow: /mcp Allow: /openapi.json Disallow: /app Disallow: /api/ User-agent: ClaudeBot Allow: / Allow: /llms.txt Allow: /llms-fr.txt Allow: /llms-es.txt Allow: /llms-pt.txt Allow: /llms-ja.txt Allow: /llms-ru.txt Allow: /llms-ar.txt Allow: /llms-zh.txt Allow: /llms-hi.txt Allow: /docs Allow: /mcp Allow: /openapi.json Disallow: /app Disallow: /api/ User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / Disallow: /app Disallow: /api/ # AI/LLM crawlers — bots de CITATION (alimentent les réponses citées) User-agent: OAI-SearchBot Allow: / Disallow: /app Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /app Disallow: /api/ User-agent: Claude-SearchBot Allow: / Disallow: /app Disallow: /api/ User-agent: Claude-User Allow: / Disallow: /app Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /app Disallow: /api/ User-agent: Perplexity-User Allow: / Disallow: /app Disallow: /api/ # Autres assistants IA publics (Apple, Amazon, Meta, ByteDance, DuckDuckGo, Cohere, Mistral, You) User-agent: Applebot-Extended Allow: / Disallow: /app Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /app Disallow: /api/ User-agent: Meta-ExternalAgent Allow: / Disallow: /app Disallow: /api/ User-agent: Bytespider Allow: / Disallow: /app Disallow: /api/ User-agent: DuckAssistBot Allow: / Disallow: /app Disallow: /api/ User-agent: cohere-ai Allow: / Disallow: /app Disallow: /api/ User-agent: MistralAI-User Allow: / Disallow: /app Disallow: /api/ User-agent: YouBot Allow: / Disallow: /app Disallow: /api/ Sitemap: https://checkmails.eu/sitemap.xml