# Reach intentionally allows normal search and AI retrieval crawlers for V1. # Revisit training-crawler policy before public launch if Dvir wants a stricter boundary. User-agent: * Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / Sitemap: https://dvirshamay.com/sitemap.xml