# Voice2Sub permits public-page discovery by search engines and AI retrieval systems. # Private API and Cloudflare infrastructure paths are excluded from automated crawling. User-agent: OAI-SearchBot Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: ChatGPT-User Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: GPTBot Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: Claude-SearchBot Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: Claude-User Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: ClaudeBot Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: PerplexityBot Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: Perplexity-User Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: Google-Extended Disallow: /api/ Disallow: /cdn-cgi/ Allow: / User-agent: * Disallow: /api/ Disallow: /cdn-cgi/ Allow: / Sitemap: https://voice2sub.pro.vn/sitemap.xml