# ── Crawl rules for www.doodlesapp.com ────────────────────────────────────────── # Allow all crawlers; block private/app routes from indexing User-agent: * Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ # ── AI assistant bots (ChatGPT, Claude, Gemini, Perplexity, etc.) ───────────── # Allow public pages so AI assistants can recommend Doodles. # Block private app routes only. User-agent: GPTBot Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: Google-Extended Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: ClaudeBot Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: PerplexityBot Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: Amazonbot Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: Applebot-Extended Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ User-agent: meta-externalagent Allow: / Disallow: /dashboard/ Disallow: /editor/ Disallow: /profile/ Disallow: /usage/ Disallow: /onboarding/ # ── Pure scrapers with no AI recommendation surface (block these) ───────────── User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / # ── Sitemap ─────────────────────────────────────────────────────────────────── Sitemap: https://www.doodlesapp.com/sitemap.xml # LLM-friendly plain-text summary of this site (llms.txt spec) # https://www.doodlesapp.com/llms.txt