# Search and answer-engine crawlers are welcome on public content. # Editor, monitoring, preview, API, and internal brand-guide routes are excluded. User-agent: OAI-SearchBot Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: ChatGPT-User Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: Claude-SearchBot Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: Claude-User Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: PerplexityBot Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: Perplexity-User Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /status/ Disallow: /assessment-preview/ Disallow: /brand/ Disallow: /brand-quickref/ Disallow: /build-info.json User-agent: * Allow: / Disallow: /keystatic/ Disallow: /api/ Disallow: /build-info.json # The public status, assessment-preview, and legacy brand-reference pages carry # noindex meta directives. Generic search crawlers must be able to fetch those # pages to see and honor noindex; blocking them here could leave URL-only results. Sitemap: https://www.willowstick.com/sitemap-index.xml