mirror of
https://github.com/koala73/worldmonitor.git
synced 2026-04-25 17:14:57 +02:00
3918cc9ea8
Per contentsignals.org draft RFC: declare AI content-usage preferences at the origin level. Closes #3307, part of epic #3306. Values: ai-train=no — no consent for model-training corpora search=yes — allow search indexing for referral traffic ai-input=yes — allow live agent retrieval (Perplexity, ChatGPT browsing, Claude, etc.)
16 lines
445 B
Plaintext
16 lines
445 B
Plaintext
# World Monitor - protect API routes from crawlers
|
|
|
|
# AI content-usage preferences (contentsignals.org draft RFC).
|
|
# Origin-wide directive, NOT scoped under User-agent per the spec.
|
|
Content-Signal: ai-train=no, search=yes, ai-input=yes
|
|
|
|
User-agent: *
|
|
Allow: /
|
|
Allow: /api/story
|
|
Allow: /api/og-story
|
|
Disallow: /api/
|
|
Disallow: /tests/
|
|
|
|
Sitemap: https://www.worldmonitor.app/sitemap.xml
|
|
Sitemap: https://www.worldmonitor.app/blog/sitemap-index.xml
|