eliott/worldmonitor
1
0
Fork 0
mirror of https://github.com/koala73/worldmonitor.git synced 2026-04-25 17:14:57 +02:00
Code Issues Packages Projects Releases Wiki Activity

feat(agent-readiness): declare Content-Signal in robots.txt (#3327)

Browse Source 
Per contentsignals.org draft RFC: declare AI content-usage
preferences at the origin level. Closes #3307, part of epic #3306.

Values:
  ai-train=no   — no consent for model-training corpora
  search=yes    — allow search indexing for referral traffic
  ai-input=yes  — allow live agent retrieval (Perplexity,
                  ChatGPT browsing, Claude, etc.)
This commit is contained in:
Elie Habib
2026-04-23 09:15:43 +04:00
committed by GitHub
parent 2789b07095
commit 3918cc9ea8
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
public/robots.txt
View File

@@ -1,4 +1,9 @@
# World Monitor - protect API routes from crawlers # World Monitor - protect API routes from crawlers
# AI content-usage preferences (contentsignals.org draft RFC).
# Origin-wide directive, NOT scoped under User-agent per the spec.
Content-Signal: ai-train=no, search=yes, ai-input=yes
User-agent: * User-agent: *
Allow: / Allow: /
Allow: /api/story Allow: /api/story