# ---------------------------------------------------------------------------
# Site-owner directives — AUTHORITATIVE.
#
# History: Cloudflare's Managed Content feature used to INJECT a "Content
# Signals" block above everything below, setting `ai-train=no` plus `Disallow: /`
# for GPTBot, ClaudeBot, CCBot, Google-Extended, Applebot-Extended, Bytespider,
# Amazonbot and meta-externalagent — the exact opposite of this site's policy.
# That injection was disabled in the Cloudflare dashboard on 5 August 2026 and
# the served file is now this file verbatim (verified: no "Cloudflare Managed"
# block in the response).
#
# The explicit per-agent Allow list below is therefore belt-and-braces rather
# than a workaround, and is kept for two reasons: it states the policy plainly
# for anyone reading robots.txt, and it re-asserts it if edge injection is ever
# re-enabled (under RFC 9309 a crawler merges the records matching its own
# user-agent token, and with Allow and Disallow of equal path specificity the
# Allow wins — so as the LAST block, these directives govern either way).
# Keep this block at the END of the file: do not add anything after it.
#
# If the injection is ever re-enabled and needs disabling again: Cloudflare
# dashboard -> marinaportvell.com zone -> Security -> Settings -> the robots.txt
# / Content Signals control (also surfaced under AI Crawl Control; the naming
# has moved between releases) -> turn off managed robots.txt.
# ---------------------------------------------------------------------------

# Marina Port Vell
User-agent: *
Content-Signal: search=yes,ai-input=yes,ai-train=yes,use=full
Allow: /

# AI crawlers are explicitly permitted.
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Perplexity-User
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Claude-Web
Allow: /
User-agent: anthropic-ai
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: CCBot
Allow: /
User-agent: Applebot-Extended
Allow: /
User-agent: Bytespider
Allow: /
# Were blocked by the (now-disabled) Cloudflare block while every other AI
# crawler here was permitted; listed for consistency with the policy stated
# above. Remove these two if the intent is genuinely to keep Amazon's and Meta's
# AI crawlers out.
User-agent: Amazonbot
Allow: /
User-agent: meta-externalagent
Allow: /

Sitemap: https://www.marinaportvell.com/sitemap.xml