# VeriNourish Men
#
# Ghost publishes a Markdown twin of every post and page (append .md to any URL) plus
# a consolidated /llms-full.txt. They exist so AI tooling can read the site cleanly.
# For classic search they are duplicates of the HTML, so Googlebot and Bingbot are kept
# on the HTML while AI crawlers keep full access. /llms.txt itself stays open to
# everyone: it is the small discovery file, not a copy of the content.
#
# Robots.txt group matching is most-specific-wins, so the Ghost defaults are repeated
# inside each named group. A crawler reads exactly one group and ignores the rest.
# This file replaces Ghost's default robots.txt because it lives in the theme root.

User-agent: Googlebot
Disallow: /ghost/
Disallow: /email/
Disallow: /members/api/comments/counts/
Disallow: /r/
Disallow: /webmentions/receive/
Disallow: /.ghost/analytics/api/
Disallow: /*.md$
Disallow: /llms-full.txt

User-agent: Bingbot
Disallow: /ghost/
Disallow: /email/
Disallow: /members/api/comments/counts/
Disallow: /r/
Disallow: /webmentions/receive/
Disallow: /.ghost/analytics/api/
Disallow: /*.md$
Disallow: /llms-full.txt

User-agent: *
Disallow: /ghost/
Disallow: /email/
Disallow: /members/api/comments/counts/
Disallow: /r/
Disallow: /webmentions/receive/
Disallow: /.ghost/analytics/api/

Sitemap: https://verinourishmen.com/sitemap.xml