# World Alpagut Federation — robots.txt # https://alpagutfederation.org User-agent: * Allow: / # Disallow admin, auth, and internal routes Disallow: /admin Disallow: /admin/ Disallow: /panel Disallow: /panel/ Disallow: /login Disallow: /auth/ # API: block by default, but explicitly allow the public read-only endpoints # that React's StaticPage / NewsPage / NewsArticlePage call during render. # Without these Allow rules, Googlebot respects the Disallow and refuses the # JS-triggered fetch — the React fallback then renders "Page Not Found" and # Google flags every SPA route as Soft 404. Disallow: /api/ Allow: /api/v1/pages/ Allow: /api/v1/posts/ Allow: /api/v1/i18n/ Allow: /api/v1/federations Allow: /api/v1/representatives # The home page reads these four on load. While they were blocked Google rendered # it with no slider, no calendar and none of the texts edited in the panel. Allow: /api/v1/slider Allow: /api/v1/homepage Allow: /api/v1/calendar Allow: /api/v1/translations/ # Sitemap Sitemap: https://alpagutfederation.org/sitemap.xml # LLMs # Machine-readable product summary for AI systems # https://alpagutfederation.org/llms.txt