Configuration

All settings live under Stores → Configuration → Qoliber → SEO: AI Discoverability.

Master switch

Top-level toggle. When off, the module is inert: no robots.txt modifications, no X-Robots-Tag header changes, the /llms.txt route returns 404.

robots.txt rules

• Enable — appends per-bot Disallow: / blocks to the robots.txt Magento serves.
• Bot list — admin-editable list of User-agent strings. Defaults cover the major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.). Edit, add or remove rows as your policy evolves.

X-Robots-Tag header

• Enable — emits an X-Robots-Tag HTTP header on every storefront response.
• Directive value — defaults to noai, noimageai. Edit to suit your policy (e.g., noai only).

This header is honoured by major AI crawlers as the per-response equivalent of a robots.txt rule. It does not affect search-engine indexing.

/llms.txt manifest

• Enable — exposes /llms.txt at your storefront root.
• Manifest content — plain-text, admin-edited. See llmstxt.org for the draft format. Typical structure: a heading, an introductory paragraph, then ## Pages we recommend / ## Pages to ignore sections.

When disabled, the route returns 404 — identical to a store without the module installed.

Per-store-view configuration

Every setting can be scoped per website / store / store-view. Run different policies on different markets if your legal team requires it (e.g., stricter opt-out in EU markets).