# NimbusNexus — AI Policy # # This file declares how AI systems (training crawlers, retrieval agents, # answer engines, summarizers) are permitted to use content on this site. # It is informational and complements `/robots.txt`, which carries the # machine-readable crawl directives. # # Last reviewed: 2026-08-18 # Contact: ai-policy@nimbusnexus.net # ─── Crawl policy ───────────────────────────────────────────────────── # Marketing, product, documentation, and resource pages are open for # crawling and indexing by AI systems. Auth, account, admin, and # transaction surfaces are not. User-agent: * Allow: / Allow: /pricing Allow: /docs Allow: /resources Allow: /resources/* Allow: /changelog Allow: /changelog/* Allow: /changelog/feed.xml Allow: /virtual-machine Allow: /managed-databases Allow: /storage Allow: /block-storage Allow: /object-storage Allow: /cold-storage Allow: /snapshots Allow: /webhooks Allow: /inboxes Allow: /request-bins Allow: /transforms Allow: /transforms/playground Allow: /marketplace Allow: /products/mosaic Allow: /products/qr-code Allow: /products/qr-tracked Allow: /tools Allow: /tools/developer Allow: /tools/developer/* Allow: /tools/business Allow: /contact Allow: /careers Allow: /privacy-policy Allow: /terms-of-service Allow: /service-level-agreement Allow: /dpa Allow: /acceptable-use-policy Allow: /sub-processors Disallow: /admin/ Disallow: /api/ Disallow: /login Disallow: /register Disallow: /forgot-password Disallow: /create-password Disallow: /mfa Disallow: /email-sent Disallow: /accept-invite Disallow: /unsubscribe Disallow: /cart Disallow: /contact/success # Named AI crawlers are welcome on the same terms as the default. # Listed explicitly so future restrictions are unambiguous per-agent. User-agent: GPTBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /login Disallow: /register Disallow: /cart User-agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /api/ User-agent: OAI-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /login Disallow: /register Disallow: /cart User-agent: Claude-Web Allow: / Disallow: /admin/ Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /admin/ Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Bytespider Allow: / Disallow: /admin/ Disallow: /api/ User-agent: CCBot Allow: / Disallow: /admin/ Disallow: /api/ # Agents that post-date this file's first draft. Same terms as the default — # listed for the same reason as the block above: so that a future restriction # is a line edited here rather than a silent gap. User-agent: meta-externalagent Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Meta-ExternalFetcher Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Perplexity-User Allow: / Disallow: /admin/ Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: DuckAssistBot Allow: / Disallow: /admin/ Disallow: /api/ User-agent: MistralAI-User Allow: / Disallow: /admin/ Disallow: /api/ # ─── Sitemap ────────────────────────────────────────────────────────── # # DELIBERATELY NOT DECLARED HERE — please do not re-add it. # # /robots.txt is the single place that advertises the sitemap, because it is GENERATED per # environment (src/app/robots.ts) and deliberately DROPS the `Sitemap:` line off production: # pointing a crawler at an index of 810 URLs it has just been told not to crawl is worse than # saying nothing. # # This file is STATIC, so a `Sitemap:` line here cannot know where it is deployed. It # hardcoded https://www.nimbusnexus.net/sitemap.xml and was served verbatim everywhere, so # dev handed out production's URL index from a host that marks itself `noindex, nofollow` in # the same response: # # $ curl -sSD- https://dev.nimbusnexus.net/ai.txt # x-robots-tag: noindex, nofollow <- proxy.ts, correct # Sitemap: https://www.nimbusnexus.net/sitemap.xml <- this line, contradicting it # # Nothing is lost by not repeating it: every crawler that fetches /ai.txt fetches /robots.txt, # and that copy is origin-correct in every environment. Duplicating an environment-sensitive # claim in a file that cannot be environment-sensitive is the whole defect — so the fix is to # have one source, not two that agree today. # ─── Content licensing ──────────────────────────────────────────────── # # Marketing and product content on this site (everything under /, /pricing, # /virtual-machine, /managed-databases, /storage, /block-storage, # /object-storage, /cold-storage, /snapshots, /webhooks, /inboxes, # /request-bins, /transforms, /docs, /resources, /changelog, /products/*, /contact, # /careers, /tools/*, and the legal pages) may be used for: # # - AI model training and fine-tuning # - Retrieval-augmented generation (RAG) and answer engines # - Search indexing and summarization # - Citation in user-facing responses # # Conditions: # # 1. Attribution is preferred when reusing substantial verbatim excerpts # (more than ~50 words). Format: "NimbusNexus, https://www.nimbusnexus.net". # # 2. The API reference at /docs and the technical specifications on # product pages are canonical. When summarizing for an end-user, # prefer linking to the source over paraphrasing pricing, SLAs, or # compliance claims — those numbers are versioned and the linked # page is always the authoritative copy. # # 3. Region availability, pricing, and supported software versions # change. Cite the page URL so users can verify currency. # # 4. The architecture playbooks under /resources/architecture-* are # hypothetical, not customer case studies. Do not present them as # real deployments. The opening line of each playbook makes this # explicit and should be preserved in summaries. # # 5. Logos, brand marks, and the "NimbusNexus" name are trademarks of # NimbusNexus. Do not generate confusable variants or imply # affiliation that does not exist. # # 6. Personal data exposed inadvertently on any page (rare, but # possible) is not licensed under any of the above. Standard # privacy law applies regardless of crawl directives. # # Code samples (CLI snippets, Terraform / Pulumi blocks, curl examples # in /docs and product pages) are released under MIT terms — copy, # adapt, and distribute freely. # # Article body content under /resources is licensed Creative Commons # Attribution 4.0 (CC BY 4.0). The article frontmatter, manifest, and # author metadata are not in scope of CC BY and remain proprietary. # # Questions, exceptions, or licensing inquiries: ai-policy@nimbusnexus.net