# facet.llc robots.txt # Facet is the commerce system adapter that lets any website sell to AI agents. We want # both AI training crawlers and transactional agents to read this site. # Everything here is public and intended for machine consumption. # # Agents that want to transact (not just read) should start at # /agents.txt, not this file. /agents.txt points to the Terminal, # trusted KYA issuers, the OpenAPI spec, and the UBI discovery endpoint. # # Directory (agent commerce): the network directory of Facet-enabled # businesses is at https://terminal.facet.llc/v1/discover, the same URL # published as the Directory line in /agents.txt. (robots.txt has no # native Directory directive, so this stays a comment.) User-agent: * Allow: / # ─── AI assistants / answer engines (explicit allow) ─── User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bingbot Allow: / User-agent: meta-externalagent Allow: / User-agent: CCBot Allow: / User-agent: Amazonbot Allow: / User-agent: cohere-ai Allow: / User-agent: Diffbot Allow: / Sitemap: https://facet.llc/sitemap.xml