# Lead Without the Title - crawl policy + Content Signals # Spec: https://contentsignals.org/ # Draft: https://datatracker.ietf.org/doc/draft-romm-aipref-contentsignals/ User-agent: * Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # Must match this host (same origin as this robots.txt) Sitemap: https://lead-without-the-title.grok.me/sitemap.xml # LLM-oriented site summaries # https://lead-without-the-title.grok.me/llms.txt # https://lead-without-the-title.grok.me/llms-full.txt # Agent Skills discovery # https://lead-without-the-title.grok.me/.well-known/agent-skills/index.json Disallow: /api/ Disallow: /auth/