# Content and AI use: https://spenomatic.net/content-and-ai-use-policy/ # Search, AI answer and AI training crawlers are welcome; bulk dataset archives are not. User-agent: CCBot Disallow: / User-agent: * Disallow: /admin Disallow: /search Allow: / Sitemap: https://spenomatic.net/sitemap_index.xml