User-agent: * Allow: / # Allow major search and AI crawlers to access public content User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / Sitemap: https://xn--c3cyhfa0bjf0gb3bt3d2ora1b.com/sitemap.xml