User-agent: * Disallow: /app/ Disallow: /config/ Disallow: /search Disallow: /*?sort= # AI Crawlers Configuration (Selectively allow indexable content) User-agent: GPTBot Allow: / Disallow: /app/ Disallow: /config/ User-agent: Google-Extended Allow: / Disallow: /app/ Disallow: /config/ Sitemap: https://www.turtlesweb.com/sitemap.xml