# Robots.txt for nexart.io # LLM-readable index: https://nexart.io/llms.txt # LLM-readable full content: https://nexart.io/llms-full.txt # LLM-readable page index (all pages): https://nexart.io/llms-index.txt # LLM-readable full site corpus: https://nexart.io/llms-pages.txt # Per-page plain text mirrors: https://nexart.io/txt/.txt # LLM-readable blog map: https://nexart.io/blog.txt # Search engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # AI crawlers (explicit allow) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: Applebot-Extended Allow: / User-agent: * Allow: / # Allow crawling of all assets required for rendering Allow: /assets/ Allow: /*.js$ Allow: /*.css$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.svg$ Allow: /*.woff2$ Allow: /llms.txt Allow: /llms-full.txt Allow: /llms-index.txt Allow: /llms-pages.txt Allow: /txt/ Allow: /*.txt$ Allow: /blog.txt Allow: /blog-index.json # IndexNow key verification file Allow: /74b3fa79aba86eb2ad1c1db6c4556765.txt # Disallow OAuth, auth callback, and preview paths Disallow: /auth/callback Disallow: /auth/reset-password Disallow: /*?code= Disallow: /*?error= Disallow: /*?access_token= Disallow: /*?refresh_token= # Disallow authenticated areas Disallow: /dashboard Disallow: /dashboard/ Disallow: /auth Disallow: /auth/ Disallow: /welcome Disallow: /checkout/success Disallow: /settings/team Disallow: /newsletter/unsubscribe Allow: /pricing.txt Sitemap: https://nexart.io/sitemap.xml