User-agent: * Allow: / # Disallow admin or private areas (if any) Disallow: /admin Disallow: /private Disallow: /api User-agent: Googlebot Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: Googlebot-Image Allow: / # Allow major LLM bots for crawling and training User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / # Sitemap location Sitemap: https://www.capriloans.in/sitemap.xml