User-agent: Googlebot Disallow: Allow: / # Block a specific bot from crawling the entire site User-agent: BadBot Disallow: / User-agent: * Allow: / Disallow: /admin/ Disallow: /uploads/ Disallow: /profile/ Disallow: /assets/ Disallow: /cgi-bin/ Disallow: /public/ Disallow: /users/ Disallow: /cache/ Disallow: /phpqrcode/ Disallow: /vendor/ Disallow: /includes/ # Sitemap locations for better indexing Sitemap: https://in.locatebits.com/sitemap/escorts Sitemap: https://in.locatebits.com/sitemap/call-girls Sitemap: https://in.locatebits.com/sitemaps/sitemap-index.xml