# ====================================== # πŸ€– Default rule # Allow all by default # ====================================== User-agent: * Allow: / # ====================================== # 🚫 Block aggressive / unnecessary bots # (SEO scrapers, AI crawlers, backlink tools) # ====================================== User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: MegaIndex Disallow: / User-agent: PetalBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: CCBot Disallow: / User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / # ====================================== # βœ… Explicitly allow Google bots # (important for ranking & indexing) # ====================================== User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: Mediapartners-Google Allow: / # ====================================== # πŸ—ΊοΈ Sitemaps # ====================================== Sitemap: https://www.qb365.in/sitemap_index.xml Sitemap: https://www.qb365.in/studymaterials_post_sitemap.xml