# SE Crawlers Setup ## Enable robots.txt rules for all crawlers User-agent: * Disallow: Sitemap: https://www.ideal.in/sitemap_index.xml # Paths (no clean URLs) Disallow: /*?*