user-agent:* Disallow:/*?* Disallow:/?* User-agent:AhrefsBot Disallow:/ User-agent:Bytespider Disallow:/ User-agent:SemrushBot Disallow:/ User-agent:MJ12bot Disallow:/ User-agent:BLEXBot Disallow:/ User-agent:serpstatbot Disallow:/ User-agent:VelenPublicWebCrawler Disallow:/ User-agent:Buck Disallow:/ User-agent:PetalBot Disallow:/ User-agent:* Allow:/sitemap.xml Sitemap:/sitemap.xml Crawl-delay: 30