User-agent: SemrushBot-SA Crawl-delay:3 User-agent: * Disallow: /wp-admin/ Disallow: /paypal-retun-implementation-c201/ Allow: /wp-admin/admin-ajax.php Host: luckybansko.bg Sitemap: https://luckybansko.bg/sitemaps.xml User-agent: MJ12bot Disallow: / User-agent: * Disallow: /reservations/ User-agent: SemrushBot-SA Disallow: /reservations/ User-agent: SiteAuditBot Disallow: /reservations/ User-agent: SiteAuditBot-Mobile Disallow: /reservations/ # (LB-205 and earlier) Avoid indexing such URLs, they should not be generated by the CMS, but somehow gets crawled (.com first, then .bg)... User-agent: * Disallow: /*?lang=bgpage*