User-agent: * # === Lightning code start #Disallow: /*tag= #Disallow: /*search= #Disallow: /*manufacturer_id= #Disallow: /*sort= #Disallow: /*order= #Disallow: /*limit= Disallow: /*filter_name= Disallow: /*filter_sub_category= Disallow: /*filter_description= Disallow: /*affiliates # === Lightning code end # And block bots that keep hitting us too hard / do not obey the disallow/nofollows: User-agent: Yandex Disallow: / User-Agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / #User-agent: SemrushBot Disallow: / User-agent: HTTrack Disallow: / User-agent: Linguee Disallow: / User-agent: dotbot Disallow: / User-agent: BUbiNG Disallow: / User-agent: Barkrowler Disallow: / User-agent: DAUM Disallow: / User-agent: MauiBot Disallow: / User-agent: AlphaSeoBot Disallow: / User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-agent: InoopaBot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: serpstatbot Disallow: / User-agent: um-IC Disallow: / User-agent: um-LN Disallow: / User-agent: Paracrawl Disallow: / User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: Scrapy Disallow: / User-agent: MTRobot Disallow: / User-agent: AwarioRssBot User-agent: AwarioSmartBot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: GeedoBot Disallow: / User-agent: SeekportBot Disallow: / # Try again for Ahrefs, they seem to ignore the global disallow setting? #User-agent: AhrefsBot #Crawl-Delay: 15 ## Website sitemap Sitemap: https://www.yako.bg/google-sitemaps/sitemap.xml