# http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://tool.motoricerca.info/robots-checker.phtml Sitemap: https://www.dach-spengler.eu/sitemap.xml # Common search engine User-agents blocked User-agent: AhrefsBot User-agent: Baiduspider User-agent: Ezooms User-agent: MJ12bot User-agent: YandexBot User-agent: SeznamBot User-agent: Mail.RU_Bot Disallow: / User-agent: * Disallow: /assets/ Disallow: /content/ Disallow: /lib/ Disallow: manifest.appcache