User-agent: * Sitemap: https://www.manorcottages.co.uk/sitemap.xml Sitemap: https://www.manorcottages.co.uk/blog/sitemap_index.xml #Disallow Disallow: /ppc Disallow: /book-holiday.html Disallow: /search.html Disallow: /utilities/ Disallow: /beta/ Disallow: */en-ppc/ Disallow: /de-ppc/ Disallow: /blog/wp-login.php Disallow: /offer/ #Disallow Filters Disallow:*letter=* Disallow:*filters=* Disallow:*npropertyid=* Disallow:*search=* #Site Audit Tools #SemrushBot-SA User-agent: SemrushBot-SA Crawl-delay: 5 #Rogerbot User-agent: rogerbot Crawl-delay: 5 #Dotbot User-agent: dotbot Crawl-delay: 5