User-Agent: * Allow: / Disallow: /*-%26 Disallow: /*?pageno= Disallow: /rss-feeds-* Sitemap: http://www.pryers-solicitors.co.uk/sitemap.xml ##note in this robots the "Disallow: /" is only applicable on the test site because of duplicate issues, ##after implementing it on live please change it to "Allow: /"