# Robots.txt file for a standard eZ Publish website # All robots will spider all the domain, except for search User-agent: * Disallow: /content/search/ Disallow: /content/advancedsearch/ Disallow: /content/pdf/ Disallow: /content/tipafriend/ Disallow: /design/ Disallow: /extension/ Disallow: /layout/set/ Disallow: /oms/test # Example Agent Disallow #User-agent: infometrics #Disallow: / Sitemap: http://www.franceagrimer.fr/layout/set/google/googlesitemap/generate