#BLOCAGE SECTIONS DU SITE User-agent: * Disallow: */produits/ Disallow: /Account/ Disallow: /Cart/ Disallow: /alerte.nt.php #Ancienne url Materiel.net Disallow: /bonnes-affaires-et-produits-occasion/ Disallow: /cart/oneclick/ Disallow: /compare/ Disallow: /configurator/ Disallow: /depot-avis-client/* Disallow: /form/ #Crawl formulaire de Login / Inscription Newsletter home Disallow: /header/user Disallow: /menu/ Disallow: /mise-au-panier/ Disallow: /newsletter/unsubscribe/ Disallow: /newsletter/unsubscribe/* Disallow: /panier.nt.html #Ancienne url Materiel.net Disallow: /product-listing/ #Crawl JS ou routes AJAX Disallow: /qa/like/ Disallow: /recherche/ Disallow: /reconditionnement Disallow: /reconditionnement-* Disallow: /search/ #Crawl JS ou routes AJAX Disallow: /user/ Disallow: /v4/ Disallow: /ps/ Disallow: /V4px/ Disallow: /slider/ #BLOCAGE AGENTS ET CRAWLERS User-agent: Fasterfox Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: CazoodleBot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: discobot Disallow: / User-agent: Fasterfox Disallow: / User-agent: Gaisbot Disallow: / User-agent: heritrix Disallow: / User-agent: ichiro Disallow: / User-agent: IRLbot Disallow: / User-agent: kalooga Disallow: / User-agent: MJ12bot Disallow: / User-agent: MLBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Nutch Disallow: / User-agent: Ocelli Disallow: / User-agent: penthesilea Disallow: / User-agent: PhpDig Disallow: / User-agent: SearchDaimon.com-dc Disallow: / User-agent: ShopWiki Disallow: / User-agent: Snapbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: woozweb-monitoring Disallow: / User-agent: woriobot Disallow: / User-agent: Yandex Disallow: / User-agent: Yeti Disallow: / User-agent: PetalBot Disallow: /