view src/browser/public/robots.txt @ 954:7892f1a1e2cf

server (blog): temporary fix for atom feed: max_items can't be used with MAM, but for now MAM is now detected correctly to get blogs, so max_items is disabled.
author Goffi <goffi@goffi.org>
date Fri, 07 Jul 2017 07:28:42 +0200
parents 0f309eeef26d
children a54882348ecc
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Disallow: /

User-agent: Mediapartners-*
Disallow: /