view src/browser/public/robots.txt @ 1011:fe08a5c95b27

pages (blog): added pagination using RSM and blog now fill older_url and newer_url in template_data
author Goffi <goffi@goffi.org>
date Fri, 12 Jan 2018 22:04:33 +0100
parents 0f309eeef26d
children a54882348ecc
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Disallow: /

User-agent: Mediapartners-*
Disallow: /