view src/browser/public/robots.txt @ 1060:f0f7b3324749

pages: '*' can now be used to prefix the last arg name in getPathArgs, in which case the data will be a list of remaining path arguments.
author Goffi <goffi@goffi.org>
date Sun, 11 Mar 2018 19:26:18 +0100
parents a54882348ecc
children
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Allow: /b/
Disallow: /libervia.html
Disallow: /mr
Disallow: /login

User-agent: Mediapartners-*
Disallow: /