Mercurial > libervia-web

view src/browser/public/robots.txt @ 972:c4e58c4dba75

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
server: getURL + minor improvments: - new getURL method allow to retrieve URL (same as "url" property) with possibility to specify arguments which will be quoted and added to the path - added quote function which encode unicode value and do a urllib.quote_plus - use of new getURL in _on_data_post_redirect, this simplify a bit the code
author Goffi <goffi@goffi.org>
date Fri, 10 Nov 2017 11:10:15 +0100
parents 0f309eeef26d
children a54882348ecc
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Disallow: /

User-agent: Mediapartners-*
Disallow: /