Mercurial > libervia-web

view src/browser/public/robots.txt @ 1018:78af5457d3f8

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Pages: added url_cache setting: when url_cache is set, result of parse_url is cached (per profile, because in some pages date retrieved may differ between profiles), and then reused. This is useful if some data are fetched during parse_url (e.g. bridge/XMPP call).
author Goffi <goffi@goffi.org>
date Sun, 21 Jan 2018 13:08:54 +0100
parents 0f309eeef26d
children a54882348ecc
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Disallow: /

User-agent: Mediapartners-*
Disallow: /