Mercurial > libervia-web

view src/browser/public/robots.txt @ 1067:808ec98de8b3

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
pages (files/list): retrieve thumbnail: when thumbnail url is not available (only id is available), thumbnail are retrieved using BoB. The thumbnail closest to 300px witdh is used.
author Goffi <goffi@goffi.org>
date Wed, 14 Mar 2018 09:23:23 +0100
parents a54882348ecc
children
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Allow: /b/
Disallow: /libervia.html
Disallow: /mr
Disallow: /login

User-agent: Mediapartners-*
Disallow: /