view browser/public/robots.txt @ 1132:0cafb79ced6d

server: use site names in _moveFirstLevelToDict to better distinguish values for default site at first level + better handling of default menu
author Goffi <goffi@goffi.org>
date Tue, 18 Sep 2018 21:16:53 +0200
parents 28e3eb3bb217
children
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Allow: /b/
Disallow: /libervia.html
Disallow: /mr
Disallow: /login

User-agent: Mediapartners-*
Disallow: /