view browser/public/robots.txt @ 1208:584e29d9510a

pages: display a warning instead or raising exception if write fails: request.write sometimes raise an AttributeError. This case happens most of time when browser tab is closed or reloaded before the page has been written. fix 214
author Goffi <goffi@goffi.org>
date Fri, 19 Jul 2019 18:01:38 +0200
parents 28e3eb3bb217
children
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Allow: /b/
Disallow: /libervia.html
Disallow: /mr
Disallow: /login

User-agent: Mediapartners-*
Disallow: /