view browser/public/robots.txt @ 1154:a1625e68b726

server (tasks): task can now use a "prepare" method to prepare data before running (e.g. WATCH_DIRS)
author Goffi <goffi@goffi.org>
date Fri, 22 Feb 2019 18:42:47 +0100
parents 28e3eb3bb217
children
line wrap: on
line source

User-agent: *
Allow: /blog/
Allow: /u/
Allow: /b/
Disallow: /libervia.html
Disallow: /mr
Disallow: /login

User-agent: Mediapartners-*
Disallow: /