diff browser/public/robots.txt @ 1124:28e3eb3bb217

files reorganisation and installation rework: - files have been reorganised to follow other SàT projects and usual Python organisation (no more "/src" directory) - VERSION file is now used, as for other SàT projects - replace the overcomplicated setup.py be a more sane one. Pyjamas part is not compiled anymore by setup.py, it must be done separatly - removed check for data_dir if it's empty - installation tested working in virtual env - libervia launching script is now in bin/libervia
author Goffi <goffi@goffi.org>
date Sat, 25 Aug 2018 17:59:48 +0200
parents src/browser/public/robots.txt@a54882348ecc
children
line wrap: on
line diff
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/browser/public/robots.txt	Sat Aug 25 17:59:48 2018 +0200
@@ -0,0 +1,10 @@
+User-agent: *
+Allow: /blog/
+Allow: /u/
+Allow: /b/
+Disallow: /libervia.html
+Disallow: /mr
+Disallow: /login
+
+User-agent: Mediapartners-*
+Disallow: /