Mercurial > libervia-web

annotate browser/public/robots.txt @ 1124:28e3eb3bb217

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
files reorganisation and installation rework: - files have been reorganised to follow other SàT projects and usual Python organisation (no more "/src" directory) - VERSION file is now used, as for other SàT projects - replace the overcomplicated setup.py be a more sane one. Pyjamas part is not compiled anymore by setup.py, it must be done separatly - removed check for data_dir if it's empty - installation tested working in virtual env - libervia launching script is now in bin/libervia
author Goffi <goffi@goffi.org>
date Sat, 25 Aug 2018 17:59:48 +0200
parents src/browser/public/robots.txt@a54882348ecc
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
952
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
1 User-agent: *
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
2 Allow: /blog/
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
3 Allow: /u/
1053
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
4 Allow: /b/
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
5 Disallow: /libervia.html
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
6 Disallow: /mr
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
7 Disallow: /login
952
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
8
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
9 User-agent: Mediapartners-*
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
10 Disallow: /