annotate browser/public/robots.txt @ 1203:251eba911d4d

server (websockets): fixed websocket handling on HTTPS connections: Original request used to retrieve a page was stored on dynamic pages, but after the end of it, the channel was deleted, resulting in a isSecure() always returning False, and troubles in chain leading to the the use of the wrong session object. This patch fixes this by reworking the way original request is used, and creating a new wrapping class allowing to keep an API similar to iweb.IRequest, with data coming from both the original request and the websocket request. fix 327
author Goffi <goffi@goffi.org>
date Sun, 14 Jul 2019 14:45:51 +0200
parents 28e3eb3bb217
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
952
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
1 User-agent: *
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
2 Allow: /blog/
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
3 Allow: /u/
1053
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
4 Allow: /b/
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
5 Disallow: /libervia.html
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
6 Disallow: /mr
a54882348ecc browser: updated robots.txt
Goffi <goffi@goffi.org>
parents: 952
diff changeset
7 Disallow: /login
952
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
8
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
9 User-agent: Mediapartners-*
0f309eeef26d Added robots.txt:
Goffi <goffi@goffi.org>
parents:
diff changeset
10 Disallow: /