libervia-backend: libervia/backend/plugins/plugin_comp_ap_gateway/http

annotate libervia/backend/plugins/plugin_comp_ap_gateway/http_server.py @ 4219:1b5cf2ee1d86

plugin XEP-0384, XEP-0391: download missing devices list: when a peer jid was not in our roster, devices list was not retrieved, resulting in failed en/decryption. This patch does check it and download missing devices list in necessary. There is no subscription managed yet, so the list won't be updated in case of new devices, this should be addressed at some point.

author	Goffi <goffi@goffi.org>
date	Tue, 05 Mar 2024 17:31:36 +0100
parents	5f2d496c633f
children	49019947cc76

rev	line source
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1 #!/usr/bin/env python3
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	2
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	3 # Libervia ActivityPub Gateway
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	4 # Copyright (C) 2009-2021 Jérôme Poisson (goffi@goffi.org)
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	5
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	6 # This program is free software: you can redistribute it and/or modify
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	7 # it under the terms of the GNU Affero General Public License as published by
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	8 # the Free Software Foundation, either version 3 of the License, or
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	9 # (at your option) any later version.
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	10
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	11 # This program is distributed in the hope that it will be useful,
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	12 # but WITHOUT ANY WARRANTY; without even the implied warranty of
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	13 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	14 # GNU Affero General Public License for more details.
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	15
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	16 # You should have received a copy of the GNU Affero General Public License
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	17 # along with this program. If not, see <http://www.gnu.org/licenses/>.
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	18
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	19 import time
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	20 import html
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	21 from typing import Optional, Dict, List, Any
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	22 import json
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	23 from urllib import parse
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	24 from collections import deque
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	25 import unicodedata
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	26
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	27 from twisted.web import http, resource as web_resource, server
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	28 from twisted.web import static
3977 6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	29 from twisted.web import util as web_util
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	30 from twisted.python import failure
3833 381340b9a9ee component AP gateway: convert XMPP mentions to AP: Goffi <goffi@goffi.org> parents: 3826 diff changeset	31 from twisted.internet import defer
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	32 from twisted.words.protocols.jabber import jid, error
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	33 from wokkel import pubsub, rsm
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	34
4071 4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	35 from libervia.backend.core import exceptions
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	36 from libervia.backend.core.constants import Const as C
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	37 from libervia.backend.core.i18n import _
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	38 from libervia.backend.core.core_types import SatXMPPEntity
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	39 from libervia.backend.core.log import getLogger
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	40 from libervia.backend.tools.common import date_utils, uri
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4037 diff changeset	41 from libervia.backend.memory.sqla_mapping import SubscriptionState
3729 86eea17cafa7 component AP gateway: split plugin in several files: Goffi <goffi@goffi.org> parents: 3728 diff changeset	42
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	43 from .constants import (
4109 7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	44 NS_AP, MEDIA_TYPE_AP, MEDIA_TYPE_AP_ALT, CONTENT_TYPE_WEBFINGER, CONTENT_TYPE_AP,
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	45 TYPE_ACTOR, TYPE_INBOX, TYPE_SHARED_INBOX, TYPE_OUTBOX, TYPE_EVENT, AP_REQUEST_TYPES,
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	46 PAGE_SIZE, ACTIVITY_TYPES_LOWER, ACTIVIY_NO_ACCOUNT_ALLOWED, SIGN_HEADERS, HS2019,
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	47 SIGN_EXP, TYPE_FOLLOWERS, TYPE_FOLLOWING, TYPE_ITEM, TYPE_LIKE, TYPE_REACTION,
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	48 ST_AP_CACHE
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	49 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	50 from .regex import RE_SIG_PARAM
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	51
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	52
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	53 log = getLogger(__name__)
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	54
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	55 VERSION = unicodedata.normalize(
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	56 'NFKD',
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	57 f"{C.APP_NAME} ActivityPub Gateway {C.APP_VERSION}"
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	58 )
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	59
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	60
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	61 class HTTPAPGServer(web_resource.Resource):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	62 """HTTP Server handling ActivityPub S2S protocol"""
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	63 isLeaf = True
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	64
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	65 def __init__(self, ap_gateway):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	66 self.apg = ap_gateway
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	67 self._seen_digest = deque(maxlen=50)
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	68 super().__init__()
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	69
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	70 def response_code(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	71 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	72 request: "HTTPRequest",
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	73 http_code: int,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	74 msg: Optional[str] = None
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	75 ) -> None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	76 """Log and set HTTP return code and associated message"""
3833 381340b9a9ee component AP gateway: convert XMPP mentions to AP: Goffi <goffi@goffi.org> parents: 3826 diff changeset	77 if msg is not None:
381340b9a9ee component AP gateway: convert XMPP mentions to AP: Goffi <goffi@goffi.org> parents: 3826 diff changeset	78 log.warning(msg)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	79 request.setResponseCode(http_code, None if msg is None else msg.encode())
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	80
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	81 def _on_request_error(self, failure_: failure.Failure, request: "HTTPRequest") -> None:
4014 4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	82 exc = failure_.value
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	83 if isinstance(exc, exceptions.NotFound):
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	84 self.response_code(
4014 4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	85 request,
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	86 http.NOT_FOUND,
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	87 str(exc)
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	88 )
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	89 else:
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	90 log.exception(f"Internal error: {failure_.value}")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	91 self.response_code(
4014 4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	92 request,
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	93 http.INTERNAL_SERVER_ERROR,
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	94 f"internal error: {failure_.value}"
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	95 )
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	96 request.finish()
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	97 raise failure_
4ef473116499 component AP gateway (http): handle properly NotFound error: Goffi <goffi@goffi.org> parents: 4009 diff changeset	98
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	99 request.finish()
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	100
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	101 async def webfinger(self, request):
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	102 url_parsed = parse.urlparse(request.uri.decode())
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	103 query = parse.parse_qs(url_parsed.query)
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	104 resource = query.get("resource", [""])[0]
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	105 account = resource[5:].strip()
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	106 if not resource.startswith("acct:") or not account:
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	107 return web_resource.ErrorPage(
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	108 http.BAD_REQUEST, "Bad Request" , "Invalid webfinger resource"
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	109 ).render(request)
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	110
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	111 actor_url = self.apg.build_apurl(TYPE_ACTOR, account)
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	112
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	113 resp = {
3882 1bd44367337d component AP gateway: add `aliases` to webfinger data Goffi <goffi@goffi.org> parents: 3881 diff changeset	114 "aliases": [actor_url],
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	115 "subject": resource,
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	116 "links": [
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	117 {
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	118 "rel": "self",
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	119 "type": "application/activity+json",
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	120 "href": actor_url
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	121 }
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	122 ]
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	123 }
4104 58bbc100f13b component AP gateway: fix webfinger content type Goffi <goffi@goffi.org> parents: 4093 diff changeset	124 request.setHeader("content-type", CONTENT_TYPE_WEBFINGER)
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	125 request.write(json.dumps(resp).encode())
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	126 request.finish()
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	127
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	128 async def handle_undo_activity(
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	129 self,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	130 request: "HTTPRequest",
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	131 data: dict,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	132 account_jid: jid.JID,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	133 node: Optional[str],
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	134 ap_account: str,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	135 ap_url: str,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	136 signing_actor: str
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	137 ) -> None:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	138 if node is None:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	139 node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	140 client = await self.apg.get_virtual_client(signing_actor)
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	141 object_ = data.get("object")
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	142 if isinstance(object_, str):
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	143 # we check first if it's not a cached object
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	144 ap_cache_key = f"{ST_AP_CACHE}{object_}"
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	145 value = await self.apg.client._ap_storage.get(ap_cache_key)
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	146 else:
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	147 value = None
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	148 if value is not None:
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	149 objects = [value]
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	150 # because we'll undo the activity, we can remove it from cache
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	151 await self.apg.client._ap_storage.remove(ap_cache_key)
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	152 else:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	153 objects = await self.apg.ap_get_list(data, "object")
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	154 for obj in objects:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	155 type_ = obj.get("type")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	156 actor = await self.apg.ap_get_sender_actor(obj)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	157 if actor != signing_actor:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	158 log.warning(f"ignoring object not attributed to signing actor: {data}")
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	159 continue
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	160
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	161 if type_ == "Follow":
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	162 try:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	163 target_account = obj["object"]
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	164 except KeyError:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	165 log.warning(f'ignoring invalid object, missing "object" key: {data}')
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	166 continue
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	167 if not self.apg.is_local_url(target_account):
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	168 log.warning(f"ignoring unfollow request to non local actor: {data}")
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	169 continue
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	170 await self.apg._p.unsubscribe(
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	171 client,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	172 account_jid,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	173 node,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	174 sender=client.jid,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	175 )
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	176 elif type_ == "Announce":
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	177 # we can use directly the Announce object, as only the "id" field is
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	178 # needed
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	179 await self.apg.new_ap_delete_item(client, None, node, obj)
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	180 elif type_ == TYPE_LIKE:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	181 await self.handle_attachment_item(client, obj, {"noticed": False})
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	182 elif type_ == TYPE_REACTION:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	183 await self.handle_attachment_item(client, obj, {
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	184 "reactions": {"operation": "update", "remove": [obj["content"]]}
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	185 })
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	186 else:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	187 log.warning(f"Unmanaged undo type: {type_!r}")
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	188
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	189 async def handle_follow_activity(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	190 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	191 request: "HTTPRequest",
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	192 data: dict,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	193 account_jid: jid.JID,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	194 node: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	195 ap_account: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	196 ap_url: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	197 signing_actor: str
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	198 ) -> None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	199 if node is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	200 node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	201 client = await self.apg.get_virtual_client(signing_actor)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	202 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	203 subscription = await self.apg._p.subscribe(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	204 client,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	205 account_jid,
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	206 node,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	207 # subscriptions from AP are always public
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	208 options=self.apg._pps.set_public_opt()
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	209 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	210 except pubsub.SubscriptionPending:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	211 log.info(f"subscription to node {node!r} of {account_jid} is pending")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	212 # TODO: manage SubscriptionUnconfigured
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	213 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	214 if subscription.state != "subscribed":
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	215 # other states should raise an Exception
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	216 raise exceptions.InternalError('"subscribed" state was expected')
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	217 inbox = await self.apg.get_ap_inbox_from_id(signing_actor, use_shared=False)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	218 actor_id = self.apg.build_apurl(TYPE_ACTOR, ap_account)
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 4016 diff changeset	219 accept_data = self.apg.create_activity(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	220 "Accept", actor_id, object_=data
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	221 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	222 await self.apg.sign_and_post(inbox, actor_id, accept_data)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	223 await self.apg._c.synchronise(client, account_jid, node, resync=False)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	224
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	225 async def handle_accept_activity(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	226 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	227 request: "HTTPRequest",
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	228 data: dict,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	229 account_jid: jid.JID,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	230 node: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	231 ap_account: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	232 ap_url: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	233 signing_actor: str
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	234 ) -> None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	235 if node is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	236 node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	237 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	238 objects = await self.apg.ap_get_list(data, "object")
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	239 for obj in objects:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	240 type_ = obj.get("type")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	241 if type_ == "Follow":
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	242 follow_node = await self.apg.host.memory.storage.get_pubsub_node(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	243 client, client.jid, node, with_subscriptions=True
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	244 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	245 if follow_node is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	246 log.warning(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	247 f"Received a follow accept on an unknown node: {node!r} at "
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	248 f"{client.jid}. Ignoring it"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	249 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	250 continue
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	251 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	252 sub = next(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	253 s for s in follow_node.subscriptions if s.subscriber==account_jid
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	254 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	255 except StopIteration:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	256 log.warning(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	257 "Received a follow accept on a node without subscription: "
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	258 f"{node!r} at {client.jid}. Ignoring it"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	259 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	260 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	261 if sub.state == SubscriptionState.SUBSCRIBED:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	262 log.warning(f"Already subscribed to {node!r} at {client.jid}")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	263 elif sub.state == SubscriptionState.PENDING:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	264 follow_node.subscribed = True
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	265 sub.state = SubscriptionState.SUBSCRIBED
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	266 await self.apg.host.memory.storage.add(follow_node)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	267 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	268 raise exceptions.InternalError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	269 f"Unhandled subscription state {sub.state!r}"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	270 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	271 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	272 log.warning(f"Unmanaged accept type: {type_!r}")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	273
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	274 async def handle_delete_activity(
3793 b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	275 self,
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	276 request: "HTTPRequest",
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	277 data: dict,
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	278 account_jid: Optional[jid.JID],
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	279 node: Optional[str],
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	280 ap_account: Optional[str],
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	281 ap_url: str,
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	282 signing_actor: str
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	283 ):
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	284 if node is None:
b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	285 node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	286 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	287 objects = await self.apg.ap_get_list(data, "object")
3793 b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	288 for obj in objects:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	289 await self.apg.new_ap_delete_item(client, account_jid, node, obj)
3793 b5c9021020df component AP gateway: convert `Delete` AP activities to corresponding Pubsub `retract`: Goffi <goffi@goffi.org> parents: 3764 diff changeset	290
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	291 async def handle_new_ap_items(
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	292 self,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	293 request: "HTTPRequest",
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	294 data: dict,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	295 account_jid: Optional[jid.JID],
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	296 node: Optional[str],
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	297 signing_actor: str,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	298 repeated: bool = False,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	299 ):
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	300 """Helper method to handle workflow for new AP items
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	301
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	302 accept globally the same parameter as for handle_create_activity
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	303 @param repeated: if True, the item is an item republished from somewhere else
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	304 """
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	305 if "_repeated" in data:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	306 log.error(
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	307 '"_repeated" field already present in given AP item, this should not '
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	308 f"happen. Ignoring object from {signing_actor}\n{data}"
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	309 )
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	310 raise exceptions.DataError("unexpected field in item")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	311 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	312 objects = await self.apg.ap_get_list(data, "object")
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	313 for obj in objects:
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	314 if node is None:
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	315 if obj.get("type") == TYPE_EVENT:
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	316 node = self.apg._events.namespace
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	317 else:
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	318 node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	319 sender = await self.apg.ap_get_sender_actor(obj)
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	320 if repeated:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	321 # we don't check sender when item is repeated, as it should be different
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	322 # from post author in this case
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	323 sender_jid = await self.apg.get_jid_from_id(sender)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	324 repeater_jid = await self.apg.get_jid_from_id(signing_actor)
3870 bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	325 repeated_item_id = obj["id"]
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	326 if self.apg.is_local_url(repeated_item_id):
3870 bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	327 # the repeated object is from XMPP, we need to parse the URL to find
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	328 # the right ID
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	329 url_type, url_args = self.apg.parse_apurl(repeated_item_id)
3870 bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	330 if url_type != "item":
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	331 raise exceptions.DataError(
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	332 "local URI is not an item: {repeated_id}"
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	333 )
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	334 try:
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	335 url_account, url_item_id = url_args
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	336 if not url_account or not url_item_id:
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	337 raise ValueError
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	338 except (RuntimeError, ValueError):
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	339 raise exceptions.DataError(
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	340 "local URI is invalid: {repeated_id}"
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	341 )
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	342 else:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	343 url_jid, url_node = await self.apg.get_jid_and_node(url_account)
3870 bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	344 if ((url_jid != sender_jid
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	345 or url_node and url_node != self.apg._m.namespace)):
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	346 raise exceptions.DataError(
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	347 "announced ID doesn't match sender ({sender}): "
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	348 f"[repeated_item_id]"
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	349 )
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	350
bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	351 repeated_item_id = url_item_id
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	352
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	353 obj["_repeated"] = {
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	354 "by": repeater_jid.full(),
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	355 "at": data.get("published"),
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	356 "uri": uri.build_xmpp_uri(
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	357 "pubsub",
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	358 path=sender_jid.full(),
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	359 node=self.apg._m.namespace,
3870 bd84d289fc94 component AP gateway: fix item ID for XMPP items on Announce: Goffi <goffi@goffi.org> parents: 3869 diff changeset	360 item=repeated_item_id
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	361 )
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	362 }
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	363 # we must use activity's id and targets, not the original item ones
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	364 for field in ("id", "to", "bto", "cc", "bcc"):
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	365 obj[field] = data.get(field)
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	366 else:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	367 if sender != signing_actor:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	368 log.warning(
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	369 "Ignoring object not attributed to signing actor: {obj}"
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	370 )
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	371 continue
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	372
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	373 await self.apg.new_ap_item(client, account_jid, node, obj)
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	374
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	375 async def handle_create_activity(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	376 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	377 request: "HTTPRequest",
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	378 data: dict,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	379 account_jid: Optional[jid.JID],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	380 node: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	381 ap_account: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	382 ap_url: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	383 signing_actor: str
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	384 ):
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	385 await self.handle_new_ap_items(request, data, account_jid, node, signing_actor)
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	386
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	387 async def handle_update_activity(
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	388 self,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	389 request: "HTTPRequest",
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	390 data: dict,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	391 account_jid: Optional[jid.JID],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	392 node: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	393 ap_account: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	394 ap_url: str,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	395 signing_actor: str
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	396 ):
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	397 # Update is the same as create: the item ID stays the same, thus the item will be
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	398 # overwritten
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	399 await self.handle_new_ap_items(request, data, account_jid, node, signing_actor)
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	400
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	401 async def handle_announce_activity(
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	402 self,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	403 request: "HTTPRequest",
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	404 data: dict,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	405 account_jid: Optional[jid.JID],
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	406 node: Optional[str],
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	407 ap_account: Optional[str],
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	408 ap_url: str,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	409 signing_actor: str
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	410 ):
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	411 # we create a new item
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	412 await self.handle_new_ap_items(
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	413 request,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	414 data,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	415 account_jid,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	416 node,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	417 signing_actor,
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	418 repeated=True
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	419 )
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	420
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	421 async def handle_attachment_item(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	422 self,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	423 client: SatXMPPEntity,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	424 data: dict,
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	425 attachment_data: dict
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	426 ) -> None:
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	427 target_ids = data.get("object")
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	428 if not target_ids:
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	429 raise exceptions.DataError("object should be set")
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	430 elif isinstance(target_ids, list):
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	431 try:
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	432 target_ids = [o["id"] for o in target_ids]
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	433 except (KeyError, TypeError):
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	434 raise exceptions.DataError(f"invalid object: {target_ids!r}")
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	435 elif isinstance(target_ids, dict):
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	436 obj_id = target_ids.get("id")
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	437 if not obj_id or not isinstance(obj_id, str):
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	438 raise exceptions.DataError(f"invalid object: {target_ids!r}")
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	439 target_ids = [obj_id]
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	440 elif isinstance(target_ids, str):
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	441 target_ids = [target_ids]
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	442
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	443 # XXX: we have to cache AP items because some implementation (Pleroma notably)
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	444 # don't keep object accessible, and we need to be able to retrieve them for
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	445 # UNDO. Current implementation will grow, we need to add a way to flush it after
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	446 # a while.
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	447 # TODO: add a way to flush old cached AP items.
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	448 await client._ap_storage.aset(f"{ST_AP_CACHE}{data['id']}", data)
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	449
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	450 for target_id in target_ids:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	451 if not self.apg.is_local_url(target_id):
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	452 log.debug(f"ignoring non local target ID: {target_id}")
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	453 continue
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	454 url_type, url_args = self.apg.parse_apurl(target_id)
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	455 if url_type != TYPE_ITEM:
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	456 log.warning(f"unexpected local URL for attachment on item {target_id}")
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	457 continue
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	458 try:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	459 account, item_id = url_args
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	460 except ValueError:
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	461 raise ValueError(f"invalid URL: {target_id}")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	462 author_jid, item_node = await self.apg.get_jid_and_node(account)
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	463 if item_node is None:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	464 item_node = self.apg._m.namespace
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	465 attachment_node = self.apg._pa.get_attachment_node_name(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	466 author_jid, item_node, item_id
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	467 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	468 cached_node = await self.apg.host.memory.storage.get_pubsub_node(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	469 client,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	470 author_jid,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	471 attachment_node,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	472 with_subscriptions=True,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	473 create=True
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	474 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	475 found_items, __ = await self.apg.host.memory.storage.get_items(
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	476 cached_node, item_ids=[client.jid.userhost()]
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	477 )
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	478 if not found_items:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	479 old_item_elt = None
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	480 else:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	481 found_item = found_items[0]
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	482 old_item_elt = found_item.data
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	483
3980 9b5092225e46 component AP gateway: fix pubsub attachment plugin call following renaming. Goffi <goffi@goffi.org> parents: 3977 diff changeset	484 item_elt = await self.apg._pa.apply_set_handler(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	485 client,
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	486 {"extra": attachment_data},
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	487 old_item_elt,
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	488 None
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	489 )
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	490 # we reparse the element, as there can be other attachments
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	491 attachments_data = self.apg._pa.items_2_attachment_data(client, [item_elt])
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	492 # and we update the cache
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	493 await self.apg.host.memory.storage.cache_pubsub_items(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	494 client,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	495 cached_node,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	496 [item_elt],
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	497 attachments_data or [{}]
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	498 )
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	499
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	500 if self.apg.is_virtual_jid(author_jid):
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	501 # the attachment is on t a virtual pubsub service (linking to an AP item),
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	502 # we notify all subscribers
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	503 for subscription in cached_node.subscriptions:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	504 if subscription.state != SubscriptionState.SUBSCRIBED:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	505 continue
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	506 self.apg.pubsub_service.notifyPublish(
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	507 author_jid,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	508 attachment_node,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	509 [(subscription.subscriber, None, [item_elt])]
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	510 )
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	511 else:
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	512 # the attachment is on an XMPP item, we publish it to the attachment node
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	513 await self.apg._p.send_items(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	514 client, author_jid, attachment_node, [item_elt]
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	515 )
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	516
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	517 async def handle_like_activity(
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	518 self,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	519 request: "HTTPRequest",
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	520 data: dict,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	521 account_jid: Optional[jid.JID],
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	522 node: Optional[str],
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	523 ap_account: Optional[str],
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	524 ap_url: str,
c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	525 signing_actor: str
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	526 ) -> None:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	527 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	528 await self.handle_attachment_item(client, data, {"noticed": True})
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	529
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	530 async def handle_emojireact_activity(
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	531 self,
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	532 request: "HTTPRequest",
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	533 data: dict,
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	534 account_jid: Optional[jid.JID],
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	535 node: Optional[str],
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	536 ap_account: Optional[str],
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	537 ap_url: str,
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	538 signing_actor: str
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	539 ) -> None:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	540 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	541 await self.handle_attachment_item(client, data, {
3888 aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	542 "reactions": {"operation": "update", "add": [data["content"]]}
aa7197b67c26 component AP gateway: AP <=> XMPP reactions conversions: Goffi <goffi@goffi.org> parents: 3884 diff changeset	543 })
3869 c0bcbcf5b4b7 component AP gateway: handle `Like` and `Undo`/`Like` activities: Goffi <goffi@goffi.org> parents: 3847 diff changeset	544
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	545 async def handle_join_activity(
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	546 self,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	547 request: "HTTPRequest",
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	548 data: dict,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	549 account_jid: Optional[jid.JID],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	550 node: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	551 ap_account: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	552 ap_url: str,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	553 signing_actor: str
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	554 ) -> None:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	555 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	556 await self.handle_attachment_item(client, data, {"rsvp": {"attending": "yes"}})
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	557
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	558 async def handle_leave_activity(
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	559 self,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	560 request: "HTTPRequest",
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	561 data: dict,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	562 account_jid: Optional[jid.JID],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	563 node: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	564 ap_account: Optional[str],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	565 ap_url: str,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	566 signing_actor: str
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	567 ) -> None:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	568 client = await self.apg.get_virtual_client(signing_actor)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	569 await self.handle_attachment_item(client, data, {"rsvp": {"attending": "no"}})
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	570
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	571 async def ap_actor_request(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	572 self,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	573 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	574 data: Optional[dict],
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	575 account_jid: jid.JID,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	576 node: Optional[str],
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	577 ap_account: str,
3826 81c79b7cafa7 tests (unit/ap-gateway): tests for XMPP identity/vCard4 <=> AP actor data conversion: Goffi <goffi@goffi.org> parents: 3821 diff changeset	578 ap_url: str,
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	579 signing_actor: Optional[str]
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	580 ) -> dict:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	581 inbox = self.apg.build_apurl(TYPE_INBOX, ap_account)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	582 shared_inbox = self.apg.build_apurl(TYPE_SHARED_INBOX)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	583 outbox = self.apg.build_apurl(TYPE_OUTBOX, ap_account)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	584 followers = self.apg.build_apurl(TYPE_FOLLOWERS, ap_account)
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	585 following = self.apg.build_apurl(TYPE_FOLLOWING, ap_account)
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	586
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	587 # we have to use AP account as preferredUsername because it is used to retrieve
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	588 # actor handle (see https://socialhub.activitypub.rocks/t/how-to-retrieve-user-server-tld-handle-from-actors-url/2196)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	589 preferred_username = ap_account.split("@", 1)[0]
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	590
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	591 identity_data = await self.apg._i.get_identity(self.apg.client, account_jid)
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	592 if node and node.startswith(self.apg._events.namespace):
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	593 events = outbox
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	594 else:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	595 events_account = await self.apg.get_ap_account_from_jid_and_node(
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	596 account_jid, self.apg._events.namespace
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	597 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	598 events = self.apg.build_apurl(TYPE_OUTBOX, events_account)
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	599
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	600 actor_data = {
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	601 "@context": [
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	602 "https://www.w3.org/ns/activitystreams",
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	603 "https://w3id.org/security/v1"
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	604 ],
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	605
3994 69d970f974ff component AP gateway: don't percent-encode `@`: Goffi <goffi@goffi.org> parents: 3992 diff changeset	606 # XXX: Mastodon doesn't like percent-encode arobas, so we have to unescape it
69d970f974ff component AP gateway: don't percent-encode `@`: Goffi <goffi@goffi.org> parents: 3992 diff changeset	607 # if it is escaped
69d970f974ff component AP gateway: don't percent-encode `@`: Goffi <goffi@goffi.org> parents: 3992 diff changeset	608 "id": ap_url.replace("%40", "@"),
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	609 "type": "Person",
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	610 "preferredUsername": preferred_username,
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	611 "inbox": inbox,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	612 "outbox": outbox,
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	613 "events": events,
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	614 "followers": followers,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	615 "following": following,
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	616 "publicKey": {
3826 81c79b7cafa7 tests (unit/ap-gateway): tests for XMPP identity/vCard4 <=> AP actor data conversion: Goffi <goffi@goffi.org> parents: 3821 diff changeset	617 "id": f"{ap_url}#main-key",
81c79b7cafa7 tests (unit/ap-gateway): tests for XMPP identity/vCard4 <=> AP actor data conversion: Goffi <goffi@goffi.org> parents: 3821 diff changeset	618 "owner": ap_url,
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	619 "publicKeyPem": self.apg.public_key_pem
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	620 },
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	621 "endpoints": {
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	622 "sharedInbox": shared_inbox,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	623 "events": events,
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	624 },
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	625 }
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	626
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	627 if identity_data.get("nicknames"):
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	628 actor_data["name"] = identity_data["nicknames"][0]
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	629 if identity_data.get("description"):
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	630 # description is plain text while summary expects HTML
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	631 actor_data["summary"] = html.escape(identity_data["description"])
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	632 if identity_data.get("avatar"):
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	633 avatar_data = identity_data["avatar"]
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	634 try:
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	635 filename = avatar_data["filename"]
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	636 media_type = avatar_data["media_type"]
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	637 except KeyError:
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	638 log.error(f"incomplete avatar data: {identity_data!r}")
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	639 else:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	640 avatar_url = self.apg.build_apurl("avatar", filename)
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	641 actor_data["icon"] = {
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	642 "type": "Image",
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	643 "url": avatar_url,
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	644 "mediaType": media_type
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	645 }
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	646
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	647 return actor_data
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	648
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	649 def get_canonical_url(self, request: "HTTPRequest") -> str:
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	650 return parse.urljoin(
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	651 f"https://{self.apg.public_url}",
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	652 request.path.decode().rstrip("/")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	653 # we unescape "@" for the same reason as in [ap_actor_request]
3994 69d970f974ff component AP gateway: don't percent-encode `@`: Goffi <goffi@goffi.org> parents: 3992 diff changeset	654 ).replace("%40", "@")
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	655
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	656 def query_data_2_rsm_request(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	657 self,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	658 query_data: Dict[str, List[str]]
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	659 ) -> rsm.RSMRequest:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	660 """Get RSM kwargs to use with RSMRequest from query data"""
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	661 page = query_data.get("page")
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	662
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	663 if page == ["first"]:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	664 return rsm.RSMRequest(max_=PAGE_SIZE, before="")
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	665 elif page == ["last"]:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	666 return rsm.RSMRequest(max_=PAGE_SIZE)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	667 else:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	668 for query_key in ("index", "before", "after"):
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	669 try:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	670 kwargs={query_key: query_data[query_key][0], "max_": PAGE_SIZE}
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	671 except (KeyError, IndexError, ValueError):
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	672 pass
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	673 else:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	674 return rsm.RSMRequest(**kwargs)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	675 raise ValueError(f"Invalid query data: {query_data!r}")
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	676
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	677 async def ap_outbox_page_request(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	678 self,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	679 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	680 data: Optional[dict],
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	681 account_jid: jid.JID,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	682 node: Optional[str],
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	683 ap_account: str,
3729 86eea17cafa7 component AP gateway: split plugin in several files: Goffi <goffi@goffi.org> parents: 3728 diff changeset	684 ap_url: str,
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	685 query_data: Dict[str, List[str]]
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	686 ) -> dict:
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	687 if node is None:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	688 node = self.apg._m.namespace
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	689 # we only keep useful keys, and sort to have consistent URL which can
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	690 # be used as ID
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	691 url_keys = sorted(set(query_data) & {"page", "index", "before", "after"})
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	692 query_data = {k: query_data[k] for k in url_keys}
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	693 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	694 items, metadata = await self.apg._p.get_items(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	695 client=self.apg.client,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	696 service=account_jid,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	697 node=node,
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	698 rsm_request=self.query_data_2_rsm_request(query_data),
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	699 extra = {C.KEY_USE_CACHE: False}
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	700 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	701 except error.StanzaError as e:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	702 log.warning(f"Can't get data from pubsub node {node} at {account_jid}: {e}")
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	703 return {}
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	704
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	705 base_url = self.get_canonical_url(request)
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	706 url = f"{base_url}?{parse.urlencode(query_data, True)}"
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	707 if node and node.startswith(self.apg._events.namespace):
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	708 ordered_items = [
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	709 await self.apg.ap_events.event_data_2_ap_item(
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	710 self.apg._events.event_elt_2_event_data(item),
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	711 account_jid
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	712 )
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	713 for item in reversed(items)
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	714 ]
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	715 else:
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	716 ordered_items = [
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	717 await self.apg.mb_data_2_ap_item(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	718 self.apg.client,
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 4016 diff changeset	719 await self.apg._m.item_2_mb_data(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	720 self.apg.client,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	721 item,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	722 account_jid,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	723 node
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	724 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	725 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	726 for item in reversed(items)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	727 ]
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	728 ret_data = {
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	729 "@context": ["https://www.w3.org/ns/activitystreams"],
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	730 "id": url,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	731 "type": "OrderedCollectionPage",
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	732 "partOf": base_url,
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	733 "orderedItems": ordered_items
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	734 }
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	735
4009 48e8b3dba793 component AP gateway (http/outbox): return data when no RSM is available Goffi <goffi@goffi.org> parents: 4005 diff changeset	736 if "rsm" not in metadata:
48e8b3dba793 component AP gateway (http/outbox): return data when no RSM is available Goffi <goffi@goffi.org> parents: 4005 diff changeset	737 # no RSM available, we return what we have
48e8b3dba793 component AP gateway (http/outbox): return data when no RSM is available Goffi <goffi@goffi.org> parents: 4005 diff changeset	738 return ret_data
48e8b3dba793 component AP gateway (http/outbox): return data when no RSM is available Goffi <goffi@goffi.org> parents: 4005 diff changeset	739
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	740 # AP OrderedCollection must be in reversed chronological order, thus the opposite
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	741 # of what we get with RSM (at least with Libervia Pubsub)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	742 if not metadata["complete"]:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	743 try:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	744 last= metadata["rsm"]["last"]
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	745 except KeyError:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	746 last = None
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	747 ret_data["prev"] = f"{base_url}?{parse.urlencode({'after': last})}"
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	748 if metadata["rsm"]["index"] != 0:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	749 try:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	750 first= metadata["rsm"]["first"]
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	751 except KeyError:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	752 first = None
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	753 ret_data["next"] = f"{base_url}?{parse.urlencode({'before': first})}"
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	754
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	755 return ret_data
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	756
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	757 async def ap_outbox_request(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	758 self,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	759 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	760 data: Optional[dict],
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	761 account_jid: jid.JID,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	762 node: Optional[str],
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	763 ap_account: str,
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	764 ap_url: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	765 signing_actor: Optional[str]
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	766 ) -> dict:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	767 if node is None:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	768 node = self.apg._m.namespace
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	769
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	770 parsed_url = parse.urlparse(request.uri.decode())
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	771 query_data = parse.parse_qs(parsed_url.query)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	772 if query_data:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	773 return await self.ap_outbox_page_request(
3995 27e5294649c2 component AP gateway: fix missing argument when calling APOutboxPageRequest Goffi <goffi@goffi.org> parents: 3994 diff changeset	774 request, data, account_jid, node, ap_account, ap_url, query_data
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	775 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	776
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	777 # XXX: we can't use disco#info here because this request won't work on a bare jid
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	778 # due to security considerations of XEP-0030 (we don't have presence
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	779 # subscription).
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	780 # The current workaround is to do a request as if RSM was available, and actually
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	781 # check its availability according to result.
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	782 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	783 __, metadata = await self.apg._p.get_items(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	784 client=self.apg.client,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	785 service=account_jid,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	786 node=node,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	787 max_items=0,
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	788 rsm_request=rsm.RSMRequest(max_=0),
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	789 extra = {C.KEY_USE_CACHE: False}
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	790 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	791 except error.StanzaError as e:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	792 log.warning(f"Can't get data from pubsub node {node} at {account_jid}: {e}")
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	793 return {}
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	794 try:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	795 items_count = metadata["rsm"]["count"]
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	796 except KeyError:
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	797 log.warning(
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	798 f"No RSM metadata found when requesting pubsub node {node} at "
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	799 f"{account_jid}, defaulting to items_count=20"
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	800 )
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	801 items_count = 20
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	802
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	803 url = self.get_canonical_url(request)
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	804 url_first_page = f"{url}?{parse.urlencode({'page': 'first'})}"
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	805 url_last_page = f"{url}?{parse.urlencode({'page': 'last'})}"
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	806 return {
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	807 "@context": ["https://www.w3.org/ns/activitystreams"],
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	808 "id": url,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	809 "totalItems": items_count,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	810 "type": "OrderedCollection",
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	811 "first": url_first_page,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	812 "last": url_last_page,
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	813 }
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	814
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	815 async def ap_inbox_request(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	816 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	817 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	818 data: Optional[dict],
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	819 account_jid: Optional[jid.JID],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	820 node: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	821 ap_account: Optional[str],
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	822 ap_url: str,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	823 signing_actor: Optional[str]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	824 ) -> None:
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	825 assert data is not None
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	826 if signing_actor is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	827 raise exceptions.InternalError("signing_actor must be set for inbox requests")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	828 await self.check_signing_actor(data, signing_actor)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	829 activity_type = (data.get("type") or "").lower()
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	830 if not activity_type in ACTIVITY_TYPES_LOWER:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	831 return self.response_code(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	832 request,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	833 http.UNSUPPORTED_MEDIA_TYPE,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	834 f"request is not an activity, ignoring"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	835 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	836
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	837 if account_jid is None and activity_type not in ACTIVIY_NO_ACCOUNT_ALLOWED:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	838 return self.response_code(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	839 request,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	840 http.UNSUPPORTED_MEDIA_TYPE,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	841 f"{activity_type.title()!r} activity must target an account"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	842 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	843
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	844 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	845 method = getattr(self, f"handle_{activity_type}_activity")
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	846 except AttributeError:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	847 return self.response_code(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	848 request,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	849 http.UNSUPPORTED_MEDIA_TYPE,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	850 f"{activity_type.title()} activity is not yet supported"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	851 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	852 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	853 await method(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	854 request, data, account_jid, node, ap_account, ap_url, signing_actor
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	855 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	856
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	857 async def ap_followers_request(
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	858 self,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	859 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	860 data: Optional[dict],
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	861 account_jid: jid.JID,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	862 node: Optional[str],
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	863 ap_account: Optional[str],
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	864 ap_url: str,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	865 signing_actor: Optional[str]
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	866 ) -> dict:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	867 if node is None:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	868 node = self.apg._m.namespace
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	869 client = self.apg.client
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	870 subscribers = await self.apg._pps.get_public_node_subscriptions(
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	871 client, account_jid, node
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	872 )
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	873 followers = []
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	874 for subscriber in subscribers.keys():
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	875 if self.apg.is_virtual_jid(subscriber):
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	876 # the subscriber is an AP user subscribed with this gateway
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	877 ap_account = self.apg._e.unescape(subscriber.user)
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	878 else:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	879 # regular XMPP user
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	880 ap_account = await self.apg.get_ap_account_from_jid_and_node(subscriber, node)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	881 followers.append(ap_account)
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	882
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	883 url = self.get_canonical_url(request)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	884 return {
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	885 "@context": ["https://www.w3.org/ns/activitystreams"],
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	886 "type": "OrderedCollection",
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	887 "id": url,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	888 "totalItems": len(subscribers),
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	889 "first": {
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	890 "type": "OrderedCollectionPage",
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	891 "id": url,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	892 "orderedItems": followers
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	893 }
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	894 }
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	895
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	896 async def ap_following_request(
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	897 self,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	898 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	899 data: Optional[dict],
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	900 account_jid: jid.JID,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	901 node: Optional[str],
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	902 ap_account: Optional[str],
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	903 ap_url: str,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	904 signing_actor: Optional[str]
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	905 ) -> dict[str, Any]:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	906 client = self.apg.client
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	907 subscriptions = await self.apg._pps.subscriptions(
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	908 client, account_jid, node
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	909 )
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	910 following = []
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	911 for sub_dict in subscriptions:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	912 service = jid.JID(sub_dict["service"])
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	913 if self.apg.is_virtual_jid(service):
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	914 # the subscription is to an AP actor with this gateway
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	915 ap_account = self.apg._e.unescape(service.user)
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	916 else:
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	917 # regular XMPP user
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	918 ap_account = await self.apg.get_ap_account_from_jid_and_node(
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	919 service, sub_dict["node"]
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	920 )
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	921 following.append(ap_account)
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	922
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	923 url = self.get_canonical_url(request)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	924 return {
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	925 "@context": ["https://www.w3.org/ns/activitystreams"],
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	926 "type": "OrderedCollection",
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	927 "id": url,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	928 "totalItems": len(subscriptions),
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	929 "first": {
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	930 "type": "OrderedCollectionPage",
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	931 "id": url,
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	932 "orderedItems": following
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	933 }
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	934 }
125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	935
4015 2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	936 def _get_to_log(
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	937 self,
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	938 request: "HTTPRequest",
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	939 data: Optional[dict] = None,
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	940 ) -> List[str]:
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	941 """Get base data to logs in verbose mode"""
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	942 from pprint import pformat
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	943 to_log = [
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	944 "",
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	945 f"<<< got {request.method.decode()} request - {request.uri.decode()}"
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	946 ]
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	947 if data is not None:
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	948 to_log.append(pformat(data))
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	949 if self.apg.verbose>=3:
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	950 headers = "\n".join(
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	951 f" {k.decode()}: {v.decode()}"
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	952 for k,v in request.getAllHeaders().items()
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	953 )
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	954 to_log.append(f" headers:\n{headers}")
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	955 return to_log
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	956
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	957 async def ap_request(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	958 self,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	959 request: "HTTPRequest",
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	960 data: Optional[dict] = None,
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	961 signing_actor: Optional[str] = None
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	962 ) -> None:
3847 aaa4e7815ba8 component AP gateway: new `verbose` attribute in AP gateway to activate debug logs: Goffi <goffi@goffi.org> parents: 3846 diff changeset	963 if self.apg.verbose:
4015 2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	964 to_log = self._get_to_log(request, data)
3847 aaa4e7815ba8 component AP gateway: new `verbose` attribute in AP gateway to activate debug logs: Goffi <goffi@goffi.org> parents: 3846 diff changeset	965
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	966 path = request.path.decode()
3729 86eea17cafa7 component AP gateway: split plugin in several files: Goffi <goffi@goffi.org> parents: 3728 diff changeset	967 ap_url = parse.urljoin(
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	968 f"https://{self.apg.public_url}",
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	969 path
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	970 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	971 request_type, extra_args = self.apg.parse_apurl(ap_url)
4109 7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	972 header_accept = request.getHeader("accept") or ""
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	973 if ((MEDIA_TYPE_AP not in header_accept
7067b0d73183 component AP gateway: fix AP media type in GET and POST requests headers Goffi <goffi@goffi.org> parents: 4104 diff changeset	974 and MEDIA_TYPE_AP_ALT not in header_accept
3977 6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	975 and request_type in self.apg.html_redirect)):
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	976 # this is not a AP request, and we have a redirections for it
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	977 kw = {}
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	978 if extra_args:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	979 kw["jid"], kw["node"] = await self.apg.get_jid_and_node(extra_args[0])
3977 6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	980 kw["jid_user"] = kw["jid"].user
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	981 if kw["node"] is None:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	982 kw["node"] = self.apg._m.namespace
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	983 if len(extra_args) > 1:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	984 kw["item"] = extra_args[1]
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	985 else:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	986 kw["item"] = ""
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	987 else:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	988 kw["jid"], kw["jid_user"], kw["node"], kw["item"] = "", "", "", ""
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	989
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	990 redirections = self.apg.html_redirect[request_type]
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	991 for redirection in redirections:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	992 filters = redirection["filters"]
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	993 if not filters:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	994 break
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	995 # if we have filter, they must all match
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	996 elif all(v in kw[k] for k,v in filters.items()):
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	997 break
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	998 else:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	999 # no redirection is matching
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1000 redirection = None
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1001
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1002 if redirection is not None:
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1003 kw = {k: parse.quote(str(v), safe="") for k,v in kw.items()}
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1004 target_url = redirection["url"].format(**kw)
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1005 content = web_util.redirectTo(target_url.encode(), request)
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1006 request.write(content)
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1007 request.finish()
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1008 return
6fa4ca0c047e component AP gateway: HTML redirection: Goffi <goffi@goffi.org> parents: 3904 diff changeset	1009
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1010 if len(extra_args) == 0:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1011 if request_type != "shared_inbox":
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1012 raise exceptions.DataError(f"Invalid request type: {request_type!r}")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1013 ret_data = await self.ap_inbox_request(
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1014 request, data, None, None, None, ap_url, signing_actor
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1015 )
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	1016 elif request_type == "avatar":
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	1017 if len(extra_args) != 1:
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	1018 raise exceptions.DataError("avatar argument expected in URL")
0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	1019 avatar_filename = extra_args[0]
4212 5f2d496c633f core: get rid of `pickle`: Goffi <goffi@goffi.org> parents: 4109 diff changeset	1020 avatar_path = self.apg.host.common_cache.get_path(avatar_filename)
3821 0b1c30ff2cbb component AP: XMPP identity => AP actor data converstion: Goffi <goffi@goffi.org> parents: 3807 diff changeset	1021 return static.File(str(avatar_path)).render(request)
3846 cc13efdd8360 component AP gateway: return item when `item` URL is used: Goffi <goffi@goffi.org> parents: 3844 diff changeset	1022 elif request_type == "item":
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1023 ret_data = await self.apg.ap_get_local_object(ap_url)
3904 0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	1024 if "@context" not in ret_data:
0aa7023dcd08 component AP gateway: events: Goffi <goffi@goffi.org> parents: 3888 diff changeset	1025 ret_data["@context"] = [NS_AP]
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1026 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1027 if len(extra_args) > 1:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1028 log.warning(f"unexpected extra arguments: {extra_args!r}")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1029 ap_account = extra_args[0]
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1030 account_jid, node = await self.apg.get_jid_and_node(ap_account)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1031 if request_type not in AP_REQUEST_TYPES.get(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1032 request.method.decode().upper(), []
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1033 ):
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1034 raise exceptions.DataError(f"Invalid request type: {request_type!r}")
4093 13b1079c27ec component AP gateway: fix method retrieval in `ap_request`: Goffi <goffi@goffi.org> parents: 4071 diff changeset	1035 method = getattr(self, f"ap_{request_type}_request")
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1036 ret_data = await method(
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1037 request, data, account_jid, node, ap_account, ap_url, signing_actor
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1038 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1039 if ret_data is not None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1040 request.setHeader("content-type", CONTENT_TYPE_AP)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1041 request.write(json.dumps(ret_data).encode())
3881 2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1042 if self.apg.verbose:
2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1043 to_log.append(f"--- RET (code: {request.code})---")
3847 aaa4e7815ba8 component AP gateway: new `verbose` attribute in AP gateway to activate debug logs: Goffi <goffi@goffi.org> parents: 3846 diff changeset	1044 if self.apg.verbose>=2:
3881 2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1045 if ret_data is not None:
4016 97df34151c6d component AP gateway (http): fix missing `pformat` module in verbose mode Goffi <goffi@goffi.org> parents: 4015 diff changeset	1046 from pprint import pformat
3881 2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1047 to_log.append(f"{pformat(ret_data)}")
2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1048 to_log.append("---")
2e4a0f6050bd component AP gateway: better verbose logging: Goffi <goffi@goffi.org> parents: 3870 diff changeset	1049 log.info("\n".join(to_log))
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1050 request.finish()
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1051
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1052 async def ap_post_request(self, request: "HTTPRequest") -> None:
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1053 try:
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1054 data = json.load(request.content)
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1055 if not isinstance(data, dict):
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1056 log.warning(f"JSON data should be an object (uri={request.uri.decode()})")
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1057 self.response_code(
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1058 request,
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1059 http.BAD_REQUEST,
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1060 f"invalid body, was expecting a JSON object"
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1061 )
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1062 request.finish()
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1063 return
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1064 except (json.JSONDecodeError, ValueError) as e:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1065 self.response_code(
3981 acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1066 request,
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1067 http.BAD_REQUEST,
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1068 f"invalid json in inbox request: {e}"
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1069 )
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1070 request.finish()
acc9dfc8ba8d component AP gateway: parse body immediately on `POST` request: Goffi <goffi@goffi.org> parents: 3980 diff changeset	1071 return
4005 54a6b44f173b component AP gateway: reset stream position after getting payload: Goffi <goffi@goffi.org> parents: 3996 diff changeset	1072 else:
54a6b44f173b component AP gateway: reset stream position after getting payload: Goffi <goffi@goffi.org> parents: 3996 diff changeset	1073 request.content.seek(0)
54a6b44f173b component AP gateway: reset stream position after getting payload: Goffi <goffi@goffi.org> parents: 3996 diff changeset	1074
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1075 try:
3983 31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1076 if data["type"] == "Delete" and data["actor"] == data["object"]:
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1077 # we don't handle actor deletion
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1078 request.setResponseCode(http.ACCEPTED)
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1079 log.debug(f"ignoring actor deletion ({data['actor']})")
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1080 # TODO: clean data in cache coming from this actor, maybe with a tombstone
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1081 request.finish()
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1082 return
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1083 except KeyError:
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1084 pass
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1085
31c3d6652115 component AP gateway: ignore actor delection notifications: Goffi <goffi@goffi.org> parents: 3982 diff changeset	1086 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1087 signing_actor = await self.check_signature(request)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1088 except exceptions.EncryptionError as e:
4015 2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	1089 if self.apg.verbose:
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	1090 to_log = self._get_to_log(request)
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	1091 to_log.append(f" body: {request.content.read()!r}")
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	1092 request.content.seek(0)
2913313ca58f component AP gateway (http): add verbose log when signature verification fails on POST request Goffi <goffi@goffi.org> parents: 4014 diff changeset	1093 log.info("\n".join(to_log))
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1094 self.response_code(
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1095 request,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1096 http.FORBIDDEN,
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1097 f"invalid signature: {e}"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1098 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1099 request.finish()
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1100 return
3982 74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1101 except Exception as e:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1102 self.response_code(
3982 74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1103 request,
74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1104 http.INTERNAL_SERVER_ERROR,
74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1105 f"Can't check signature: {e}"
74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1106 )
74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1107 request.finish()
74f7c10a48bc component AP gateway: properly close the HTTP connection on `checkSignature` exception: Goffi <goffi@goffi.org> parents: 3981 diff changeset	1108 return
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1109
3844 65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1110 request.setResponseCode(http.ACCEPTED)
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1111
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1112 digest = request.getHeader("digest")
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1113 if digest in self._seen_digest:
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1114 log.debug(f"Ignoring duplicated request (digest: {digest!r})")
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1115 request.finish()
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1116 return
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1117 self._seen_digest.append(digest)
65e5718e7710 component AP gateway: `Announce` activity implementation: Goffi <goffi@goffi.org> parents: 3833 diff changeset	1118
3802 983df907d456 component AP gateway: set POST default response code to 202 (accepted) Goffi <goffi@goffi.org> parents: 3793 diff changeset	1119 # default response code, may be changed, e.g. in case of exception
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	1120 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1121 return await self.ap_request(request, data, signing_actor)
3764 125c7043b277 comp AP gateway: publish, (un)subscribe/(un)follow, public subscription/following/followers: Goffi <goffi@goffi.org> parents: 3745 diff changeset	1122 except Exception as e:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1123 self._on_request_error(failure.Failure(e), request)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1124
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1125 async def check_signing_actor(self, data: dict, signing_actor: str) -> None:
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1126 """That that signing actor correspond to actor declared in data
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1127
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1128 @param data: request payload
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1129 @param signing_actor: actor ID of the signing entity, as returned by
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1130 check_signature
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1131 @raise exceptions.NotFound: no actor found in data
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1132 @raise exceptions.EncryptionError: signing actor doesn't match actor in data
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1133 """
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1134 actor = await self.apg.ap_get_sender_actor(data)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1135
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1136 if signing_actor != actor:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1137 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1138 f"signing actor ({signing_actor}) doesn't match actor in data ({actor})"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1139 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1140
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1141 async def check_signature(self, request: "HTTPRequest") -> str:
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1142 """Check and validate HTTP signature
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1143
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1144 @return: id of the signing actor
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1145
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1146 @raise exceptions.EncryptionError: signature is not present or doesn't match
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1147 """
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1148 signature = request.getHeader("Signature")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1149 if signature is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1150 raise exceptions.EncryptionError("No signature found")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1151 sign_data = {
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1152 m["key"]: m["uq_value"] or m["quoted_value"][1:-1]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1153 for m in RE_SIG_PARAM.finditer(signature)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1154 }
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1155 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1156 key_id = sign_data["keyId"]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1157 except KeyError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1158 raise exceptions.EncryptionError('"keyId" is missing from signature')
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1159 algorithm = sign_data.get("algorithm", HS2019)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1160 signed_headers = sign_data.get(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1161 "headers",
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1162 "(created)" if algorithm==HS2019 else "date"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1163 ).lower().split()
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1164 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1165 headers_to_check = SIGN_HEADERS[None] + SIGN_HEADERS[request.method]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1166 except KeyError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1167 raise exceptions.InternalError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1168 f"there should be a list of headers for {request.method} method"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1169 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1170 if not headers_to_check:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1171 raise exceptions.InternalError("headers_to_check must not be empty")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1172
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1173 for header in headers_to_check:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1174 if isinstance(header, tuple):
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1175 if len(set(header).intersection(signed_headers)) == 0:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1176 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1177 f"at least one of following header must be signed: {header}"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1178 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1179 elif header not in signed_headers:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1180 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1181 f"the {header!r} header must be signed"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1182 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1183
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1184 body = request.content.read()
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1185 request.content.seek(0)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1186 headers = {}
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1187 for to_sign in signed_headers:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1188 if to_sign == "(request-target)":
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1189 method = request.method.decode().lower()
3884 cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1190 uri = request.uri.decode()
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1191 headers[to_sign] = f"{method} /{uri.lstrip('/')}"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1192 elif to_sign in ("(created)", "(expires)"):
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1193 if algorithm != HS2019:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1194 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1195 f"{to_sign!r} pseudo-header can only be used with {HS2019} "
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1196 "algorithm"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1197 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1198 key = to_sign[1:-1]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1199 value = sign_data.get(key)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1200 if not value:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1201 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1202 "{key!r} parameter is missing from signature"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1203 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1204 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1205 if float(value) < 0:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1206 raise ValueError
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1207 except ValueError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1208 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1209 f"{to_sign} must be a Unix timestamp"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1210 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1211 headers[to_sign] = value
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1212 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1213 value = request.getHeader(to_sign)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1214 if not value:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1215 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1216 f"value of header {to_sign!r} is missing!"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1217 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1218 elif to_sign == "host":
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1219 # we check Forwarded/X-Forwarded-Host headers
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1220 # as we need original host if a proxy has modified the header
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1221 forwarded = request.getHeader("forwarded")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1222 if forwarded is not None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1223 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1224 host = [
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1225 f[5:] for f in forwarded.split(";")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1226 if f.startswith("host=")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1227 ][0] or None
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1228 except IndexError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1229 host = None
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1230 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1231 host = None
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1232 if host is None:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1233 host = request.getHeader("x-forwarded-host")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1234 if host:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1235 value = host
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1236 elif to_sign == "digest":
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1237 hashes = {
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1238 algo.lower(): hash_ for algo, hash_ in (
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1239 digest.split("=", 1) for digest in value.split(",")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1240 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1241 }
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1242 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1243 given_digest = hashes["sha-256"]
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1244 except KeyError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1245 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1246 "Only SHA-256 algorithm is currently supported for digest"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1247 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1248 __, computed_digest = self.apg.get_digest(body)
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1249 if given_digest != computed_digest:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1250 raise exceptions.EncryptionError(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1251 f"SHA-256 given and computed digest differ:\n"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1252 f"given: {given_digest!r}\ncomputed: {computed_digest!r}"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1253 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1254 headers[to_sign] = value
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1255
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1256 # date check
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1257 limit_ts = time.time() + SIGN_EXP
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1258 if "(created)" in headers:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1259 created = float(headers["created"])
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1260 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1261 created = date_utils.date_parse(headers["date"])
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1262
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1263
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1264 try:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1265 expires = float(headers["expires"])
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1266 except KeyError:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1267 pass
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1268 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1269 if expires < created:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1270 log.warning(
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1271 f"(expires) [{expires}] set in the past of (created) [{created}] "
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1272 "ignoring it according to specs"
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1273 )
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1274 else:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1275 limit_ts = min(limit_ts, expires)
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1276
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1277 if created > limit_ts:
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1278 raise exceptions.EncryptionError("Signature has expired")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1279
3884 cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1280 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1281 return await self.apg.check_signature(
3884 cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1282 sign_data["signature"],
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1283 key_id,
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1284 headers
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1285 )
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1286 except exceptions.EncryptionError:
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1287 method, url = headers["(request-target)"].rsplit(' ', 1)
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1288 headers["(request-target)"] = f"{method} {parse.unquote(url)}"
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1289 log.debug(
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1290 "Using workaround for (request-target) encoding bug in signature, "
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1291 "see https://github.com/mastodon/mastodon/issues/18871"
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1292 )
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1293 return await self.apg.check_signature(
3884 cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1294 sign_data["signature"],
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1295 key_id,
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1296 headers
cea52400623d component AP gateway: work around encoding bug in Mastodon: Goffi <goffi@goffi.org> parents: 3882 diff changeset	1297 )
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1298
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1299 def render(self, request):
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1300 request.setHeader("server", VERSION)
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1301 return super().render(request)
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1302
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1303 def render_GET(self, request):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1304 path = request.path.decode().lstrip("/")
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1305 if path.startswith(".well-known/webfinger"):
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1306 defer.ensureDeferred(self.webfinger(request))
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1307 return server.NOT_DONE_YET
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1308 elif path.startswith(self.apg.ap_path):
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1309 d = defer.ensureDeferred(self.ap_request(request))
524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1310 d.addErrback(self._on_request_error, request)
3728 b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1311 return server.NOT_DONE_YET
b15644cae50d component AP gateway: JID/node ⟺ AP outbox conversion: Goffi <goffi@goffi.org> parents: 3684 diff changeset	1312
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1313 return web_resource.NoResource().render(request)
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1314
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1315 def render_POST(self, request):
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1316 path = request.path.decode().lstrip("/")
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1317 if not path.startswith(self.apg.ap_path):
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1318 return web_resource.NoResource().render(request)
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	1319 defer.ensureDeferred(self.ap_post_request(request))
3745 a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1320 return server.NOT_DONE_YET
a8c7e5cef0cb comp AP gateway: signature checking, caching and threads management: Goffi <goffi@goffi.org> parents: 3729 diff changeset	1321
3682 7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1322
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1323 class HTTPRequest(server.Request):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1324 pass
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1325
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1326
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1327 class HTTPServer(server.Site):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1328 requestFactory = HTTPRequest
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1329
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1330 def __init__(self, ap_gateway):
7c990aaa49d3 comp AP Gateway: ActivityPub Component first draft: Goffi <goffi@goffi.org> parents: diff changeset	1331 super().__init__(HTTPAPGServer(ap_gateway))

Mercurial > libervia-backend

annotate libervia/backend/plugins/plugin_comp_ap_gateway/http_server.py @ 4219:1b5cf2ee1d86