libervia-backend: libervia/backend/plugins/plugin_sec

annotate libervia/backend/plugins/plugin_sec_aesgcm.py @ 4340:ea72364131d5 default tip @

doc (components): Update Email Gateway documentation: A section has been added to explain how attachments are handled. fix 453

author	Goffi <goffi@goffi.org>
date	Tue, 03 Dec 2024 00:53:18 +0100
parents	0d7bb4df2343
children

rev	line source
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	1 #!/usr/bin/env python3
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	2
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	3 # SàT plugin for handling AES-GCM file encryption
3479 be6d91572633 date update Goffi <goffi@goffi.org> parents: 3222 diff changeset	4 # Copyright (C) 2009-2021 Jérôme Poisson (goffi@goffi.org)
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	5
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	6 # This program is free software: you can redistribute it and/or modify
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	7 # it under the terms of the GNU Affero General Public License as published by
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	8 # the Free Software Foundation, either version 3 of the License, or
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	9 # (at your option) any later version.
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	10
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	11 # This program is distributed in the hope that it will be useful,
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	12 # but WITHOUT ANY WARRANTY; without even the implied warranty of
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	13 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	14 # GNU Affero General Public License for more details.
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	15
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	16 # You should have received a copy of the GNU Affero General Public License
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	17 # along with this program. If not, see <http://www.gnu.org/licenses/>.
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	18
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	19 import re
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	20 from textwrap import dedent
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	21 from functools import partial
3186 84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	22 from urllib import parse
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	23 import mimetypes
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	24 import secrets
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	25 from cryptography.hazmat.primitives import ciphers
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	26 from cryptography.hazmat.primitives.ciphers import modes
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	27 from cryptography.hazmat import backends
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	28 from cryptography.exceptions import AlreadyFinalized
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	29 import treq
3186 84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	30 from twisted.internet import defer
4071 4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	31 from libervia.backend.core.i18n import _
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	32 from libervia.backend.core.constants import Const as C
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	33 from libervia.backend.core import exceptions
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	34 from libervia.backend.tools import stream
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	35 from libervia.backend.core.log import getLogger
4b842c1fb686 refactoring: renamed `sat` package to `libervia.backend` Goffi <goffi@goffi.org> parents: 4051 diff changeset	36 from libervia.backend.tools.web import treq_client_no_ssl
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	37
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	38 log = getLogger(__name__)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	39
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	40 PLUGIN_INFO = {
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	41 C.PI_NAME: "AES-GCM",
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	42 C.PI_IMPORT_NAME: "AES-GCM",
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	43 C.PI_TYPE: "SEC",
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	44 C.PI_PROTOCOLS: ["OMEMO Media sharing"],
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	45 C.PI_DEPENDENCIES: ["XEP-0363", "XEP-0384", "DOWNLOAD", "ATTACH"],
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	46 C.PI_MAIN: "AESGCM",
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	47 C.PI_HANDLER: "no",
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	48 C.PI_DESCRIPTION: dedent(
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	49 _(
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	50 """\
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	51 Implementation of AES-GCM scheme, a way to encrypt files (not official XMPP standard).
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	52 See https://xmpp.org/extensions/inbox/omemo-media-sharing.html for details
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	53 """
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	54 )
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	55 ),
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	56 }
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	57
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	58 AESGCM_RE = re.compile(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	59 r"aesgcm:\/\/(www\.)?[-a-zA-Z0-9@:%._\+~#=]{1,256}\.[a-zA-Z0-9()]{1,6}\b([-a-zA-Z0-9"
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	60 r"()@:%_\+.~#?&\/\/=]*)"
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	61 )
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	62
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	63
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	64 class AESGCM(object):
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	65
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	66 def __init__(self, host):
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	67 self.host = host
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	68 log.info(_("AESGCM plugin initialization"))
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	69 self._http_upload = host.plugins["XEP-0363"]
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	70 self._attach = host.plugins["ATTACH"]
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	71 host.plugins["DOWNLOAD"].register_scheme("aesgcm", self.download)
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	72 self._attach.register(self.can_handle_attachment, self.attach, encrypted=True)
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	73 host.trigger.add("XEP-0363_upload_pre_slot", self._upload_pre_slot)
0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	74 host.trigger.add("XEP-0363_upload", self._upload_trigger)
4051 c23cad65ae99 core: renamed `messageReceived` trigger to `message_received` Goffi <goffi@goffi.org> parents: 4037 diff changeset	75 host.trigger.add("message_received", self._message_received_trigger)
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	76
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	77 async def download(self, client, uri_parsed, dest_path, options):
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	78 fragment = bytes.fromhex(uri_parsed.fragment)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	79
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	80 # legacy method use 16 bits IV, but OMEMO media sharing published spec indicates
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	81 # which is 12 bits IV (AES-GCM spec recommandation), so we have to determine
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	82 # which size has been used.
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	83 if len(fragment) == 48:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	84 iv_size = 16
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	85 elif len(fragment) == 44:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	86 iv_size = 12
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	87 else:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	88 raise ValueError(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	89 f"Invalid URL fragment, can't decrypt file at {uri_parsed.get_url()}"
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	90 )
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	91
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	92 iv, key = fragment[:iv_size], fragment[iv_size:]
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	93
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	94 decryptor = ciphers.Cipher(
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	95 ciphers.algorithms.AES(key),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	96 modes.GCM(iv),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	97 backend=backends.default_backend(),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	98 ).decryptor()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	99
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	100 download_url = parse.urlunparse(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	101 ("https", uri_parsed.netloc, uri_parsed.path, "", "", "")
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	102 )
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	103
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	104 if options.get("ignore_tls_errors", False):
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	105 log.warning("TLS certificate check disabled, this is highly insecure")
3205 2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	106 treq_client = treq_client_no_ssl
2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	107 else:
2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	108 treq_client = treq
2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	109
2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	110 head_data = await treq_client.head(download_url)
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	111 content_length = int(head_data.headers.getRawHeaders("content-length")[0])
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	112 # the 128 bits tag is put at the end
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	113 file_size = content_length - 16
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	114
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	115 file_obj = stream.SatFile(
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	116 self.host,
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	117 client,
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	118 dest_path,
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	119 mode="wb",
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	120 size=file_size,
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	121 )
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	122
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	123 progress_id = file_obj.uid
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	124
3205 2c0628f3927e plugin download, aesgcm: disable TLS check if `check_certificate` setting is disabled Goffi <goffi@goffi.org> parents: 3196 diff changeset	125 resp = await treq_client.get(download_url, unbuffered=True)
3186 84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	126 if resp.code == 200:
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	127 d = treq.collect(
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	128 resp,
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	129 partial(
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	130 self.on_data_download,
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	131 client=client,
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	132 file_obj=file_obj,
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	133 decryptor=decryptor,
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	134 ),
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	135 )
3186 84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	136 else:
84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	137 d = defer.Deferred()
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	138 self.host.plugins["DOWNLOAD"].errback_download(file_obj, d, resp)
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	139 return progress_id, d
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	140
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	141 async def can_handle_attachment(self, client, data):
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	142 try:
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	143 await self._http_upload.get_http_upload_entity(client)
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	144 except exceptions.NotFound:
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	145 return False
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	146 else:
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	147 return True
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	148
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	149 async def _upload_cb(self, client, filepath, filename, extra):
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	150 extra["encryption"] = C.ENC_AES_GCM
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	151 return await self._http_upload.file_http_upload(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	152 client=client, filepath=filepath, filename=filename, extra=extra
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	153 )
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	154
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	155 async def attach(self, client, data):
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	156 # XXX: the attachment removal/resend code below is due to the one file per
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	157 # message limitation of OMEMO media sharing unofficial XEP. We have to remove
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	158 # attachments from original message, and send them one by one.
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	159 # TODO: this is to be removed when a better mechanism is available with OMEMO (now
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	160 # possible with the 0.4 version of OMEMO, it's possible to encrypt other stanza
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	161 # elements than body).
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 3922 diff changeset	162 attachments = data["extra"][C.KEY_ATTACHMENTS]
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	163 if not data["message"] or data["message"] == {"": ""}:
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	164 extra_attachments = attachments[1:]
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	165 del attachments[1:]
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	166 await self._attach.upload_files(client, data, upload_cb=self._upload_cb)
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	167 else:
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	168 # we have a message, we must send first attachment separately
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	169 extra_attachments = attachments[:]
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	170 attachments.clear()
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 3922 diff changeset	171 del data["extra"][C.KEY_ATTACHMENTS]
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	172
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	173 body_elt = data["xml"].body
0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	174 if body_elt is None:
0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	175 body_elt = data["xml"].addElement("body")
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	176
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	177 for attachment in attachments:
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	178 body_elt.addContent(attachment["url"])
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	179
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	180 for attachment in extra_attachments:
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	181 # we send all remaining attachment in a separate message
3222 653fa213d2f8 plugin aesgcm: wait for each splitted message to be sent before sending next one Goffi <goffi@goffi.org> parents: 3219 diff changeset	182 await client.sendMessage(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	183 to_jid=data["to"],
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	184 message={"": ""},
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	185 subject=data["subject"],
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	186 mess_type=data["type"],
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 3922 diff changeset	187 extra={C.KEY_ATTACHMENTS: [attachment]},
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	188 )
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	189
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	190 if (
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	191 not data["extra"]
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	192 and (not data["message"] or data["message"] == {"": ""})
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	193 and not data["subject"]
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	194 ):
3219 2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	195 # nothing left to send, we can cancel the message
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	196 raise exceptions.CancelError("Cancelled by AESGCM attachment handling")
2ba602aef90e plugin attach, aesgcm: attachments refactoring: Goffi <goffi@goffi.org> parents: 3205 diff changeset	197
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	198 def on_data_download(self, data, client, file_obj, decryptor):
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	199 if file_obj.tell() + len(data) > file_obj.size:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	200 # we're reaching end of file with this bunch of data
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	201 # we may still have a last bunch if the tag is incomplete
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	202 bytes_left = file_obj.size - file_obj.tell()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	203 if bytes_left > 0:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	204 decrypted = decryptor.update(data[:bytes_left])
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	205 file_obj.write(decrypted)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	206 tag = data[bytes_left:]
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	207 else:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	208 tag = data
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	209 if len(tag) < 16:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	210 # the tag is incomplete, either we'll get the rest in next data bunch
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	211 # or we have already the other part from last bunch of data
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	212 try:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	213 # we store partial tag in decryptor._sat_tag
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	214 tag = decryptor._sat_tag + tag
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	215 except AttributeError:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	216 # no other part, we'll get the rest at next bunch
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	217 decryptor.sat_tag = tag
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	218 else:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	219 # we have the complete tag, it must be 128 bits
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	220 if len(tag) != 16:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	221 raise ValueError(f"Invalid tag: {tag}")
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	222 remain = decryptor.finalize_with_tag(tag)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	223 file_obj.write(remain)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	224 file_obj.close()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	225 else:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	226 decrypted = decryptor.update(data)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	227 file_obj.write(decrypted)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	228
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	229 def _upload_pre_slot(self, client, extra, file_metadata):
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	230 if extra.get("encryption") != C.ENC_AES_GCM:
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	231 return True
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	232 # the tag is appended to the file
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	233 file_metadata["size"] += 16
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	234 return True
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	235
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	236 def _encrypt(self, data, encryptor):
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	237 if data:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	238 return encryptor.update(data)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	239 else:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	240 try:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	241 # end of file is reached, me must finalize
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	242 ret = encryptor.finalize()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	243 tag = encryptor.tag
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	244 return ret + tag
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	245 except AlreadyFinalized:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	246 # as we have already finalized, we can now send EOF
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	247 return b""
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	248
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	249 def _upload_trigger(self, client, extra, sat_file, file_producer, slot):
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	250 if extra.get("encryption") != C.ENC_AES_GCM:
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	251 return True
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	252 log.debug("encrypting file with AES-GCM")
3178 98b321234068 plugin aesgcm: use 12 bytes Initialisation Vector: Goffi <goffi@goffi.org> parents: 3174 diff changeset	253 iv = secrets.token_bytes(12)
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	254 key = secrets.token_bytes(32)
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	255 fragment = f"{iv.hex()}{key.hex()}"
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	256 ori_url = parse.urlparse(slot.get)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	257 # we change the get URL with the one with aesgcm scheme and containing the
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	258 # encoded key + iv
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	259 slot.get = parse.urlunparse(["aesgcm", *ori_url[1:5], fragment])
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	260
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	261 # encrypted data size will be bigger than original file size
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	262 # so we need to check with final data length to avoid a warning on close()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	263 sat_file.check_size_with_read = True
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	264
3922 0ff265725489 plugin XEP-0447: handle attachment and download: Goffi <goffi@goffi.org> parents: 3859 diff changeset	265 # file_producer get length directly from file, and this cause trouble as
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	266 # we have to change the size because of encryption. So we adapt it here,
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	267 # else the producer would stop reading prematurely
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	268 file_producer.length = sat_file.size
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	269
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	270 encryptor = ciphers.Cipher(
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	271 ciphers.algorithms.AES(key),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	272 modes.GCM(iv),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	273 backend=backends.default_backend(),
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	274 ).encryptor()
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	275
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	276 if sat_file.data_cb is not None:
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	277 raise exceptions.InternalError(
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	278 f"data_cb was expected to be None, it is set to {sat_file.data_cb}"
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	279 )
3090 4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	280
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	281 # with data_cb we encrypt the file on the fly
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	282 sat_file.data_cb = partial(self._encrypt, encryptor=encryptor)
4f8bdf50593f plugin sec aesgcm: new plugin handling `aesgcm:` scheme for e2e encrypted media sharing: Goffi <goffi@goffi.org> parents: diff changeset	283 return True
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	284
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	285 def _pop_aesgcm_links(self, match, links):
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	286 link = match.group()
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	287 if link not in links:
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	288 links.append(link)
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	289 return ""
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	290
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	291 def _check_aesgcm_attachments(self, client, data):
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	292 if not data.get("message"):
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	293 return data
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	294 links = []
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	295
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	296 for lang, message in list(data["message"].items()):
0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	297 message = AESGCM_RE.sub(partial(self._pop_aesgcm_links, links=links), message)
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	298 if links:
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	299 message = message.strip()
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	300 if not message:
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	301 del data["message"][lang]
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	302 else:
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	303 data["message"][lang] = message
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	304 mess_encrypted = client.encryption.isEncrypted(data)
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	305 attachments = data["extra"].setdefault(C.KEY_ATTACHMENTS, [])
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	306 for link in links:
3186 84b0c8b4dee0 plugin download, aesgcm: fixed handling of HTTP errors Goffi <goffi@goffi.org> parents: 3178 diff changeset	307 path = parse.urlparse(link).path
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	308 attachment = {
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	309 "url": link,
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	310 }
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	311 media_type = mimetypes.guess_type(path, strict=False)[0]
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	312 if media_type is not None:
4023 78b5f356900c component AP gateway: handle attachments Goffi <goffi@goffi.org> parents: 3922 diff changeset	313 attachment[C.KEY_ATTACHMENTS_MEDIA_TYPE] = media_type
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	314
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	315 if mess_encrypted:
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	316 # we don't add the encrypted flag if the message itself is not
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	317 # encrypted, because the decryption key is part of the link,
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	318 # so sending it over unencrypted channel is like having no
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	319 # encryption at all.
4270 0d7bb4df2343 Reformatted code base using black. Goffi <goffi@goffi.org> parents: 4071 diff changeset	320 attachment["encrypted"] = True
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	321 attachments.append(attachment)
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	322
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	323 return data
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	324
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	325 def _message_received_trigger(self, client, message_elt, post_treat):
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	326 # we use a post_treat callback instead of "message_parse" trigger because we need
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	327 # to check if the "encrypted" flag is set to decide if we add the same flag to the
c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	328 # attachment
4037 524856bd7b19 massive refactoring to switch from camelCase to snake_case: Goffi <goffi@goffi.org> parents: 4023 diff changeset	329 post_treat.addCallback(partial(self._check_aesgcm_attachments, client))
3174 c90f27ce52b0 plugin aesgcm: look for "aesgcm" links in body to use them as attachments Goffi <goffi@goffi.org> parents: 3136 diff changeset	330 return True

Mercurial > libervia-backend

annotate libervia/backend/plugins/plugin_sec_aesgcm.py @ 4340:ea72364131d5 default tip @