libervia-backend: libervia/backend/memory/sqla

annotate libervia/backend/memory/sqla_mapping.py @ 4202:b26339343076

core: use a user specific directory for PID file: default location of pid file is now specific to logged user, this allow to run several instances of Libervia by different users on the same machine without PID conflicts.

author	Goffi <goffi@goffi.org>
date	Sun, 14 Jan 2024 17:48:02 +0100
parents	2074b2bbe616
children	5f2d496c633f

rev	line source
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	1 #!/usr/bin/env python3
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	2
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	3 # Libervia: an XMPP client
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	4 # Copyright (C) 2009-2021 Jérôme Poisson (goffi@goffi.org)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	5
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	6 # This program is free software: you can redistribute it and/or modify
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	7 # it under the terms of the GNU Affero General Public License as published by
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	8 # the Free Software Foundation, either version 3 of the License, or
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	9 # (at your option) any later version.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	10
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	11 # This program is distributed in the hope that it will be useful,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	12 # but WITHOUT ANY WARRANTY; without even the implied warranty of
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	13 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	14 # GNU Affero General Public License for more details.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	15
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	16 # You should have received a copy of the GNU Affero General Public License
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	17 # along with this program. If not, see <http://www.gnu.org/licenses/>.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	18
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	19 from datetime import datetime
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	20 import enum
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	21 import json
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	22 import pickle
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	23 import time
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	24 from typing import Any, Dict
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	25
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	26 from sqlalchemy import (
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	27 Boolean,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	28 Column,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	29 DDL,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	30 DateTime,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	31 Enum,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	32 Float,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	33 ForeignKey,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	34 Index,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	35 Integer,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	36 JSON,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	37 MetaData,
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	38 text,
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	39 Text,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	40 UniqueConstraint,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	41 event,
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	42 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	43 from sqlalchemy.orm import declarative_base, relationship
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	44 from sqlalchemy.sql.functions import now
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	45 from sqlalchemy.types import TypeDecorator
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	46 from twisted.words.protocols.jabber import jid
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	47 from wokkel import generic
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	48
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	49 from libervia.backend.core.constants import Const as C
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	50
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	51
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	52 Base = declarative_base(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	53 metadata=MetaData(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	54 naming_convention={
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	55 "ix": "ix_%(column_0_label)s",
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	56 "uq": "uq_%(table_name)s_%(column_0_name)s",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	57 "ck": "ck_%(table_name)s_%(constraint_name)s",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	58 "fk": "fk_%(table_name)s_%(column_0_name)s_%(referred_table_name)s",
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	59 "pk": "pk_%(table_name)s",
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	60 }
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	61 )
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	62 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	63 # keys which are in message data extra but not stored in extra field this is
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	64 # because those values are stored in separate fields
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	65 NOT_IN_EXTRA = ("origin_id", "stanza_id", "received_timestamp", "update_uid")
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	66
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	67
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	68 class Profiles(dict):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	69 def __init__(self, args, *kwargs):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	70 super().__init__(args, *kwargs)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	71 self.id_to_profile = {v: k for k, v in self.items()}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	72
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	73 def __setitem__(self, key, value):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	74 super().__setitem__(key, value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	75 self.id_to_profile[value] = key
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	76
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	77 def __delitem__(self, key):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	78 del self.id_to_profile[self[key]]
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	79 super().__delitem__(key)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	80
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	81 def update(self, args, *kwargs):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	82 super().update(args, *kwargs)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	83 self.id_to_profile = {v: k for k, v in self.items()}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	84
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	85 def clear(self):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	86 super().clear()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	87 self.id_to_profile.clear()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	88
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	89
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	90 profiles = Profiles()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	91
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	92
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	93 def get_profile_by_id( profile_id):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	94 return profiles.id_to_profile.get(profile_id)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	95
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	96
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	97 class SyncState(enum.Enum):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	98 #: synchronisation is currently in progress
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	99 IN_PROGRESS = 1
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	100 #: synchronisation is done
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	101 COMPLETED = 2
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	102 #: something wrong happened during synchronisation, won't sync
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	103 ERROR = 3
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	104 #: synchronisation won't be done even if a syncing analyser matches
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	105 NO_SYNC = 4
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	106
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	107
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	108 class SubscriptionState(enum.Enum):
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	109 SUBSCRIBED = 1
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	110 PENDING = 2
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	111
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	112
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	113 class NotificationType(enum.Enum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	114 chat = "chat"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	115 blog = "blog"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	116 calendar = "calendar"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	117 file = "file"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	118 call = "call"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	119 service = "service"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	120 other = "other"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	121
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	122
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	123 class NotificationStatus(enum.Enum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	124 new = "new"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	125 read = "read"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	126
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	127
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	128 class NotificationPriority(enum.IntEnum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	129 LOW = 10
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	130 MEDIUM = 20
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	131 HIGH = 30
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	132 URGENT = 40
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	133
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	134
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	135 class LegacyPickle(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	136 """Handle troubles with data pickled by former version of SàT
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	137
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	138 This type is temporary until we do migration to a proper data type
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	139 """
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	140
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	141 # Blob is used on SQLite but gives errors when used here, while Text works fine
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	142 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	143 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	144
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	145 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	146 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	147 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	148 return pickle.dumps(value, 0)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	149
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	150 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	151 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	152 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	153 # value types are inconsistent (probably a consequence of Python 2/3 port
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	154 # and/or SQLite dynamic typing)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	155 try:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	156 value = value.encode()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	157 except AttributeError:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	158 pass
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	159 # "utf-8" encoding is needed to handle Python 2 pickled data
4095 684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	160 try:
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	161 return pickle.loads(value, encoding="utf-8")
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	162 except ModuleNotFoundError:
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	163 # FIXME: workaround due to package renaming, need to move all pickle code to
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	164 # JSON
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	165 return pickle.loads(
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	166 value.replace(b"sat.plugins", b"libervia.backend.plugins"),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	167 encoding="utf-8",
4095 684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	168 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	169
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	170
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	171 class Json(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	172 """Handle JSON field in DB independant way"""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	173
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	174 # Blob is used on SQLite but gives errors when used here, while Text works fine
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	175 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	176 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	177
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	178 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	179 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	180 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	181 return json.dumps(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	182
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	183 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	184 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	185 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	186 return json.loads(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	187
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	188
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	189 class JsonDefaultDict(Json):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	190 """Json type which convert NULL to empty dict instead of None"""
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	191
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	192 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	193 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	194 return {}
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	195 return json.loads(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	196
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	197
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	198 class Xml(TypeDecorator):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	199 impl = Text
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	200 cache_ok = True
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	201
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	202 def process_bind_param(self, value, dialect):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	203 if value is None:
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	204 return None
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	205 return value.toXml()
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	206
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	207 def process_result_value(self, value, dialect):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	208 if value is None:
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	209 return None
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	210 return generic.parseXml(value.encode())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	211
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	212
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	213 class JID(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	214 """Store twisted JID in text fields"""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	215
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	216 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	217 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	218
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	219 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	220 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	221 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	222 return value.full()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	223
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	224 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	225 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	226 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	227 return jid.JID(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	228
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	229
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	230 class Profile(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	231 __tablename__ = "profiles"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	232
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	233 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	234 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	235 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	236 nullable=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	237 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	238 name = Column(Text, unique=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	239
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	240 params = relationship("ParamInd", back_populates="profile", passive_deletes=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	241 private_data = relationship(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	242 "PrivateInd", back_populates="profile", passive_deletes=True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	243 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	244 private_bin_data = relationship(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	245 "PrivateIndBin", back_populates="profile", passive_deletes=True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	246 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	247
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	248
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	249 class Component(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	250 __tablename__ = "components"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	251
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	252 profile_id = Column(
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	253 ForeignKey("profiles.id", ondelete="CASCADE"), nullable=True, primary_key=True
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	254 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	255 entry_point = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	256 profile = relationship("Profile")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	257
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	258
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	259 class History(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	260 __tablename__ = "history"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	261 __table_args__ = (
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	262 UniqueConstraint("profile_id", "stanza_id", "source", "dest"),
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	263 UniqueConstraint("profile_id", "origin_id", "source", name="uq_origin_id"),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	264 Index("history__profile_id_timestamp", "profile_id", "timestamp"),
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	265 Index(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	266 "history__profile_id_received_timestamp", "profile_id", "received_timestamp"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	267 ),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	268 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	269
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	270 uid = Column(Text, primary_key=True)
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	271 # FIXME: version_id is only needed for changes in `extra` column. It would maybe be
23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	272 # better to use separate table for `extra` data instead.
23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	273 version_id = Column(Integer, nullable=False, server_default=text("1"))
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	274 origin_id = Column(Text)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	275 stanza_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	276 update_uid = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	277 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	278 source = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	279 dest = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	280 source_res = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	281 dest_res = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	282 timestamp = Column(Float, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	283 received_timestamp = Column(Float)
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	284 type = Column(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	285 Enum(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	286 "chat",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	287 "error",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	288 "groupchat",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	289 "headline",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	290 "normal",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	291 # info is not XMPP standard, but used to keep track of info like join/leave
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	292 # in a MUC
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	293 "info",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	294 name="message_type",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	295 create_constraint=True,
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	296 ),
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	297 nullable=False,
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	298 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	299 extra = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	300
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	301 profile = relationship("Profile")
4161 2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	302 messages = relationship(
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	303 "Message",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	304 backref="history",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	305 cascade="all, delete-orphan",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	306 passive_deletes=True
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	307 )
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	308 subjects = relationship(
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	309 "Subject",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	310 backref="history",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	311 cascade="all, delete-orphan",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	312 passive_deletes=True
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	313 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	314 thread = relationship(
4161 2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	315 "Thread",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	316 uselist=False,
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	317 back_populates="history",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	318 cascade="all, delete-orphan",
2074b2bbe616 core (memory/sqla_mapping): `delete-orphan` in History: Goffi <goffi@goffi.org> parents: 4152 diff changeset	319 passive_deletes=True
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	320 )
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	321 __mapper_args__ = {"version_id_col": version_id}
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	322
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	323 def __init__(self, args, *kwargs):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	324 source_jid = kwargs.pop("source_jid", None)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	325 if source_jid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	326 kwargs["source"] = source_jid.userhost()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	327 kwargs["source_res"] = source_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	328 dest_jid = kwargs.pop("dest_jid", None)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	329 if dest_jid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	330 kwargs["dest"] = dest_jid.userhost()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	331 kwargs["dest_res"] = dest_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	332 super().__init__(args, *kwargs)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	333
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	334 @property
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	335 def source_jid(self) -> jid.JID:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	336 return jid.JID(f"{self.source}/{self.source_res or ''}")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	337
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	338 @source_jid.setter
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	339 def source_jid(self, source_jid: jid.JID) -> None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	340 self.source = source_jid.userhost
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	341 self.source_res = source_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	342
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	343 @property
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	344 def dest_jid(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	345 return jid.JID(f"{self.dest}/{self.dest_res or ''}")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	346
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	347 @dest_jid.setter
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	348 def dest_jid(self, dest_jid: jid.JID) -> None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	349 self.dest = dest_jid.userhost
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	350 self.dest_res = dest_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	351
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	352 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	353 dt = datetime.fromtimestamp(self.timestamp)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	354 return f"History<{self.source_jid.full()}->{self.dest_jid.full()} [{dt}]>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	355
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	356 def serialise(self):
4026 fe4725bf42fb core (memory/sqla): be sure to have a dict when serialising History.extra: Goffi <goffi@goffi.org> parents: 3796 diff changeset	357 extra = self.extra or {}
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	358 if self.origin_id is not None:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	359 extra["origin_id"] = self.origin_id
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	360 if self.stanza_id is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	361 extra["stanza_id"] = self.stanza_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	362 if self.update_uid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	363 extra["update_uid"] = self.update_uid
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	364 if self.received_timestamp is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	365 extra["received_timestamp"] = self.received_timestamp
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	366 if self.thread is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	367 extra["thread"] = self.thread.thread_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	368 if self.thread.parent_id is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	369 extra["thread_parent"] = self.thread.parent_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	370
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	371 return {
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	372 "from": f"{self.source}/{self.source_res}"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	373 if self.source_res
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	374 else self.source,
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	375 "to": f"{self.dest}/{self.dest_res}" if self.dest_res else self.dest,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	376 "uid": self.uid,
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	377 "message": {m.language or "": m.message for m in self.messages},
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	378 "subject": {m.language or "": m.subject for m in self.subjects},
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	379 "type": self.type,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	380 "extra": extra,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	381 "timestamp": self.timestamp,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	382 }
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	383
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	384 def as_tuple(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	385 d = self.serialise()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	386 return (
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	387 d["uid"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	388 d["timestamp"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	389 d["from"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	390 d["to"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	391 d["message"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	392 d["subject"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	393 d["type"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	394 d["extra"],
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	395 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	396
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	397 @staticmethod
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	398 def debug_collection(history_collection):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	399 for idx, history in enumerate(history_collection):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	400 history.debug_msg(idx)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	401
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	402 def debug_msg(self, idx=None):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	403 """Print messages"""
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	404 dt = datetime.fromtimestamp(self.timestamp)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	405 if idx is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	406 dt = f"({idx}) {dt}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	407 parts = []
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	408 parts.append(f"[{dt}]<{self.source_jid.full()}->{self.dest_jid.full()}> ")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	409 for message in self.messages:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	410 if message.language:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	411 parts.append(f"[{message.language}] ")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	412 parts.append(f"{message.message}\n")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	413 print("".join(parts))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	414
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	415
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	416 class Message(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	417 __tablename__ = "message"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	418 __table_args__ = (Index("message__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	419
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	420 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	421 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	422 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	423 )
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	424 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"), nullable=False)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	425 message = Column(Text, nullable=False)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	426 language = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	427
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	428 def serialise(self) -> Dict[str, Any]:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	429 s = {}
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	430 if self.message:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	431 s["message"] = str(self.message)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	432 if self.language:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	433 s["language"] = str(self.language)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	434 return s
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	435
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	436 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	437 lang_str = f"[{self.language}]" if self.language else ""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	438 msg = f"{self.message[:20]}…" if len(self.message) > 20 else self.message
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	439 content = f"{lang_str}{msg}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	440 return f"Message<{content}>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	441
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	442
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	443 class Subject(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	444 __tablename__ = "subject"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	445 __table_args__ = (Index("subject__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	446
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	447 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	448 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	449 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	450 )
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	451 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"), nullable=False)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	452 subject = Column(Text, nullable=False)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	453 language = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	454
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	455 def serialise(self) -> Dict[str, Any]:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	456 s = {}
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	457 if self.subject:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	458 s["subject"] = str(self.subject)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	459 if self.language:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	460 s["language"] = str(self.language)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	461 return s
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	462
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	463 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	464 lang_str = f"[{self.language}]" if self.language else ""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	465 msg = f"{self.subject[:20]}…" if len(self.subject) > 20 else self.subject
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	466 content = f"{lang_str}{msg}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	467 return f"Subject<{content}>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	468
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	469
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	470 class Thread(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	471 __tablename__ = "thread"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	472 __table_args__ = (Index("thread__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	473
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	474 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	475 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	476 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	477 )
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	478 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"))
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	479 thread_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	480 parent_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	481
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	482 history = relationship("History", uselist=False, back_populates="thread")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	483
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	484 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	485 return f"Thread<{self.thread_id} [parent: {self.parent_id}]>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	486
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	487
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	488 class Notification(Base):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	489 __tablename__ = "notifications"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	490 __table_args__ = (Index("notifications_profile_id_status", "profile_id", "status"),)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	491
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	492 id = Column(Integer, primary_key=True, autoincrement=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	493 timestamp = Column(Float, nullable=False, default=time.time)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	494 expire_at = Column(Float, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	495
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	496 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), index=True, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	497 profile = relationship("Profile")
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	498
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	499 type = Column(Enum(NotificationType), nullable=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	500
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	501 title = Column(Text, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	502 body_plain = Column(Text, nullable=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	503 body_rich = Column(Text, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	504
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	505 requires_action = Column(Boolean, default=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	506 priority = Column(Integer, default=NotificationPriority.MEDIUM.value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	507
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	508 extra_data = Column(JSON)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	509 status = Column(Enum(NotificationStatus), default=NotificationStatus.new)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	510
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	511 def serialise(self) -> dict[str, str \| float \| bool \| int \| dict]:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	512 """
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	513 Serialises the Notification instance to a dictionary.
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	514 """
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	515 result = {}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	516 for column in self.__table__.columns:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	517 value = getattr(self, column.name)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	518 if value is not None:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	519 if column.name in ("type", "status"):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	520 result[column.name] = value.name
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	521 elif column.name == "id":
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	522 result[column.name] = str(value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	523 elif column.name == "profile_id":
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	524 if value is None:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	525 result["profile"] = C.PROF_KEY_ALL
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	526 else:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	527 result["profile"] = get_profile_by_id(value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	528 else:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	529 result[column.name] = value
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	530 return result
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	531
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	532
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	533 class ParamGen(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	534 __tablename__ = "param_gen"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	535
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	536 category = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	537 name = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	538 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	539
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	540
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	541 class ParamInd(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	542 __tablename__ = "param_ind"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	543
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	544 category = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	545 name = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	546 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	547 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	548
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	549 profile = relationship("Profile", back_populates="params")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	550
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	551
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	552 class PrivateGen(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	553 __tablename__ = "private_gen"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	554
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	555 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	556 key = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	557 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	558
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	559
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	560 class PrivateInd(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	561 __tablename__ = "private_ind"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	562
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	563 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	564 key = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	565 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	566 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	567
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	568 profile = relationship("Profile", back_populates="private_data")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	569
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	570
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	571 class PrivateGenBin(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	572 __tablename__ = "private_gen_bin"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	573
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	574 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	575 key = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	576 value = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	577
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	578
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	579 class PrivateIndBin(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	580 __tablename__ = "private_ind_bin"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	581
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	582 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	583 key = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	584 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	585 value = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	586
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	587 profile = relationship("Profile", back_populates="private_bin_data")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	588
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	589
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	590 class File(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	591 __tablename__ = "files"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	592 __table_args__ = (
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	593 Index("files__profile_id_owner_parent", "profile_id", "owner", "parent"),
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	594 Index(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	595 "files__profile_id_owner_media_type_media_subtype",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	596 "profile_id",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	597 "owner",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	598 "media_type",
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	599 "media_subtype",
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	600 ),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	601 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	602
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	603 id = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	604 public_id = Column(Text, unique=True)
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	605 version = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	606 parent = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	607 type = Column(
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	608 Enum("file", "directory", name="file_type", create_constraint=True),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	609 nullable=False,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	610 server_default="file",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	611 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	612 file_hash = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	613 hash_algo = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	614 name = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	615 size = Column(Integer)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	616 namespace = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	617 media_type = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	618 media_subtype = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	619 created = Column(Float, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	620 modified = Column(Float)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	621 owner = Column(JID)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	622 access = Column(JsonDefaultDict)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	623 extra = Column(JsonDefaultDict)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	624 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	625
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	626 profile = relationship("Profile")
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	627
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	628
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	629 class PubsubNode(Base):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	630 __tablename__ = "pubsub_nodes"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	631 __table_args__ = (UniqueConstraint("profile_id", "service", "name"),)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	632
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	633 id = Column(Integer, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	634 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	635 service = Column(JID)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	636 name = Column(Text, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	637 subscribed = Column(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	638 Boolean(create_constraint=True, name="subscribed_bool"), nullable=False
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	639 )
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	640 analyser = Column(Text)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	641 sync_state = Column(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	642 Enum(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	643 SyncState,
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	644 name="sync_state",
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	645 create_constraint=True,
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	646 ),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	647 nullable=True,
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	648 )
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	649 sync_state_updated = Column(Float, nullable=False, default=time.time())
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	650 type_ = Column(Text, name="type", nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	651 subtype = Column(Text, nullable=True)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	652 extra = Column(JSON)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	653
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	654 items = relationship("PubsubItem", back_populates="node", passive_deletes=True)
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	655 subscriptions = relationship("PubsubSub", back_populates="node", passive_deletes=True)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	656
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	657 def __str__(self):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	658 return f"Pubsub node {self.name!r} at {self.service}"
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	659
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	660
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	661 class PubsubSub(Base):
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	662 """Subscriptions to pubsub nodes
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	663
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	664 Used by components managing a pubsub service
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	665 """
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	666
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	667 __tablename__ = "pubsub_subs"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	668 __table_args__ = (UniqueConstraint("node_id", "subscriber"),)
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	669
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	670 id = Column(Integer, primary_key=True)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	671 node_id = Column(ForeignKey("pubsub_nodes.id", ondelete="CASCADE"), nullable=False)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	672 subscriber = Column(JID)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	673 state = Column(
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	674 Enum(
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	675 SubscriptionState,
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	676 name="state",
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	677 create_constraint=True,
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	678 ),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	679 nullable=True,
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	680 )
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	681
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	682 node = relationship("PubsubNode", back_populates="subscriptions")
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	683
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	684
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	685 class PubsubItem(Base):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	686 __tablename__ = "pubsub_items"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	687 __table_args__ = (UniqueConstraint("node_id", "name"),)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	688 id = Column(Integer, primary_key=True)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	689 node_id = Column(ForeignKey("pubsub_nodes.id", ondelete="CASCADE"), nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	690 name = Column(Text, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	691 data = Column(Xml, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	692 created = Column(DateTime, nullable=False, server_default=now())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	693 updated = Column(DateTime, nullable=False, server_default=now(), onupdate=now())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	694 parsed = Column(JSON)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	695
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	696 node = relationship("PubsubNode", back_populates="items")
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	697
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	698
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	699 ## Full-Text Search
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	700
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	701 # create
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	702
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	703
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	704 @event.listens_for(PubsubItem.__table__, "after_create")
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	705 def fts_create(target, connection, **kw):
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	706 """Full-Text Search table creation"""
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	707 if connection.engine.name == "sqlite":
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	708 # Using SQLite FTS5
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	709 queries = [
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	710 "CREATE VIRTUAL TABLE pubsub_items_fts "
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	711 "USING fts5(data, content=pubsub_items, content_rowid=id)",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	712 "CREATE TRIGGER pubsub_items_fts_sync_ins AFTER INSERT ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	713 " INSERT INTO pubsub_items_fts(rowid, data) VALUES (new.id, new.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	714 "END",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	715 "CREATE TRIGGER pubsub_items_fts_sync_del AFTER DELETE ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	716 " INSERT INTO pubsub_items_fts(pubsub_items_fts, rowid, data) "
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	717 "VALUES('delete', old.id, old.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	718 "END",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	719 "CREATE TRIGGER pubsub_items_fts_sync_upd AFTER UPDATE ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	720 " INSERT INTO pubsub_items_fts(pubsub_items_fts, rowid, data) VALUES"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	721 "('delete', old.id, old.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	722 " INSERT INTO pubsub_items_fts(rowid, data) VALUES(new.id, new.data);"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	723 "END",
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	724 ]
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	725 for q in queries:
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	726 connection.execute(DDL(q))
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	727
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	728
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	729 # drop
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	730
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	731
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	732 @event.listens_for(PubsubItem.__table__, "before_drop")
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	733 def fts_drop(target, connection, **kw):
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	734 "Full-Text Search table drop" ""
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	735 if connection.engine.name == "sqlite":
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	736 # Using SQLite FTS5
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	737 queries = [
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	738 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_ins",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	739 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_del",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	740 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_upd",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	741 "DROP TABLE IF EXISTS pubsub_items_fts",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	742 ]
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	743 for q in queries:
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	744 connection.execute(DDL(q))

Mercurial > libervia-backend

annotate libervia/backend/memory/sqla_mapping.py @ 4202:b26339343076