libervia-backend: libervia/backend/memory/sqla

annotate libervia/backend/memory/sqla_mapping.py @ 4152:23d21daed216

core (memory/sqla_mapping): add a `version_id` column to detect race conditions.

author	Goffi <goffi@goffi.org>
date	Wed, 22 Nov 2023 14:52:00 +0100
parents	02f0adc745c6
children	2074b2bbe616

rev	line source
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	1 #!/usr/bin/env python3
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	2
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	3 # Libervia: an XMPP client
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	4 # Copyright (C) 2009-2021 Jérôme Poisson (goffi@goffi.org)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	5
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	6 # This program is free software: you can redistribute it and/or modify
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	7 # it under the terms of the GNU Affero General Public License as published by
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	8 # the Free Software Foundation, either version 3 of the License, or
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	9 # (at your option) any later version.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	10
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	11 # This program is distributed in the hope that it will be useful,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	12 # but WITHOUT ANY WARRANTY; without even the implied warranty of
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	13 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	14 # GNU Affero General Public License for more details.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	15
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	16 # You should have received a copy of the GNU Affero General Public License
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	17 # along with this program. If not, see <http://www.gnu.org/licenses/>.
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	18
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	19 from datetime import datetime
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	20 import enum
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	21 import json
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	22 import pickle
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	23 import time
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	24 from typing import Any, Dict
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	25
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	26 from sqlalchemy import (
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	27 Boolean,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	28 Column,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	29 DDL,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	30 DateTime,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	31 Enum,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	32 Float,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	33 ForeignKey,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	34 Index,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	35 Integer,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	36 JSON,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	37 MetaData,
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	38 text,
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	39 Text,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	40 UniqueConstraint,
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	41 event,
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	42 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	43 from sqlalchemy.orm import declarative_base, relationship
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	44 from sqlalchemy.sql.functions import now
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	45 from sqlalchemy.types import TypeDecorator
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	46 from twisted.words.protocols.jabber import jid
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	47 from wokkel import generic
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	48
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	49 from libervia.backend.core.constants import Const as C
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	50
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	51
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	52 Base = declarative_base(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	53 metadata=MetaData(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	54 naming_convention={
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	55 "ix": "ix_%(column_0_label)s",
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	56 "uq": "uq_%(table_name)s_%(column_0_name)s",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	57 "ck": "ck_%(table_name)s_%(constraint_name)s",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	58 "fk": "fk_%(table_name)s_%(column_0_name)s_%(referred_table_name)s",
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	59 "pk": "pk_%(table_name)s",
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	60 }
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	61 )
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	62 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	63 # keys which are in message data extra but not stored in extra field this is
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	64 # because those values are stored in separate fields
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	65 NOT_IN_EXTRA = ("origin_id", "stanza_id", "received_timestamp", "update_uid")
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	66
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	67
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	68 class Profiles(dict):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	69 def __init__(self, args, *kwargs):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	70 super().__init__(args, *kwargs)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	71 self.id_to_profile = {v: k for k, v in self.items()}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	72
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	73 def __setitem__(self, key, value):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	74 super().__setitem__(key, value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	75 self.id_to_profile[value] = key
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	76
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	77 def __delitem__(self, key):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	78 del self.id_to_profile[self[key]]
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	79 super().__delitem__(key)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	80
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	81 def update(self, args, *kwargs):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	82 super().update(args, *kwargs)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	83 self.id_to_profile = {v: k for k, v in self.items()}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	84
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	85 def clear(self):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	86 super().clear()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	87 self.id_to_profile.clear()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	88
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	89
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	90 profiles = Profiles()
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	91
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	92
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	93 def get_profile_by_id( profile_id):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	94 return profiles.id_to_profile.get(profile_id)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	95
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	96
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	97 class SyncState(enum.Enum):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	98 #: synchronisation is currently in progress
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	99 IN_PROGRESS = 1
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	100 #: synchronisation is done
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	101 COMPLETED = 2
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	102 #: something wrong happened during synchronisation, won't sync
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	103 ERROR = 3
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	104 #: synchronisation won't be done even if a syncing analyser matches
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	105 NO_SYNC = 4
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	106
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	107
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	108 class SubscriptionState(enum.Enum):
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	109 SUBSCRIBED = 1
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	110 PENDING = 2
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	111
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	112
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	113 class NotificationType(enum.Enum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	114 chat = "chat"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	115 blog = "blog"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	116 calendar = "calendar"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	117 file = "file"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	118 call = "call"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	119 service = "service"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	120 other = "other"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	121
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	122
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	123 class NotificationStatus(enum.Enum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	124 new = "new"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	125 read = "read"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	126
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	127
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	128 class NotificationPriority(enum.IntEnum):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	129 LOW = 10
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	130 MEDIUM = 20
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	131 HIGH = 30
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	132 URGENT = 40
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	133
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	134
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	135 class LegacyPickle(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	136 """Handle troubles with data pickled by former version of SàT
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	137
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	138 This type is temporary until we do migration to a proper data type
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	139 """
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	140
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	141 # Blob is used on SQLite but gives errors when used here, while Text works fine
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	142 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	143 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	144
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	145 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	146 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	147 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	148 return pickle.dumps(value, 0)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	149
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	150 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	151 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	152 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	153 # value types are inconsistent (probably a consequence of Python 2/3 port
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	154 # and/or SQLite dynamic typing)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	155 try:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	156 value = value.encode()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	157 except AttributeError:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	158 pass
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	159 # "utf-8" encoding is needed to handle Python 2 pickled data
4095 684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	160 try:
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	161 return pickle.loads(value, encoding="utf-8")
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	162 except ModuleNotFoundError:
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	163 # FIXME: workaround due to package renaming, need to move all pickle code to
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	164 # JSON
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	165 return pickle.loads(
684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	166 value.replace(b"sat.plugins", b"libervia.backend.plugins"),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	167 encoding="utf-8",
4095 684ba556a617 core (memory/sqla_mapping): fix legacy pickled values: Goffi <goffi@goffi.org> parents: 4071 diff changeset	168 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	169
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	170
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	171 class Json(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	172 """Handle JSON field in DB independant way"""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	173
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	174 # Blob is used on SQLite but gives errors when used here, while Text works fine
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	175 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	176 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	177
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	178 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	179 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	180 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	181 return json.dumps(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	182
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	183 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	184 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	185 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	186 return json.loads(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	187
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	188
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	189 class JsonDefaultDict(Json):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	190 """Json type which convert NULL to empty dict instead of None"""
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	191
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	192 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	193 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	194 return {}
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	195 return json.loads(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	196
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	197
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	198 class Xml(TypeDecorator):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	199 impl = Text
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	200 cache_ok = True
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	201
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	202 def process_bind_param(self, value, dialect):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	203 if value is None:
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	204 return None
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	205 return value.toXml()
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	206
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	207 def process_result_value(self, value, dialect):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	208 if value is None:
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	209 return None
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	210 return generic.parseXml(value.encode())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	211
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	212
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	213 class JID(TypeDecorator):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	214 """Store twisted JID in text fields"""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	215
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	216 impl = Text
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	217 cache_ok = True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	218
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	219 def process_bind_param(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	220 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	221 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	222 return value.full()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	223
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	224 def process_result_value(self, value, dialect):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	225 if value is None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	226 return None
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	227 return jid.JID(value)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	228
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	229
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	230 class Profile(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	231 __tablename__ = "profiles"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	232
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	233 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	234 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	235 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	236 nullable=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	237 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	238 name = Column(Text, unique=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	239
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	240 params = relationship("ParamInd", back_populates="profile", passive_deletes=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	241 private_data = relationship(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	242 "PrivateInd", back_populates="profile", passive_deletes=True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	243 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	244 private_bin_data = relationship(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	245 "PrivateIndBin", back_populates="profile", passive_deletes=True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	246 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	247
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	248
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	249 class Component(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	250 __tablename__ = "components"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	251
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	252 profile_id = Column(
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	253 ForeignKey("profiles.id", ondelete="CASCADE"), nullable=True, primary_key=True
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	254 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	255 entry_point = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	256 profile = relationship("Profile")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	257
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	258
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	259 class History(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	260 __tablename__ = "history"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	261 __table_args__ = (
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	262 UniqueConstraint("profile_id", "stanza_id", "source", "dest"),
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	263 UniqueConstraint("profile_id", "origin_id", "source", name="uq_origin_id"),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	264 Index("history__profile_id_timestamp", "profile_id", "timestamp"),
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	265 Index(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	266 "history__profile_id_received_timestamp", "profile_id", "received_timestamp"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	267 ),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	268 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	269
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	270 uid = Column(Text, primary_key=True)
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	271 # FIXME: version_id is only needed for changes in `extra` column. It would maybe be
23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	272 # better to use separate table for `extra` data instead.
23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	273 version_id = Column(Integer, nullable=False, server_default=text("1"))
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	274 origin_id = Column(Text)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	275 stanza_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	276 update_uid = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	277 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	278 source = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	279 dest = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	280 source_res = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	281 dest_res = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	282 timestamp = Column(Float, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	283 received_timestamp = Column(Float)
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	284 type = Column(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	285 Enum(
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	286 "chat",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	287 "error",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	288 "groupchat",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	289 "headline",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	290 "normal",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	291 # info is not XMPP standard, but used to keep track of info like join/leave
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	292 # in a MUC
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	293 "info",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	294 name="message_type",
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	295 create_constraint=True,
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	296 ),
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	297 nullable=False,
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	298 )
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	299 extra = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	300
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	301 profile = relationship("Profile")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	302 messages = relationship("Message", backref="history", passive_deletes=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	303 subjects = relationship("Subject", backref="history", passive_deletes=True)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	304 thread = relationship(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	305 "Thread", uselist=False, back_populates="history", passive_deletes=True
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	306 )
4152 23d21daed216 core (memory/sqla_mapping): add a `version_id` column to detect race conditions. Goffi <goffi@goffi.org> parents: 4130 diff changeset	307 __mapper_args__ = {"version_id_col": version_id}
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	308
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	309 def __init__(self, args, *kwargs):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	310 source_jid = kwargs.pop("source_jid", None)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	311 if source_jid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	312 kwargs["source"] = source_jid.userhost()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	313 kwargs["source_res"] = source_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	314 dest_jid = kwargs.pop("dest_jid", None)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	315 if dest_jid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	316 kwargs["dest"] = dest_jid.userhost()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	317 kwargs["dest_res"] = dest_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	318 super().__init__(args, *kwargs)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	319
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	320 @property
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	321 def source_jid(self) -> jid.JID:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	322 return jid.JID(f"{self.source}/{self.source_res or ''}")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	323
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	324 @source_jid.setter
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	325 def source_jid(self, source_jid: jid.JID) -> None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	326 self.source = source_jid.userhost
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	327 self.source_res = source_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	328
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	329 @property
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	330 def dest_jid(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	331 return jid.JID(f"{self.dest}/{self.dest_res or ''}")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	332
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	333 @dest_jid.setter
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	334 def dest_jid(self, dest_jid: jid.JID) -> None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	335 self.dest = dest_jid.userhost
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	336 self.dest_res = dest_jid.resource
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	337
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	338 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	339 dt = datetime.fromtimestamp(self.timestamp)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	340 return f"History<{self.source_jid.full()}->{self.dest_jid.full()} [{dt}]>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	341
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	342 def serialise(self):
4026 fe4725bf42fb core (memory/sqla): be sure to have a dict when serialising History.extra: Goffi <goffi@goffi.org> parents: 3796 diff changeset	343 extra = self.extra or {}
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	344 if self.origin_id is not None:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	345 extra["origin_id"] = self.origin_id
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	346 if self.stanza_id is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	347 extra["stanza_id"] = self.stanza_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	348 if self.update_uid is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	349 extra["update_uid"] = self.update_uid
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	350 if self.received_timestamp is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	351 extra["received_timestamp"] = self.received_timestamp
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	352 if self.thread is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	353 extra["thread"] = self.thread.thread_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	354 if self.thread.parent_id is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	355 extra["thread_parent"] = self.thread.parent_id
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	356
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	357 return {
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	358 "from": f"{self.source}/{self.source_res}"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	359 if self.source_res
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	360 else self.source,
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	361 "to": f"{self.dest}/{self.dest_res}" if self.dest_res else self.dest,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	362 "uid": self.uid,
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	363 "message": {m.language or "": m.message for m in self.messages},
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	364 "subject": {m.language or "": m.subject for m in self.subjects},
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	365 "type": self.type,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	366 "extra": extra,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	367 "timestamp": self.timestamp,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	368 }
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	369
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	370 def as_tuple(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	371 d = self.serialise()
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	372 return (
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	373 d["uid"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	374 d["timestamp"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	375 d["from"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	376 d["to"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	377 d["message"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	378 d["subject"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	379 d["type"],
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	380 d["extra"],
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	381 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	382
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	383 @staticmethod
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	384 def debug_collection(history_collection):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	385 for idx, history in enumerate(history_collection):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	386 history.debug_msg(idx)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	387
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	388 def debug_msg(self, idx=None):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	389 """Print messages"""
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	390 dt = datetime.fromtimestamp(self.timestamp)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	391 if idx is not None:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	392 dt = f"({idx}) {dt}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	393 parts = []
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	394 parts.append(f"[{dt}]<{self.source_jid.full()}->{self.dest_jid.full()}> ")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	395 for message in self.messages:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	396 if message.language:
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	397 parts.append(f"[{message.language}] ")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	398 parts.append(f"{message.message}\n")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	399 print("".join(parts))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	400
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	401
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	402 class Message(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	403 __tablename__ = "message"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	404 __table_args__ = (Index("message__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	405
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	406 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	407 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	408 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	409 )
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	410 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"), nullable=False)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	411 message = Column(Text, nullable=False)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	412 language = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	413
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	414 def serialise(self) -> Dict[str, Any]:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	415 s = {}
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	416 if self.message:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	417 s["message"] = str(self.message)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	418 if self.language:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	419 s["language"] = str(self.language)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	420 return s
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	421
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	422 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	423 lang_str = f"[{self.language}]" if self.language else ""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	424 msg = f"{self.message[:20]}…" if len(self.message) > 20 else self.message
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	425 content = f"{lang_str}{msg}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	426 return f"Message<{content}>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	427
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	428
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	429 class Subject(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	430 __tablename__ = "subject"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	431 __table_args__ = (Index("subject__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	432
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	433 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	434 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	435 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	436 )
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	437 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"), nullable=False)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	438 subject = Column(Text, nullable=False)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	439 language = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	440
3796 24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	441 def serialise(self) -> Dict[str, Any]:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	442 s = {}
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	443 if self.subject:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	444 s["subject"] = str(self.subject)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	445 if self.language:
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	446 s["language"] = str(self.language)
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	447 return s
24c1c06c865b core (memory/mapping): add `origin_id` column to History + constraints update: Goffi <goffi@goffi.org> parents: 3744 diff changeset	448
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	449 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	450 lang_str = f"[{self.language}]" if self.language else ""
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	451 msg = f"{self.subject[:20]}…" if len(self.subject) > 20 else self.subject
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	452 content = f"{lang_str}{msg}"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	453 return f"Subject<{content}>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	454
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	455
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	456 class Thread(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	457 __tablename__ = "thread"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	458 __table_args__ = (Index("thread__history_uid", "history_uid"),)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	459
3581 84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	460 id = Column(
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	461 Integer,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	462 primary_key=True,
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	463 )
84ea57a8d6b3 memory (storage): adjustements to SQLAlchemy mapping to match current state of database Goffi <goffi@goffi.org> parents: 3537 diff changeset	464 history_uid = Column(ForeignKey("history.uid", ondelete="CASCADE"))
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	465 thread_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	466 parent_id = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	467
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	468 history = relationship("History", uselist=False, back_populates="thread")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	469
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	470 def __repr__(self):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	471 return f"Thread<{self.thread_id} [parent: {self.parent_id}]>"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	472
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	473
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	474 class Notification(Base):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	475 __tablename__ = "notifications"
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	476 __table_args__ = (Index("notifications_profile_id_status", "profile_id", "status"),)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	477
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	478 id = Column(Integer, primary_key=True, autoincrement=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	479 timestamp = Column(Float, nullable=False, default=time.time)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	480 expire_at = Column(Float, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	481
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	482 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), index=True, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	483 profile = relationship("Profile")
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	484
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	485 type = Column(Enum(NotificationType), nullable=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	486
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	487 title = Column(Text, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	488 body_plain = Column(Text, nullable=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	489 body_rich = Column(Text, nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	490
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	491 requires_action = Column(Boolean, default=False)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	492 priority = Column(Integer, default=NotificationPriority.MEDIUM.value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	493
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	494 extra_data = Column(JSON)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	495 status = Column(Enum(NotificationStatus), default=NotificationStatus.new)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	496
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	497 def serialise(self) -> dict[str, str \| float \| bool \| int \| dict]:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	498 """
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	499 Serialises the Notification instance to a dictionary.
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	500 """
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	501 result = {}
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	502 for column in self.__table__.columns:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	503 value = getattr(self, column.name)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	504 if value is not None:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	505 if column.name in ("type", "status"):
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	506 result[column.name] = value.name
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	507 elif column.name == "id":
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	508 result[column.name] = str(value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	509 elif column.name == "profile_id":
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	510 if value is None:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	511 result["profile"] = C.PROF_KEY_ALL
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	512 else:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	513 result["profile"] = get_profile_by_id(value)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	514 else:
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	515 result[column.name] = value
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	516 return result
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	517
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	518
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	519 class ParamGen(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	520 __tablename__ = "param_gen"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	521
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	522 category = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	523 name = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	524 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	525
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	526
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	527 class ParamInd(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	528 __tablename__ = "param_ind"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	529
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	530 category = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	531 name = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	532 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	533 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	534
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	535 profile = relationship("Profile", back_populates="params")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	536
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	537
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	538 class PrivateGen(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	539 __tablename__ = "private_gen"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	540
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	541 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	542 key = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	543 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	544
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	545
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	546 class PrivateInd(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	547 __tablename__ = "private_ind"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	548
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	549 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	550 key = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	551 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	552 value = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	553
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	554 profile = relationship("Profile", back_populates="private_data")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	555
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	556
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	557 class PrivateGenBin(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	558 __tablename__ = "private_gen_bin"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	559
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	560 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	561 key = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	562 value = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	563
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	564
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	565 class PrivateIndBin(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	566 __tablename__ = "private_ind_bin"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	567
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	568 namespace = Column(Text, primary_key=True)
16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	569 key = Column(Text, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	570 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"), primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	571 value = Column(LegacyPickle)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	572
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	573 profile = relationship("Profile", back_populates="private_bin_data")
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	574
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	575
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	576 class File(Base):
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	577 __tablename__ = "files"
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	578 __table_args__ = (
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	579 Index("files__profile_id_owner_parent", "profile_id", "owner", "parent"),
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	580 Index(
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	581 "files__profile_id_owner_media_type_media_subtype",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	582 "profile_id",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	583 "owner",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	584 "media_type",
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	585 "media_subtype",
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	586 ),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	587 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	588
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	589 id = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	590 public_id = Column(Text, unique=True)
3583 16ade4ad63f3 core (memory/sqla_mapping): fix some technical debt: Goffi <goffi@goffi.org> parents: 3581 diff changeset	591 version = Column(Text, primary_key=True)
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	592 parent = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	593 type = Column(
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	594 Enum("file", "directory", name="file_type", create_constraint=True),
3537 f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	595 nullable=False,
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	596 server_default="file",
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	597 )
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	598 file_hash = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	599 hash_algo = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	600 name = Column(Text, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	601 size = Column(Integer)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	602 namespace = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	603 media_type = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	604 media_subtype = Column(Text)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	605 created = Column(Float, nullable=False)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	606 modified = Column(Float)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	607 owner = Column(JID)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	608 access = Column(JsonDefaultDict)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	609 extra = Column(JsonDefaultDict)
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	610 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	611
f9a5b810f14d core (memory/storage): backend storage is now based on SQLAlchemy Goffi <goffi@goffi.org> parents: diff changeset	612 profile = relationship("Profile")
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	613
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	614
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	615 class PubsubNode(Base):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	616 __tablename__ = "pubsub_nodes"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	617 __table_args__ = (UniqueConstraint("profile_id", "service", "name"),)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	618
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	619 id = Column(Integer, primary_key=True)
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	620 profile_id = Column(ForeignKey("profiles.id", ondelete="CASCADE"))
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	621 service = Column(JID)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	622 name = Column(Text, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	623 subscribed = Column(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	624 Boolean(create_constraint=True, name="subscribed_bool"), nullable=False
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	625 )
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	626 analyser = Column(Text)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	627 sync_state = Column(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	628 Enum(
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	629 SyncState,
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	630 name="sync_state",
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	631 create_constraint=True,
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	632 ),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	633 nullable=True,
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	634 )
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	635 sync_state_updated = Column(Float, nullable=False, default=time.time())
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	636 type_ = Column(Text, name="type", nullable=True)
02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	637 subtype = Column(Text, nullable=True)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	638 extra = Column(JSON)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	639
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	640 items = relationship("PubsubItem", back_populates="node", passive_deletes=True)
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	641 subscriptions = relationship("PubsubSub", back_populates="node", passive_deletes=True)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	642
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	643 def __str__(self):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	644 return f"Pubsub node {self.name!r} at {self.service}"
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	645
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	646
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	647 class PubsubSub(Base):
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	648 """Subscriptions to pubsub nodes
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	649
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	650 Used by components managing a pubsub service
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	651 """
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	652
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	653 __tablename__ = "pubsub_subs"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	654 __table_args__ = (UniqueConstraint("node_id", "subscriber"),)
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	655
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	656 id = Column(Integer, primary_key=True)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	657 node_id = Column(ForeignKey("pubsub_nodes.id", ondelete="CASCADE"), nullable=False)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	658 subscriber = Column(JID)
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	659 state = Column(
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	660 Enum(
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	661 SubscriptionState,
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	662 name="state",
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	663 create_constraint=True,
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	664 ),
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	665 nullable=True,
3744 658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	666 )
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	667
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	668 node = relationship("PubsubNode", back_populates="subscriptions")
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	669
658ddbabaf36 core (memory/sqla): new table/mapping to handle Pubsub node subscriptions: Goffi <goffi@goffi.org> parents: 3663 diff changeset	670
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	671 class PubsubItem(Base):
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	672 __tablename__ = "pubsub_items"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	673 __table_args__ = (UniqueConstraint("node_id", "name"),)
3593 cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	674 id = Column(Integer, primary_key=True)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	675 node_id = Column(ForeignKey("pubsub_nodes.id", ondelete="CASCADE"), nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	676 name = Column(Text, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	677 data = Column(Xml, nullable=False)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	678 created = Column(DateTime, nullable=False, server_default=now())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	679 updated = Column(DateTime, nullable=False, server_default=now(), onupdate=now())
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	680 parsed = Column(JSON)
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	681
cb8d0e8b917f core (memory/sqla_mapping): mapping for PubsubNode and PubsubItem (will be used for caching) Goffi <goffi@goffi.org> parents: 3583 diff changeset	682 node = relationship("PubsubNode", back_populates="items")
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	683
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	684
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	685 ## Full-Text Search
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	686
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	687 # create
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	688
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	689
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	690 @event.listens_for(PubsubItem.__table__, "after_create")
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	691 def fts_create(target, connection, **kw):
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	692 """Full-Text Search table creation"""
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	693 if connection.engine.name == "sqlite":
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	694 # Using SQLite FTS5
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	695 queries = [
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	696 "CREATE VIRTUAL TABLE pubsub_items_fts "
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	697 "USING fts5(data, content=pubsub_items, content_rowid=id)",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	698 "CREATE TRIGGER pubsub_items_fts_sync_ins AFTER INSERT ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	699 " INSERT INTO pubsub_items_fts(rowid, data) VALUES (new.id, new.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	700 "END",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	701 "CREATE TRIGGER pubsub_items_fts_sync_del AFTER DELETE ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	702 " INSERT INTO pubsub_items_fts(pubsub_items_fts, rowid, data) "
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	703 "VALUES('delete', old.id, old.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	704 "END",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	705 "CREATE TRIGGER pubsub_items_fts_sync_upd AFTER UPDATE ON pubsub_items BEGIN"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	706 " INSERT INTO pubsub_items_fts(pubsub_items_fts, rowid, data) VALUES"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	707 "('delete', old.id, old.data);"
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	708 " INSERT INTO pubsub_items_fts(rowid, data) VALUES(new.id, new.data);"
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	709 "END",
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	710 ]
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	711 for q in queries:
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	712 connection.execute(DDL(q))
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	713
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	714
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	715 # drop
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	716
4130 02f0adc745c6 core: notifications implementation, first draft: Goffi <goffi@goffi.org> parents: 4095 diff changeset	717
3663 162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	718 @event.listens_for(PubsubItem.__table__, "before_drop")
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	719 def fts_drop(target, connection, **kw):
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	720 "Full-Text Search table drop" ""
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	721 if connection.engine.name == "sqlite":
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	722 # Using SQLite FTS5
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	723 queries = [
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	724 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_ins",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	725 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_del",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	726 "DROP TRIGGER IF EXISTS pubsub_items_fts_sync_upd",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	727 "DROP TABLE IF EXISTS pubsub_items_fts",
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	728 ]
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	729 for q in queries:
162866ca4be7 db (schema): create virtual table for FTS + migration Goffi <goffi@goffi.org> parents: 3639 diff changeset	730 connection.execute(DDL(q))

Mercurial > libervia-backend

annotate libervia/backend/memory/sqla_mapping.py @ 4152:23d21daed216