Mercurial > libervia-backend
view src/plugins/plugin_exp_lang_detect.py @ 2089:0931b5a6213c
core, quick_frontends: android compatibility hacks:
a couple of hacks have been used so backend can be launched on android using kivy
- config file (sat.conf) is been read on a specific dir, using a detection of Cagou domains in constants.py
- fixed crash when using sys.stdout.isatty in log_config.py
- Q&D fix for logging encoding issue on android
- when android is detected, the path/pattern to load plugins is modified
- SRV is not working at the moment on android. If the platform is detected, the host is used directly with default port. A hosts_dir configuration can be used in [android] section to map a specific ip to a host
- getRepositoryData in tools/utils return constant string on android. Proper repository data need to be copied during package building.
- [quick app] more robust failure handling on asyncConnect error
- [quick chat] default to utf-8 when getlocale doesn't return the actual locale.
author | Goffi <goffi@goffi.org> |
---|---|
date | Sun, 04 Dec 2016 18:16:48 +0100 |
parents | d95a6d553bec |
children | 1d3f73e065e1 |
line wrap: on
line source
#!/usr/bin/env python2 # -*- coding: utf-8 -*- # SAT plugin to detect language (experimental) # Copyright (C) 2009-2016 Jérôme Poisson (goffi@goffi.org) # This program is free software: you can redistribute it and/or modify # it under the terms of the GNU Affero General Public License as published by # the Free Software Foundation, either version 3 of the License, or # (at your option) any later version. # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU Affero General Public License for more details. # You should have received a copy of the GNU Affero General Public License # along with this program. If not, see <http://www.gnu.org/licenses/>. from sat.core.i18n import _, D_ from sat.core.log import getLogger log = getLogger(__name__) from sat.core import exceptions try: from langid.langid import LanguageIdentifier, model except ImportError: raise exceptions.MissingModule(u'Missing module langid, please download/install it with "pip install langid")') identifier = LanguageIdentifier.from_modelstring(model, norm_probs=False) PLUGIN_INFO = { "name": "Language detection plugin", "import_name": "EXP-LANG-DETECT", "type": "EXP", "protocols": [], "dependencies": [], "main": "LangDetect", "handler": "no", "description": _("""Detect and set message language when unknown""") } CATEGORY = D_(u"Misc") NAME = u"lang_detect" LABEL = D_(u"language detection") PARAMS = """ <params> <individual> <category name="{category_name}"> <param name="{name}" label="{label}" type="bool" value="true" /> </category> </individual> </params> """.format(category_name=CATEGORY, name=NAME, label=_(LABEL), ) class LangDetect(object): def __init__(self, host): log.info(_(u"Language detection plugin initialization")) self.host = host host.memory.updateParams(PARAMS) host.trigger.add("MessageReceived", self.MessageReceivedTrigger) host.trigger.add("messageSend", self.MessageSendTrigger) def addLanguage(self, mess_data): message = mess_data['message'] if len(message) == 1 and message.keys()[0] == '': msg = message.values()[0] lang = identifier.classify(msg)[0] mess_data["message"] = {lang: msg} return mess_data def MessageReceivedTrigger(self, client, message_elt, post_treat): """ Check if source is linked and repeat message, else do nothing """ lang_detect = self.host.memory.getParamA(NAME, CATEGORY, profile_key=client.profile) if lang_detect: post_treat.addCallback(self.addLanguage) return True def MessageSendTrigger(self, client, data, pre_xml_treatments, post_xml_treatments): lang_detect = self.host.memory.getParamA(NAME, CATEGORY, profile_key=client.profile) if lang_detect: self.addLanguage(data) return True