tommy/libpostal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[addresses/languages] if there's only one default language and we don't have a road name or a unicode script to disambiguate, assume the default (e.g. English in the US unless there's a Spanish/French road name). Can affect things like state abbreviations

Browse Source
This commit is contained in:
Al
2016-11-22 18:27:23 -05:00
parent 3c5e2afeed
commit 3dc2a922fb
2 changed files with 6 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
scripts/geodata/addresses/components.py
View File

@@ -283,6 +283,10 @@ class AddressComponents(object):
break
else:
language = UNKNOWN_LANGUAGE
else:
default_languages = [lang for lang, default in candidate_languages if default]
if len(default_languages) == 1:
language = default_languages[0]
else:
language = UNKNOWN_LANGUAGE

2
scripts/geodata/language_id/disambiguation.py
View File

@@ -97,7 +97,7 @@ LATIN_TRANSLITERATED_SCRIPTS = {'Arabic', 'Cyrllic'}
def has_non_latin_script(languages):
for lang, is_default in languages:
scripts = script_languages.get(lang, set())
scripts = lang_scripts.get(lang, set())
if LATIN_SCRIPT not in scripts or scripts & LATIN_TRANSLITERATED_SCRIPTS:
return True
return False