Al 8562c7a5cb [unicode] Adding wide char support for language disambiguation (comes up in venue names), despite the likelihood of running on a narrow Python build. Rolling back common script chars at a script break, so in the case of e.g. Cyrllic name (Latin name), the segmentation is done at the space before the paren.

2015-09-23 00:37:59 -04:00

..

__init__.py

[languages] Moving language id methods into a separate package

2015-08-21 08:00:56 -04:00

create_language_training_data.py

[language_id] Adding formatted addresses and toponyms to language training data

2015-09-04 01:46:49 -04:00

disambiguation.py

[unicode] Adding wide char support for language disambiguation (comes up in venue names), despite the likelihood of running on a narrow Python build. Rolling back common script chars at a script break, so in the case of e.g. Cyrllic name (Latin name), the segmentation is done at the space before the paren.

2015-09-23 00:37:59 -04:00

polygon_lookup.py

[languages] Moving language id methods into a separate package

2015-08-21 08:00:56 -04:00