Al c0a468d7e8 [normalization] adding a normalize_token function and some token options for deleting periods

2016-12-09 17:46:26 -05:00

..

__init__.py

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

normalize.py

[normalization] adding a normalize_token function and some token options for deleting periods

2016-12-09 17:46:26 -05:00

phrases.py

[phrases] Using simple string encoding/decoding for default serialize/deserialize in PhraseFilter base class

2016-07-21 17:04:57 -04:00

pynormalize.c

[text] Adding NORMALIZE_STRING_COMPOSE constant in pynormalize.c

2016-07-24 03:37:43 -04:00

pytokenize.c

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

token_types.py

[tokenization] Adding two more sets to token_types for punctuation and non-alphanumerics

2016-08-02 16:24:01 -04:00

tokenize.py

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

utils.py

[abbreviations] Adding ability to abbreviate within hyphenated phrases e.g. Sint-Maarten => St.-Maarten

2016-08-24 18:50:24 -04:00