Al 97a2436ad7 [tokenization] Adding two more sets to token_types for punctuation and non-alphanumerics

2016-08-02 16:24:01 -04:00

..

__init__.py

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

normalize.py

[normalization] normalize tokens should not replace digits by default

2016-07-21 17:04:57 -04:00

phrases.py

[phrases] Using simple string encoding/decoding for default serialize/deserialize in PhraseFilter base class

2016-07-21 17:04:57 -04:00

pynormalize.c

[text] Adding NORMALIZE_STRING_COMPOSE constant in pynormalize.c

2016-07-24 03:37:43 -04:00

pytokenize.c

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

token_types.py

[tokenization] Adding two more sets to token_types for punctuation and non-alphanumerics

2016-08-02 16:24:01 -04:00

tokenize.py

[scripts] Adding the tokenize/normalize wrappers directly into the internal geodata package so pypostal can be maintained in an independent repo

2016-01-12 13:29:31 -05:00

utils.py

[text] Adding utils.py for is_numeric/is_numeric_strict

2016-07-24 03:37:11 -04:00