Al e7f783477f [python/normalize] Adding remove parentheses options in Python normalize (would require compiling with the scanner to do it from C, but could switch)

2015-10-30 01:27:16 -04:00

..

__init__.py

[python] Adding initial pypostal bindings for tokenize so we can remove address_normalizer dependency. Not tested on Python 3.

2015-09-20 14:59:39 -04:00

encoding.py

[python] Adding initial pypostal bindings for tokenize so we can remove address_normalizer dependency. Not tested on Python 3.

2015-09-20 14:59:39 -04:00

normalize.py

[python/normalize] Adding remove parentheses options in Python normalize (would require compiling with the scanner to do it from C, but could switch)

2015-10-30 01:27:16 -04:00

pynormalize.c

[normalize] Adding hyphen elimination as a string option (changes tokenization)

2015-10-27 13:32:47 -04:00

pytokenize.c

[fix] Error condition in Python tokenize

2015-10-27 13:33:28 -04:00

token_types.py

[python] Making normalized_tokens return token classes as well, mimicking the tokenize API

2015-10-27 17:07:50 -04:00

tokenize.py

[tokenization/osm] Using utf8 encoded version of string for tokens in python tokenizer

2015-09-21 17:27:43 -04:00