Al 8a188903b3 [python] Using tuples in pytokenize instead of list, pre-allocating

2015-10-26 18:04:13 -04:00

..

__init__.py

[python] Adding initial pypostal bindings for tokenize so we can remove address_normalizer dependency. Not tested on Python 3.

2015-09-20 14:59:39 -04:00

encoding.py

[python] Adding initial pypostal bindings for tokenize so we can remove address_normalizer dependency. Not tested on Python 3.

2015-09-20 14:59:39 -04:00

pytokenize.c

[python] Using tuples in pytokenize instead of list, pre-allocating

2015-10-26 18:04:13 -04:00

token_types.py

[python] Adding word_token_types

2015-10-25 18:33:09 -04:00

tokenize.py

[tokenization/osm] Using utf8 encoded version of string for tokens in python tokenizer

2015-09-21 17:27:43 -04:00