4 Commits

Author	SHA1	Message	Date
Al	4f784060a3	[python] Adding word_token_types	2015-10-25 18:33:09 -04:00
Al	236737eab3	[tokenization/osm] Using utf8 encoded version of string for tokens in python tokenizer	2015-09-21 17:27:43 -04:00
Al	5b2fd0be50	[fix] pytokenize compilation on Ubuntu/gcc	2015-09-21 03:24:14 -04:00
Al	5485ea2197	[python] Adding initial pypostal bindings for tokenize so we can remove address_normalizer dependency. Not tested on Python 3.	2015-09-20 14:59:39 -04:00