Al
|
df47dad817
|
[fix] Partial matches, ultimate misses in concatenated suffixes
|
2015-12-18 17:37:06 -05:00 |
|
Al
|
66073c17d5
|
[fix] Handling case of concatenated suffixes like straße when they stand alone
|
2015-12-18 17:17:35 -05:00 |
|
Al
|
31ed88bf6a
|
[api] Adding a --json option to expand cli
|
2015-12-17 13:46:55 -05:00 |
|
Al
|
41ea105bb4
|
[api] Simple JSON encoding for strings, UTF-8 rather than Unicode
|
2015-12-17 12:25:05 -05:00 |
|
Al
|
af78614f62
|
[fix] Print usage info on -h/--help to libpostal cli
|
2015-12-16 22:21:13 -05:00 |
|
Al
|
e0c0ed2d04
|
[numex] Return true if numex table already loaded
|
2015-12-15 14:28:40 -05:00 |
|
Al
|
b9bf5c629e
|
[fix] Moving address_parser_response_destroy into libpostal so caller can free
|
2015-12-15 00:52:24 -05:00 |
|
Al
|
b59c830ba6
|
[fix] warning about size_t
|
2015-12-14 18:17:09 -05:00 |
|
Al
|
406f9c533d
|
[api] Separating parser setup/teardown into two separate methods
|
2015-12-14 18:15:57 -05:00 |
|
Al
|
43b212a09b
|
[fix] size_t in benchmark script
|
2015-12-14 14:57:11 -05:00 |
|
Al
|
dc03c83bb2
|
[math] Adding an aligned memory allocator for vectors to help with vectorization/SIMD
|
2015-12-14 14:56:38 -05:00 |
|
Al
|
bd1e8ecaf8
|
[fix] default address parser dir
|
2015-12-12 12:55:37 -05:00 |
|
Al
|
2950358697
|
[build] address_parser client now links to libpostal, adding address_parser to download script with an "all" option
|
2015-12-12 12:49:50 -05:00 |
|
Al
|
88836e56e1
|
[api] Adding parse_address implementation to the libpostal API. GeoDB and address parser are now required. Stripping punctuation from the normalized output
|
2015-12-12 12:47:44 -05:00 |
|
Al
|
bce6ba2595
|
[fix] typedef
|
2015-12-12 11:58:41 -05:00 |
|
Al
|
a8d6cc4053
|
[api] Moving parse_address definition into libpostal.h
|
2015-12-12 03:55:31 -05:00 |
|
Al
|
fe4c528f26
|
[parser] Using different char_array for each of the potential phrases as token i
|
2015-12-12 03:23:26 -05:00 |
|
Al
|
e6303f70f3
|
[fix] removing printf
|
2015-12-11 02:53:22 -05:00 |
|
Al
|
671dd4a5d2
|
[parser] Fixing possible invalid writes in training for values beginning with a separator
|
2015-12-11 02:05:05 -05:00 |
|
Al
|
743b74aea5
|
[parser] Simplifying args in address_parser_data_set_tokenize_line
|
2015-12-10 18:48:23 -05:00 |
|
Al
|
88b8023ac8
|
[fix] Bug in address parser feature extraction, can hold onto the wrong pointer
|
2015-12-10 18:42:28 -05:00 |
|
Al
|
3de59506ae
|
[parser] Internal separators for parsing purposes include open/close parens, at sign, semicolon, etc. Ignore stray colons not internal to a word (as in Swedish abbreviations)
|
2015-12-10 18:08:51 -05:00 |
|
Al
|
71d6d3c5e1
|
[utils] Removing kvec and using similar implementation with pointers that can be passed around
|
2015-12-10 17:52:23 -05:00 |
|
Al
|
ab205eff96
|
[utils] Adding a default small size to all arrays based on a look at malloc/realloc usage
|
2015-12-09 19:46:09 -05:00 |
|
Al
|
f252869671
|
[dictionaries] adding ste to English dictionaries
|
2015-12-08 22:29:52 -05:00 |
|
Al
|
fe37286bcf
|
[fix] Fixes to matrix methods
|
2015-12-08 17:33:38 -05:00 |
|
Al
|
d9d53ce17e
|
[math] Matrix method updates
|
2015-12-08 15:39:52 -05:00 |
|
Al
|
48ee665e71
|
[scripts] Benchmark script using default options
|
2015-12-08 15:38:44 -05:00 |
|
Al
|
2fcc72ae07
|
[fix] multitoken canonical strings
|
2015-12-08 15:38:04 -05:00 |
|
Al
|
a857138d95
|
[api] Adding place name expansions by default
|
2015-12-08 15:31:36 -05:00 |
|
Al
|
beec43fe15
|
[expansion] regenerating expansion data
|
2015-12-08 15:28:54 -05:00 |
|
Al
|
e1ea2ac704
|
[expansion] Toponym dictionaries can apply to street names and place names
|
2015-12-08 02:10:22 -05:00 |
|
Al
|
cbe5cd7429
|
[expansion] The ambiguous expansions dictionary shouldn't add to the component bitset
|
2015-12-07 20:36:56 -05:00 |
|
Al
|
d35f519629
|
[expansion] Fixing case where non-ideographic tokens like # can potentially be concatenated with surrounding tokens and should normalized with whitespace in between
|
2015-12-07 19:18:46 -05:00 |
|
Al
|
f5739dd42b
|
[math] Signatures for array_exp and array_log
|
2015-12-07 18:10:04 -05:00 |
|
Al
|
0d8d396108
|
[expansion] Fixing cases like ML King where a global (all languages) expansion subsumes the specific language expansion (like English)
|
2015-12-07 18:09:25 -05:00 |
|
Al
|
9bab70909d
|
[numex] Always adding a version of the string without Roman numeral expansion since many times those tokens can be ambiguous
|
2015-12-07 14:29:18 -05:00 |
|
Al
|
a066ee9aad
|
[math] Only reallocate on matrix_resize if needed
|
2015-12-07 01:20:16 -05:00 |
|
Al
|
cfd0dc69f2
|
[parsing] Using the entire phrase as the ith word
|
2015-12-07 01:19:38 -05:00 |
|
Al
|
8186e2606e
|
[dictionaries] Regenerating address expansion data file
|
2015-12-06 16:56:27 -05:00 |
|
Al
|
44f7fd0844
|
[math] Matrix resize
|
2015-12-06 03:20:03 -05:00 |
|
Al
|
596c5ffdd3
|
[fix] Tokenized trie search
|
2015-12-05 15:21:52 -05:00 |
|
Al
|
24208c209f
|
[parsing] Adding a training data derived index of complete phrases from suburb up to country. Only adding bias and word features for non phrases, using UNKNOWN_WORD and UNKNOWN_NUMERIC for infrequent tokens (not meeting minimum vocab count threshold).
|
2015-12-05 14:34:19 -05:00 |
|
Al
|
f41158b8b3
|
[osm] Avoid using the alternate name (e.g. Brooklyn instead of Kings County) when it is the same as city
|
2015-12-05 14:21:07 -05:00 |
|
Al
|
25e89bcc41
|
[fix] tokenized trie search edge case where tail is stored on the space node
|
2015-12-03 12:25:21 -05:00 |
|
Al
|
43287db90a
|
[normalization/phrases] Fixing a bug which occurs with an already-separated elision
|
2015-12-02 16:04:39 -05:00 |
|
Al
|
746b5d0f34
|
[fix] transliterate using string_equals
|
2015-12-02 13:09:43 -05:00 |
|
Al
|
d0aaff1482
|
[utils] string_equals with NULL check
|
2015-12-01 13:12:08 -05:00 |
|
Al
|
f322ae0a1c
|
[build] adding shuffle.c to Makefile rule
|
2015-12-01 11:28:33 -05:00 |
|
Al
|
b94264b745
|
[parser] Forgot to add shuffle.h/.c
|
2015-12-01 11:25:28 -05:00 |
|