libpostal

cmp

[geodisambig] C msgpack serialization dependency

2015-04-12 15:14:01 -04:00

geohash

[utils] geohash

2015-03-03 18:51:49 -05:00

klib

[fix] fixing some formatting

2015-03-03 12:54:27 -05:00

log

[fix] fixing some formatting

2015-03-03 12:54:27 -05:00

murmur

[geodisambig] adding MurmurHash3, used by the Bloom filter

2015-03-11 17:47:57 -04:00

utf8proc

[unicode] Upgrading to JuliaLang's utf8proc (Unicode 7, maintained)

2015-03-17 12:20:08 -04:00

bloom.c

[geodisambig] Bloom filter implementation for quick probabilistic set membership tests before hitting disk. 100% recall and bounded precision, saves disk seeks for keys that definitely do not exist (useful for Geonames disambiguation-related lookups and in-process deduping).

2015-03-11 17:47:15 -04:00

bloom.h

[geodisambig] Bloom filter implementation for quick probabilistic set membership tests before hitting disk. 100% recall and bounded precision, saves disk seeks for keys that definitely do not exist (useful for Geonames disambiguation-related lookups and in-process deduping).

2015-03-11 17:47:15 -04:00

collections.h

[utils] two set types in collections.h

2015-04-19 09:32:53 -04:00

config.h

[config] Adding config header

2015-06-01 15:40:59 -04:00

constants.h

[utils] constants.h

2015-06-02 12:26:19 -04:00

features.c

[utils] More consistent naming in string_utils

2015-03-27 21:12:08 -04:00

features.h

[utils] More consistent naming in string_utils

2015-03-27 21:12:08 -04:00

file_utils.c

[utils] using unsigned ints in file_utils, adding doubles

2015-05-27 16:03:36 -04:00

file_utils.h

[utils] using unsigned ints in file_utils, adding doubles

2015-05-27 16:03:36 -04:00

gazetteers.h

[gazetteers] string name doesn't need to be part of the gazetteer itself, adding two new dictionary types to the config for named people (e.g. JFK) and named organizations (e.g. UN)

2015-03-27 20:59:21 -04:00

geonames.c

[geodisambig] Models for geonames with msgpack serialization/deserialization

2015-04-12 16:47:01 -04:00

geonames.h

[geodisambig] Models for geonames with msgpack serialization/deserialization

2015-04-12 16:47:01 -04:00

numex_data.c

[fix] new generated numex data file

2015-06-02 13:45:06 -04:00

numex_rule.h

[numex] adding stopword rules with the regular numex rules

2015-06-02 12:37:22 -04:00

numex.c

[fix] compilation/warnings

2015-06-02 13:43:55 -04:00

numex.h

[fix] compilation/warnings

2015-06-02 13:43:55 -04:00

scanner.c

[tokenization] Numeric tokens must end in number or letter

2015-04-22 14:55:18 -04:00

scanner.h

[tokenization] Adding url, email, US/international phone numbers, a separate type for ideographic numbers, more general quotes, paren types

2015-03-24 16:43:53 -04:00

scanner.re

[tokenization] Numeric tokens must end in number or letter

2015-04-22 14:55:18 -04:00

string_utils.c

[utils] changing signature of utf8proc_iterate_reversed so it takes the same arguments as utf8proc_iterate for function pointer purposes

2015-05-25 15:35:28 -04:00

string_utils.h

[utils] changing signature of utf8proc_iterate_reversed so it takes the same arguments as utf8proc_iterate for function pointer purposes

2015-05-25 15:35:28 -04:00

token_types.h

[tokenization] Adding url, email, US/international phone numbers, a separate type for ideographic numbers, more general quotes, paren types

2015-03-24 16:43:53 -04:00

tokens.c

[fix] better allocation sizes for tokenized strings

2015-04-05 22:02:31 -04:00

tokens.h

[fix] type name/import

2015-04-01 02:54:14 -04:00

transliterate.c

[fix] Removing the stub comment and a few more random comments

2015-05-29 20:10:44 -04:00

transliterate.h

[numex] Using the new representation for generated data

2015-06-02 12:28:07 -04:00

transliteration_data.c

[transliteration] New data file

2015-05-31 02:08:26 -04:00

transliteration_rule.h

[transliteration] Using revisit strings instead of keeping a backtrack count so we don't have to later map logical characters to the actual string, removing any duplicate keys in the table builder so that if any rules happen to overlap within a step, the first will take precedence

2015-05-29 16:54:05 -04:00

transliteration_scripts.h

[transliteration] New transliterator_scripts file

2015-05-31 02:09:28 -04:00

transliteration_table_builder.c

[fix] only count non-set chars in parse_groups

2015-05-29 19:42:05 -04:00

trie_search.c

[fix] trie_search using proper length in utf8proc_iterate

2015-05-27 16:08:19 -04:00

trie_search.h

[phrases] trie_search now only takes the original string and the token array. Fixed a bug where certain phrases were being found in string search but not in tokenized search

2015-04-19 09:32:20 -04:00

trie.c

[phrases] trie I/O using the uint APIs, fixes to trie_get_prefix_result_from_index

2015-05-27 16:06:35 -04:00

trie.h

[utils] using unsigned ints in file_utils, adding doubles

2015-05-27 16:03:36 -04:00

unicode_script_types.h

[fix] NUM_CHARS => NUM_CODEPOINTS

2015-05-17 13:53:19 -04:00

unicode_scripts_data.c

[unicode] Adding generated unicode script data

2015-03-18 17:01:03 -04:00

unicode_scripts.c

[unicode] Adding generated unicode script data

2015-03-18 17:01:03 -04:00

unicode_scripts.h

[unicode] header

2015-03-18 17:25:53 -04:00

vector_math.h

[utils] Adding min, max, argmin, argmax and log_sum_exp to generic vector math header

2015-04-12 12:11:04 -04:00

vector.h

[fix] vector_*_pop returns the element

2015-05-16 23:20:28 -04:00