libpostal

cmp

[geodisambig] C msgpack serialization dependency

2015-04-12 15:14:01 -04:00

geohash

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

klib

[fix] warnings in klib/ksort.h

2015-10-26 18:50:22 -04:00

linenoise

[cli] Adding antirez's linenoise for command-line interfaces

2015-11-29 11:28:31 -05:00

log

[logging] Wrapping logging statements in a do while (0) so the compiler always at least sees debug code

2015-10-12 13:42:10 -05:00

murmur

[geodisambig] adding MurmurHash3, used by the Bloom filter

2015-03-11 17:47:57 -04:00

sparkey

Add support for OpenBSD

2016-07-20 18:19:31 -04:00

utf8proc

[unicode] Upgrading to latest utf8proc from JuliaLang (Unicode 8)

2015-12-23 19:33:09 -05:00

address_dictionary_builder.c

[refactor] changing names in int-valued hash tables

2015-09-08 00:15:14 -07:00

address_dictionary.c

[expansion] Adding address_expansion_in_dictionary

2016-04-29 13:23:48 -04:00

address_dictionary.h

[expansion] Adding address_expansion_in_dictionary

2016-04-29 13:23:48 -04:00

address_expansion_data.c

[auto][ci skip] Adding data files from Travis build #161

2016-08-23 22:48:20 +00:00

address_expansion_rule.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

address_parser_cli.c

[api] Default options accessible through getters, not static structs

2016-02-15 17:34:00 -05:00

address_parser_io.c

[fix] free normalized string in address parser data set

2016-01-05 14:06:03 -05:00

address_parser_io.h

[parser] Simplifying args in address_parser_data_set_tokenize_line

2015-12-10 18:48:23 -05:00

address_parser_test.c

[fix] using string_equals, handles NULLs

2016-01-05 14:08:10 -05:00

address_parser_train.c

[fix] using string_equals, handles NULLs

2016-01-05 14:08:10 -05:00

address_parser.c

[parser] Ignore language/country options explicitly in the parser. The purpose of these options is not to be able to create language-specific/country-specific models at some point, shouldn't be used in the global model

2016-07-06 14:56:46 -04:00

address_parser.h

[parsing] Adding an optimization to the parser API where, if the entire input is a single known geographic phrase like New York, it returns the most likely label from the training data. That way e.g. a search for 'Florida' doesn't get tagged as 'house.' This doesn't affect training, only prediction.

2016-01-15 20:07:21 -05:00

averaged_perceptron_tagger.c

[fix] Labels in averaged perceptron tagger

2015-09-29 13:06:34 -04:00

averaged_perceptron_tagger.h

[doc] Averaged perceptron tagger

2015-09-23 19:37:55 -04:00

averaged_perceptron_trainer.c

[parser] using trie_new_from_hash instead of an inline implemention in averaged perceptron training

2015-10-04 18:31:16 -04:00

averaged_perceptron_trainer.h

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

averaged_perceptron.c

[parser] Averaged perceptron training

2015-09-10 10:26:24 -07:00

averaged_perceptron.h

[parser] Averaged perceptron training

2015-09-10 10:26:24 -07:00

bench.c

[api] Default options accessible through getters, not static structs

2016-02-15 17:34:00 -05:00

bloom.c

[fix] float comparison

2015-08-07 17:28:21 -04:00

bloom.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

collections.h

[fix] sort hash keys by value

2016-01-09 03:38:25 -05:00

constants.h

[constants] max country code length

2015-09-19 01:39:58 -04:00

features.c

[fix] only strdup when necessary in feature counting functions

2016-01-08 00:46:41 -05:00

features.h

[features] No copy versions of feature counts functions

2016-01-05 16:39:50 -05:00

file_utils.c

[utils] Adding functions to read numeric arrays from files

2016-01-17 20:36:57 -05:00

file_utils.h

[utils] Adding functions to read numeric arrays from files

2016-01-17 20:36:57 -05:00

float_utils.c

[math] Floating point equality with relative epsilon comparisons

2016-01-02 15:39:49 -05:00

float_utils.h

[math] Floating point equality with relative epsilon comparisons

2016-01-02 15:39:49 -05:00

gazetteer_data.c

[expansion] Toponym dictionaries can apply to street names and place names

2015-12-08 02:10:22 -05:00

gazetteers.h

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

geo_disambiguation.c

[geodisambig] Shaving a few hundred more megabytes off of the geodb by only adding a single geohash prefix and not indexing the neighbors (query can use its neighbors)

2015-10-11 00:45:26 -05:00

geo_disambiguation.h

[geodisambig] Shaving a few hundred more megabytes off of the geodb by only adding a single geohash prefix and not indexing the neighbors (query can use its neighbors)

2015-10-11 00:45:26 -05:00

geodb_builder.c

[fix] static inline

2016-02-02 00:53:13 -05:00

geodb.c

don't error on multiple setup_parser()

2016-07-17 11:25:03 -04:00

geodb.h

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

geonames_fields.h

[geonames] Re-generating postal/geonames fields headers

2015-07-08 17:02:59 -04:00

geonames.c

[fix] Check the return of malloc() in geonames.c

2016-02-25 14:53:31 -06:00

geonames.h

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

graph_builder.c

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

graph_builder.h

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

graph.c

[graph] graph_load and graph_save

2015-10-09 15:36:14 -04:00

graph.h

[graph] graph_load and graph_save

2015-10-09 15:36:14 -04:00

json_encode.c

[api] Simple JSON encoding for strings, UTF-8 rather than Unicode

2015-12-17 12:25:05 -05:00

json_encode.h

[api] Simple JSON encoding for strings, UTF-8 rather than Unicode

2015-12-17 12:25:05 -05:00

language_classifier_cli.c

[language_classification] Making directory optional on language_classifier client/test program

2016-01-27 03:18:53 -05:00

language_classifier_io.c

[language_classification] Automatic hyperparameter optimization using either the cross-validation set or two distinct subsets of the training set

2016-01-17 21:11:37 -05:00

language_classifier_io.h

[language_classification] Automatic hyperparameter optimization using either the cross-validation set or two distinct subsets of the training set

2016-01-17 21:11:37 -05:00

language_classifier_test.c

[language_classification] Making directory optional on language_classifier client/test program

2016-01-27 03:18:53 -05:00

language_classifier_train.c

[fix] temporary files for language classifier training

2016-01-26 01:42:21 -05:00

language_classifier.c

[fix] setting garbage pointer to NULL on language_classifier_teardown (fixes #82 )

2016-07-17 01:56:09 -04:00

language_classifier.h

[language_classification] Removing the per-country classifier, text-based alone is doing close to 99% accuracy now

2016-01-17 21:13:14 -05:00

language_features.c

[language_classification] Adding script feature for any non-Latin script. Even if the script doesn't directly identify the language, it can act as a modified intercept (all Han script addresses will share the Han feature, even if we haven't seen one of the > 80k Han characters)

2016-01-17 21:37:45 -05:00

language_features.h

[language_classifier] Features for address languages classification, quadgrams for most languages, unigrams for ideographic characters, script for single-script languages like Thai, Hebrew, etc.

2016-01-09 03:42:57 -05:00

libpostal_config.h

[config] language_classifier data dir

2016-01-10 03:05:36 -05:00

libpostal_data

[data] Each curl process will retry the chunk up to 3 times

2016-08-25 23:18:39 -04:00

libpostal.c

[expand] Adding exception for a few types of special punctuation (ampersand, plus, pound sign) which should be left in the original string and separated by whitespace. Closes #84 . Closes #85

2016-07-17 15:02:47 -04:00

libpostal.h

[api] Adding function to free expansions from expand_address

2016-02-16 10:56:45 -05:00

logistic_regression_trainer.c

[language_classification] Automatic hyperparameter optimization using either the cross-validation set or two distinct subsets of the training set

2016-01-17 21:11:37 -05:00

logistic_regression_trainer.h

[language_classification] Automatic hyperparameter optimization using either the cross-validation set or two distinct subsets of the training set

2016-01-17 21:11:37 -05:00

logistic_regression.c

[fix] sign comparison in regularized gradient computation for logistic regression

2016-01-26 01:16:16 -05:00

logistic_regression.h

[classification] Sparse version of logistic regression gradient which, given an array of the features/columns used in the input batch, only updates the gradient for that batch, even for the operations which otherwise would apply to the entire matrix (scaling by -1/m, regularization)

2016-01-09 01:33:33 -05:00

logistic.c

[math] Adding sigmoid and softmax functions

2015-08-31 21:04:21 -04:00

logistic.h

[math] Adding sigmoid and softmax functions

2015-08-31 21:04:21 -04:00

main.c

[api] Default options accessible through getters, not static structs

2016-02-15 17:34:00 -05:00

Makefile.am

Call libpostal_data in source path, not build path

2016-07-20 17:31:52 -04:00

matrix.c

[fix] All file_read_uint64 calls that use stack variables read into a uint64_t not a size_t so as not to smash the stack under a 32-bit arch (issue #18 )

2016-02-29 22:36:00 -05:00

matrix.h

[math] Matrix arithmetic

2016-01-09 01:45:10 -05:00

minibatch.c

[fix] NULL check

2016-01-09 01:43:25 -05:00

minibatch.h

[features] Functions for dealing with minibatches

2016-01-08 00:48:11 -05:00

msgpack_utils.c

[utils] cstring_array_terminate, moving msgpack_utils to separate file

2015-07-25 18:41:02 -04:00

msgpack_utils.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

normalize.c

[fix] Add original string to normalizations if all options were set to false

2016-07-15 13:23:23 -04:00

normalize.h

[fix][ci skip] last remaining instance of vignt in libpostal

2016-03-29 12:51:19 -04:00

numex_data.c

[auto][ci skip] Adding data files from Travis build #105

2016-03-29 15:39:14 +00:00

numex_rule.h

[numex] Separating rules from keys for Linux gcc compilation

2015-08-09 01:00:57 -04:00

numex_table_builder.c

[fix] numex_table builder program using new API (heap-allocated strings)

2016-03-02 16:28:28 -05:00

numex.c

[fix] Log errors in numex module if not loaded

2016-03-21 18:15:53 -04:00

numex.h

[numex] using module init method for building, otherwise passing NULL path uses the default path

2015-09-16 21:13:05 -04:00

postal_fields.h

[geonames] Re-generating postal/geonames fields headers

2015-07-08 17:02:59 -04:00

scanner.c

[tokenization] Using the new re2c 0.16 generates a 75% smaller DFA for scanner, should speed up compile times on gcc

2016-01-30 02:20:01 -05:00

scanner.h

[fix] stdint include

2015-09-20 20:10:47 -04:00

scanner.re

[fix] tokenize_add_tokens respects specified length

2016-01-17 20:51:47 -05:00

shuffle.c

[parser] Forgot to add shuffle.h/.c

2015-12-01 11:25:28 -05:00

shuffle.h

[parser] Forgot to add shuffle.h/.c

2015-12-01 11:25:28 -05:00

sparse_matrix_utils.c

[math] Unique columns as array for CSR sparse matrix

2016-01-09 01:40:26 -05:00

sparse_matrix_utils.h

[math] Unique columns as array for CSR sparse matrix

2016-01-09 01:40:26 -05:00

sparse_matrix.c

[fix] All file_read_uint64 calls that use stack variables read into a uint64_t not a size_t so as not to smash the stack under a 32-bit arch (issue #18 )

2016-02-29 22:36:00 -05:00

sparse_matrix.h

[math] Adding sparse dot sparse given a dense output matrix (suitable for the minibatch use case), fixing sparse dot vector

2016-01-11 13:55:54 -05:00

stochastic_gradient_descent.c

[optimization] Using adapted learning rate in stochastic gradient descent (if lambda > 0)

2016-01-17 20:59:47 -05:00

stochastic_gradient_descent.h

[optimization] Adding learning rate to lazy sparse update in stochastic gradient descent

2016-01-12 11:04:16 -05:00

string_utils.c

[numex] Concatenating a string of numeric expressions with no intervening tokens like Seventeen Eighty or Ten Oh Four

2016-02-10 09:21:31 -05:00

string_utils.h

[numex] Concatenating a string of numeric expressions with no intervening tokens like Seventeen Eighty or Ten Oh Four

2016-02-10 09:21:31 -05:00

token_types.h

[expand] Adding exception for a few types of special punctuation (ampersand, plus, pound sign) which should be left in the original string and separated by whitespace. Closes #84 . Closes #85

2016-07-17 15:02:47 -04:00

tokens.c

[tokenization] tokenized string with source

2015-10-04 18:27:04 -04:00

tokens.h

[tokenization] tokenized string with source

2015-10-04 18:27:04 -04:00

transliterate.c

[fix] Log error in transliteration if setup hasn't been called

2016-03-21 18:06:02 -04:00

transliterate.h

[fix] Compiler warnings for casts/printf

2015-10-26 18:52:18 -04:00

transliteration_data.c

[transliteration] Distinguishing between variables with numbers and backreferences in transliteration rules

2015-12-23 13:07:44 -05:00

transliteration_rule.h

[transliteration] Using revisit strings instead of keeping a backtrack count so we don't have to later map logical characters to the actual string, removing any duplicate keys in the table builder so that if any rules happen to overlap within a step, the first will take precedence

2015-05-29 16:54:05 -04:00

transliteration_scripts_data.c

[transliteration] Regenerating transliterator scripts

2016-01-18 12:04:14 -05:00

transliteration_table_builder.c

[fix] logging warnings in transliterate

2015-10-12 13:50:42 -05:00

trie_search.c

[phrases] Another fix to tail token search

2016-02-08 17:55:21 -05:00

trie_search.h

[phrases] Adding with_phrases versions of trie search methods for pre-allocated phrases

2015-09-16 21:23:34 -04:00

trie_utils.c

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

trie_utils.h

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

trie.c

[fix] var declaration during trie creation

2016-03-02 16:05:32 -05:00

trie.h

[fix] All file_read_uint64 calls that use stack variables read into a uint64_t not a size_t so as not to smash the stack under a 32-bit arch (issue #18 )

2016-02-29 22:36:00 -05:00

unicode_script_types.h

[unicode] Regenerating unicode_script_data.c

2016-01-17 20:53:44 -05:00

unicode_scripts_data.c

[unicode] Regenerating unicode_script_data.c

2016-01-17 20:53:44 -05:00

unicode_scripts.c

[unicode] Adding SCRIPT_INHERITED as a common script so diacritics like COMBING CEDILLA don't break the current script and produce false word breaks

2016-01-11 16:39:21 -05:00

unicode_scripts.h

[transliteration] Regenerating transliteration data files

2015-09-23 04:04:38 -04:00

vector_math.h

[math] Adding array_{op}_times_scalar methods

2016-01-09 01:42:54 -05:00

vector.h

[math] Adding array_{op}_times_scalar methods

2016-01-09 01:42:54 -05:00