Al 622dc354e7 [optimization] Adding learning rate to lazy sparse update in stochastic gradient descent

2016-01-12 11:04:16 -05:00

..

cmp

[geodisambig] C msgpack serialization dependency

2015-04-12 15:14:01 -04:00

geohash

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

klib

[fix] warnings in klib/ksort.h

2015-10-26 18:50:22 -04:00

linenoise

[cli] Adding antirez's linenoise for command-line interfaces

2015-11-29 11:28:31 -05:00

log

[logging] Wrapping logging statements in a do while (0) so the compiler always at least sees debug code

2015-10-12 13:42:10 -05:00

murmur

[geodisambig] adding MurmurHash3, used by the Bloom filter

2015-03-11 17:47:57 -04:00

sparkey

[fix] Ubuntu build

2015-12-28 17:19:50 -05:00

utf8proc

[unicode] Upgrading to latest utf8proc from JuliaLang (Unicode 8)

2015-12-23 19:33:09 -05:00

address_dictionary_builder.c

[refactor] changing names in int-valued hash tables

2015-09-08 00:15:14 -07:00

address_dictionary.c

[build] substitution for use of LIBPOSTAL_DATA_DIR in Makefile.am

2015-10-26 18:47:07 -04:00

address_dictionary.h

[phrases] Adding _with_phrases versions of address dictionary methods for pre-allocated phrases

2015-09-16 21:24:28 -04:00

address_expansion_data.c

[dictionaries] adding ste to English dictionaries

2015-12-08 22:29:52 -05:00

address_expansion_rule.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

address_parser_cli.c

[fix] Encode strings as JSON in address parser cli

2015-12-21 17:45:09 -05:00

address_parser_io.c

[fix] free normalized string in address parser data set

2016-01-05 14:06:03 -05:00

address_parser_io.h

[parser] Simplifying args in address_parser_data_set_tokenize_line

2015-12-10 18:48:23 -05:00

address_parser_test.c

[fix] using string_equals, handles NULLs

2016-01-05 14:08:10 -05:00

address_parser_train.c

[fix] using string_equals, handles NULLs

2016-01-05 14:08:10 -05:00

address_parser.c

[fix] Moving address_parser_response_destroy into libpostal so caller can free

2015-12-15 00:52:24 -05:00

address_parser.h

[fix] Moving address_parser_response_destroy into libpostal so caller can free

2015-12-15 00:52:24 -05:00

averaged_perceptron_tagger.c

[fix] Labels in averaged perceptron tagger

2015-09-29 13:06:34 -04:00

averaged_perceptron_tagger.h

[doc] Averaged perceptron tagger

2015-09-23 19:37:55 -04:00

averaged_perceptron_trainer.c

[parser] using trie_new_from_hash instead of an inline implemention in averaged perceptron training

2015-10-04 18:31:16 -04:00

averaged_perceptron_trainer.h

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

averaged_perceptron.c

[parser] Averaged perceptron training

2015-09-10 10:26:24 -07:00

averaged_perceptron.h

[parser] Averaged perceptron training

2015-09-10 10:26:24 -07:00

bench.c

[fix] size_t in benchmark script

2015-12-14 14:57:11 -05:00

bloom.c

[fix] float comparison

2015-08-07 17:28:21 -04:00

bloom.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

collections.h

[fix] sort hash keys by value

2016-01-09 03:38:25 -05:00

constants.h

[constants] max country code length

2015-09-19 01:39:58 -04:00

features.c

[fix] only strdup when necessary in feature counting functions

2016-01-08 00:46:41 -05:00

features.h

[features] No copy versions of feature counts functions

2016-01-05 16:39:50 -05:00

file_utils.c

[utils] using unsigned ints in file_utils, adding doubles

2015-05-27 16:03:36 -04:00

file_utils.h

[fix] Removing default dirent include

2015-08-31 21:38:29 -04:00

float_utils.c

[math] Floating point equality with relative epsilon comparisons

2016-01-02 15:39:49 -05:00

float_utils.h

[math] Floating point equality with relative epsilon comparisons

2016-01-02 15:39:49 -05:00

gazetteer_data.c

[expansion] Toponym dictionaries can apply to street names and place names

2015-12-08 02:10:22 -05:00

gazetteers.h

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

geo_disambiguation.c

[geodisambig] Shaving a few hundred more megabytes off of the geodb by only adding a single geohash prefix and not indexing the neighbors (query can use its neighbors)

2015-10-11 00:45:26 -05:00

geo_disambiguation.h

[geodisambig] Shaving a few hundred more megabytes off of the geodb by only adding a single geohash prefix and not indexing the neighbors (query can use its neighbors)

2015-10-11 00:45:26 -05:00

geodb_builder.c

[geodb] Adding some logging to geodb

2015-10-11 01:00:08 -05:00

geodb.c

[fix] close file handle

2015-11-30 12:51:13 -05:00

geodb.h

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

geonames_fields.h

[geonames] Re-generating postal/geonames fields headers

2015-07-08 17:02:59 -04:00

geonames.c

[fix] Initializing booleans in postal code constructor

2015-10-09 15:40:28 -04:00

geonames.h

[fix] Removing C++ checks from all but the main API functions

2015-08-07 17:15:39 -04:00

graph_builder.c

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

graph_builder.h

[geodb] Additional filenames and struct members in geodb.h

2015-10-09 15:37:10 -04:00

graph.c

[graph] graph_load and graph_save

2015-10-09 15:36:14 -04:00

graph.h

[graph] graph_load and graph_save

2015-10-09 15:36:14 -04:00

json_encode.c

[api] Simple JSON encoding for strings, UTF-8 rather than Unicode

2015-12-17 12:25:05 -05:00

json_encode.h

[api] Simple JSON encoding for strings, UTF-8 rather than Unicode

2015-12-17 12:25:05 -05:00

language_classifier_io.c

[language_classifier] Language classifier data set I/O

2016-01-10 01:22:29 -05:00

language_classifier_io.h

[language_classifier] Language classifier data set I/O

2016-01-10 01:22:29 -05:00

language_classifier_train.c

[language_classifier] Language classifier training using L2-regularized logistic regression and stochastic gradient descent

2016-01-10 01:31:18 -05:00

language_classifier.c

[language_classifier] Language classifier structs, I/O and API

2016-01-10 01:20:17 -05:00

language_classifier.h

[language_classifier] Language classifier structs, I/O and API

2016-01-10 01:20:17 -05:00

language_features.c

[language_classifier] Features for address languages classification, quadgrams for most languages, unigrams for ideographic characters, script for single-script languages like Thai, Hebrew, etc.

2016-01-09 03:42:57 -05:00

language_features.h

[language_classifier] Features for address languages classification, quadgrams for most languages, unigrams for ideographic characters, script for single-script languages like Thai, Hebrew, etc.

2016-01-09 03:42:57 -05:00

libpostal_config.h

[config] language_classifier data dir

2016-01-10 03:05:36 -05:00

libpostal_data

[build] address_parser client now links to libpostal, adding address_parser to download script with an "all" option

2015-12-12 12:49:50 -05:00

libpostal.c

[api] More spacing fixes and using language information in normalize string

2015-12-31 03:52:14 -05:00

libpostal.h

[fix] Options out of order

2015-12-19 15:05:50 -05:00

logistic_regression_trainer.c

[optimization] Adding learning rate to lazy sparse update in stochastic gradient descent

2016-01-12 11:04:16 -05:00

logistic_regression_trainer.h

[classification] Pre-allocating memory in logistic regression trainer, storing last updated timestamps for sparse stochastic gradient descent and using the new gradient API

2016-01-09 01:39:24 -05:00

logistic_regression.c

[optimization] Using sparse updates in stochastic gradient descent. Decomposing the updates into the gradient of the loss function (zero for features not observed in the current batch) and the gradient of the regularization term. The derivative of the regularization term in L2-regularized models is equivalent to an exponential decay function. Before computing the gradient for the current batch, we bring the weights up to date only for the features observed in that batch, and update only those values

2016-01-09 03:37:31 -05:00

logistic_regression.h

[classification] Sparse version of logistic regression gradient which, given an array of the features/columns used in the input batch, only updates the gradient for that batch, even for the operations which otherwise would apply to the entire matrix (scaling by -1/m, regularization)

2016-01-09 01:33:33 -05:00

logistic.c

[math] Adding sigmoid and softmax functions

2015-08-31 21:04:21 -04:00

logistic.h

[math] Adding sigmoid and softmax functions

2015-08-31 21:04:21 -04:00

main.c

[api] Adding a --json option to expand cli

2015-12-17 13:46:55 -05:00

Makefile.am

[build] Removing source from libpostal shared lib

2016-01-12 10:31:22 -05:00

matrix.c

[math] Matrix arithmetic

2016-01-09 01:45:10 -05:00

matrix.h

[math] Matrix arithmetic

2016-01-09 01:45:10 -05:00

minibatch.c

[fix] NULL check

2016-01-09 01:43:25 -05:00

minibatch.h

[features] Functions for dealing with minibatches

2016-01-08 00:48:11 -05:00

msgpack_utils.c

[utils] cstring_array_terminate, moving msgpack_utils to separate file

2015-07-25 18:41:02 -04:00

msgpack_utils.h

[fix] Adding stdint.h include to most of the header files for portability

2015-08-07 02:43:44 -04:00

normalize.c

[normalize] Adding normalize_string_languages method which can use additional transliterators

2015-12-31 03:50:36 -05:00

normalize.h

[normalize] Adding normalize_string_languages method which can use additional transliterators

2015-12-31 03:50:36 -05:00

numex_data.c

[numex] Separating rules from keys for Linux gcc compilation

2015-08-09 01:00:57 -04:00

numex_rule.h

[numex] Separating rules from keys for Linux gcc compilation

2015-08-09 01:00:57 -04:00

numex_table_builder.c

[numex] using module init method for building, otherwise passing NULL path uses the default path

2015-09-16 21:13:05 -04:00

numex.c

[fix] Check for result.len > 0 in false start continuation numex parsing, plus additional safety check during replacement

2015-12-24 02:26:53 -05:00

numex.h

[numex] using module init method for building, otherwise passing NULL path uses the default path

2015-09-16 21:13:05 -04:00

postal_fields.h

[geonames] Re-generating postal/geonames fields headers

2015-07-08 17:02:59 -04:00

scanner.c

[tokenization] Regenerating scanner.c

2015-10-05 01:41:48 -04:00

scanner.h

[fix] stdint include

2015-09-20 20:10:47 -04:00

scanner.re

[tokenization] skipping control characters in tokenization, comes up in OSM surprisingly

2015-10-04 18:25:50 -04:00

shuffle.c

[parser] Forgot to add shuffle.h/.c

2015-12-01 11:25:28 -05:00

shuffle.h

[parser] Forgot to add shuffle.h/.c

2015-12-01 11:25:28 -05:00

sparse_matrix_utils.c

[math] Unique columns as array for CSR sparse matrix

2016-01-09 01:40:26 -05:00

sparse_matrix_utils.h

[math] Unique columns as array for CSR sparse matrix

2016-01-09 01:40:26 -05:00

sparse_matrix.c

[math] Adding sparse dot sparse given a dense output matrix (suitable for the minibatch use case), fixing sparse dot vector

2016-01-11 13:55:54 -05:00

sparse_matrix.h

[math] Adding sparse dot sparse given a dense output matrix (suitable for the minibatch use case), fixing sparse dot vector

2016-01-11 13:55:54 -05:00

stochastic_gradient_descent.c

[optimization] Adding learning rate to lazy sparse update in stochastic gradient descent

2016-01-12 11:04:16 -05:00

stochastic_gradient_descent.h

[optimization] Adding learning rate to lazy sparse update in stochastic gradient descent

2016-01-12 11:04:16 -05:00

string_utils.c

[utils] char_array_cat_printf was forcing a doubling of the size of the buffer, which is bad if calling many times. Now only initiates a realloc if the char_array is almost full. Also adding cstring_array_from_strings which takes a list of char *s

2016-01-06 22:56:01 -05:00

string_utils.h

[fix] adding functions to string_utils header

2016-01-06 23:03:16 -05:00

token_types.h

[tokenization] is_whitespace

2016-01-05 16:40:35 -05:00

tokens.c

[tokenization] tokenized string with source

2015-10-04 18:27:04 -04:00

tokens.h

[tokenization] tokenized string with source

2015-10-04 18:27:04 -04:00

transliterate.c

[transliteration] In set match checks, use the current index, not current index - char_len

2015-12-23 13:12:30 -05:00

transliterate.h

[fix] Compiler warnings for casts/printf

2015-10-26 18:52:18 -04:00

transliteration_data.c

[transliteration] Distinguishing between variables with numbers and backreferences in transliteration rules

2015-12-23 13:07:44 -05:00

transliteration_rule.h

[transliteration] Using revisit strings instead of keeping a backtrack count so we don't have to later map logical characters to the actual string, removing any duplicate keys in the table builder so that if any rules happen to overlap within a step, the first will take precedence

2015-05-29 16:54:05 -04:00

transliteration_scripts_data.c

[fix] Adding Korean-Latin-BGN to excluded transliterators

2015-12-21 16:24:50 -05:00

transliteration_table_builder.c

[fix] logging warnings in transliterate

2015-10-12 13:50:42 -05:00

trie_search.c

[fix] In trie search, moving fall-off and tail checks inside the inner character loop dding tail position as a separate variable from offset in the string

2015-12-23 19:16:43 -05:00

trie_search.h

[phrases] Adding with_phrases versions of trie search methods for pre-allocated phrases

2015-09-16 21:23:34 -04:00

trie_utils.c

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

trie_utils.h

[mv] Moving trie_new_from_hash to a module

2016-01-05 16:43:17 -05:00

trie.c

[phrases] trie_num_keys

2016-01-05 22:02:15 -05:00

trie.h

[phrases] trie_num_keys

2016-01-05 22:02:15 -05:00

unicode_script_types.h

[unicode] Regenerated unicode script types (ignore extraneous scripts, they're not used, just reside in the upper unicode planes)

2015-09-23 00:35:08 -04:00

unicode_scripts_data.c

[unicode] Regenerated unicode scripts data file, using simple integers instead of repeating the enum types for succinctness

2015-09-23 00:36:29 -04:00

unicode_scripts.c

[unicode] Adding SCRIPT_INHERITED as a common script so diacritics like COMBING CEDILLA don't break the current script and produce false word breaks

2016-01-11 16:39:21 -05:00

unicode_scripts.h

[transliteration] Regenerating transliteration data files

2015-09-23 04:04:38 -04:00

vector_math.h

[math] Adding array_{op}_times_scalar methods

2016-01-09 01:42:54 -05:00

vector.h

[math] Adding array_{op}_times_scalar methods

2016-01-09 01:42:54 -05:00