tommy/libpostal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,679 Commits 2 Branches 0 Tags
2bae8075b00fecfd92494e069b8f128552bf5e48
Commit Graph

1679 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
jeffrey04
2bae8075b0 initial commit of malay words 2016-09-28 18:41:15 +08:00
Al
01afbf80ef [data] Each curl process will retry the chunk up to 3 times 2016-08-25 23:18:39 -04:00
Travis
de1255af00 [auto][ci skip] Adding data files from Travis build #161 2016-08-23 22:48:20 +00:00
Al Barrentine
f03df6aab8 Merge pull request #108 from petacat/patch-5 
Update toponyms.txt
 2016-08-23 18:38:08 -04:00
Travis
f19c9852aa [auto][ci skip] Adding data files from Travis build #160 2016-08-23 22:24:19 +00:00
Travis
d797d6c863 [auto][ci skip] Adding data files from Travis build #159 2016-08-23 22:14:07 +00:00
Al Barrentine
d1991848a3 Merge pull request #106 from petacat/patch-3 
Update place_names.txt
 2016-08-23 18:09:47 -04:00
Al Barrentine
964b440380 Merge pull request #104 from petacat/patch-1 
Update directionals.txt
 2016-08-23 17:49:36 -04:00
Thomas Rosen
a787c25cdf Update toponyms.txt 2016-08-23 23:09:32 +02:00
Thomas Rosen
7e258f2d87 Update place_names.txt 2016-08-23 23:03:31 +02:00
Thomas Rosen
bd109dc9ca Update directionals.txt 2016-08-23 22:56:56 +02:00
Al
757a7ee15f [docs][ci skip] Moving parser examples up so they come before normalization 2016-08-10 01:16:07 -04:00
Al
7ff8e1a5cb [docs][ci skip] Moving OpenCollective folks to the top of the README 2016-08-10 01:14:45 -04:00
Al Barrentine
a277096c96 Merge pull request #72 from piamancini/patch-1 
Added backers and sponsors from OpenCollective
 2016-08-09 23:05:45 -04:00
Al Barrentine
3e3950b37a Merge pull request #98 from uberbaud/posix_sh 
Use posix `sh` for systems without `bash`
 2016-07-27 18:44:11 -04:00
Tom Davis
18c8e90eb3 Use xargs to start workers as soon as possible 2016-07-27 17:46:44 -04:00
Tom Davis
11abf6cb22 Use posix sh for systems without bash 2016-07-26 20:17:18 -04:00
Al Barrentine
65c4688f89 Merge pull request #97 from uberbaud/multipart_edgecase 
Don't call `download_multipart` for 1 chunk
 2016-07-24 00:03:51 -04:00
Travis
3f0eff228e [auto][ci skip] Adding data files from Travis build #145 2016-07-23 22:28:32 +00:00
Al
bedfd34363 [fix] small change to dictionary so generated file rebuilds 2016-07-23 18:18:36 -04:00
Al
e8beca0971 [fix] ReEscape backslash when escaping dictionary files 2016-07-23 18:16:44 -04:00
Tom Davis
2991ffd193 Don't call download_multipart for 1 chunk 
Previously, where a file was larger than `$LARGE_FILE_SIZE` but smaller
than `$CHUNK_SIZE*2`, `download_multipart` would be called but would
only download one (1) chunk that was the whole file.

This fix keeps the same download performance as before but optimizes
processing chunks out.
 2016-07-23 16:41:04 -04:00
Al Barrentine
e3eaa9efaf Merge pull request #93 from uberbaud/no_seq 
Remove call to `seq` which may not exist
 2016-07-23 01:16:57 -04:00
Tom Davis
24e0314e71 Remove call to seq which may not exist 2016-07-23 01:03:15 -04:00
Al Barrentine
e02c6adc85 Merge pull request #91 from uberbaud/openbsd 
Add support for OpenBSD
 2016-07-20 19:47:18 -04:00
Al Barrentine
08e4284f68 Merge pull request #89 from uberbaud/alt_build_path 
Call libpostal_data in source path, not build path
 2016-07-20 18:33:00 -04:00
Tom Davis
c0366147e8 Add support for OpenBSD 2016-07-20 18:19:31 -04:00
Tom Davis
a8bb798ce0 Call libpostal_data in source path, not build path 
This fix updates Makefile to find the actual libpostal_data file when
`configure` is called from another directory, which it uses as the build
directory.
 2016-07-20 17:31:52 -04:00
Travis
a0f6e100f1 [auto][ci skip] Adding data files from Travis build #133 2016-07-17 19:13:46 +00:00
Al
12d50aac12 Merge branch 'master' of https://github.com/openvenues/libpostal 2016-07-17 15:03:52 -04:00
Al
83381e9d8a [expand] Adding exception for a few types of special punctuation (ampersand, plus, pound sign) which should be left in the original string and separated by whitespace. Closes #84. Closes #85 2016-07-17 15:02:47 -04:00
Al
d8a0e19a32 [dictionaries] Adding hyphenated version of rr-row, should always normalize 2016-07-17 15:01:32 -04:00
Travis
2fb677ca73 [auto][ci skip] Adding data files from Travis build #132 2016-07-17 18:47:28 +00:00
Al
22c02151ea Merge branch 'master' of https://github.com/openvenues/libpostal 2016-07-17 14:37:02 -04:00
Al
ce7fb82fcc [dictionaries] RR-ROW for #87 and new abbreviation for right-of-way generally 2016-07-17 14:32:22 -04:00
Al Barrentine
7c4593f08e Merge pull request #86 from dnmfarrell/master 
don't error on multiple setup_parser()
 2016-07-17 13:35:48 -04:00
David Farrell
a7a9708d2b don't error on multiple setup_parser() 2016-07-17 11:25:03 -04:00
Al
c05c54c9f6 Merge branch 'null_options' 2016-07-17 01:57:10 -04:00
Al
d7996ed56c [fix] setting garbage pointer to NULL on language_classifier_teardown (fixes #82) 2016-07-17 01:56:09 -04:00
Al Barrentine
2c43a72874 Merge pull request #81 from openvenues/null_options 
Fixes for expand case where all options are set to false
 2016-07-15 13:39:03 -04:00
Al
3e8ab0ba3f [test] New expansion test with all options set to false 2016-07-15 13:26:14 -04:00
Al
ce78064988 [fix] NULL checks 2016-07-15 13:23:23 -04:00
Al
2f5f226faa [fix] Add original string to normalizations if all options were set to false 2016-07-15 13:23:23 -04:00
Al Barrentine
8a0c83a195 Merge pull request #80 from johnlonganecker/master 
Update Readme
 2016-07-15 12:48:55 -04:00
John Longanecker
dc1032fbef Update Readme 
Update Readme to Include Libpostal REST and Libpostal REST Docker projects
 2016-07-15 10:29:46 -04:00
Al Barrentine
d749fd880a Merge pull request #78 from dnmfarrell/master 
Include link to unofficial Perl bindings
 2016-07-12 20:17:23 -04:00
David Farrell
f95d8a3067 Include link to unofficial Perl bindings 2016-07-12 20:06:05 -04:00
Al
e816b4f77e [parser] Ignore language/country options explicitly in the parser. The purpose of these options is not to be able to create language-specific/country-specific models at some point, shouldn't be used in the global model 2016-07-06 14:56:46 -04:00
Al
58a5dbe7e0 [logging] Logging the value of LIBPOSTAL_DATA_DIR when a setup error occurs 2016-07-01 14:51:04 -04:00
Al
ad9dfb46bd [build] Using a process pool with 64MB chunks (similar to aws cli) for S3 downloads. Setting the max concurrent requeests to 10, also the default in aws cli. 2016-07-01 14:37:13 -04:00