Commit Graph

5318 Commits

Author SHA1 Message Date
Al B
5235caa8a8 Merge pull request #542 from openvenues/dependabot/pip/scripts/lxml-4.6.3
Bump lxml from 4.6.2 to 4.6.3 in /scripts
2021-06-22 02:44:30 -04:00
Al B
273d0e0684 Merge pull request #544 from evrial/patch-1
Update README.md
2021-06-22 02:44:15 -04:00
Alexander Grigoryev
9c98fc976d Update README.md 2021-05-02 12:40:54 +03:00
dependabot[bot]
cb3523c8bb Bump lxml from 4.6.2 to 4.6.3 in /scripts
Bumps [lxml](https://github.com/lxml/lxml) from 4.6.2 to 4.6.3.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.6.2...lxml-4.6.3)

Signed-off-by: dependabot[bot] <support@github.com>
2021-03-31 18:38:28 +00:00
Al Barrentine
f3f2af211b Merge pull request #530 from openvenues/dependabot/pip/scripts/lxml-4.6.2
Bump lxml from 3.6.0 to 4.6.2 in /scripts
2021-01-11 02:00:45 -05:00
dependabot[bot]
6ead75ccd2 Bump lxml from 3.6.0 to 4.6.2 in /scripts
Bumps [lxml](https://github.com/lxml/lxml) from 3.6.0 to 4.6.2.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-3.6.0...lxml-4.6.2)

Signed-off-by: dependabot[bot] <support@github.com>
2021-01-07 22:24:47 +00:00
Al Barrentine
7c22eb4e64 Merge pull request #513 from kyrill007/511
#511. Fixed C compilation errors for the latest versions of Mac OS X
2020-09-04 10:44:31 -04:00
Kyrill Alyoshin
9fcf066e38 #511. Fixed C compilation errors for the latest versions of Mac OS X 2020-08-26 15:28:54 -04:00
Al Barrentine
790e24bc0a Merge pull request #454 from openvenues/dependabot/pip/scripts/pyyaml-5.1
Bump pyyaml from 3.11 to 5.1 in /scripts
2020-03-03 01:59:52 -05:00
Al Barrentine
d796201ac3 Merge pull request #457 from openvenues/dependabot/pip/scripts/requests-2.20.0
Bump requests from 2.9.1 to 2.20.0 in /scripts
2020-03-03 01:59:39 -05:00
Al Barrentine
95f31de3b2 Merge pull request #468 from in-cloud-opensource/patch-2
Fix a bug in file geohash/geohash.c
2019-12-12 15:56:48 -06:00
in-cloud-opensource
ed41f42c97 Fix a bug in file geohash/geohash.c
Add missing bit shifts in the function geohashstr_to_interleaved in order to be able to calculate correctly the  
    1) geo coordinates from a given geohash and 
    2) neigbor geohashes of a given geohash.

The incorrect calculation of neighbor geohashes e.g. has the following impact on the deduplication with lieu: Features are compared that should not be compared because they are too far away from each other. This often results in distances between duplicates that exceed by far the max. expected distance according to the used geohash precision.
2019-12-12 11:34:39 +01:00
Al Barrentine
95bf70eb35 Merge pull request #465 from luizvbo/lang_classifier_exposure
Exposes language classification functions
2019-12-06 05:03:33 -06:00
Al Barrentine
610b5e12de Merge pull request #459 from in-cloud-opensource/patch-1
Fix segmentation fault in soft_tfidf.c
2019-11-29 11:48:21 -06:00
in-cloud-opensource
d6595aee9b Fix segmentation fault in soft_tfidf.c
Initialize local arrays suffixes1 and suffixes2 in function soft_tfidf_similarity_with_phrases_and_acronyms explicitly with NULL in order to prevent segmentation faults due to undefined initial values if ordinal_suffixes1 and ordinal_suffixes2 are NULL.
2019-11-19 12:49:54 +01:00
dependabot[bot]
a113d4ec6a Bump requests from 2.9.1 to 2.20.0 in /scripts
Bumps [requests](https://github.com/requests/requests) from 2.9.1 to 2.20.0.
- [Release notes](https://github.com/requests/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/master/HISTORY.md)
- [Commits](https://github.com/requests/requests/compare/v2.9.1...v2.20.0)

Signed-off-by: dependabot[bot] <support@github.com>
2019-11-07 23:04:54 +00:00
dependabot[bot]
34de474861 Bump pyyaml from 3.11 to 5.1 in /scripts
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 3.11 to 5.1.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/3.11...5.1)

Signed-off-by: dependabot[bot] <support@github.com>
2019-10-29 20:21:09 +00:00
Al
d8c9847c56 [test] adding test for hyphen replacement/deletion to libpostal C lib 2019-08-15 02:06:26 -04:00
Al
7828e568a7 [fix] remove hyphens option in libpostal expansions/token normalizations 2019-08-15 02:01:46 -04:00
Luiz Otavio V. B. Oliveira
0327150d2b Exposes language classification functions 2019-06-14 14:31:12 +02:00
Al
21601eb4b8 [fix/expand] adding test case for new per-language expansions. Also fixes #354 2019-02-16 22:31:59 -05:00
Al
42207769ef [expand] adding a --root flag to the libpostal script for root-only expansion 2019-02-16 22:27:39 -05:00
Al
b7052caf6b [dedupe] allow near-dupe hashes if only a small containing boundary is present (e.g. county/state district). 2019-02-16 22:26:13 -05:00
Al
3610ffaa05 [expand/dedupe] expansion with multiple languages (or multiple predicted languages) can sometimes produce weird string trees and thus either too many results or incorrect results, particularly for root expansions which we depend on for matching/deduping. Making one call per language identified. This may slightly affect performance on languages that are highly ambiguous (even that's doubtful, as libpostal usually identifies one or two languages with high accurracy and/or people are using a known geography) but should improve the results and was simpler implementation-wise than trying to use the single single string tree for multiple languages where, say, a two word phrase in one language might simply be token-space-token in another. 2019-02-16 22:20:36 -05:00
Al Barrentine
ea0878120c Merge pull request #407 from openvenues/fix_transliteration
fix for transliteration bug causing infinite loop or incorrect results in some expansions
2019-02-13 05:19:51 -05:00
Al
8a022698ee [fix] transliteration bug causing potential infinite loop, closes #351, closes #378 2019-02-13 04:01:29 -05:00
Al Barrentine
af8b343109 Merge pull request #406 from openvenues/new_build_process
New build process
2019-02-12 15:16:01 -05:00
Al
7a23d8922a [build] data dir version handling 2019-02-12 14:10:02 -05:00
Al
3c0e97ae59 [fix] patch version also has to be an integer 2019-02-12 14:09:03 -05:00
Al
6a50eb7b22 [fix/build] base_data should currently be at v1.0.0 in terms of where the files are uploaded 2019-02-12 13:34:54 -05:00
Al
fdb3b7e32e [build] fixing multi-part downloads, which no longer know the Content-Length so no longer know the byte ange for the last chunk. No longer needs to use any file dates/timestamps (compatibility 🎉), only the version numbers that are checked in to the repo 2019-02-12 13:33:08 -05:00
Al
acebc951b6 [fix] != instead of -ne 2019-02-12 12:32:34 -05:00
Al
a60aa9bfb1 [fix] seem to not be able to use a non-numeric version number in the Windows configure script, hopefully that fixes the Appveyor build 2018-12-29 20:16:14 -05:00
Al
9ae41dfaa4 [fix] base_data should be v1.1-alpha 2018-12-29 17:45:57 -05:00
Al
78fc457e75 [build/windows] attempting same changes to the Windows configure script 2018-12-13 14:39:24 -05:00
Al
9542c8c435 [build] adding libposatl_data.in which allows us to fetch data files from Github without using the API 2018-12-13 13:35:01 -05:00
Al
641395e811 [build] configure now uses the in-repo version strings and builds the libpostal_data script from a template 2018-11-18 11:53:46 -05:00
Al
b94519122e [build] adding new in-repo version files for each of the data files so we don't have to use the Github API on Travis builds and a template version of the download script so that the version numbers can be configured based on those files. 2018-11-18 11:46:37 -05:00
Al Barrentine
eae01d3e60 Updating issue template to not use checkboxes 2018-05-24 16:55:03 -04:00
Al Barrentine
43795a3d90 Merge pull request #328 from openvenues/github_model_releases
GitHub model releases
2018-03-11 03:55:53 -04:00
Al
027fbc5afc [fix] filename 2018-03-11 03:26:37 -04:00
Al
b4a0c79d64 [fix] adding the tempfiles in the datadir, where the user must have permissions for this to work anyway 2018-03-10 22:24:03 -05:00
Al
15cb5f68ad [fix] making this work with sh...wondering if supporting the few shells that don't have bash is worth losing array functionality. 2018-03-10 22:12:46 -05:00
Al
270bae7a32 [docs] adding the links to the Internet Archive versions of the training data as well as a file that contains the current parser training set date 2018-03-10 19:33:24 -05:00
Al
0c91379424 [build/fix] using Github for the model releases rather than the Mapzen S3 buckets which are no longer working after the shutdown. It requires a little more effort to get the metadata, but downloads should still be just as fast since Github releases are on S3 as well. Note: still need to implement the upload piece, but this at least provides a model endpoint for users. 2018-03-10 19:03:30 -05:00
Travis
fabd040860 [auto][ci skip] Adding data files from Travis build #381 2018-03-08 01:50:54 +00:00
Al Barrentine
6d41863068 Merge pull request #324 from veremenko-y/feature-update-street-types
Updated street types for EN
2018-03-07 20:37:30 -05:00
Yaroslav Veremenko
c0b770101a Removed final period 2018-03-07 17:51:34 -07:00
Yaroslav Veremenko
fd2b864b7d Updated street types for EN 2018-03-07 12:48:30 -07:00
Al
6575bdc339 [dedupe/test] adding remaining options to near_dupe_test 2018-02-24 00:34:58 -05:00