tommy/libpostal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,343 Commits 2 Branches 0 Tags
a11f33fb3d84b0a41334e10ce8a5583f514177fd
Commit Graph

5343 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Oskar Thorbjornsson
a11f33fb3d Add a link to info about Senzing data model. 2023-02-13 13:32:38 -08:00
Oskar Thorbjornsson
c4c636febd Adding directions to the readme on how to download Senzing datamodel. 2023-02-12 18:04:10 -08:00
Oskar Thorbjornsson
ec9e0e341f Enable downloading of Senzing data model. 2023-02-12 17:58:36 -08:00
Peter Johnson
cb80555b24 Merge pull request #606 from openvenues/docs-dist-clean 
docs: remove make distclean
 2022-10-30 09:09:22 +13:00
Peter Johnson
a6c17a0510 docs: remove make distclean 
The `make distclean` command is not required in this example, which is a fresh clone
 2022-10-29 22:00:07 +02:00
Peter Johnson
668b94473a Merge pull request #605 from openvenues/install-docs 
Makefile is not available until after configure
 2022-10-29 03:16:12 +13:00
Peter Johnson
5c4ef44426 Makefile is not available until after configure 
The `make` command fails when run *before* configure, this is confusing users which are not familiar with `automake`.

```bash
make distclean
make: *** No rule to make target `distclean'.  Stop.

make
make: *** No targets specified and no makefile found.  Stop.
```
 2022-10-28 12:59:12 +02:00
Peter Johnson
92f504c8c9 Merge pull request #596 from lukeoz/patch-1 
Update toponyms.txt
 2022-08-29 15:58:03 +02:00
lukeoz
99c5ffa233 Update toponyms.txt 
"South Australia" rather than "Southern Australia" for abbreviation "SA"
 2022-08-16 11:30:40 +09:30
Al B
544d510db0 Merge pull request #578 from reisub/sse2neon 
Use NEON on ARM hardware via sse2neon.h
 2022-07-10 20:00:17 -04:00
Dino Kovač
7984270453 Split hardware optimization flags 2022-07-05 19:43:11 +02:00
Dino Kovač
6064bc6c06 Use NEON on ARM hardware via sse2neon.h 
The autoconf changes were adapted from:
https://github.com/glennrp/libpng/blob/libpng16/configure.ac
 2022-06-16 15:49:01 +02:00
Al B
a97717f2b9 Merge pull request #567 from kmicklas/config-check 
Check HAVE_CONFIG_H in matrix.h
 2022-04-18 16:03:29 -04:00
Al
893745f09b [near_dupes] using quadgrams in Latin scripts as well for near dupe hashes 2022-03-25 14:05:03 -04:00
Al
26124ee72f [near_dupes] exposing name_word_hashes directly in the API 2022-03-25 14:04:26 -04:00
Al
0d8e4ec56d [fix] possible acronym for single toke phrases if it's a directional 2022-03-25 12:24:42 -04:00
Al B
6b52d426d4 Merge pull request #574 from mattwigway/m1-build 
build instructions for M1 macs (see #551)
 2022-03-02 13:27:31 -05:00
Matthew Wigginton Bhagat-Conway
41e76a7c32 build instructions for M1 macs (see #551) 2022-03-02 10:37:50 -05:00
Ken Micklas
b0c1c75209 Check HAVE_CONFIG_H in matrix.h 2021-12-08 09:33:32 -05:00
Al B
9c97597298 Merge pull request #522 from kyrill007/master 
#501. Fixed build issues on MSYS on Windows.
 2021-06-22 02:53:34 -04:00
Al B
e5b278ba64 Merge pull request #523 from kodemartin/rust-bindings 
Add rustpostal to unofficial bindings
 2021-06-22 02:48:29 -04:00
Al B
0800968b5d Merge pull request #541 from openvenues/dependabot/pip/scripts/pyyaml-5.4 
Bump pyyaml from 5.1 to 5.4 in /scripts
 2021-06-22 02:44:56 -04:00
Al B
5235caa8a8 Merge pull request #542 from openvenues/dependabot/pip/scripts/lxml-4.6.3 
Bump lxml from 4.6.2 to 4.6.3 in /scripts
 2021-06-22 02:44:30 -04:00
Al B
273d0e0684 Merge pull request #544 from evrial/patch-1 
Update README.md
 2021-06-22 02:44:15 -04:00
Alexander Grigoryev
9c98fc976d Update README.md 2021-05-02 12:40:54 +03:00
dependabot[bot]
cb3523c8bb Bump lxml from 4.6.2 to 4.6.3 in /scripts 
Bumps [lxml](https://github.com/lxml/lxml) from 4.6.2 to 4.6.3.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.6.2...lxml-4.6.3)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-03-31 18:38:28 +00:00
dependabot[bot]
40a0e7ef70 Bump pyyaml from 5.1 to 5.4 in /scripts 
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.1 to 5.4.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/5.1...5.4)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-03-25 21:48:20 +00:00
Al Barrentine
f3f2af211b Merge pull request #530 from openvenues/dependabot/pip/scripts/lxml-4.6.2 
Bump lxml from 3.6.0 to 4.6.2 in /scripts
 2021-01-11 02:00:45 -05:00
dependabot[bot]
6ead75ccd2 Bump lxml from 3.6.0 to 4.6.2 in /scripts 
Bumps [lxml](https://github.com/lxml/lxml) from 3.6.0 to 4.6.2.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-3.6.0...lxml-4.6.2)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-01-07 22:24:47 +00:00
Konstantinos Demartinos
948a0d350a Add rustpostal to unofficial bindings 2020-11-22 12:27:35 +02:00
Kyrill Alyoshin
186f6c77cc #501. Fixed build issues on MSYS on Windows. 2020-11-14 19:26:55 +00:00
Al Barrentine
7c22eb4e64 Merge pull request #513 from kyrill007/511 
#511. Fixed C compilation errors for the latest versions of Mac OS X
 2020-09-04 10:44:31 -04:00
Kyrill Alyoshin
9fcf066e38 #511. Fixed C compilation errors for the latest versions of Mac OS X 2020-08-26 15:28:54 -04:00
Al Barrentine
790e24bc0a Merge pull request #454 from openvenues/dependabot/pip/scripts/pyyaml-5.1 
Bump pyyaml from 3.11 to 5.1 in /scripts
 2020-03-03 01:59:52 -05:00
Al Barrentine
d796201ac3 Merge pull request #457 from openvenues/dependabot/pip/scripts/requests-2.20.0 
Bump requests from 2.9.1 to 2.20.0 in /scripts
 2020-03-03 01:59:39 -05:00
Al Barrentine
95f31de3b2 Merge pull request #468 from in-cloud-opensource/patch-2 
Fix a bug in file geohash/geohash.c
 2019-12-12 15:56:48 -06:00
in-cloud-opensource
ed41f42c97 Fix a bug in file geohash/geohash.c 
Add missing bit shifts in the function geohashstr_to_interleaved in order to be able to calculate correctly the  
    1) geo coordinates from a given geohash and 
    2) neigbor geohashes of a given geohash.

The incorrect calculation of neighbor geohashes e.g. has the following impact on the deduplication with lieu: Features are compared that should not be compared because they are too far away from each other. This often results in distances between duplicates that exceed by far the max. expected distance according to the used geohash precision.
 2019-12-12 11:34:39 +01:00
Al Barrentine
95bf70eb35 Merge pull request #465 from luizvbo/lang_classifier_exposure 
Exposes language classification functions
 2019-12-06 05:03:33 -06:00
Al Barrentine
610b5e12de Merge pull request #459 from in-cloud-opensource/patch-1 
Fix segmentation fault in soft_tfidf.c
 2019-11-29 11:48:21 -06:00
in-cloud-opensource
d6595aee9b Fix segmentation fault in soft_tfidf.c 
Initialize local arrays suffixes1 and suffixes2 in function soft_tfidf_similarity_with_phrases_and_acronyms explicitly with NULL in order to prevent segmentation faults due to undefined initial values if ordinal_suffixes1 and ordinal_suffixes2 are NULL.
 2019-11-19 12:49:54 +01:00
dependabot[bot]
a113d4ec6a Bump requests from 2.9.1 to 2.20.0 in /scripts 
Bumps [requests](https://github.com/requests/requests) from 2.9.1 to 2.20.0.
- [Release notes](https://github.com/requests/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/master/HISTORY.md)
- [Commits](https://github.com/requests/requests/compare/v2.9.1...v2.20.0)

Signed-off-by: dependabot[bot] <support@github.com>
 2019-11-07 23:04:54 +00:00
dependabot[bot]
34de474861 Bump pyyaml from 3.11 to 5.1 in /scripts 
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 3.11 to 5.1.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/3.11...5.1)

Signed-off-by: dependabot[bot] <support@github.com>
 2019-10-29 20:21:09 +00:00
Al
d8c9847c56 [test] adding test for hyphen replacement/deletion to libpostal C lib 2019-08-15 02:06:26 -04:00
Al
7828e568a7 [fix] remove hyphens option in libpostal expansions/token normalizations 2019-08-15 02:01:46 -04:00
Luiz Otavio V. B. Oliveira
0327150d2b Exposes language classification functions 2019-06-14 14:31:12 +02:00
Al
21601eb4b8 [fix/expand] adding test case for new per-language expansions. Also fixes #354 2019-02-16 22:31:59 -05:00
Al
42207769ef [expand] adding a --root flag to the libpostal script for root-only expansion 2019-02-16 22:27:39 -05:00
Al
b7052caf6b [dedupe] allow near-dupe hashes if only a small containing boundary is present (e.g. county/state district). 2019-02-16 22:26:13 -05:00
Al
3610ffaa05 [expand/dedupe] expansion with multiple languages (or multiple predicted languages) can sometimes produce weird string trees and thus either too many results or incorrect results, particularly for root expansions which we depend on for matching/deduping. Making one call per language identified. This may slightly affect performance on languages that are highly ambiguous (even that's doubtful, as libpostal usually identifies one or two languages with high accurracy and/or people are using a known geography) but should improve the results and was simpler implementation-wise than trying to use the single single string tree for multiple languages where, say, a two word phrase in one language might simply be token-space-token in another. 2019-02-16 22:20:36 -05:00
Al Barrentine
ea0878120c Merge pull request #407 from openvenues/fix_transliteration 
fix for transliteration bug causing infinite loop or incorrect results in some expansions
 2019-02-13 05:19:51 -05:00