tommy/libpostal
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,420 Commits 2 Branches 0 Tags
21a2a7419a1815b500c7ff41361ba828c6e778df
Commit Graph

1869 Commits

Author SHA1 Message Date
Al
e380567ac4 [osm] adding alt_place_names method which does hyphenation, de-hyphenation and abbreviated toponyms with/without hyphens 2016-10-19 02:19:09 -04:00
Al
51afc2619b [fix] only replace whitespace between words, not for instance whitespace around an existing hyphen, and reducing to one space for spaced hyphens 2016-10-19 01:24:54 -04:00
Al
e8899eafd6 [osm] adding hyphenation/de-hyphenation to OSM admin components 2016-10-19 01:00:29 -04:00
Al
98ac232eea [osm] hyphenating and de-hyphenating place names in places training data 2016-10-19 00:33:10 -04:00
Al
72e7d3ff5b [addresses/hyphens] adding some methods to hyphenate/dehyphenate place names at random 2016-10-18 19:10:31 -04:00
Al
7e007a49ab [osm] removing place=district mapping globally (means city_district in Hungary) and mapping it specifically to state_district/city_district in the places where it's needed 2016-10-18 19:02:36 -04:00
Al
d34faf42b8 [osm] fix names with pipes in them 2016-10-17 02:32:25 -04:00
Al
a796b41d90 [geonames] admin codes on geonames/postal_codes tables 2016-10-17 00:21:33 -04:00
Al
ff27ee14bb [osm] only add label props if the name property is identical (counterexample, Nottinghamshire's label is listed as West Bridgford, which is really its admin_center) 2016-10-16 22:18:52 -04:00
Al
9fb936019a [geoplanet] script to create GeoPlanet postal codes training data 2016-10-12 15:05:45 -04:00
Al
1e6a00c573 [fix] place in UK that was parented by a postal_code 2016-10-12 15:00:33 -04:00
Al
1d25f08b52 [expand] adding a function to check if two place names/addresses are equivalent after token normalization (replacing hyphens, deleting final periods, lowercasing, simple transliteration, etc.) and taking into account abbreviations from any specified libpostal dictionaries. In conjunction with place name affixes, useful in data sets like GeoPlanet or GeoNames to determine if a name variant is related to the original or not 2016-10-12 14:55:59 -04:00
Al
f8664b0deb [formatting] making regex-based tests during insert_component optional.If exact_order=True, insert the given component directly before/after the reference component, otherwise for components that already exist in the template only need to care about relative position. Adding a method to determine if template language is important for a particular country/language pair. 2016-10-12 14:42:34 -04:00
Al
2663b81670 [address_formatting] caching parsed templates from pystache yields about a 2.5x speedup per call, should shave off several hours of CPU time for large training sets 2016-10-11 15:36:49 -04:00
Al
2314acef1b [geoplanet] bypassing Québec as a county (just city and state) 2016-10-11 02:33:27 -04:00
Al
02fc172b5c [geoplanet] abbreviations for UK and NYC, fixing country codes for IM, GG and JE 2016-10-11 02:11:26 -04:00
Al
6ff1024c02 [fix] null candidate languages 2016-10-07 19:49:32 -04:00
Al
30074524d8 [fix] return empty list for languages in country_and_languages 2016-10-07 18:57:22 -04:00
Al
ff7fec6ed1 [osm/polygons] need to include id/type in polygon properties now that they're getting added earlier in the pipeline 2016-10-07 01:21:02 -04:00
Al
169a3c3d70 [osm] drop postcode as well for address-only format 2016-10-07 01:10:16 -04:00
Al
4ff3f50e01 [fix] Dublin postcode formatting 2016-10-07 01:06:37 -04:00
Al
2e8b6e6a29 [fix] args 2016-10-07 01:03:22 -04:00
Al
0401a04adb [osm] add address-only formats (sans place tags) for every address as well to better deal handle incomplete queries where location is expected to be inferred by the geocoder, etc. 2016-10-07 00:59:52 -04:00
Al
ed26d8e398 [geoplanet] a few more GeoPlanet fixes for LocalAdmins in LU and CH 2016-10-07 00:34:57 -04:00
Al
ecd71ee10d [fix] var name 2016-10-06 15:36:51 -04:00
Al
c44e6280b4 [geoplanet] Setting postal codes connected to non-admin features to parent/grandparent features. Setting postal codes connected to unitary authorities in the UK to their respective towns 2016-10-06 14:07:01 -04:00
Al
aff12106c4 [geoplanet] adding Island place_type 2016-10-06 14:04:28 -04:00
Al
b1f386cb11 [fix] typo 2016-10-06 01:37:42 -04:00
Al
7d5ef87348 [fix] geoplanet zip file 2016-10-06 01:37:30 -04:00
Al
a67efcffe4 [addresses] add new option to use city population to determine whether components should be dropped out 2016-10-05 18:16:25 -04:00
Al
66af532850 [osm] adding country-specific cleanups to OSM place training data 2016-10-05 17:13:13 -04:00
Al
6b0186782d [openaddresses] doing country-specific cleanups in OpenAddresses 2016-10-05 17:07:29 -04:00
Al
182c0b3d26 [addresses] adding country-specific cleanups for Kingston (city=Kingston 12 split into city=Kingston, postcode=12) and Dublin (e.g. Dublin 3 specified various ways will be treated as a city_district, whereas Eirecodes are treated as postal codes) 2016-10-05 17:05:24 -04:00
Al
2798420fdc [osm] add boundary=postal_district to admin borders for Ireland 2016-10-05 15:26:16 -04:00
Al
7b3a59878c [fix] bracket 2016-10-05 14:27:24 -04:00
Al
5744fc5a3c [fix] import 2016-10-05 03:23:34 -04:00
Al
70a5ded45c [fix] encode element id 2016-10-05 03:14:19 -04:00
Al
432f9dd42e [fix] format of candidate_languages in the new OSM rtree 2016-10-05 03:12:07 -04:00
Al
bb32253689 [fix] args 2016-10-05 02:54:52 -04:00
Al
faf418decb [languages] using country_and_languages method in OSM, neighborhoods and OpenAddresses 2016-10-05 02:49:55 -04:00
Al
98a8d898a1 [fix] import 2016-10-05 01:39:34 -04:00
Al
b1cd7fdc4a [osm] adding type/id to properties dict earlier in the pipeline 2016-10-05 00:53:32 -04:00
Al
6081df0cd1 [osm] adding admin1 ids to the OSM country rtree 2016-10-04 23:12:15 -04:00
Al
2bc109f519 [osm] adding an OSM-based country_and_languages method 2016-10-04 18:41:00 -04:00
Al
aea67c0769 [osm] adding admin1 exceptions to the country polygons 2016-10-04 18:33:52 -04:00
Al
ad6ddd1ede [fix] var names 2016-10-04 14:35:45 -04:00
Al
990fdff473 [coordinates] adding to_valid_latitude to bound 90 and -90 degrees 2016-10-04 02:58:05 -04:00
Al
5900f4bec9 [geoplanet] adding place name fixes for MT, IE, GU, VI, OM, LI, YT, BH, SM, ZM, AD, MP, WF, MH, AS, PM, and UM 2016-10-04 01:44:25 -04:00
Al
1986b71b8a [geoplanet] adding place name fixes for EE, SK, BD, MD, DK, GR, BE, IL, HR, CL, MX, EC, TH, NP, MK, MA, VE, SI, GT, PY, LK, HN, SV, KR, MC, PR, CR, PS, ME, FO, ET, MG, GW, SG, GN, NE, SZ, PF, KG, TM, BN, NC, MQ, GL 2016-10-03 21:41:04 -04:00
Al
adeedef39e [fix] import 2016-10-01 01:19:36 -04:00