ca5bcba85e[osm] set -e so script errors out if anything fails and add --quiet to wget for I/O redirection purposes
Al
2016-09-22 00:52:00 -04:00
c8cabb3dff[openaddresses] adding City of Oakville, ON
Al
2016-09-22 00:46:09 -04:00
320760f511[openaddresses] adding Galveston, TX
Al
2016-09-20 02:52:58 -04:00
fa12d36923[openaddresses] adding Marion County, OR
Al
2016-09-19 23:49:14 -04:00
eb0fe4a7ac[openaddresses] adding Warren County, KY
Al
2016-09-19 23:44:26 -04:00
764a74fae4[osm] overwrite downloaded files
Al
2016-09-19 03:21:37 -04:00
c3afcdfce5[osm] expanding criteria for the buildings data set (buildlings with addr:housenumber, addr:housename, addr:street, or addr:postcode are useful)
Al
2016-09-19 03:14:58 -04:00
c294326679[openaddresses] adding newly adjusted sources from PA/MN
Al
2016-09-17 00:01:14 -04:00
953daa6920[boundaries] updates to Taiwan boundaries
Al
2016-09-16 19:20:43 -04:00
d667039397[openaddresses] for configs with add_osm_boundaries=true, skip adding boundary fields from the OA file altogether when they're specified
Al
2016-09-16 01:55:36 -04:00
95cf6ad0fa[fix] default again
Al
2016-09-16 01:11:59 -04:00
d5a5104de9[fix] default
Al
2016-09-16 01:10:19 -04:00
32ad1d7bd0[fix] var name
Al
2016-09-16 01:07:10 -04:00
b618d1eaf2[fix] var name
Al
2016-09-16 01:02:47 -04:00
d43d14a34d[parser] adding state_district as one of the possible contexts for venue name (name + county could be fine as an address in some places)
Al
2016-09-16 01:01:00 -04:00
263a173d5e[boundaries] adding exceptions for a few cities in England that have designation=non_metropolitan_district
Al
2016-09-16 00:58:54 -04:00
fed3ab0741[openaddresses] typo in Honolulu
Al
2016-09-16 00:58:12 -04:00
fe12445f55[openaddresses] adding Elko County, NV
Al
2016-09-15 15:38:12 -04:00
c5977c2ad4[openaddresses] adding Westchester county (NY postcodes FTW\!)
Al
2016-09-15 15:37:51 -04:00
2e4033f527[openaddresses] use ISO 3166 alpha 2 code for PR most of the time (again mimics US state)
Al
2016-09-15 15:36:52 -04:00
0e55ad7e3a[boundaries] Changing admin_level=6 in Spain to state_district
Al
2016-09-15 13:48:40 -04:00
e963d06370[formatting] Puerto Rico template insertions, put country before postcode most of the time (often written like a US state)
Al
2016-09-15 13:18:25 -04:00
22d5f85cc7[openaddresses] adding Ketchikan Borough, AK, USA
Al
2016-09-15 13:16:56 -04:00
1cec0570d6[formatting] only using alias country insertions if the given country has not defined its own (e.g. look at Puerto Rico first, then use the US if there's nothing defined)
Al
2016-09-15 11:45:46 -04:00
9b250a9393[openaddresses] adding zero-padding option for postcodes and using in Puerto Rico
Al
2016-09-15 11:22:55 -04:00
260aedc9d3[geoplanet] Script to download GeoPlanet directly and load into a SQLite db for extracting the postal codes (admin areas need cleanupi in a number of countries, that's next)
Al
2016-09-14 14:29:05 -04:00
d9a81f767c[boundaries] mapping sub-regiao to state_district in Portugal
Al
2016-09-14 13:36:52 -04:00
b70c140a00[fix] casing in state abbreviaitons dictionary
Al
2016-09-13 21:56:19 -04:00
c9c1d912b0[dictionaries] removing spaces in the Japanese dictionaries
Al
2016-09-12 22:21:27 -04:00
14c20091f4[fix] abbreviations in hyphenated phrases like Saint-Germaine. Hyphenation should use the phrase length not the token length
Al
2016-09-12 20:56:35 -04:00
0f8e7cd9dc[boundaries] adding exception for the direct-controlled municipalities in China (Shanghai, Beijing, Tianjin and Chongqing) to be treated as city instead of state. These will use the admin_centre properties 60% of the time, relation propreties 40% of the time
Al
2016-09-12 18:46:08 -04:00
5bd2fac514[openaddresses] CITY => city_district in distrito-federal (Mexico City), add OSM boundaries to pick up Ciudad de México
Al
2016-09-12 18:24:28 -04:00
62a5f6002d[geonames] adding query method to GeoNamesDB
Al
2016-09-12 16:42:42 -04:00
e8408d39fd[fix] unzip_file checks status code
Al
2016-09-12 16:42:02 -04:00
23c9fbe3fb[wof] don't need to crawl for admin data now that whosonfirst-data is separate from venues, etc.
Al
2016-09-12 13:52:49 -04:00
2057536bd9[requirements] adding boto3 and gevent to requirements.txt for geodata package
Al
2016-09-12 04:06:49 -04:00
6fd43a1f20[wof] script to download all the WoF postal code repos and their dependencies
Al
2016-09-12 04:03:41 -04:00
d41905aa18[wof] geven-based hierarchy crawler for WoF
Al
2016-09-12 04:03:02 -04:00
45338b43b5[wof] adding basic WhosOnFirst client for interaction with S3, downloading by ID, etc.
Al
2016-09-12 03:56:27 -04:00
eaacf55f42[boundaries] exceptions for city_district and barrios in Buenos Aires and Rosario in Argentina
Al
2016-09-12 02:57:49 -04:00
55e9ab1978[places] adding world_region tag and adding the phrase West Indies with small random probability for English-speaking Caribbean nations. Ref: #113
Al
2016-09-11 21:54:47 -04:00
069e4c348c[openaddresses] adding a few US counties from the latest PR
Al
2016-09-11 16:19:39 -04:00
917493834d[dictionaries] removing R as an abbreviation for river, can re-add it in a street name only dictionary if needed, but don't want to abbreviate towns with River in the name simply to R
Al
2016-09-10 16:19:28 -04:00
551cce8cb1[fix] making a separate gazetteer for toponym abbreviations
Al
2016-09-10 01:08:58 -04:00
bcde9e2fe7[fix] toponym abbreviations after country name, may want to use it
Al
2016-09-10 00:49:31 -04:00
bbc5131cb6[fix] toponym abbreviations
Al
2016-09-10 00:48:31 -04:00
19a044f7f3[fix] imports
Al
2016-09-10 00:09:11 -04:00
ae02b0769d[openaddresses] abbreviating boundary components for OpenAddresses
Al
2016-09-10 00:04:11 -04:00
604e898d65[fix] using toponym_gazetteer in OSM boundary abbreviations
Al
2016-09-10 00:02:59 -04:00
8e86b5caf7[addresses] reverting AUS probabilties
Al
2016-09-09 23:39:07 -04:00
543d2335b7[addresses] alternatives
Al
2016-09-09 23:17:15 -04:00
5d26ab41e7[openaddresses] removing OpenAddresses hacks now that upstream changes are merged
Al
2016-09-09 09:40:45 -04:00
9cdcd7f21a[fix] indentation
Al
2016-09-09 08:59:50 -04:00
a14202fc7a[fix] default value
Al
2016-09-09 01:46:03 -04:00
85ad3bf0f4[formatting] allowing a non-default option for components that can be inserted between road and house number
Al
2016-09-09 01:38:39 -04:00
4c6bcda3b2[fix] config
Al
2016-09-08 15:21:19 -04:00
d1e3c6a24a[openaddresses] adding Italy countrywide to a pre_release_downloads set so it can be used in libpostal without having been merged yet
Al
2016-09-08 15:13:25 -04:00
0edbe5a593[formatting] don't allow insertions between house number and road name
Al
2016-09-08 13:43:18 -04:00
a329503155[formatting] adding structural exceptions for house_number before road in continental Europe (and house_number after road in France). Ref: https://github.com/pelias/api/pull/655
Al
2016-09-08 12:10:57 -04:00
170e8d74d8[fix] checking for components
Al
2016-09-08 03:19:10 -04:00
769a65b808[openaddresses] adding place-only and place+postcode probability to OpenAddresses to capture more place names not in OSM as standalone queries
Al
2016-09-08 03:17:21 -04:00
6ffd697d7e[places] using probability 1.0 for cities in the places config. Can do full dropouts of place components separately
Al
2016-09-07 17:22:00 -04:00
6543afaaa3[utils] checking for 200 from download_file
Al
2016-09-07 14:13:42 -04:00
317e4caca9[fix] only percent quote the filename
Al
2016-09-07 13:55:34 -04:00
f061d4239b[fix] quote, not urlencode
Al
2016-09-07 13:51:08 -04:00
5c915855c9[fix] urlencode
Al
2016-09-07 13:48:39 -04:00
62c8fa9048[fix] encoding III
Al
2016-09-07 13:39:38 -04:00
6e5908385a[fix] encoding again
Al
2016-09-07 13:34:04 -04:00
3bc122f7a0[fix] encoding
Al
2016-09-07 13:28:18 -04:00
cb3fe5273a[components] using gnis:class=Populated Place to map to city for the US when admin_level is not specified and the place key is not specified/not mapped
Al
2016-09-07 11:49:39 -04:00
88be23c85b[boundaries] adding borough mapping to Mexico as it's used for Mexico City
Al
2016-09-07 11:25:06 -04:00
ec24c4b6ac[boundaries] removing the place=borough mapping because it's used on the east coast and PA to mean city
Al
2016-09-07 11:24:37 -04:00
978c436071[boundaries] added Kingston, Jamaica as an admin_centre in OSM for Kingston and St Andrew Corporation in Jamaica. Overriding with a 0.9 probability so the full name of the combined parish gets used (as "state") some of the time, but mostly just stands in as a city boundary for Kingston
Al
2016-09-06 15:27:09 -04:00
6ff643f5a9[addresses] adding "Lot" with more probability in the default/residential zone for English. Increasing sampling probabilities for AU/NZ
Al
2016-09-06 01:21:51 -04:00
7bcf29cb69[openaddresses] adding Cape Town for city since it's not quite in OSM as such
Al
2016-09-03 12:37:33 -04:00
7e7ee7462a[fix] dutch house number formatting, strip spaces
Al
2016-09-02 14:47:52 -04:00
95384e5a2c[openaddresses adding hack for Honolulu until join function can handle null in OpenAddresses
Al
2016-09-02 14:29:40 -04:00
eab8765ac8[openaddresses] adding Honolulu
Al
2016-09-02 14:28:53 -04:00
4e9f88594b[fix] /safe_encode/safe_decode/
Al
2016-09-02 13:50:48 -04:00
8fd69b5e4a[fix] args
Al
2016-09-02 12:03:24 -04:00
df8e781e02[openaddresses] adding hack for Italy until machine's join function handles null fields
Al
2016-09-02 12:01:04 -04:00
f9a96b3b95[addresses] adding interno to Italian config
Al
2016-09-02 11:46:19 -04:00
a2671955a0[fix] /json/csv/
Al
2016-09-02 11:29:32 -04:00
5957f45f40[fix] strings
Al
2016-09-02 05:00:39 -04:00
4ab749d962[fix] format_address with minimal_only=False
Al
2016-09-02 04:59:03 -04:00
d70662e6d7[fix] postcodes
Al
2016-09-02 04:42:34 -04:00
188dc51fc6[openaddresses] adding in Reno County, KS after the last update to OpenAddresses
Al
2016-09-02 04:21:27 -04:00
bb1c071623[fix] config move
Al
2016-09-02 04:16:59 -04:00
552ebf2bcf[fix] var name
Al
2016-09-02 04:03:47 -04:00
832faf709f[openaddresses] adding a few of the fixed counties from the recent US update
Al
2016-09-02 03:59:30 -04:00
611bf2e2b9[openaddresses] adding Recife, Brasil
Al
2016-09-02 03:51:29 -04:00
a4a09fcb3e[openaddresses] don't allow postcodes that are all zeroes with a dash (Poland, US ZIP+4)
Al
2016-09-02 03:39:19 -04:00
3b15ae7c44[openaddresses] adding South Africa
Al
2016-09-02 03:35:08 -04:00
5e971dfd97[openaddresses] using OSM boundaries for the last few entries
Al
2016-09-02 03:26:15 -04:00
45c6e2e49c[openaddresses] adding Montevideo, Uruguay
Al
2016-09-02 03:24:53 -04:00
d4eeb6f95f[openaddresses] adding City of Dnipropetrovsk in the Ukraine
Al
2016-09-02 03:23:05 -04:00
4a41a56759[openaddresses] adding Slovakia
Al
2016-09-02 03:21:51 -04:00
04e3a03bab[openaddresses] adding Singapore
Al
2016-09-02 03:20:33 -04:00
c2d0136610[openaddresses] adding Poland
Al
2016-09-02 03:18:13 -04:00
3f7bfca1ad[openaddresses] allowing house numbers with slashes as well as number + specific fractions separated by space
Al
2016-09-02 02:53:26 -04:00