Commit Graph

109 Commits

Author SHA1 Message Date
Al
c7df3fcb3a [osm] Adding a list of various OSM name tags obtained from Nominatim 2015-10-29 11:44:56 -04:00
Al
da53d7ebac [osm] Adding an OSM neighborhoods/suburbs data set for matching with Quattroshapes boundaries, updating definitions for admin boundaries 2015-10-22 11:37:11 -04:00
Al
6478e65a06 [osm] Moving Wikipedia title normalization to osm.extract 2015-10-22 11:35:38 -04:00
Al
6f6d04966b [fix] role in OSM polygon extraction 2015-10-21 16:35:25 -04:00
Al
1e8e592e0b [fix] import 2015-10-19 23:30:12 -04:00
Al
5187e6073a [fix] admin boundary imports 2015-10-19 17:14:48 -04:00
Al
8609ccbb1d [polygons/osm] lon, lat 2015-10-19 15:40:43 -04:00
Al
ef94f1b712 [doc] Adding some comments to fetch_osm_address_data.sh 2015-10-19 15:39:31 -04:00
Al
83295b1b34 [polygons/osm] Adding in-memory OSM reverse geocoder for all admin boundaries 2015-10-19 15:38:23 -04:00
Al
4a3994c65e [polygons/osm] Construct polygons from OSM relations using a number of space-saving optimizations in order to process planet in a reasonable amount of memory. Builds a graph of connected ways such that forming polygons is equivalent to finding strongly connected components. 2015-10-18 20:53:49 -04:00
Al
ade0e2dc1f [osm] Adding final .osm file variable for borders output 2015-10-16 00:46:40 -04:00
Al
b5f8b696bf [osm] Moving parse_osm to a separate module, adding option to list dependencies 2015-10-15 20:22:12 -04:00
Al
ca629e295d [osm] Adding admin boundaries filter in OSM data 2015-10-15 12:06:11 -04:00
Al
cfa57c96a3 [fix] untagged formatted addresses 2015-10-04 02:02:59 -04:00
Al
5d2a24872a [osm] Adding dependencies so single street names are not valid without at least one of {house, number, suburb, city, postcode} 2015-10-03 15:22:26 -04:00
Al
77be2fe433 [osm] Adjusting priors for country code expansion 2015-10-03 15:13:16 -04:00
Al
0b98a26426 [fix] keeping name tag in address components 2015-10-03 15:10:14 -04:00
Al
0f9ad259dc [osm] Doing initial formatting after replacing country/state 2015-10-03 14:40:38 -04:00
Al
71233c9c02 [fix] import, initialization 2015-10-03 14:37:08 -04:00
Al
1948aa87ea [fix] typo 2015-10-03 14:33:45 -04:00
Al
22efce7337 [osm/parsing] Randomly replacing country codes with local and foreign language expansions as well as randomly expanding state abbreviations to make parser more robust to different input 2015-10-03 14:31:51 -04:00
Al
db71b65412 [fix] checking validity of component combination 2015-10-02 20:28:45 -04:00
Al
a2fd6e25f8 [fix] import 2015-10-02 20:25:48 -04:00
Al
49abb70b59 [fix] dictionary 2015-10-02 20:24:21 -04:00
Al
521f33d892 [fix] bitset for address components, only looking at valid component keys 2015-10-02 20:21:59 -04:00
Al
528285f735 [fix] only OSM tagged addresses need extra logic 2015-10-02 20:18:30 -04:00
Al
83aecb9f2c [osm/parsing] Making tagged training data for address parser more robust to the types of partial input we see in geocoding by randomly eliminating components subject to some constraints (e.g. house number cannot be used without a street name) 2015-10-02 19:54:28 -04:00
Al
ca25b48687 [fix] Not writing empty fields in formatted addresses 2015-09-22 08:13:55 -04:00
Al
134cf616d6 [osm] Using street for language disambiguation in training data 2015-09-21 04:09:15 -04:00
Al
84cf21df88 [osm] Separating address formatter into its own module, adding some documentation of the various training sets with examples 2015-09-20 20:05:46 -04:00
Al
6731395ca0 [osm] Separating tagged from untagged output 2015-09-19 14:11:47 -04:00
Al
b85fe50fad [osm] Training data for toponyms only cares about valid languages for name field 2015-09-08 16:38:05 -07:00
Al
e566063343 [osm] Doing an all-to-nodes conversion and an additional filter on the borders data set 2015-09-08 09:18:08 -07:00
Al
8525529968 [osm] Not requiring qualified name tags to process OSM toponyms 2015-09-06 21:03:01 -07:00
Al
df20e2cbc0 [osm] Including toponyms in the training data for countries where the unqualified place names can be assumed to be examples of a given language 2015-09-04 14:13:33 -04:00
Al
17fcfa8b59 [fix] adding house to ignore keys rather than aliasing it 2015-09-04 12:40:08 -04:00
Al
d64a27bc57 [osm] Converting relations to nodes in borders training data 2015-09-04 12:32:25 -04:00
Al
168b7f59da [fix] default indices in strip_component 2015-09-04 12:29:47 -04:00
Al
64db63e3eb [osm] Removing house tag 2015-09-04 12:23:47 -04:00
Al
4ebdca0ea7 [fix] var 2015-09-03 21:01:20 -04:00
Al
8345afbcd0 [fix] exclude country toponyms where the default languages is well represented 2015-09-03 20:56:58 -04:00
Al
20bb191624 [fix] chaining 2015-09-03 20:52:00 -04:00
Al
e7cf5000fe [fix] Exclude polygons with > 1 regional language 2015-09-03 20:48:04 -04:00
Al
9a9530c1b9 [fix] unqualified names 2015-09-03 20:37:22 -04:00
Al
a5fdd911d8 [fix] only use name key for default names 2015-09-03 20:35:08 -04:00
Al
d8e1432533 [osm] Adding unqualified names in single-language countries 2015-09-03 20:31:49 -04:00
Al
b15d2d70aa [fix] top language 2015-09-03 20:09:46 -04:00
Al
44bf94a158 [osm] Better borders training data set (only need the metadata, not the polygons) 2015-09-03 20:09:03 -04:00
Al
55af9b0a0c [fix] OSM address tagged training data formatting 2015-09-03 18:35:19 -04:00
Al
c6bfc0e021 [osm] Postponing punctuation stripping until after address template rendering 2015-09-03 18:13:41 -04:00