Commit Graph

559 Commits

Author SHA1 Message Date
Al
72ee2e00ae [osm] Moving OSM boundaries to YAML files instead of JSON for consistency 2016-07-21 17:04:57 -04:00
Al
6a03b0376c [osm/polygons] Using greater simplify tolerance 2016-07-21 17:04:57 -04:00
Al
ae62471d32 [fix] simplify_polygons in building geocoder, and adding caching back to OSM admin polygons as it's faster when taking into account startup time. Also adding a few properties to buildings and landuse polygons 2016-07-21 17:04:57 -04:00
Al
1f52f8ddcc [osm/polygons] Same check for closed ways as for relations in OSM polygon readers 2016-07-21 17:04:57 -04:00
Al
26ada5cdbb [osm/polygons] From benchmarking it seems to make sense to keep OSM polygons in memory after all 2016-07-21 17:04:57 -04:00
Al
f76a78120d [fix] properties/polygon key split 2016-07-21 17:04:57 -04:00
Al
d460e2abe9 [osm/polygons] Trying persistent polygons again on OSM/Quattroshapes to test the new settings 2016-07-21 17:04:57 -04:00
Al
171a85bdff [osm/polygons] Storing polygon JSON under a different key so it doesn't have to be read from disk after a successful cache matched point-in-polygon test just to retrieve the properties 2016-07-21 17:04:57 -04:00
Al
67a3ee8e2a [fix] var name 2016-07-21 17:04:57 -04:00
Al
58f075f2ea [fix] classmethod for loading polygons 2016-07-21 17:04:57 -04:00
Al
9755d2cee9 [osm/polygons] Keep OSM/Quattroshapes admin polygons in memory as there are fewer of them and they are large 2016-07-21 17:04:57 -04:00
Al
f6b88ba456 [fix] double prep 2016-07-21 17:04:57 -04:00
Al
941ab39a6a [fix] return_all in polygon index 2016-07-21 17:04:57 -04:00
Al
7b82af5526 [osm/polygons] Keep stats on cache hits/misses for testing cache sizes 2016-07-21 17:04:57 -04:00
Al
499a20cb36 [osm/polygons] Using an LRU cache for prepped polygons in the various PolygonIndex subclasses. That way can store less simplified polygons but keep frequently accessed ones (like countries) in memory 2016-07-21 17:04:57 -04:00
Al
a84047b567 [fix] name 2016-07-21 17:04:57 -04:00
Al
57c3e0ddd4 [fix] import 2016-07-21 17:04:57 -04:00
Al
0e58f24172 [fix] arg name 2016-07-21 17:04:57 -04:00
Al
2f862ca0ec [osm] Adding place=plot to subdivisions data set 2016-07-21 17:04:57 -04:00
Al
6d1352334e [fix] command for subdivision polys 2016-07-21 17:04:57 -04:00
Al
fe7cc0a937 [fix] import 2016-07-21 17:04:57 -04:00
Al
142bc293bb [fix] var scope 2016-07-21 17:04:57 -04:00
Al
70effea0f7 [fix] Simplify OSM polygons but using the new threshold 2016-07-21 17:04:57 -04:00
Al
4e17ef6f91 [osm] Storing polygon properties in a LevelDB, polygons themselves stay in memory 2016-07-21 17:04:57 -04:00
Al
8db7f139ba [osm] Adding building polygon reader, including closed ways for admin polys 2016-07-21 17:04:57 -04:00
Al
12a688df36 [osm] Splitting out generic amenities like ATM, fuel, restrooms, etc. so they can be used in category queries. Adding subdivision polygons, postcode polygons, building polygons, adding a few types of place keys to venues data set 2016-07-21 17:04:57 -04:00
Al
fc689222da [osm] adding civil boundaries (e.g. postal areas in Dublin), fixing output files 2016-07-21 17:04:57 -04:00
Al
492b6ee235 [categories] Using TSV files instead of YAML for category queries, easier to edit 2016-07-21 17:04:57 -04:00
Al
f3a9f4a257 [fix] removing init_gazetteers, doing it at the module level 2016-07-21 17:04:57 -04:00
Al
0162194dbc [dictionaries] Adding dictionary type enums to the generator script 2016-07-21 17:04:57 -04:00
Al
5d19aacb25 [categories] Keeping keys sorted in generated YAML files, ignoring Interlingua queries 2016-07-21 17:04:57 -04:00
Al
e65711f6fa [fix] changing extension to .yaml 2016-07-21 17:04:57 -04:00
Al
3cd32584c6 [categories] Moving category configs to YAML files 2016-07-21 17:04:57 -04:00
Al
2b4a9f0962 [osm] Splitting category queries data into several files (amenities, buildings, natural features, waterways) 2016-07-21 17:04:57 -04:00
Al
b25682e761 [polygons/zones] Adding a polygon reader for OSM zones (named residential/commercial/industrial/military areas) which are closed ways and can be used in addresses e.g. in office parks, larger housing complexes, etc. 2016-07-21 17:04:57 -04:00
Al
9ee1f56a0f [categories] documentation of Nominatim special phrases scraper 2016-07-21 17:04:57 -04:00
Al
ac18e383bd [osm] Building OSM file for deriving category queries, zone data for including the names of residential, commercial and industrial areas in the parser. Named landuse and historic features are considered valid places/venues. 2016-07-21 17:04:57 -04:00
Al
af73bb300d [fix] Adding islands to admin borders 2016-07-21 17:04:57 -04:00
Al
5e2d9f371e [numex] Moving numex script to a different subpackage, adding function for creating ordinals 2016-07-21 17:04:57 -04:00
Al
e6b59980e7 [categories] Scraper for Nominatim Special Phrases, translated into a number of languages 2016-07-21 17:04:57 -04:00
Al
1bc92d6995 [fix] output path in numex.py 2016-03-29 11:25:36 -04:00
Al
2a2d1738a3 [fix] path for running numex.py 2016-03-29 11:15:24 -04:00
Al
7696179843 [osm] Removing generic amenities like ATMs, parking, restrooms, etc. from addresses but keeping them in venues to support generic queries 2016-03-14 01:07:03 -04:00
Al
18e2c7519e [fix] Absolute dir check in generating expansion data files 2016-03-13 23:23:46 -04:00
Al
c5498c6c0c [osm] Incorporating airports, and only including certain values for tourism= and leisure= since not all are physical place types, adding building= to addresses 2016-03-12 15:02:31 -05:00
Al Barrentine
942e5df1b9 Merge pull request #40 from thatdatabaseguy/master
Including landmarks + more venues in OSM training data
2016-03-11 16:47:11 -05:00
Al
7a24ced43c [fix] longitude validation 2016-03-11 16:35:33 -05:00
Al
99f452c7b1 [geo] Validate lat/lon in latlon_to_decimal 2016-03-11 16:18:31 -05:00
Al
a2f186a0ee [geo] Adding lat/lon validation functions for the training scripts 2016-03-11 14:09:10 -05:00
Al
f7d6943994 [fix] no comma in download_quattroshapes filenames 2016-03-10 23:40:54 -05:00