Commit Graph

575 Commits

Author SHA1 Message Date
Al
a93f110112 [fix] moving methods 2016-07-21 17:04:57 -04:00
Al
efd167323b [polygons/neighborhoods] refactoring Zetashapes download, adding in PediaCities polygons for NYC neighborhoods 2016-07-21 17:04:57 -04:00
Al
333bd7ef45 [polygons] refactoring methods for getting cached/non-cached polygons 2016-07-21 17:04:57 -04:00
Al
e4ff4a28b1 [polygons] Quattroshapes neighborhoods use regular in-memory polygons 2016-07-21 17:04:57 -04:00
Al
9dd5d5c210 [dictionaries] encapsulating reading address dictionaries so it's easy to implement sampling for the address training data 2016-07-21 17:04:57 -04:00
Al
23525df39d [numex] Nicer API for ordinal suffixes 2016-07-21 17:04:57 -04:00
Al
0f0af1f295 [osm/polygons] Adding properties in building polygons 2016-07-21 17:04:57 -04:00
Al
e24306701f [numex] Moving numex files to YAML as well 2016-07-21 17:04:57 -04:00
Al
76fc337d0e [osm/polygons] add building:part to building polygons 2016-07-21 17:04:57 -04:00
Al
72ee2e00ae [osm] Moving OSM boundaries to YAML files instead of JSON for consistency 2016-07-21 17:04:57 -04:00
Al
6a03b0376c [osm/polygons] Using greater simplify tolerance 2016-07-21 17:04:57 -04:00
Al
ae62471d32 [fix] simplify_polygons in building geocoder, and adding caching back to OSM admin polygons as it's faster when taking into account startup time. Also adding a few properties to buildings and landuse polygons 2016-07-21 17:04:57 -04:00
Al
1f52f8ddcc [osm/polygons] Same check for closed ways as for relations in OSM polygon readers 2016-07-21 17:04:57 -04:00
Al
26ada5cdbb [osm/polygons] From benchmarking it seems to make sense to keep OSM polygons in memory after all 2016-07-21 17:04:57 -04:00
Al
f76a78120d [fix] properties/polygon key split 2016-07-21 17:04:57 -04:00
Al
d460e2abe9 [osm/polygons] Trying persistent polygons again on OSM/Quattroshapes to test the new settings 2016-07-21 17:04:57 -04:00
Al
171a85bdff [osm/polygons] Storing polygon JSON under a different key so it doesn't have to be read from disk after a successful cache matched point-in-polygon test just to retrieve the properties 2016-07-21 17:04:57 -04:00
Al
67a3ee8e2a [fix] var name 2016-07-21 17:04:57 -04:00
Al
58f075f2ea [fix] classmethod for loading polygons 2016-07-21 17:04:57 -04:00
Al
9755d2cee9 [osm/polygons] Keep OSM/Quattroshapes admin polygons in memory as there are fewer of them and they are large 2016-07-21 17:04:57 -04:00
Al
f6b88ba456 [fix] double prep 2016-07-21 17:04:57 -04:00
Al
941ab39a6a [fix] return_all in polygon index 2016-07-21 17:04:57 -04:00
Al
7b82af5526 [osm/polygons] Keep stats on cache hits/misses for testing cache sizes 2016-07-21 17:04:57 -04:00
Al
bea2b879a7 [build] Adding lru-dict, a fast C LRU cache, to requirements.txt for geodata package 2016-07-21 17:04:57 -04:00
Al
499a20cb36 [osm/polygons] Using an LRU cache for prepped polygons in the various PolygonIndex subclasses. That way can store less simplified polygons but keep frequently accessed ones (like countries) in memory 2016-07-21 17:04:57 -04:00
Al
a84047b567 [fix] name 2016-07-21 17:04:57 -04:00
Al
57c3e0ddd4 [fix] import 2016-07-21 17:04:57 -04:00
Al
0e58f24172 [fix] arg name 2016-07-21 17:04:57 -04:00
Al
2f862ca0ec [osm] Adding place=plot to subdivisions data set 2016-07-21 17:04:57 -04:00
Al
6d1352334e [fix] command for subdivision polys 2016-07-21 17:04:57 -04:00
Al
fe7cc0a937 [fix] import 2016-07-21 17:04:57 -04:00
Al
142bc293bb [fix] var scope 2016-07-21 17:04:57 -04:00
Al
70effea0f7 [fix] Simplify OSM polygons but using the new threshold 2016-07-21 17:04:57 -04:00
Al
4e17ef6f91 [osm] Storing polygon properties in a LevelDB, polygons themselves stay in memory 2016-07-21 17:04:57 -04:00
Al
8db7f139ba [osm] Adding building polygon reader, including closed ways for admin polys 2016-07-21 17:04:57 -04:00
Al
7990e15661 [requirements] Adding LevelDB to requirements 2016-07-21 17:04:57 -04:00
Al
12a688df36 [osm] Splitting out generic amenities like ATM, fuel, restrooms, etc. so they can be used in category queries. Adding subdivision polygons, postcode polygons, building polygons, adding a few types of place keys to venues data set 2016-07-21 17:04:57 -04:00
Al
fc689222da [osm] adding civil boundaries (e.g. postal areas in Dublin), fixing output files 2016-07-21 17:04:57 -04:00
Al
492b6ee235 [categories] Using TSV files instead of YAML for category queries, easier to edit 2016-07-21 17:04:57 -04:00
Al
f3a9f4a257 [fix] removing init_gazetteers, doing it at the module level 2016-07-21 17:04:57 -04:00
Al
0162194dbc [dictionaries] Adding dictionary type enums to the generator script 2016-07-21 17:04:57 -04:00
Al
5d19aacb25 [categories] Keeping keys sorted in generated YAML files, ignoring Interlingua queries 2016-07-21 17:04:57 -04:00
Al
e65711f6fa [fix] changing extension to .yaml 2016-07-21 17:04:57 -04:00
Al
a1a4c5ff7c [build] Moving dependencies for scripts into a requirements.txt 2016-07-21 17:04:57 -04:00
Al
3cd32584c6 [categories] Moving category configs to YAML files 2016-07-21 17:04:57 -04:00
Al
2b4a9f0962 [osm] Splitting category queries data into several files (amenities, buildings, natural features, waterways) 2016-07-21 17:04:57 -04:00
Al
b25682e761 [polygons/zones] Adding a polygon reader for OSM zones (named residential/commercial/industrial/military areas) which are closed ways and can be used in addresses e.g. in office parks, larger housing complexes, etc. 2016-07-21 17:04:57 -04:00
Al
9ee1f56a0f [categories] documentation of Nominatim special phrases scraper 2016-07-21 17:04:57 -04:00
Al
ac18e383bd [osm] Building OSM file for deriving category queries, zone data for including the names of residential, commercial and industrial areas in the parser. Named landuse and historic features are considered valid places/venues. 2016-07-21 17:04:57 -04:00
Al
af73bb300d [fix] Adding islands to admin borders 2016-07-21 17:04:57 -04:00