Commit Graph

376 Commits

Author SHA1 Message Date
Al
04183c672e [fix] non-integer admin levels 2015-11-22 18:33:27 -05:00
Al
7ee8045a0f [fix] comparison 2015-11-22 18:27:05 -05:00
Al
efa0e38e45 [fix] another issue with tokenize API 2015-11-22 18:08:45 -05:00
Al
ce065bb9ec [fix] using new pypostal tokenize API 2015-11-22 18:01:07 -05:00
Al
71afcafe11 [fix] key names 2015-11-22 17:46:56 -05:00
Al
f77ddc71e7 [fix] reverting to old Rtree index filename 2015-11-22 17:25:51 -05:00
Al
ee482e7a07 [fix] import 2015-11-22 16:04:50 -05:00
Al
ee75ffccd5 [fix] import 2015-11-22 15:51:13 -05:00
Al
c6f531ca95 [fix] arguments 2015-11-22 15:35:25 -05:00
Al
c851cf2547 [fix] OSM R-tree 2015-11-22 15:24:35 -05:00
Al
d3703ce6b4 [fix] var name 2015-11-22 14:27:25 -05:00
Al
5b6fbd66e0 [fix] arg 2015-11-22 14:24:05 -05:00
Al
422ea668d8 [fix] import 2015-11-22 14:23:09 -05:00
Al
4f0d6fbf79 [fix] default arg again 2015-11-22 14:22:09 -05:00
Al
4cc275e313 [fix] doc and default arg 2015-11-22 14:21:20 -05:00
Al
c8f47b38a2 [osm/formatting] Adding OSM polygon lookups and neighborhood polygon lookups to the training data in order to provide more variations for the model to work with 2015-11-21 17:05:35 -05:00
Al
9fc60600dd [fix] OSM reverse geocoder polygon ordering 2015-11-20 14:49:37 -05:00
Al
130518fe58 [polygons] OSM reverse geocoder sort levels 2015-11-20 13:52:30 -05:00
Al
b948a8ebd8 [osm] Adding global keys which map to OSM address components 2015-11-20 12:48:54 -05:00
Al
85667997cd [formatting] Adding city_district and state_district tags to address formatting templates where it makes sense. These will not be in all addresses, tags can be added and removed from the training data with certain probabilities 2015-11-20 12:24:51 -05:00
Al
946bce1cb9 [osm] Adding a few more boundary types to planet admin borders 2015-11-17 11:40:42 -05:00
Al
b3ef8ded12 [formatting] Adding OSM address components lookup by country 2015-11-17 11:39:39 -05:00
Al
0b74039a6a [formatting] Adding city_district as a separate format tag 2015-11-17 11:38:38 -05:00
Al
48a305c8c4 [fix] Reverting last two changes, have to fix on the OSM side 2015-11-01 16:23:41 -05:00
Al
90773294b9 [polygons] Only fixing polygons in cases with inner rings 2015-11-01 12:36:35 -05:00
Al
477300c061 [polygons] Eliminating fix_polygon 2015-11-01 03:12:58 -05:00
Al
aba2c51e65 [fix] name 2015-11-01 01:35:01 -04:00
Al
1dbfc6a87b [polygons/neighborhoods] Not counting local admin polys unless they match OSM, fix for Paris arrondissements 2015-11-01 01:24:43 -04:00
Al
4fdaef2638 [fix] Don't need Quattroshapes dir for OSM Rtree 2015-10-31 19:08:04 -04:00
Al
e9a6ea1d72 [fix] default index path 2015-10-31 18:47:24 -04:00
Al
4a35c50f92 [fix] index paths 2015-10-31 18:30:53 -04:00
Al
c54fb412a3 [fix] save_index 2015-10-31 17:59:44 -04:00
Al
0227d9335f [fix] Removing some debug code 2015-10-31 14:50:32 -04:00
Al
5882c2d64b [fix] command-line arg II 2015-10-31 14:25:17 -04:00
Al
66f8a2dc9e [fix] command-line arg 2015-10-31 14:24:23 -04:00
Al
e5d8812504 [fix] argument default 2015-10-31 14:23:37 -04:00
Al
f39090869e [fix] imports 2015-10-31 14:22:45 -04:00
Al
8166cd66c8 [fix] encoding yet again 2015-10-31 14:19:50 -04:00
Al
f473ff0dad [fix] encoding, different file 2015-10-31 14:18:47 -04:00
Al
a2eb40109c [fix] file encoding 2015-10-31 14:17:26 -04:00
Al
3e43ac7255 [polygons/osm] Adding a unified neighborhood reverse geocoder incorporating Zetashapes, OSM and Quattroshapes. Uses the new Soft TFIDF implementation to approximately match OSM names to Quattroshapes/Zetashapes names and geohash indices for more coarse point-in-polygon tests (OSM neighborhoods are stored as points not polygons, so need to match with a geometry from the other sources) 2015-10-31 14:15:39 -04:00
Al
a38624ba59 [similarity] Adding NameDeduper base class for deduping geographic names using the new Soft TFIDF similarity 2015-10-31 00:57:02 -04:00
Al
a5c1296044 [similarity] Adding Jaccard similarity with word frequencies instead of simple sets, better for ideographic scripts (Han, Hangul, etc.) in the absence of word segmentation since there may be many high frequency characters 2015-10-30 14:35:38 -04:00
Al
cccc3e9cf5 [similarity] Using Soft-TFIDF for approximate name matching. Soft-TFIDF is a hybrid string distance metric which balances local token similarities (using Jaro-Winkler similarity by default) allowing for slight spelling errors with global TFIDF statistics so that very frequent words don't affect the score as much 2015-10-30 02:48:16 -04:00
Al
5076c0409b [similarity] Adding an in-memory IDF index for weighted similarities 2015-10-29 13:33:01 -04:00
Al
1c543a5271 [osm/formatting] Adding is_in tags to the address formatter as they're common in OSM, aliasing addr:district to state_district instead of suburb 2015-10-29 12:30:56 -04:00
Al
c7df3fcb3a [osm] Adding a list of various OSM name tags obtained from Nominatim 2015-10-29 11:44:56 -04:00
Al
bbd10e97bd [fix] imports 2015-10-28 21:32:09 -04:00
Al
110451d6d6 [polygons] Polygon area calculations 2015-10-28 21:19:35 -04:00
Al
e946e63222 [polygons] Changing language polygon index to use new index_polygon method 2015-10-28 21:18:27 -04:00