Commit Graph

1632 Commits

Author SHA1 Message Date
Ed Chalstrey
709be9ef70 separate python step since memory failiure is possible 2022-04-14 09:28:34 +01:00
Ed Chalstrey
08d4610336 remove index not needed 2022-04-14 09:28:34 +01:00
Ed Chalstrey
d100f12991 add coordinates step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
96707f1d73 spelling 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7faf79aa9e create new csv instead of using old 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0e3c754075 switch to cython 2022-04-14 09:28:34 +01:00
Ed Chalstrey
5e89bc9dac add conversion to latlon step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c1e51531f7 update instructions for python 2022-04-14 09:28:34 +01:00
Ed Chalstrey
6593f9d249 add python script to convert to lat lon 2022-04-14 09:28:34 +01:00
Ed Chalstrey
faa6ddbe4d add creation of the_geom column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
239b1db0f0 add missing column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
22f3773632 create load coordinates script 2022-04-14 09:28:34 +01:00
Ed Chalstrey
9242b22bb5 add OS TOID download info 2022-04-14 09:28:34 +01:00
Ed Chalstrey
75e6382897 load new geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
a4771eaac0
Merge pull request #798 from colouring-cities/os-data-loading
Document & test Ordnance Survey data loading
2022-04-13 13:28:06 +01:00
Ed Chalstrey
a635655995 explain "ETL" 2022-04-01 11:23:24 +01:00
Ed Chalstrey
667110537f clarify 2022-04-01 10:50:34 +01:00
Ed Chalstrey
efc49bd2b9 fix link 2022-04-01 10:37:56 +01:00
Ed Chalstrey
aba46dc95d add contents 2022-04-01 10:32:53 +01:00
Ed Chalstrey
647d75abb4 update gitignore 2022-04-01 10:21:58 +01:00
Ed Chalstrey
b470591420 rearrange sections 2022-04-01 10:20:18 +01:00
Ed Chalstrey
a3d2537e22 Revert "create script to load new geometries"
This reverts commit d6ca8852d4.
2022-04-01 10:05:11 +01:00
Ed Chalstrey
d6ca8852d4 create script to load new geometries 2022-03-31 16:27:36 +01:00
Ed Chalstrey
5b2029a4e3 remove bad comments 2022-03-31 15:42:06 +01:00
Ed Chalstrey
57e655b482 fix link 2022-03-29 16:56:58 +01:00
Ed Chalstrey
a8e6dc0b09 add new header on db creation 2022-03-29 16:55:40 +01:00
Ed Chalstrey
ea76ad0288 clarify 2022-03-29 16:50:31 +01:00
Ed Chalstrey
8227320b9d move python instructions specific to test data 2022-03-29 16:48:15 +01:00
Ed Chalstrey
7bd78bf03a fix filtering script 2022-03-29 15:41:00 +01:00
Ed Chalstrey
2163dc5812 add echos to load geometries 2022-03-29 14:48:27 +01:00
Ed Chalstrey
0e01971b4a add echos to extraction step 2022-03-29 14:46:18 +01:00
Ed Chalstrey
4a8d79a54a add echos to filtration step 2022-03-29 14:42:34 +01:00
Ed Chalstrey
3f07a9b081 remove print statement 2022-03-29 14:37:42 +01:00
Ed Chalstrey
f1946ea35b flake8 2022-03-29 10:33:47 +01:00
Ed Chalstrey
f49e378fe3 fix filter_mastermap 2022-03-29 10:32:13 +01:00
Ed Chalstrey
7297354f5b update test that so that it fails 2022-03-29 10:12:31 +01:00
Ed Chalstrey
6602fc916a comment out step temporarily 2022-03-28 15:23:40 +01:00
Ed Chalstrey
4cd14ffd77 remove sudo 2022-03-28 15:22:04 +01:00
Ed Chalstrey
c85b321a60 revert changes to env vars 2022-03-28 15:06:23 +01:00
Ed Chalstrey
7bffa44502 use env vars properly? 2022-03-28 14:42:29 +01:00
Tom Russell
98ce36b287
Add direct link to "blog" category in forum 2022-03-28 14:23:06 +01:00
Ed Chalstrey
bb964f55c9 add sudo 2022-03-28 14:18:10 +01:00
Ed Chalstrey
405f9558ad gather stored vars for postgres 2022-03-28 14:17:55 +01:00
Ed Chalstrey
da89c9b63b clarify comment 2022-03-28 14:02:47 +01:00
Ed Chalstrey
5f9aaf7f0b tidy 2022-03-28 13:54:00 +01:00
Ed Chalstrey
d060ebf4bb add comment 2022-03-28 13:42:08 +01:00
Ed Chalstrey
d7b4f9eeb5 only convert gml files with 5690395 to csv 2022-03-24 11:41:56 +00:00
Ed Chalstrey
8398bcea3a remove python environment not needed 2022-03-24 09:51:41 +00:00
Ed Chalstrey
cf30f71d0a remove bad comments 2022-03-18 16:52:41 +00:00
Ed Chalstrey
27623cf3d4 update filter step explanation 2022-03-18 16:49:46 +00:00