a_adli/colouring-montreal
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,996 Commits 3 Branches 0 Tags 30 MiB
4110d2624b
Commit Graph

216 Commits

Author SHA1 Message Date
Ed Chalstrey
0c86a72e5f notes 2022-04-14 09:28:34 +01:00
Ed Chalstrey
fa8723b30f fix sql 2022-04-14 09:28:34 +01:00
Ed Chalstrey
ae4eb1a925 fix sql mistake 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7f5c3506ec add lat/lon coords geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
e83419cc3b alt way to load geometries (untested) 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c42f5423b8 update pseudocode 2022-04-14 09:28:34 +01:00
Ed Chalstrey
5dc7ac9206 add update_building_records script pseudocode 2022-04-14 09:28:34 +01:00
Ed Chalstrey
ee59455dca dont delete open_toid table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
50f07b854b add hypothetical next scripts 2022-04-14 09:28:34 +01:00
Ed Chalstrey
2f1ebc89b2 spelling 2022-04-14 09:28:34 +01:00
Ed Chalstrey
37631b82f7 delete temp table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
52f045c404 fix missing table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
814203952a change column type 2022-04-14 09:28:34 +01:00
Ed Chalstrey
bc0aca8d56 doc fix 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7ed8d8defe add warning 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0048f0ae73 Updating the buildings table with coordinates SQL 2022-04-14 09:28:34 +01:00
Ed Chalstrey
66138855a3 find the converted csvs 2022-04-14 09:28:34 +01:00
Ed Chalstrey
709be9ef70 separate python step since memory failiure is possible 2022-04-14 09:28:34 +01:00
Ed Chalstrey
08d4610336 remove index not needed 2022-04-14 09:28:34 +01:00
Ed Chalstrey
d100f12991 add coordinates step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
96707f1d73 spelling 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7faf79aa9e create new csv instead of using old 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0e3c754075 switch to cython 2022-04-14 09:28:34 +01:00
Ed Chalstrey
5e89bc9dac add conversion to latlon step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c1e51531f7 update instructions for python 2022-04-14 09:28:34 +01:00
Ed Chalstrey
6593f9d249 add python script to convert to lat lon 2022-04-14 09:28:34 +01:00
Ed Chalstrey
faa6ddbe4d add creation of the_geom column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
239b1db0f0 add missing column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
22f3773632 create load coordinates script 2022-04-14 09:28:34 +01:00
Ed Chalstrey
9242b22bb5 add OS TOID download info 2022-04-14 09:28:34 +01:00
Ed Chalstrey
75e6382897 load new geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
a635655995 explain "ETL" 2022-04-01 11:23:24 +01:00
Ed Chalstrey
667110537f clarify 2022-04-01 10:50:34 +01:00
Ed Chalstrey
efc49bd2b9 fix link 2022-04-01 10:37:56 +01:00
Ed Chalstrey
aba46dc95d add contents 2022-04-01 10:32:53 +01:00
Ed Chalstrey
b470591420 rearrange sections 2022-04-01 10:20:18 +01:00
Ed Chalstrey
a3d2537e22 Revert "create script to load new geometries" 
This reverts commit d6ca8852d4.
 2022-04-01 10:05:11 +01:00
Ed Chalstrey
d6ca8852d4 create script to load new geometries 2022-03-31 16:27:36 +01:00
Ed Chalstrey
5b2029a4e3 remove bad comments 2022-03-31 15:42:06 +01:00
Ed Chalstrey
7bd78bf03a fix filtering script 2022-03-29 15:41:00 +01:00
Ed Chalstrey
2163dc5812 add echos to load geometries 2022-03-29 14:48:27 +01:00
Ed Chalstrey
0e01971b4a add echos to extraction step 2022-03-29 14:46:18 +01:00
Ed Chalstrey
4a8d79a54a add echos to filtration step 2022-03-29 14:42:34 +01:00
Ed Chalstrey
3f07a9b081 remove print statement 2022-03-29 14:37:42 +01:00
Ed Chalstrey
f1946ea35b flake8 2022-03-29 10:33:47 +01:00
Ed Chalstrey
f49e378fe3 fix filter_mastermap 2022-03-29 10:32:13 +01:00
Ed Chalstrey
6602fc916a comment out step temporarily 2022-03-28 15:23:40 +01:00
Ed Chalstrey
4cd14ffd77 remove sudo 2022-03-28 15:22:04 +01:00
Ed Chalstrey
c85b321a60 revert changes to env vars 2022-03-28 15:06:23 +01:00
Ed Chalstrey
7bffa44502 use env vars properly? 2022-03-28 14:42:29 +01:00
Ed Chalstrey
bb964f55c9 add sudo 2022-03-28 14:18:10 +01:00
Ed Chalstrey
405f9558ad gather stored vars for postgres 2022-03-28 14:17:55 +01:00
Ed Chalstrey
da89c9b63b clarify comment 2022-03-28 14:02:47 +01:00
Ed Chalstrey
5f9aaf7f0b tidy 2022-03-28 13:54:00 +01:00
Ed Chalstrey
d060ebf4bb add comment 2022-03-28 13:42:08 +01:00
Ed Chalstrey
d7b4f9eeb5 only convert gml files with 5690395 to csv 2022-03-24 11:41:56 +00:00
Ed Chalstrey
8398bcea3a remove python environment not needed 2022-03-24 09:51:41 +00:00
Ed Chalstrey
cf30f71d0a remove bad comments 2022-03-18 16:52:41 +00:00
Ed Chalstrey
27623cf3d4 update filter step explanation 2022-03-18 16:49:46 +00:00
Ed Chalstrey
db01442d9b flake8 2022-03-18 16:18:44 +00:00
Ed Chalstrey
3f281a5e73 handle missing descriptiveGroup 2022-03-18 15:44:19 +00:00
Ed Chalstrey
b875e27fb8 missing colon 2022-03-18 14:48:19 +00:00
Ed Chalstrey
f6cb0c488e add test for filtering mastermap (not working) 2022-03-18 14:34:06 +00:00
Ed Chalstrey
103300f969 remove not needed non-buildings toid code 2022-03-18 13:36:06 +00:00
Ed Chalstrey
7ec09a7123 add screenshot image 2022-03-18 11:27:05 +00:00
Ed Chalstrey
dfe48da577 tidy script 2022-03-18 11:08:33 +00:00
Ed Chalstrey
3653e30362 remove addressbase from all steps and reorder readme 2022-03-18 11:07:15 +00:00
Ed Chalstrey
f55ce63d84 add drop_outside_limit to instructions 2022-03-18 10:49:41 +00:00
Ed Chalstrey
9e4224f51c add sudo cmds and comment 2022-03-18 10:46:28 +00:00
Ed Chalstrey
0e35a7cca2 mastermap filtering without using addressbase 2022-03-17 15:43:23 +00:00
Ed Chalstrey
d822dfaaec removee addressbase stuff 2022-03-17 15:02:51 +00:00
Ed Chalstrey
dafe5de278 comment out addessbase stuff 2022-03-17 14:47:08 +00:00
Ed Chalstrey
8b8f6622f5 temp python path edit 2022-03-17 14:41:54 +00:00
Ed Chalstrey
8fccec6827 temp python path edit 2022-03-14 09:39:29 +00:00
Ed Chalstrey
7e8817d2c5 make scripts executable 2022-03-11 13:28:23 +00:00
Ed Chalstrey
6916e4ca59 remove use of addressbase 2022-03-11 11:46:00 +00:00
Ed Chalstrey
7f3693355e add comments and update how to run 2022-03-10 14:02:00 +00:00
Ed Chalstrey
5b06b12f98 temp hard code python path 2022-03-10 13:51:05 +00:00
Ed Chalstrey
5796df69a1 update python path in script 2022-03-10 13:47:43 +00:00
Ed Chalstrey
4f58ea64f4 rearrange 2022-03-10 13:40:30 +00:00
Ed Chalstrey
8050419e71 add error 2022-03-10 12:02:26 +00:00
Ed Chalstrey
26090e03b0 update mastermap instructions 2022-03-10 12:01:41 +00:00
Ed Chalstrey
3366b67560 Revert "unzip stage" 
This reverts commit b773cec0e8.
 2022-03-10 12:00:37 +00:00
Ed Chalstrey
c1cf06dca9 update AddressBase instructions 2022-03-10 11:55:35 +00:00
Ed Chalstrey
e66e375cb8 add note 2022-03-10 11:46:34 +00:00
Ed Chalstrey
5810aafc1e update how to run migrations 2022-03-10 10:44:31 +00:00
Ed Chalstrey
5fb4f91e5c source python env 2022-03-10 10:40:38 +00:00
Ed Chalstrey
4da6c96181 tidy 2022-03-10 10:39:06 +00:00
Ed Chalstrey
c029976741 todo 2022-03-10 10:06:44 +00:00
Ed Chalstrey
b773cec0e8 unzip stage 2022-03-10 09:59:22 +00:00
Ed Chalstrey
b85a2bf865 add sudo cmds 2022-03-10 09:53:12 +00:00
Ed Chalstrey
490307e9c5 clarify 2022-03-10 09:46:12 +00:00
Ed Chalstrey
d58b0d35fb remove duplicate info 2022-03-10 09:35:04 +00:00
Ed Chalstrey
269f24b946 remove section duplicated elsewhere 2022-03-10 09:33:55 +00:00
Ed Chalstrey
bf75d6f9ed make data available 2022-03-09 13:38:57 +00:00
Ed Chalstrey
732bae1f20 clarify 2022-03-09 13:33:26 +00:00
Ed Chalstrey
2dae59e540 data downloading 2022-03-09 13:24:27 +00:00
Ed Chalstrey
48fd7ec67f clarify pre-rquisites and link to doc 2022-03-09 11:48:45 +00:00
Ed Chalstrey
99056aac4b remove docker stuff - new branch: dockerise-colouring-london 2022-02-14 09:48:59 +00:00
Ed Chalstrey
226c9a1a5f add etl files with specific db name 2022-02-07 13:45:55 +00:00