Ed Chalstrey
|
68e40a1e46
|
remove openTOID stuff from this particular branch
|
2022-04-14 16:33:08 +01:00 |
|
Ed Chalstrey
|
3ef990ae2d
|
tidy
|
2022-04-14 14:21:55 +01:00 |
|
Ed Chalstrey
|
5800b578d4
|
fix create new buildings
|
2022-04-14 14:21:35 +01:00 |
|
Ed Chalstrey
|
81d8b1ef51
|
add create_new_building_records
|
2022-04-14 14:16:44 +01:00 |
|
Ed Chalstrey
|
ee09491dfe
|
include dropping boundary step regardless of updating db or making new
|
2022-04-14 14:11:07 +01:00 |
|
Ed Chalstrey
|
e10213c54c
|
update the doc
|
2022-04-14 14:10:07 +01:00 |
|
Ed Chalstrey
|
8a540256bb
|
fix mark demolitions script again
|
2022-04-14 13:39:42 +01:00 |
|
Ed Chalstrey
|
ca75e8004f
|
fix mark ddemolitions script psql
|
2022-04-14 13:37:15 +01:00 |
|
Ed Chalstrey
|
880e8d6424
|
mark demolitions script
|
2022-04-14 13:32:56 +01:00 |
|
Ed Chalstrey
|
71250a7abf
|
indent
|
2022-04-14 10:34:28 +01:00 |
|
Ed Chalstrey
|
80508aa387
|
fix insert statement
|
2022-04-14 10:33:38 +01:00 |
|
Ed Chalstrey
|
d730f37190
|
update new geometries loading
|
2022-04-14 09:55:58 +01:00 |
|
Ed Chalstrey
|
a6ccd6bbfa
|
rename file
|
2022-04-14 09:34:37 +01:00 |
|
Ed Chalstrey
|
ffe879fb25
|
geometries changes in update_building_records
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
7d3d936340
|
remove changes
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
8d10afd68b
|
add drop boundary step
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
688154d055
|
add update check
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
99a8dbc63b
|
reorder
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
2f63f15aef
|
copy all table columns
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
8433a95f2d
|
turn select statement to insert
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
d930ae3a75
|
select statement for geometries not in builings
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
2c6051682b
|
fix semicolon issue
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
c11d06a3dc
|
another experiment
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
76086150b8
|
testing way to record new geometries
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
f4a85e7a68
|
comment
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
0c86a72e5f
|
notes
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
fa8723b30f
|
fix sql
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
ae4eb1a925
|
fix sql mistake
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
7f5c3506ec
|
add lat/lon coords geometries
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
e83419cc3b
|
alt way to load geometries (untested)
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
c42f5423b8
|
update pseudocode
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
5dc7ac9206
|
add update_building_records script pseudocode
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
ee59455dca
|
dont delete open_toid table
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
50f07b854b
|
add hypothetical next scripts
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
2f1ebc89b2
|
spelling
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
37631b82f7
|
delete temp table
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
52f045c404
|
fix missing table
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
814203952a
|
change column type
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
bc0aca8d56
|
doc fix
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
7ed8d8defe
|
add warning
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
0048f0ae73
|
Updating the buildings table with coordinates SQL
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
66138855a3
|
find the converted csvs
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
709be9ef70
|
separate python step since memory failiure is possible
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
08d4610336
|
remove index not needed
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
d100f12991
|
add coordinates step
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
96707f1d73
|
spelling
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
7faf79aa9e
|
create new csv instead of using old
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
0e3c754075
|
switch to cython
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
5e89bc9dac
|
add conversion to latlon step
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
c1e51531f7
|
update instructions for python
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
6593f9d249
|
add python script to convert to lat lon
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
faa6ddbe4d
|
add creation of the_geom column
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
239b1db0f0
|
add missing column
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
22f3773632
|
create load coordinates script
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
9242b22bb5
|
add OS TOID download info
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
75e6382897
|
load new geometries
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
a635655995
|
explain "ETL"
|
2022-04-01 11:23:24 +01:00 |
|
Ed Chalstrey
|
667110537f
|
clarify
|
2022-04-01 10:50:34 +01:00 |
|
Ed Chalstrey
|
efc49bd2b9
|
fix link
|
2022-04-01 10:37:56 +01:00 |
|
Ed Chalstrey
|
aba46dc95d
|
add contents
|
2022-04-01 10:32:53 +01:00 |
|
Ed Chalstrey
|
b470591420
|
rearrange sections
|
2022-04-01 10:20:18 +01:00 |
|
Ed Chalstrey
|
a3d2537e22
|
Revert "create script to load new geometries"
This reverts commit d6ca8852d4 .
|
2022-04-01 10:05:11 +01:00 |
|
Ed Chalstrey
|
d6ca8852d4
|
create script to load new geometries
|
2022-03-31 16:27:36 +01:00 |
|
Ed Chalstrey
|
5b2029a4e3
|
remove bad comments
|
2022-03-31 15:42:06 +01:00 |
|
Ed Chalstrey
|
7bd78bf03a
|
fix filtering script
|
2022-03-29 15:41:00 +01:00 |
|
Ed Chalstrey
|
2163dc5812
|
add echos to load geometries
|
2022-03-29 14:48:27 +01:00 |
|
Ed Chalstrey
|
0e01971b4a
|
add echos to extraction step
|
2022-03-29 14:46:18 +01:00 |
|
Ed Chalstrey
|
4a8d79a54a
|
add echos to filtration step
|
2022-03-29 14:42:34 +01:00 |
|
Ed Chalstrey
|
3f07a9b081
|
remove print statement
|
2022-03-29 14:37:42 +01:00 |
|
Ed Chalstrey
|
f1946ea35b
|
flake8
|
2022-03-29 10:33:47 +01:00 |
|
Ed Chalstrey
|
f49e378fe3
|
fix filter_mastermap
|
2022-03-29 10:32:13 +01:00 |
|
Ed Chalstrey
|
6602fc916a
|
comment out step temporarily
|
2022-03-28 15:23:40 +01:00 |
|
Ed Chalstrey
|
4cd14ffd77
|
remove sudo
|
2022-03-28 15:22:04 +01:00 |
|
Ed Chalstrey
|
c85b321a60
|
revert changes to env vars
|
2022-03-28 15:06:23 +01:00 |
|
Ed Chalstrey
|
7bffa44502
|
use env vars properly?
|
2022-03-28 14:42:29 +01:00 |
|
Ed Chalstrey
|
bb964f55c9
|
add sudo
|
2022-03-28 14:18:10 +01:00 |
|
Ed Chalstrey
|
405f9558ad
|
gather stored vars for postgres
|
2022-03-28 14:17:55 +01:00 |
|
Ed Chalstrey
|
da89c9b63b
|
clarify comment
|
2022-03-28 14:02:47 +01:00 |
|
Ed Chalstrey
|
5f9aaf7f0b
|
tidy
|
2022-03-28 13:54:00 +01:00 |
|
Ed Chalstrey
|
d060ebf4bb
|
add comment
|
2022-03-28 13:42:08 +01:00 |
|
Ed Chalstrey
|
d7b4f9eeb5
|
only convert gml files with 5690395 to csv
|
2022-03-24 11:41:56 +00:00 |
|
Ed Chalstrey
|
8398bcea3a
|
remove python environment not needed
|
2022-03-24 09:51:41 +00:00 |
|
Ed Chalstrey
|
cf30f71d0a
|
remove bad comments
|
2022-03-18 16:52:41 +00:00 |
|
Ed Chalstrey
|
27623cf3d4
|
update filter step explanation
|
2022-03-18 16:49:46 +00:00 |
|
Ed Chalstrey
|
db01442d9b
|
flake8
|
2022-03-18 16:18:44 +00:00 |
|
Ed Chalstrey
|
3f281a5e73
|
handle missing descriptiveGroup
|
2022-03-18 15:44:19 +00:00 |
|
Ed Chalstrey
|
b875e27fb8
|
missing colon
|
2022-03-18 14:48:19 +00:00 |
|
Ed Chalstrey
|
f6cb0c488e
|
add test for filtering mastermap (not working)
|
2022-03-18 14:34:06 +00:00 |
|
Ed Chalstrey
|
103300f969
|
remove not needed non-buildings toid code
|
2022-03-18 13:36:06 +00:00 |
|
Ed Chalstrey
|
7ec09a7123
|
add screenshot image
|
2022-03-18 11:27:05 +00:00 |
|
Ed Chalstrey
|
dfe48da577
|
tidy script
|
2022-03-18 11:08:33 +00:00 |
|
Ed Chalstrey
|
3653e30362
|
remove addressbase from all steps and reorder readme
|
2022-03-18 11:07:15 +00:00 |
|
Ed Chalstrey
|
f55ce63d84
|
add drop_outside_limit to instructions
|
2022-03-18 10:49:41 +00:00 |
|
Ed Chalstrey
|
9e4224f51c
|
add sudo cmds and comment
|
2022-03-18 10:46:28 +00:00 |
|
Ed Chalstrey
|
0e35a7cca2
|
mastermap filtering without using addressbase
|
2022-03-17 15:43:23 +00:00 |
|
Ed Chalstrey
|
d822dfaaec
|
removee addressbase stuff
|
2022-03-17 15:02:51 +00:00 |
|
Ed Chalstrey
|
dafe5de278
|
comment out addessbase stuff
|
2022-03-17 14:47:08 +00:00 |
|
Ed Chalstrey
|
8b8f6622f5
|
temp python path edit
|
2022-03-17 14:41:54 +00:00 |
|
Ed Chalstrey
|
8fccec6827
|
temp python path edit
|
2022-03-14 09:39:29 +00:00 |
|
Ed Chalstrey
|
7e8817d2c5
|
make scripts executable
|
2022-03-11 13:28:23 +00:00 |
|