Commit Graph

267 Commits

Author SHA1 Message Date
Mateusz Konieczny
90dae39f12 tweak wording of disclaimer 2022-10-05 19:56:25 +02:00
Mateusz Konieczny
bfe8720f09 explicitly skip more confusing statuses 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
71b67d9890 still skip unexpected statuses 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
1fce51c104 stop treating unexpected status as error 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
9c19ad24ba one more status 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
658a30adcc new skipped status 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
def260e584 support unknown status 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
ac7a11a805 drop dead code 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
f995a92a82 fix mismatch in documentation 2022-10-05 19:54:39 +02:00
Mateusz Konieczny
0ae856a6f6 import of recovered data - maybe it should be done differently 2022-10-05 19:52:45 +02:00
Mateusz Konieczny
21957d0da2 fix typo 2022-10-05 19:52:45 +02:00
Mateusz Konieczny
88c3378fcd Fix time zone to London 2022-10-05 19:52:45 +02:00
Mateusz Konieczny
cdbf92399b add one more data field to database 2022-10-05 19:52:45 +02:00
Mateusz Konieczny
8cbb3cd84b Display official planning data. 2022-10-05 19:52:14 +02:00
Ed Chalstrey
1eb925dec1 remove superfluous step 2022-04-27 16:37:04 +01:00
Ed Chalstrey
f75cbe7bd0 update comment 2022-04-27 15:59:20 +01:00
Ed Chalstrey
7e569d28e3 final steps 2022-04-27 15:25:05 +01:00
Ed Chalstrey
8f6d23e7c5 clarify 2022-04-22 14:17:00 +01:00
Ed Chalstrey
e421e52c8e clarify 2022-04-22 14:15:03 +01:00
Ed Chalstrey
46012e9309 doc clarify 2022-04-22 14:13:17 +01:00
Ed Chalstrey
a22bf0079b drop new geometries outside boundary before adding to geometries table 2022-04-21 14:33:49 +01:00
Ed Chalstrey
8d5f386349 add prints 2022-04-21 14:14:46 +01:00
Ed Chalstrey
4b47483a70 simplify 2022-04-21 11:02:52 +01:00
Ed Chalstrey
568fbccb25 remove superfluous sub-headers 2022-04-21 10:53:52 +01:00
Ed Chalstrey
915d328e3f restore ubuntu section 2022-04-21 10:48:12 +01:00
Ed Chalstrey
ebe3c38f67 remove primary key constraint and delete duplicates 2022-04-21 10:21:22 +01:00
Ed Chalstrey
68e40a1e46 remove openTOID stuff from this particular branch 2022-04-14 16:33:08 +01:00
Ed Chalstrey
3ef990ae2d tidy 2022-04-14 14:21:55 +01:00
Ed Chalstrey
5800b578d4 fix create new buildings 2022-04-14 14:21:35 +01:00
Ed Chalstrey
81d8b1ef51 add create_new_building_records 2022-04-14 14:16:44 +01:00
Ed Chalstrey
ee09491dfe include dropping boundary step regardless of updating db or making new 2022-04-14 14:11:07 +01:00
Ed Chalstrey
e10213c54c update the doc 2022-04-14 14:10:07 +01:00
Ed Chalstrey
8a540256bb fix mark demolitions script again 2022-04-14 13:39:42 +01:00
Ed Chalstrey
ca75e8004f fix mark ddemolitions script psql 2022-04-14 13:37:15 +01:00
Ed Chalstrey
880e8d6424 mark demolitions script 2022-04-14 13:32:56 +01:00
Ed Chalstrey
71250a7abf indent 2022-04-14 10:34:28 +01:00
Ed Chalstrey
80508aa387 fix insert statement 2022-04-14 10:33:38 +01:00
Ed Chalstrey
d730f37190 update new geometries loading 2022-04-14 09:55:58 +01:00
Ed Chalstrey
a6ccd6bbfa rename file 2022-04-14 09:34:37 +01:00
Ed Chalstrey
ffe879fb25 geometries changes in update_building_records 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7d3d936340 remove changes 2022-04-14 09:28:34 +01:00
Ed Chalstrey
8d10afd68b add drop boundary step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
688154d055 add update check 2022-04-14 09:28:34 +01:00
Ed Chalstrey
99a8dbc63b reorder 2022-04-14 09:28:34 +01:00
Ed Chalstrey
2f63f15aef copy all table columns 2022-04-14 09:28:34 +01:00
Ed Chalstrey
8433a95f2d turn select statement to insert 2022-04-14 09:28:34 +01:00
Ed Chalstrey
d930ae3a75 select statement for geometries not in builings 2022-04-14 09:28:34 +01:00
Ed Chalstrey
2c6051682b fix semicolon issue 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c11d06a3dc another experiment 2022-04-14 09:28:34 +01:00
Ed Chalstrey
76086150b8 testing way to record new geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
f4a85e7a68 comment 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0c86a72e5f notes 2022-04-14 09:28:34 +01:00
Ed Chalstrey
fa8723b30f fix sql 2022-04-14 09:28:34 +01:00
Ed Chalstrey
ae4eb1a925 fix sql mistake 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7f5c3506ec add lat/lon coords geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
e83419cc3b alt way to load geometries (untested) 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c42f5423b8 update pseudocode 2022-04-14 09:28:34 +01:00
Ed Chalstrey
5dc7ac9206 add update_building_records script pseudocode 2022-04-14 09:28:34 +01:00
Ed Chalstrey
ee59455dca dont delete open_toid table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
50f07b854b add hypothetical next scripts 2022-04-14 09:28:34 +01:00
Ed Chalstrey
2f1ebc89b2 spelling 2022-04-14 09:28:34 +01:00
Ed Chalstrey
37631b82f7 delete temp table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
52f045c404 fix missing table 2022-04-14 09:28:34 +01:00
Ed Chalstrey
814203952a change column type 2022-04-14 09:28:34 +01:00
Ed Chalstrey
bc0aca8d56 doc fix 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7ed8d8defe add warning 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0048f0ae73 Updating the buildings table with coordinates SQL 2022-04-14 09:28:34 +01:00
Ed Chalstrey
66138855a3 find the converted csvs 2022-04-14 09:28:34 +01:00
Ed Chalstrey
709be9ef70 separate python step since memory failiure is possible 2022-04-14 09:28:34 +01:00
Ed Chalstrey
08d4610336 remove index not needed 2022-04-14 09:28:34 +01:00
Ed Chalstrey
d100f12991 add coordinates step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
96707f1d73 spelling 2022-04-14 09:28:34 +01:00
Ed Chalstrey
7faf79aa9e create new csv instead of using old 2022-04-14 09:28:34 +01:00
Ed Chalstrey
0e3c754075 switch to cython 2022-04-14 09:28:34 +01:00
Ed Chalstrey
5e89bc9dac add conversion to latlon step 2022-04-14 09:28:34 +01:00
Ed Chalstrey
c1e51531f7 update instructions for python 2022-04-14 09:28:34 +01:00
Ed Chalstrey
6593f9d249 add python script to convert to lat lon 2022-04-14 09:28:34 +01:00
Ed Chalstrey
faa6ddbe4d add creation of the_geom column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
239b1db0f0 add missing column 2022-04-14 09:28:34 +01:00
Ed Chalstrey
22f3773632 create load coordinates script 2022-04-14 09:28:34 +01:00
Ed Chalstrey
9242b22bb5 add OS TOID download info 2022-04-14 09:28:34 +01:00
Ed Chalstrey
75e6382897 load new geometries 2022-04-14 09:28:34 +01:00
Ed Chalstrey
a635655995 explain "ETL" 2022-04-01 11:23:24 +01:00
Ed Chalstrey
667110537f clarify 2022-04-01 10:50:34 +01:00
Ed Chalstrey
efc49bd2b9 fix link 2022-04-01 10:37:56 +01:00
Ed Chalstrey
aba46dc95d add contents 2022-04-01 10:32:53 +01:00
Ed Chalstrey
b470591420 rearrange sections 2022-04-01 10:20:18 +01:00
Ed Chalstrey
a3d2537e22 Revert "create script to load new geometries"
This reverts commit d6ca8852d4.
2022-04-01 10:05:11 +01:00
Ed Chalstrey
d6ca8852d4 create script to load new geometries 2022-03-31 16:27:36 +01:00
Ed Chalstrey
5b2029a4e3 remove bad comments 2022-03-31 15:42:06 +01:00
Ed Chalstrey
7bd78bf03a fix filtering script 2022-03-29 15:41:00 +01:00
Ed Chalstrey
2163dc5812 add echos to load geometries 2022-03-29 14:48:27 +01:00
Ed Chalstrey
0e01971b4a add echos to extraction step 2022-03-29 14:46:18 +01:00
Ed Chalstrey
4a8d79a54a add echos to filtration step 2022-03-29 14:42:34 +01:00
Ed Chalstrey
3f07a9b081 remove print statement 2022-03-29 14:37:42 +01:00
Ed Chalstrey
f1946ea35b flake8 2022-03-29 10:33:47 +01:00
Ed Chalstrey
f49e378fe3 fix filter_mastermap 2022-03-29 10:32:13 +01:00
Ed Chalstrey
6602fc916a comment out step temporarily 2022-03-28 15:23:40 +01:00
Ed Chalstrey
4cd14ffd77 remove sudo 2022-03-28 15:22:04 +01:00
Ed Chalstrey
c85b321a60 revert changes to env vars 2022-03-28 15:06:23 +01:00