Ed Chalstrey
0e35a7cca2
mastermap filtering without using addressbase
2022-03-17 15:43:23 +00:00
Ed Chalstrey
d822dfaaec
removee addressbase stuff
2022-03-17 15:02:51 +00:00
Ed Chalstrey
dafe5de278
comment out addessbase stuff
2022-03-17 14:47:08 +00:00
Ed Chalstrey
8b8f6622f5
temp python path edit
2022-03-17 14:41:54 +00:00
Ed Chalstrey
8fccec6827
temp python path edit
2022-03-14 09:39:29 +00:00
Ed Chalstrey
7e8817d2c5
make scripts executable
2022-03-11 13:28:23 +00:00
Ed Chalstrey
6916e4ca59
remove use of addressbase
2022-03-11 11:46:00 +00:00
Ed Chalstrey
7f3693355e
add comments and update how to run
2022-03-10 14:02:00 +00:00
Ed Chalstrey
5b06b12f98
temp hard code python path
2022-03-10 13:51:05 +00:00
Ed Chalstrey
5796df69a1
update python path in script
2022-03-10 13:47:43 +00:00
Ed Chalstrey
4f58ea64f4
rearrange
2022-03-10 13:40:30 +00:00
Ed Chalstrey
8050419e71
add error
2022-03-10 12:02:26 +00:00
Ed Chalstrey
26090e03b0
update mastermap instructions
2022-03-10 12:01:41 +00:00
Ed Chalstrey
3366b67560
Revert "unzip stage"
...
This reverts commit b773cec0e8
2022-03-10 12:00:37 +00:00
Ed Chalstrey
c1cf06dca9
update AddressBase instructions
2022-03-10 11:55:35 +00:00
Ed Chalstrey
e66e375cb8
add note
2022-03-10 11:46:34 +00:00
Ed Chalstrey
5810aafc1e
update how to run migrations
2022-03-10 10:44:31 +00:00
Ed Chalstrey
5fb4f91e5c
source python env
2022-03-10 10:40:38 +00:00
Ed Chalstrey
4da6c96181
tidy
2022-03-10 10:39:06 +00:00
Ed Chalstrey
c029976741
todo
2022-03-10 10:06:44 +00:00
Ed Chalstrey
b773cec0e8
unzip stage
2022-03-10 09:59:22 +00:00
Ed Chalstrey
b85a2bf865
add sudo cmds
2022-03-10 09:53:12 +00:00
Ed Chalstrey
490307e9c5
clarify
2022-03-10 09:46:12 +00:00
Ed Chalstrey
d58b0d35fb
remove duplicate info
2022-03-10 09:35:04 +00:00
Ed Chalstrey
269f24b946
remove section duplicated elsewhere
2022-03-10 09:33:55 +00:00
Ed Chalstrey
bf75d6f9ed
make data available
2022-03-09 13:38:57 +00:00
Ed Chalstrey
732bae1f20
clarify
2022-03-09 13:33:26 +00:00
Ed Chalstrey
2dae59e540
data downloading
2022-03-09 13:24:27 +00:00
Ed Chalstrey
48fd7ec67f
clarify pre-rquisites and link to doc
2022-03-09 11:48:45 +00:00
Ed Chalstrey
99056aac4b
remove docker stuff - new branch: dockerise-colouring-london
2022-02-14 09:48:59 +00:00
Ed Chalstrey
226c9a1a5f
add etl files with specific db name
2022-02-07 13:45:55 +00:00
Ed Chalstrey
97caaa5f06
bump shapely version
2022-02-03 14:51:48 +00:00
Ed Chalstrey
df77db2854
bump osmnx version
2022-02-03 14:46:49 +00:00
Maciej Ziarkowski
fef3a6532c
Merge branch 'master' of github.com:tomalrussell/colouring-london
2020-06-18 13:00:53 +01:00
Maciej Ziarkowski
da52fa4971
Fix typo in etl requirements.txt
2020-06-18 13:00:39 +01:00
Tom Russell
150ef00ca9
Update etl/migrations docs with a little more on prerequisites
2020-06-18 10:32:35 +01:00
Tom Russell
4eb5961af5
Fix use of osmnx to work with v0.14
2020-06-18 10:31:34 +01:00
Maciej Ziarkowski
c997654545
Add debug, no overwrite flags
2020-06-16 16:16:46 +01:00
Maciej Ziarkowski
e2b94cfe2e
Move to argparse for command line options
2020-06-16 13:27:08 +01:00
Maciej Ziarkowski
cd74ff6f32
Add retrying logic
2020-06-16 13:24:43 +01:00
Tom Russell
5d8a0dd42b
Merge branch 'master' into features/migrations_sustainability
2020-04-09 10:47:55 +01:00
Tom Russell
055ed426b4
Merge branch 'master' into fix/upload
2020-04-09 10:19:13 +01:00
dominic
bdd3462e99
Update load_csv_to_staging.py
...
Updates to bring staging script into line with main upload script
- Script was not working
2020-02-27 12:04:09 +00:00
dom_ucl_mb
5ca6a6f7fe
WIP for #405
2020-02-13 17:22:16 +00:00
Maciej Ziarkowski
82a50d77d6
Allow specifying JSON columns for CSV bulk import
2019-12-10 17:25:55 +00:00
Maciej Ziarkowski
26ca7f8873
Accept CSV with building_id for API data import
2019-12-10 17:16:26 +00:00
Tom Russell
f3b9be39bf
Update load_csv python script
...
- use building_id if present in CSV
- print DEBUG even if response from API is 200
- handle empty-string sust_dec (which fails because empty-string isn't a valid
enum value as defined in 011.sustainability.up.sql) by deleting from data
if present
2019-11-21 13:17:17 +00:00
Dominic H
1d372823ed
Adjusts guide notes no code change
2019-11-08 12:36:54 +00:00
Dominic H
e00d912686
Enable python upload to staging
...
- Based on load_csv.py with edit for staging
2019-11-08 12:31:40 +00:00
Dominic H
9943bdd9a5
Test load to staging
...
- Copy of main load_csv.py with edit to get round ssh error
2019-10-02 16:35:56 +01:00
