Ed Chalstrey
|
75e6382897
|
load new geometries
|
2022-04-14 09:28:34 +01:00 |
|
Ed Chalstrey
|
a4771eaac0
|
Merge pull request #798 from colouring-cities/os-data-loading
Document & test Ordnance Survey data loading
|
2022-04-13 13:28:06 +01:00 |
|
Ed Chalstrey
|
a635655995
|
explain "ETL"
|
2022-04-01 11:23:24 +01:00 |
|
Ed Chalstrey
|
667110537f
|
clarify
|
2022-04-01 10:50:34 +01:00 |
|
Ed Chalstrey
|
efc49bd2b9
|
fix link
|
2022-04-01 10:37:56 +01:00 |
|
Ed Chalstrey
|
aba46dc95d
|
add contents
|
2022-04-01 10:32:53 +01:00 |
|
Ed Chalstrey
|
647d75abb4
|
update gitignore
|
2022-04-01 10:21:58 +01:00 |
|
Ed Chalstrey
|
b470591420
|
rearrange sections
|
2022-04-01 10:20:18 +01:00 |
|
Ed Chalstrey
|
a3d2537e22
|
Revert "create script to load new geometries"
This reverts commit d6ca8852d4.
|
2022-04-01 10:05:11 +01:00 |
|
Ed Chalstrey
|
d6ca8852d4
|
create script to load new geometries
|
2022-03-31 16:27:36 +01:00 |
|
Ed Chalstrey
|
5b2029a4e3
|
remove bad comments
|
2022-03-31 15:42:06 +01:00 |
|
Ed Chalstrey
|
57e655b482
|
fix link
|
2022-03-29 16:56:58 +01:00 |
|
Ed Chalstrey
|
a8e6dc0b09
|
add new header on db creation
|
2022-03-29 16:55:40 +01:00 |
|
Ed Chalstrey
|
ea76ad0288
|
clarify
|
2022-03-29 16:50:31 +01:00 |
|
Ed Chalstrey
|
8227320b9d
|
move python instructions specific to test data
|
2022-03-29 16:48:15 +01:00 |
|
Ed Chalstrey
|
7bd78bf03a
|
fix filtering script
|
2022-03-29 15:41:00 +01:00 |
|
Ed Chalstrey
|
2163dc5812
|
add echos to load geometries
|
2022-03-29 14:48:27 +01:00 |
|
Ed Chalstrey
|
0e01971b4a
|
add echos to extraction step
|
2022-03-29 14:46:18 +01:00 |
|
Ed Chalstrey
|
4a8d79a54a
|
add echos to filtration step
|
2022-03-29 14:42:34 +01:00 |
|
Ed Chalstrey
|
3f07a9b081
|
remove print statement
|
2022-03-29 14:37:42 +01:00 |
|
Ed Chalstrey
|
f1946ea35b
|
flake8
|
2022-03-29 10:33:47 +01:00 |
|
Ed Chalstrey
|
f49e378fe3
|
fix filter_mastermap
|
2022-03-29 10:32:13 +01:00 |
|
Ed Chalstrey
|
7297354f5b
|
update test that so that it fails
|
2022-03-29 10:12:31 +01:00 |
|
Ed Chalstrey
|
6602fc916a
|
comment out step temporarily
|
2022-03-28 15:23:40 +01:00 |
|
Ed Chalstrey
|
4cd14ffd77
|
remove sudo
|
2022-03-28 15:22:04 +01:00 |
|
Ed Chalstrey
|
c85b321a60
|
revert changes to env vars
|
2022-03-28 15:06:23 +01:00 |
|
Ed Chalstrey
|
7bffa44502
|
use env vars properly?
|
2022-03-28 14:42:29 +01:00 |
|
Tom Russell
|
98ce36b287
|
Add direct link to "blog" category in forum
|
2022-03-28 14:23:06 +01:00 |
|
Ed Chalstrey
|
bb964f55c9
|
add sudo
|
2022-03-28 14:18:10 +01:00 |
|
Ed Chalstrey
|
405f9558ad
|
gather stored vars for postgres
|
2022-03-28 14:17:55 +01:00 |
|
Ed Chalstrey
|
da89c9b63b
|
clarify comment
|
2022-03-28 14:02:47 +01:00 |
|
Ed Chalstrey
|
5f9aaf7f0b
|
tidy
|
2022-03-28 13:54:00 +01:00 |
|
Ed Chalstrey
|
d060ebf4bb
|
add comment
|
2022-03-28 13:42:08 +01:00 |
|
Ed Chalstrey
|
d7b4f9eeb5
|
only convert gml files with 5690395 to csv
|
2022-03-24 11:41:56 +00:00 |
|
Ed Chalstrey
|
8398bcea3a
|
remove python environment not needed
|
2022-03-24 09:51:41 +00:00 |
|
Ed Chalstrey
|
cf30f71d0a
|
remove bad comments
|
2022-03-18 16:52:41 +00:00 |
|
Ed Chalstrey
|
27623cf3d4
|
update filter step explanation
|
2022-03-18 16:49:46 +00:00 |
|
Ed Chalstrey
|
48e56b0ad7
|
3.7
|
2022-03-18 16:40:40 +00:00 |
|
Ed Chalstrey
|
d985b32146
|
switch to python 3.7.4
|
2022-03-18 16:37:30 +00:00 |
|
Ed Chalstrey
|
0d9e54d08d
|
use sudo with libgeos-dev
|
2022-03-18 16:34:20 +00:00 |
|
Ed Chalstrey
|
426aa98a33
|
add libgeos-dev
|
2022-03-18 16:32:52 +00:00 |
|
Ed Chalstrey
|
0b176c7531
|
make sure pytest and flake8 installed
|
2022-03-18 16:30:14 +00:00 |
|
Ed Chalstrey
|
1b43d4c1ba
|
run tests on PR only
|
2022-03-18 16:22:21 +00:00 |
|
Ed Chalstrey
|
8eeea322aa
|
update path to etl requirements
|
2022-03-18 16:21:29 +00:00 |
|
Ed Chalstrey
|
db01442d9b
|
flake8
|
2022-03-18 16:18:44 +00:00 |
|
Ed Chalstrey
|
37ecbd0bd2
|
add etl github workflow
|
2022-03-18 16:02:14 +00:00 |
|
Ed Chalstrey
|
3f281a5e73
|
handle missing descriptiveGroup
|
2022-03-18 15:44:19 +00:00 |
|
Ed Chalstrey
|
158a09637b
|
add failing test for missing mastermap type
|
2022-03-18 15:30:17 +00:00 |
|
Ed Chalstrey
|
a159c974dc
|
name output_file with input_file
|
2022-03-18 15:27:12 +00:00 |
|
Ed Chalstrey
|
35f85ee2ed
|
test mastermap filtering works
|
2022-03-18 15:04:09 +00:00 |
|