tidy
This commit is contained in:
parent
ecb9301be1
commit
4da6c96181
@ -55,27 +55,64 @@ The scripts should be run in the following order:
|
|||||||
|
|
||||||
```bash
|
```bash
|
||||||
cd ~/colouring-london/etl
|
cd ~/colouring-london/etl
|
||||||
# extract both datasets
|
```
|
||||||
|
|
||||||
|
Extract the addressBase dataset.
|
||||||
|
|
||||||
|
```bash
|
||||||
sudo ./extract_addressbase.sh ./addressbase_dir
|
sudo ./extract_addressbase.sh ./addressbase_dir
|
||||||
|
```
|
||||||
|
|
||||||
|
Extract the MasterMap data (this step could take a while).
|
||||||
|
|
||||||
|
```bash
|
||||||
sudo ./extract_mastermap.sh ./mastermap_dir
|
sudo ./extract_mastermap.sh ./mastermap_dir
|
||||||
# filter mastermap ('building' polygons and any others referenced by addressbase)
|
```
|
||||||
|
|
||||||
|
Filter MasterMap 'building' polygons and any others referenced by addressbase.
|
||||||
|
|
||||||
|
```bash
|
||||||
sudo ./filter_transform_mastermap_for_loading.sh ./addressbase_dir ./mastermap_dir
|
sudo ./filter_transform_mastermap_for_loading.sh ./addressbase_dir ./mastermap_dir
|
||||||
# load all building outlines
|
```
|
||||||
|
|
||||||
|
Load all building outlines.
|
||||||
|
|
||||||
|
```bash
|
||||||
sudo ./load_geometries.sh ./mastermap_dir
|
sudo ./load_geometries.sh ./mastermap_dir
|
||||||
# index geometries (should be faster after loading)
|
```
|
||||||
|
|
||||||
|
Index geometries.
|
||||||
|
|
||||||
|
```bash
|
||||||
psql < ../migrations/002.index-geometries.sql
|
psql < ../migrations/002.index-geometries.sql
|
||||||
# create a building record per outline
|
```
|
||||||
|
|
||||||
|
Create a building record per outline.
|
||||||
|
|
||||||
|
```bash
|
||||||
sudo ./create_building_records.sh
|
sudo ./create_building_records.sh
|
||||||
# add UPRNs where they match
|
```
|
||||||
|
|
||||||
|
Add UPRNs where they match.
|
||||||
|
|
||||||
|
<!-- TODO: python install -->
|
||||||
|
|
||||||
|
```bash
|
||||||
load_uprns.py ./addressbase_dir
|
load_uprns.py ./addressbase_dir
|
||||||
# index building records
|
````
|
||||||
|
|
||||||
|
Index building records.
|
||||||
|
|
||||||
|
```bash
|
||||||
psql < ../migrations/003.index-buildings.sql
|
psql < ../migrations/003.index-buildings.sql
|
||||||
```
|
```
|
||||||
|
|
||||||
## Finally
|
|
||||||
|
|
||||||
Run the remaining migrations in `../migrations` to create the rest of the database structure.
|
Run the remaining migrations in `../migrations` to create the rest of the database structure.
|
||||||
|
|
||||||
|
<!-- ```bash
|
||||||
|
|
||||||
|
``` -->
|
||||||
|
|
||||||
# [WIP] Updating the Colouring London database with new OS data
|
# [WIP] Updating the Colouring London database with new OS data
|
||||||
|
|
||||||
TODO: this section should instruct how to update and existing db
|
TODO: this section should instruct how to update and existing db
|
Loading…
Reference in New Issue
Block a user