This commit is contained in:
Ed Chalstrey 2022-03-10 10:39:06 +00:00
parent ecb9301be1
commit 4da6c96181

View File

@ -55,27 +55,64 @@ The scripts should be run in the following order:
```bash ```bash
cd ~/colouring-london/etl cd ~/colouring-london/etl
# extract both datasets ```
Extract the addressBase dataset.
```bash
sudo ./extract_addressbase.sh ./addressbase_dir sudo ./extract_addressbase.sh ./addressbase_dir
```
Extract the MasterMap data (this step could take a while).
```bash
sudo ./extract_mastermap.sh ./mastermap_dir sudo ./extract_mastermap.sh ./mastermap_dir
# filter mastermap ('building' polygons and any others referenced by addressbase) ```
Filter MasterMap 'building' polygons and any others referenced by addressbase.
```bash
sudo ./filter_transform_mastermap_for_loading.sh ./addressbase_dir ./mastermap_dir sudo ./filter_transform_mastermap_for_loading.sh ./addressbase_dir ./mastermap_dir
# load all building outlines ```
Load all building outlines.
```bash
sudo ./load_geometries.sh ./mastermap_dir sudo ./load_geometries.sh ./mastermap_dir
# index geometries (should be faster after loading) ```
Index geometries.
```bash
psql < ../migrations/002.index-geometries.sql psql < ../migrations/002.index-geometries.sql
# create a building record per outline ```
Create a building record per outline.
```bash
sudo ./create_building_records.sh sudo ./create_building_records.sh
# add UPRNs where they match ```
Add UPRNs where they match.
<!-- TODO: python install -->
```bash
load_uprns.py ./addressbase_dir load_uprns.py ./addressbase_dir
# index building records ````
Index building records.
```bash
psql < ../migrations/003.index-buildings.sql psql < ../migrations/003.index-buildings.sql
``` ```
## Finally
Run the remaining migrations in `../migrations` to create the rest of the database structure. Run the remaining migrations in `../migrations` to create the rest of the database structure.
<!-- ```bash
``` -->
# [WIP] Updating the Colouring London database with new OS data # [WIP] Updating the Colouring London database with new OS data
TODO: this section should instruct how to update and existing db TODO: this section should instruct how to update and existing db