2022-10-05 13:52:14 -04:00
|
|
|
Following scripts should be scheduled to run regularly to load livestream data into database.
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
# querying API to obtain data
|
|
|
|
|
python3 obtain_livestream_data.py > all_data.json
|
|
|
|
|
|
|
|
|
|
# loading data into Colouring database
|
|
|
|
|
python3 load_into_database
|
|
|
|
|
|
|
|
|
|
# removing tile cache for planning_applications_status layer - note that location of cache depends on your configuration
|
|
|
|
|
rm /srv/colouring-london/tilecache/planning_applications_status/* -rf
|
|
|
|
|
```
|
|
|
|
|
|
2022-08-30 09:23:54 -04:00
|
|
|
As loading into databases expects environment variables to be set, one option to actually schedule it in a cron is something like
|
2022-10-05 13:52:14 -04:00
|
|
|
|
|
|
|
|
```
|
|
|
|
|
export $(cat ~/scripts/.env | xargs) && /usr/bin/python3 ~/colouring-london/etl/planning_data/load_into_database.py
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
with
|
|
|
|
|
|
|
|
|
|
```
|
2022-09-14 06:07:33 -04:00
|
|
|
~/scripts/.env
|
2022-10-05 13:52:14 -04:00
|
|
|
```
|
|
|
|
|
|
|
|
|
|
being in following format
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
PGHOST=localhost
|
|
|
|
|
PGDATABASE=colouringlondondb
|
|
|
|
|
PGUSER=cldbadmin
|
|
|
|
|
PGPASSWORD=actualpassword
|
|
|
|
|
```
|
