From e4ff180cbe01605da12f3eeecc112b142775967a Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 12:32:27 +0530 Subject: [PATCH 1/7] Update README.md --- README.md | 39 ++++++++++++++++++++++++++++++--------- 1 file changed, 30 insertions(+), 9 deletions(-) diff --git a/README.md b/README.md index 9e130f8..2f20da1 100644 --- a/README.md +++ b/README.md @@ -1,24 +1,37 @@ # uk analysis dashboard [![All Contributors](https://img.shields.io/badge/all_contributors-7-orange.svg?style=flat-square)](#contributors-) +[![ease of contribution: easy](https://img.shields.io/badge/ease%20of%20contribution:%20easy-32bd50)](https://github.com/openclimatefix#how-easy-is-it-to-get-involved) -Internal dashboard for OCF to track UK forecast statistics. +Internal dashboard for OCF to track forecast statistics and log the historical data of the forecast performance. The analysis dashboard is a tool that was developed for OCF’s internal use and continues to evolve. -Built with [Streamlit](https://streamlit.io/), a Python-based framework made specifically for creating data apps, the dashboard tracks and displays Quartz Solar and other data model statistics, such as mean absolute error (MAE) on both the national and GSP level. The database provides the error statistic using Sheffield Solar's PVLive day-after updated values as the baseline --the larger the error, the less accurate the forecast. +Built with [Streamlit](https://streamlit.io/), a Python-based framework made specifically for creating data apps, the dashboard tracks and displays Quartz Solar and other data model statistics, such as mean absolute error (MAE), normalized mean absolute error (nMAE) for all the client sites. The database provides the error statistic using comparing the live generation with the forecast provided. Internally it has the option of chosing the forecast horizion to check the performance with genration. The larger the error, the less accurate the forecast. -Thanks to the analysis dashboard, OCF has a valuable feedback tool for understanding the accuracy of both the Quartz Solar forecast and other models in production. +Thanks to the analysis dashboard, OCF has a valuable feedback tool for understanding the accuracy of the forecasts being provided to it's clients. ## Installation +You can install the `analysis-dashboard` package directly from GitHub. In the main project folder, install requirements: -`pip install -r requirements.txt` or `pip3 install -r requirements.txt`. + +```shell +pip install -r requirements.txt +``` +or + +```shell +pip3 install -r requirements.txt +``` Run `streamlit hello` to check that Streamlit installed. A "Welcome to Streamlit!" page should open in the browser. -Create a login secret: `echo "password = example" > src/.streamlit/secrets.toml`. +Create a login secret: ` +```shell +echo "password = example" > src/.streamlit/secrets.toml +``` ## Database connection @@ -26,12 +39,20 @@ To run the app locally, you'll need to connect it to the `forecast development d OCF team members can connect to the `forecast development database` using [these Notion instructions](https://www.notion.so/openclimatefix/Connecting-to-AWS-RDS-bf35b3fbd61f40df9c974c240e042354). Add `DB_URL= (db_url from notion documents)` to a `secrets.toml` file. Follow the instructions in the Notion document to connect to the database v. -Run app: `cd src && streamlit run main.py`. -## files +Run app: +``` shell +cd src && streamlit run main.py +``` + +## Files ### main.py `main.py` contains functions for the `home page` of the app, which focuses on MAE for the OCF `Quartz Solar` forecast. +### main_india.py + +`main_india.py` contains functions for the `home page` of the app, which focuses on MAE for the OCF `Quartz Emnergy` forecast. + ### forecast.py `forecast.py` contains functions for the `forecast page`. The forecast page looks at how well each of OCF's forecast models is performing compared to `PVLive updated` truth values. @@ -46,11 +67,11 @@ Run app: `cd src && streamlit run main.py`. ### pvsite_forecast.py -TODO +`pvsite_forecast.py` contains the formulas and the metrics used to calculate MAE, nMAE and penalty incured against all sites. ### site_toolbox.py -TODO +`site_toolbox.py` is a page on the dashboard that can be used to get details of any particular site that OCF provides forecast to. ### plots/make_pinball_and_exceedance_plots.py From 4604122b4e8f07ce6698e73c9ddd5999b9b3acbc Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 14:43:21 +0530 Subject: [PATCH 2/7] Update README.md --- README.md | 17 +++++++++++++---- 1 file changed, 13 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 2f20da1..44d21a5 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,8 @@ # uk analysis dashboard [![All Contributors](https://img.shields.io/badge/all_contributors-7-orange.svg?style=flat-square)](#contributors-) -[![ease of contribution: easy](https://img.shields.io/badge/ease%20of%20contribution:%20easy-32bd50)](https://github.com/openclimatefix#how-easy-is-it-to-get-involved) +[![ease of contribution: easy](https://img.shields.io/badge/ease%20of%20contribution:%20easy-32bd50)](https://github.com/openclimatefix#how-easy-is-it-to-get-involved) Internal dashboard for OCF to track forecast statistics and log the historical data of the forecast performance. @@ -23,7 +23,7 @@ pip install -r requirements.txt or ```shell -pip3 install -r requirements.txt +pip install -r requirements.txt ``` Run `streamlit hello` to check that Streamlit installed. A "Welcome to Streamlit!" page should open in the browser. @@ -51,7 +51,7 @@ cd src && streamlit run main.py ### main_india.py -`main_india.py` contains functions for the `home page` of the app, which focuses on MAE for the OCF `Quartz Emnergy` forecast. +`main_india.py` contains functions for the `home page` of the app, which focuses on MAE for the OCF `Quartz Energy` forecast. ### forecast.py @@ -98,7 +98,16 @@ With any push to `main`, in order to deploy changes, the `Terraform Cloud` varia - ENVIRONMENT: Option can be `development` or `production`. This effects the default values on the NWP and Satellite pages -## Contributors +## Contributors and community + + +[![issues badge](https://img.shields.io/github/issues/openclimatefix/elexonpy?color=FFAC5F)](https://github.com/openclimatefix/elexonpy/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc) + +- PR's are welcome! See the [Organisation Profile](https://github.com/openclimatefix) for details on contributing +- Find out about our other projects in the [OCF Meta Repo](https://github.com/openclimatefix/ocf-meta-repo) +- Check out the [OCF blog](https://openclimatefix.org/blog) for updates +- Follow OCF on [LinkedIn](https://uk.linkedin.com/company/open-climate-fix) +- OCF templete: (https://github.com/openclimatefix/ocf-template?tab=readme-ov-file#contributing-and-community) The following folks have contributed to this repo. From 5b9a51facaf4cbb8bbf9f681aecbe157734dedd5 Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 14:55:30 +0530 Subject: [PATCH 3/7] Update README.md --- README.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/README.md b/README.md index 44d21a5..a366ddc 100644 --- a/README.md +++ b/README.md @@ -98,6 +98,21 @@ With any push to `main`, in order to deploy changes, the `Terraform Cloud` varia - ENVIRONMENT: Option can be `development` or `production`. This effects the default values on the NWP and Satellite pages +## Develop + +Currently this repository is only used by OCF for internal metric calculations, as it contiains client information. We hope to make it more freely useable in the near future. + +### Tests + +To run the tests, make sure you have `pytest` installed +```bash +pip install pytest +``` +and then you can run +```bash +pytest +``` + ## Contributors and community From 4591bc94e48d862f63e9f5e6d0f2a416408d550a Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 15:14:09 +0530 Subject: [PATCH 4/7] Update README.md --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index a366ddc..da1ac1b 100644 --- a/README.md +++ b/README.md @@ -155,7 +155,8 @@ The following folks have contributed to this repo. +*Part of the [Open Climate Fix](https://github.com/orgs/openclimatefix/people) community.* - +[![OCF Logo](https://cdn.prod.website-files.com/62d92550f6774db58d441cca/6324a2038936ecda71599a8b_OCF_Logo_black_trans.png)](https://openclimatefix.org) From 323577b05de8a853522a1523394b691ed7672dc1 Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 15:14:52 +0530 Subject: [PATCH 5/7] Update README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index da1ac1b..2c2c591 100644 --- a/README.md +++ b/README.md @@ -154,6 +154,8 @@ The following folks have contributed to this repo. +This project follows the [all-contributors](https://github.com/all-contributors/all-contributors) specification. Contributions of any kind welcome! + *Part of the [Open Climate Fix](https://github.com/orgs/openclimatefix/people) community.* From f1f72650bfd76bdf0c6eea3e800cc10b1abd1d30 Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 16:09:15 +0530 Subject: [PATCH 6/7] Update README.md --- README.md | 5 ----- 1 file changed, 5 deletions(-) diff --git a/README.md b/README.md index 2c2c591..b1480c6 100644 --- a/README.md +++ b/README.md @@ -20,11 +20,6 @@ In the main project folder, install requirements: ```shell pip install -r requirements.txt ``` -or - -```shell -pip install -r requirements.txt -``` Run `streamlit hello` to check that Streamlit installed. A "Welcome to Streamlit!" page should open in the browser. From c044ca151c1eb365db641060563238de0319ec73 Mon Sep 17 00:00:00 2001 From: Adimanv Date: Fri, 15 Nov 2024 16:14:41 +0530 Subject: [PATCH 7/7] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index b1480c6..7f21d6e 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ [![All Contributors](https://img.shields.io/badge/all_contributors-7-orange.svg?style=flat-square)](#contributors-) -[![ease of contribution: easy](https://img.shields.io/badge/ease%20of%20contribution:%20easy-32bd50)](https://github.com/openclimatefix#how-easy-is-it-to-get-involved) +[![ease of contribution: hard](https://img.shields.io/badge/ease%20of%20contribution:%20hard-bb2629)](https://github.com/openclimatefix#how-easy-is-it-to-get-involved) Internal dashboard for OCF to track forecast statistics and log the historical data of the forecast performance.