This repository contains files with Python-code used to download hydroclimate historical series from the IDEAM (Instituto de Hidrología, Meteorología y Estudios Ambientales), Colombia. The following gives a brief description of the individual files:
-
A WebDriver to drive a browser natively. This tool allows automated testing of webapps across many browsers. It provides capabilities for navigating to web pages, user input, JavaScript execution, and more. Be sure to download the version that is compatible with your browser.
NOTE: the program is written to work with Chrome. In case of using another browser, it is necessary to change the specifications of the following lines in the IDEAM_extract.py function:
- Line 23 : change the WebDriver's name (from "chromedriver.exe" to "geckodriver.exe" for example)
- Lines 26-30: from chrome_options to Firefox_options
- Line 54 : from driver = webdriver.Chrome(chrome_path, chrome_options = chrome_options) to driver = webdriver.Firefox(Firefox_path, options=Firefox_options)
-
An Excel file with the following columns:
| CODIGO | DEPARTAMENTO | MUNICIPIO |
|---|---|---|
| Content | Content | Content |
The input document extension must be in .xls or .xlsx. The file name must follow the format: DD-MM-YYYYY_DD-MM-YYYYY_VARIABLE_Description.xls.
Example: 16-02-2020_17-02-2020_PRECIPITACION_Día pluviométrico.xls
* Start date: 16-02-2020
* End date: 17-02-2020
* Variable: PRECIPITACION
* Description: Día pluviométrico
Important:
-
This file does not necessarily have to be in the same folder as the functions.
-
All the information on the website is in Spanish, be sure to write the variable names and their description correctly. Otherwise, the program will display an error.
-
You must have an .xls file for each description. The website is configured to select one description and variable at a time, so the name of the Excel file should only contain one. Incorrects 👎:
16-02-2020_17-02-2020_PRECIPITACION_Día pluviométrico_Precipitación total diaria.xls 16-02-2020_17-02-2020_PRECIPITACION_CAUDAL_Día pluviométrico_Caudal medio diario.xls -
Only ten inquiries can be made per request. Therefore, the number of stations in the Excel document should not exceed this amount.
MainIDEAM.py. This is the only function to execute. It prepares the inputs to extract the data from the website using the Excel document detailed above. This function does not need to be modified.
IDEAM_extract.py. In this function, you must specify the output path and where the WebDriver is located (lines 22-23)
The file ListVariablesAndDescriptions.md contains some variables with their descriptions. If you are interested in other variables, you can visit the IDEAM website and check the different options.
NOTE: The function works well, but is still in progress. Feel free to contact me if you want to contribute or if you find any bugs. 😃 Upcoming updates 💃:
- Work with any browser
- Specify the name of the output file
You can contact me at [email protected] 📧