Skip to content
Bakinam Tarik Essawy edited this page Oct 8, 2015 · 35 revisions

Software Details for the VIC/iRODS Data Pre-Processing Pipeline

Bakinam T. Essawy*
Jonathon L. Goodall*
*Department of Civil and Environmental Engineering, University of Virginia, Charlottesville, Virginia

precipitation.r

processncdcPrcp.r

Description: Process precipitation data from study area.

Shell scripts used: run_convert_prcp.scr Argument file: None

Source code: convertPrcp.cpp Source code language: C++ Compiler used: g++ Operating system: Ubuntu

Input files: prcpncdc.inf, one or more weather station files

Output files: prcp.daily, prcp.inf

readPreprocDly.r

Description: Formatting the combined data

Shell scripts used: inputPrcp.scr Argument files: prcp.daily, prcp.inf, and basin_prcp.fmt

Source code: read_prec_dly.f Source code language: FORTRAN Compiler used: f77 –o Additional information from the FORTRAN code: This program reads the output from the script previous script and formats the daily precipitation so the regrid program can read them. It uses the daily data and the station information files

Output file: prcpncdc.daily

precTobAdj.r

Description: Time of adjustment of the combined data

Shell scripts used: prcp_tobAdj.scr Argument files: prec_tob_adj.input

Source code: prec_tob_adj.f Source code language: FORTRAN Compiler used: f77 –o Additional information from the FORTRAN code: This program reads the output from the read_prec_dly.f program and adjusts the daily precipitation to account for the time of observation for each gauge. This prepares a new file in the same format as the .fmt file for input to the regridding program.

Input files: basin_prcp.fmt, prcp.inf, and coop_tob.his

Output file: basin_prcp_adj.fmt

createMask.r

Description: Create mask (ascii file) for the study area

Shell scripts used: run_convert_tif_ascii.scr Argument file: None

Source code: convert_tif_ascii.py, tiff2ascii.py Source code language: Python Libraries used: sys, Image, logging, gdal

Input files: DEM.tif,

Output files: mask_125.asc

regridPrcp.r

Description: Regridding the precipitation data for the basin This script will store the content of the regridPrcp directory to the tmp directory under the name of prcp.log

Shell scripts used: regrd_prcp.scr Argument file: None

Input files: regrdPrcp

Output files: prcp.log, adjprcp_grid.grd

mkMonthlyPrcp.r

Description: Estimate monthly precipitation from NCDC data

Shell scripts used: mk_monthly_ir.scr Argument files: None

Source code: mk_monthly.c Source code language: C Compiler used: gcc –o
Additional information from the C code: This program reads the output file from the regridding program (adjprcp_grid.grd). It then generates monthly values for jan,feb,mar,etc that will be used together with PRISM data to scale the timeseries in each gridcell

Input files: adjprcp_grid.grd

Output file: mk_monthly/*.monthly

Shell scripts used: run.mk_monthly.scr Argument files: None

Additional information from the additional script run.mk_monthly.scr: This script is used to run 'mk_monthly'. The output directory for 'jan.monthly, feb.monthly, etc, must be made before program execution. binflag=1 means data is in 2-byte signed binary formatmult is the data multiplier (saved as data*mult) -- only used for binary

Input files: 'mk_monthly/*

Output file: mk_mnth/monthly.*

mkPrism.r

Description: estimate monthly PRISM data

Shell scripts used: get_prism_ir.scr Argument files: None

Source code: get_prism.c Source code language: C Compiler used: gcc –o
Additional information from the script: This program reads the prism data (C.Daly et al 1993) and converts them into monthly gridded data at a chosen resolution. The program needs a maskfile as input together with the prism rawdata. The rawdata used in this program is located at /can-usa-prism/can_us_prism.jan . These files contains prism data for USA. If other prism rawdatafiles are used, then lines 28 to 38 should be changed in this program. If there are gridcells forexample in Canada that the prism data is not covering. The no_data value will be written in the outputfiles corresponding gridcell . The rescaling program will check for this void value at a later stage and the precip value will not be scaled for this gridcell.

Input files: mask_125.asc, prism-rawdata/can_us_prism.*

Output file: Prism/prisim.*

mkRescale.r

Description: Rescaling the precipitation data

Shell scripts used: rescale_ir.scr Argument file: None

Source code: convertPrcp.cpp Source code language: C Compiler used: gcc -o Operating system: Ubuntu

Additional information from the script: This program rescales the gridded data from the program regrid with the ratio of precipvalue in cell * (prism.jan/monthly.jan). This is done to achieve monthly precipitation in each grid cell equal to prism monthly meansInputfiles are the gridded data file, monthly values (mk_monthly) and prism monthly values (get_prism). Output is a new rescaled gridded file that can be turned into the final VIC input files.

Input files: mask_125.asc, mk_mnth/monthly., Prism/prism., adjprcp_grid.grd

Output files: adjprcp_rsm.rsc

processncdcTmax.r

Description: Process maximum temperature data from study area

Shell scripts used: run_convert_tmax.scr Argument file: None

Source code: convertTmax.cpp Source code language: C++ Compiler used: gcc -o Operating system: Ubuntu

Input files: stationinfo.txt, Climate stations.

Output files: Tmax/ tmax.daily

readPreprocTmaxDly.r

Description: Formatting the combined data

Shell scripts used: inputTmax.scr Argument file: tmax.daily, tmax.inf and basin_tmax.fmt

Source code: read_temp_dly.f Source code language: FORTRAN Compiler used: f77 -o Operating system: Ubuntu

Additional information from the script: This program reads the output from the script inputPrcp.scr and formats the daily temperature so the regrid program can read them. Only the .fmt (cmb_prcp.fmt) file is output

Output files: basin_tmax.fmt

tmaxTobAdj.r

Description: Time of adjustment of the combined data

Shell scripts used: tmax_tobAdj.scr Argument file: tmax_tob_adj.input

Source code: tmax_tob_adj.f Source code language: FORTRAN Compiler used: f77 -o Operating system: Ubuntu

Additional information from the script: This program reads the output from the read_prec_dly.f program and adjusts the daily precipitation to account for the time of observation for each gauge. This prepares a new file in the same format as the .fmt file for input to the regridding program.

Input files: Tmax/basin_tmax.fmt, Tmax/tmax.inf and Tmax/tob/coop_tob.his Output files: basin_tmax_adj.fmt

regridTmax.r

Description: Regridding the maximum temperature data for the basin

Shell scripts used: regridTmax.scr Argument file: None

The shell script regrid/Tmax/*o , then the regrdTmax will be stored in the tmp directory under tmax.log.

processncdcTmin.r

Description: Process minimum temperature data from study area

Shell scripts used: run_convert_tmin.scr Argument file:None

Source code: convertTmin.cpp Source code language: C++ Compiler used: g++ -o Operating system: Ubuntu

Input files: stationinfo.txt, tminncdc.inf and climate stations Output files: tmin.daily, tmin.inf

readPreprocTminDly.r

Description: Formatting the combined data

Shell scripts used: inputTmin.scr Argument file: Tmin/tmin.daily, Tmin/tmin.inf, Tmin/basin_tmin.fmt

Source code: read_temp_dly.f Source code language: FORTRAN Compiler used: f77 -o Operating system: Ubuntu

Additional information from the script: This program reads the output from the script inputPrcp_tmax/tmin.scr and formats the daily temperature so the regrid program can read them Only the *.fmt (cmb_prcp.fmt) file is output

Output files: basin_tmin.fmt

tminTobAdj.r

Description: Time of adjustment of the combined data

Shell scripts used: tmin_tobAdj.scr Argument file: tmin_tob_adj.input

Source code: tmin_tob_adj.f Source code language: FORTRAN Compiler used: f77 -o Operating system: Ubuntu

Additional information from the script: This program reads the output from the read_prec_dly.f program and adjusts the daily precipitation to account for the time of observation for each gauge. This prepares a new file in the same format as the .fmt file for input to the regridding program.

Output files: Tmin/basin_tmin.fmt

regridTmin.r

Description: Time of adjustment of the combined data

Shell scripts used: regrd_tmin.scr Argument file: None

The shell script regrid/Tmin/*o , then the regrdTmin will be stored in the tmp directory under tmin.log

vicInputMeteoData.r

Description: Run meteorological data (prcp_grid.rsc, tmax_grid.grd and tmin_grid.grd) to create gridded data for the study area.

Shell scripts used: run_vicinput_ir.scr Argument file: None

Source code: vicinput.c Source code language: C Compiler used: gcc -o Operating system: Ubuntu

Additional information from the script: This program reads the output from A.H.s regridding program and generates the vicinput files. The input needed is prcp, tmin, tmax,maskfile, outp_directory, binary_flag

Additional script is used to set the input files script: run_vicinput.scr

Input file: adjprcp_rsm.rsc, adjtmax_grid.grd, adjtmin_grid.grd, and mask_125.asc Output files: meteoCombined/data_*_

getNCARwind.r

Description: Collect wind speed data from NCEP/NCAR.

Shell scripts used: getwind.scr Argument file: None

This script sets the limits for the lat and long, output directory, and uses the ncks tool for conversion of the netCDF data to text

Additional script is used to set the input files script: run_vicinput.scr

Input file: gauss_t62_lat.list, gauss_t62_lon.list Output files: raw_wind/uwnd..asc, raw_wind/vwnd.asc

Clone this wiki locally