WW3_Optimization

Physics Optimization tools

Users who only need to check out the latest code or certain tags can clone the repository without having a GitHub account:
git clone https://github.com/aliabdolali/WW3_Optimization.git
or with GitHub account
git clone [email protected]:aliabdolali/WW3_Optimization.git
cd WW3_Optimization
% git checkout develop (or tags)
git submodule update --init --recursive

compile nlopt with Matlab plugin

cd WW3_Optimization/tools
./makenlopt.sh

Fill the templates and retrieve the forcings from global dump and hpss and spinup run

cd WW3_Optimization/tests/test<test_name>
modify input_vars.sh and add the start day (STARTDATE), number of forecast days (forecast_day) and other required parameters:
STARTDATE="<YYYY-MM-DD>"
spinup_day=<NO1>
forecast_day=<NO2>
execute
./prep_spinup.sh
to fill templates for WW3 fix files, forcing and observations (satellite and point source data) retrieval. This script is for model spinup for the duration of spinup_day before STARTDATE and continues for forecast_day. The filled WW3 input templates are then added to input_spinup.

Run model spinup

cd WW3_Optimization/tests execute
./bin/spinup_matrix_prep
to prepare spinup jobcard and submit it:
sbatch spinup
Once the spinup simulation is done, the restart* files at (STARTDATE) are written in WW3_Optimization/tests/test<test_name>/work_spinup.

Run initial runs (Optional)

In order to optimize n physics parameters, the NLOPT_LN_BOBYQA optimization method requires the model skill for the default and 2 perturbations around each parameter (Total of 2n+1). These initial simulations can be done concurrently. cd WW3_Optimization/tests execute
./bin/initial_matrix_prep
The initial matrix can be divided into sub-matrixes using
./bin/divider initial 9
which divides initial matrix into submatrixes, each with 3 tests.

Run Optimization

cd WW3_Optimization/tests
execute
./bin/opt_matrix_prep
to prepare opt_matrix jobcard and submit:
sbatch opt_matrix

WW3_Optimization/tests/opt_table_Err_unnorm is populated after each round of data exchange between WW3 and NLOPT, where each row starts with global and regional scores followed by n input variables.

Developers:
Ali Abdolali (EMC/NCEP/NOAA [email protected])
Matthew Masarik (EMC/NCEP/NOAA [email protected])