Weird SyntaxError in latest runs

[PerryShafran-NOAA]

I have this weird error now in my mesoscale run, where I am seeing this error, with very little information as to what it is:

  File "<string>", line 1
SyntaxError: keyword argument repeated: njob

That's it, that's the error. I'm not sure what this is referring to and I can't see in any of the job scripts where anything is repeated in error.

The log file in question is:
/lfs/h2/emc/vpppg/noscrub/perry.shafran/EVS_mesoscale_restart/EVS/dev/drivers/scripts/stats/mesoscale/jevs_mesoscale_nam_grid2obs_stats_00.o177911999

The working directory is:
/lfs/h2/emc/stmp/perry.shafran/evs_test/prod/tmp/jevs_mesoscale_nam_grid2obs_stats_00.177911999.cbqs01

I don't know what's causing these statements, but it is not causing any FATAL ERRORs, nor is it causing the code to crash. In fact, the resultant final stats file is identical to the stats file in emc.vpppg (at least in size).

All issues with the completed_jobs.txt have been resolved, and I am now using SENDCOM to send data to COMOUT. It's possible that maybe there is some issue with indentation, but I am not sure and extra set of eyes hopefully can assist.

If you check the current PR #652 , you can see what is different from the current code to what's currently in develop. One of these changes introduced an error and I can't figure out where. See https://github.com/NOAA-EMC/EVS/pull/652/files.

Thanks so much!

[malloryprow]

I found this on Google: https://stackoverflow.com/questions/63064844/python-syntaxerror-vs-typeerror-for-repeated-keyword-arguments.

It seems like somewhere in the code you are passing njob= twice.

[PerryShafran-NOAA]

Oh, OK, I think I know where it is. Don't know how it got there, but I'll see if that's the issue.

I think it may be this:

                    if SENDCOM == 'YES':
                      job_cmd_list_iterative.append(
                        f'#python -c '
                        + '\"import mesoscale_util as cutil; cutil.copy_data_to_restart('
                        + '\\\"${DATA}\\\", \\\"${RESTART_DIR}\\\", '
                        + f'njob=\\\"{njob}\\\", '
                        + 'verif_case=\\\"${VERIF_CASE}\\\", '
                        + 'verif_type=\\\"${VERIF_TYPE}\\\", '
                        + 'vx_mask=\\\"${NEST}\\\", '
                        + 'met_tool=\\\"merged_ptype\\\", '
                        + 'vdate=\\\"${VDATE}\\\", '
                        + 'vhour=\\\"${VHOUR}\\\", '
                        + 'fhr_start=\\\"${FHR_START}\\\", '
                        + 'fhr_end=\\\"${FHR_END}\\\", '
                        + 'fhr_incr=\\\"${FHR_INCR}\\\", '
                        + 'model=\\\"${MODELNAME}\\\", '
                        + f'njob=\\\"{njob}\\\"'
                        + ')\"'
                      )

I don't know how the second njob got in there. Just checked the corresponding script in cam and there is no 2nd njob. Must have been put there in error.

[malloryprow]

Glad you found it! Shall we close this discussion?

[PerryShafran-NOAA]

That was it! Removing the 2nd njob instance in several sections did the trick. I think we can resolve this issue.

[PerryShafran-NOAA]

Yes, I confirmed that this was the problem, and we can close the discussion.