Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix/nfcens wafs #391

Merged

Conversation

SamiraArdani-NOAA
Copy link
Contributor

Pull Request Testing

  • Describe testing already performed for this Pull Request:

    clone my EVS repository in your local, then find the driver scripts located at: EVS/dev/drivers/scripts

  • Recommend testing for the reviewer(s) to perform, including the location of input datasets, and any additional instructions:

    for NFCENS:
    To run prep: dev/drivers/scripts/prep/nfcens/jevs_nfcens_wave_grid2obs_prep.sh
    To run stats: dev/driver/scripts/stats/nfcens/jevs_nfcens_wave_grid2obs_stats.sh
    To run plots: dev/driver/scripts/plots/nfcens/jevs_nfcens_wave_grid2obs_plots.sh
    for WAFS:
    To run stats: dev/driver/scripts/stats/wafs/jevs_wafs_atmos_stats.sh

  • Has the code been checked to ensure that no errors occur during the execution? [Yes]

  • Do these updates/additions include sufficient testing updates? [Yes or No]

  • Please complete this pull request review by [Fill in date].

Pull Request Checklist

  • Review the source issue metadata (required labels, projects, and milestone).

  • Complete the PR description above.

  • Ensure the PR title matches the feature branch name.

  • Check the following:

  • Instructions provided on how to run

  • Developer's name is replaced by ${user} where necessary throughout the code

  • Check that the ecf file has all the proper definitions of variables

  • Check that the jobs file has all the proper settings of COMIN and COMOUT and other input variables

  • Check to see that the output directory structure is followed

  • Be sure that you are not using MET utilities outside the METplus wrapper structure

  • After submitting the PR, select Development issue with the original issue number.

  • After the PR is approved, merge your changes. If permissions do not allow this, request that the reviewer do the merge.

  • Close the linked issue.

@ShelleyMelchior-NOAA
Copy link
Contributor

I have cloned your fork and checked out branch bugfix/nfcens_wafs.

@ShelleyMelchior-NOAA
Copy link
Contributor

ShelleyMelchior-NOAA commented Dec 20, 2023

The wafs changes look good. I ran wafs processing. I grepped on cmdfile in the log file in both my test and in the latest emc.vpppg runs.

[dlogin07 /lfs/h2/emc/ptmp/shelley.melchior/EVS_out]$ grep cmdfile jevs_wafs_stats.o121727939 
0 + '[' -s wafs_stat.cmdfile ']'
1 + mpiexec -np 4 -cpu-bind verbose,core cfp wafs_stat.cmdfile
[dlogin07 /lfs/h2/emc/ptmp/shelley.melchior/EVS_out]$ grep cmdfile ../../emc.vpppg/output/jevs_wafs_stats.o121656992 
0 + '[' -s wafs_stat.cmdfile ']'
0 + echo 'WARNING: wafs_stat.cmdfile DOES NOT EXIST'
WARNING: wafs_stat.cmdfile DOES NOT EXIST
1 + mpiexec -np 4 -cpu-bind verbose,core cfp wafs_stat.cmdfile

The WARNING was removed is no longer part of the if test. ✔️

stats processing completed successfully.

@ShelleyMelchior-NOAA
Copy link
Contributor

The AQM change looks fine and align with NCO SPA suggestion. I do not believe I can test it since our dev driver scripts override COMIN and COMOUT default settings.

@ShelleyMelchior-NOAA
Copy link
Contributor

ShelleyMelchior-NOAA commented Dec 20, 2023

The ecf changes can't be tested. But @SamiraArdani-NOAA checked that the equivalent dev driver scripts had the appropriate #PBS -N naming convention. prep and stats looked good already. plots needed updating. I ran nfcens plots. The job is now the proper name, as born out in the name of the logfile:
/lfs/h2/emc/ptmp/shelley.melchior/EVS_out/jevs_nfcens_wave_grid2obs_plots.o121728373
vs the name in the latest run of nfcens plots in the emc.vpppg parallel:
/lfs/h2/emc/ptmp/emc.vpppg/output/jevs_nfcens_grid2obs_plots.o121680647

plots processing completed successfully. ✔️

@ShelleyMelchior-NOAA
Copy link
Contributor

I was trying to find the mkdir -p ${DATA}/sfcshp manifest in the output log file. In trying to track it down, I think we need to add the err_chk to return from the processes of evs_wave_timeseries.sh and evs_wave_leadaverages.sh in exevs_nfcens_wave_grid2obs_plots.sh.

See lines 99-102 of exevs_nfcens_wave_grid2obs_plots.sh

${USHevs}/${COMPONENT}/evs_wave_timeseries.sh

## lead_averages
${USHevs}/${COMPONENT}/evs_wave_leadaverages.sh
  

I think the following line needs to be put after each call to run the USHevs scripts:
export err=$?; err_chk

Do you agree? If so, I think we need to do this as something that was missed in the EE2 checklist.

@ShelleyMelchior-NOAA
Copy link
Contributor

I ran nfcens plots w/ SENDDBN set up for FAKE dbn_alert. The new for loop works correctly for the FAKE dbn_alert set up. ✔️

@ShelleyMelchior-NOAA
Copy link
Contributor

The re-run of nfcens plotting to include err_chk worked correctly. From the logfile (/lfs/h2/emc/ptmp/shelley.melchior/EVS_out/jevs_nfcens_wave_grid2obs_plots.o121773518):

+ 3 + /lfs/h2/emc/vpppg/noscrub/shelley.melchior/EVS/ush/nfcens/evs_wave_timeseries.sh
+ 6 + export err=0
+ 6 + err=0
+ 6 + err_chk
 completed cleanly
+ 6 + /lfs/h2/emc/vpppg/noscrub/shelley.melchior/EVS/ush/nfcens/evs_wave_leadaverages.sh
+ 6 + export err=0
+ 6 + err=0
+ 6 + err_chk
 completed cleanly

The plots tar files are generated and match closely with emc.vpppg.

Copy link
Contributor

@ShelleyMelchior-NOAA ShelleyMelchior-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All tests yielded expected results. I approve this PR for merge.

@ShelleyMelchior-NOAA
Copy link
Contributor

@AliciaBentley-NOAA, @PerryShafran-NOAA , I recommend this PR for merge. However, I will not merge it yet, allowing the chance for your review.

@AliciaBentley-NOAA
Copy link
Contributor

@SamiraArdani-NOAA @ShelleyMelchior-NOAA I have looked over this PR and think it is good to go! Thank you!

@ShelleyMelchior-NOAA ShelleyMelchior-NOAA merged commit 9d572a3 into NOAA-EMC:develop Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants