Cheyenne-disabled tests also include cpld_bmark_p8, cpld_restart_bmark_p8 and conus13km_debug_qr

Cheyenne-disabled tests also include cpld_bmark_p8, cpld_restart_bmark_p8 and conus13km_debug_qr

Yes, true. Ok, noted in description as well.

Here are the modules that are needed to be loaded on Derecho to enable use of ecflow and rocoto:

module use /glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles
module load ecflow/5.8.4

module use /glade/work/epicufsrt/contrib/derecho/rocoto/modulefiles
module load rocoto

@natalie-perlin ok, should variable ECFLOW_START=/glade/p/ral/jntp/tools/miniconda3/4.8.3/envs/ufs-weather-model/bin/ecflow_start.sh be changed?

Derecho has it's own ecflow install through module load ecflow, if it's easier to use that.

Once you module load ecflow it creates the paths to use their ecflow_start.sh. I am not sure though, how much that complicates ecflow package on python.

There is an ecflow_start.sh script already:
ECFLOW_START=/glade/work/epicufsrt/contrib/spack-stack/derecho/ecflow-5.8.4/bin/ecflow_start.sh

Derecho has it's own ecflow install through module load ecflow, if it's easier to use that.

Once you module load ecflow it creates the paths to use their ecflow_start.sh. I am not sure though, how much that complicates ecflow package on python.

@BrianCurtis-NOAA - it might be more handy to use the same ecflow version as used during the spack-stack build

I have this setup for Derecho in rt.sh.
elif [[ $MACHINE_ID = derecho ]]; then

export PATH=/glade/work/epicufsrt/contrib/derecho/rocoto/bin:$PATH
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles
module load ecflow/5.8.4
ECF_PORT=$(( $(id -u) + 1500 ))
ECFLOW_START=/glade/work/epicufsrt/contrib/spack-stack/derecho/ecflow-5.8.4/bin/ecflow_start.sh

Getting: ImportError: /glade/u/home/zshrader/miniconda3/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /glade/work/epicufsrt/contrib/spack-stack/derecho/ecflow-5.8.4/lib/python3.10/site-packages/ecflow/ecflow.so)

These changes to rt.sh allowed a job to enter the queue (still Queued ):

elif [[ $MACHINE_ID = derecho ]]; then

 module use /glade/work/epicufsrt/contrib/derecho/rocoto/modulefiles
 module load rocoto
 module use /glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles
 module load ecflow/5.8.4
 module unload ncarcompilers
 module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-1.5.1/envs/unified-env/install/modulefiles/Core
 module load stack-intel/2021.10.0
 module load stack-python/3.10.8
 ECFLOW_START=/glade/work/epicufsrt/contrib/spack-stack/derecho/ecflow-5.8.4/bin/ecflow_start.sh

I could also suggest to modify the following in the ./modulefiles/ufs_derecho.intel.lua:

Change the line:
prepend_path("MODULEPATH", "/lustre/desc1/scratch/epicufsrt/contrib/modulefiles")
to
prepend_path("MODULEPATH", "/glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles")

@zach1221 - with these changes, a test cpld_control_p8_mixedmode_intel passed successfully (only this test is set in rt.conf).
Regression test log: /glade/derecho/scratch/nperlin/UFS-WM/ufs-weather-model/tests/logs/RegressionTests_derecho.log

/glade/derecho/scratch/nperlin/UFS-WM/ufs-weather-model/tests

Seems to be working @natalie-perlin . Thank you,