Sample .xml using groups? #3299
-
|
I would like to use groups for my post-processing tasks to increase the performance of my rocoto commands, but I am also trying to keep my global-workflow hash synced with the SFS_baseline_hydro. Does someone have a sample .xml file that I could look at to see how I would need to change my .xml files to use groups? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 7 replies
-
|
@benjamin-cash manually editing the XML would be both cumbersome and not sufficient, as the rocoto job stubs ( |
Beta Was this translation helpful? Give feedback.
-
|
@WalterKolczynski-NOAA - I was successful in cherry picking this update and with the default setting it reduced the rocotorun time to a little less than 4 minutes. Still not ideal, but much much better. |
Beta Was this translation helpful? Give feedback.
-
|
If it is still slow, you can try reducing the number of groups further by modifying |
Beta Was this translation helpful? Give feedback.
-
|
How long are your rocoto commands taking? And for what kind of experiment setup? Frontera is experiencing some kind of disk/performance flakiness that could be contributing. |
Beta Was this translation helpful? Give feedback.
-
|
It was a couple weeks ago now, but it I think it was under a minute for a 21-member GEFS to 384. With the groups, the forecast length shouldn't matter once you've saturated |
Beta Was this translation helpful? Give feedback.
-
|
Update - timing is now down close to 1 minute, so I think I was seeing the impact of whatever was happening on Frontera. |
Beta Was this translation helpful? Give feedback.
@benjamin-cash manually editing the XML would be both cumbersome and not sufficient, as the rocoto job stubs (
jobs/rocoto) also need to be updated to handle looping over a list of hours. I recommend cherry-picking #3208 into your branch if you need that capability.