Hi Roland,

Thank you for your clarification. I think I missed the true error, so the actual error is here:

WARNING level 1 from host x1005c1s1b0n1h0.chn.perlmutter.nersc.gov, process 0 in thorn CarpetIOHDF5, file /Cactus/configs/sim/build/CarpetIOHDF5/Output.cc:442: -> Values for DISTRIB=CONSTANT grid variable 'TERMINATIONTRIGGER::watchminutes' (timelevel 0) differ between processors 0 and 383; only the array from processor 0 will be stored.
cactus_sim: H5C.c:6732: H5C_load_entry: Assertion entry->size < ((size_t)(32 * 1024 * 1024)) failed.
Rank 0 with PID 1727399 received signal 6.
Writing backtrace to /Multipole/backtrace.0.txt
srun: error: nid004365: task 0: Aborted.

Then I modified my parameter file by setting IO::out_mode = "proc" to make the checkpoint.h5 file chunked, which fixed the aborted issue. However, this also changed my 3D output HDF5 file to chunked format as well.

Even after adding out_unchunked='yes' in the out_vars parameter, for example:
CarpetIOHDF5::out3D_vars = "HydroBase::rho{out_unchunked='yes'}", it doesn't work.

Is it possible that I didn’t write it in the correct way?

Thank you,

Wei