#1743: Reduce number of output files per directory -----------------------+---------------------------------------------------- Reporter: eschnett | Owner: Type: defect | Status: review Priority: unset | Milestone: Component: Other | Version: development version Resolution: | Keywords: -----------------------+----------------------------------------------------
Comment (by eschnett):
In CarpetSimulationIO (my new output thorn), I introduce a parameter that selects the maximum number of output files per directory. Files are then automatically split over sub-directories as necessary. The root process also creates a single file containing the relevant metadata as well as HDF5 external links to the datasets in the files in the subdirectories.
We should have a ET developers' day for SimulationIO. That's probably more accessible than FunHPC as well, thus there might be more interest.