#1273: hdf5 index files created for checkpoints not deleted -----------------------------------------+---------------------------------- Reporter: wolfgang.kastaun@… | Owner: eschnett Type: defect | Status: new Priority: minor | Milestone: Component: Carpet | Version: ET_2012_11 Keywords: | -----------------------------------------+---------------------------------- I recently evolved with activated hdf5 index file creation, using the Oersted release. I notice that also for checkpoint files the index files are saved, but in contrast to the checkpoint files themselves, the old index files are never deleted. I had more than 25000 checkpoint index files accumulated in my simulation directory !
#1273: hdf5 index files created for checkpoints not deleted ------------------------------------------+--------------------------------- Reporter: wolfgang.kastaun@… | Owner: eschnett Type: defect | Status: review Priority: minor | Milestone: Component: Carpet | Version: ET_2012_11 Resolution: | Keywords: ------------------------------------------+--------------------------------- Changes (by rhaas):
* status: new => review
Comment:
The two patches attached should fix this by (1) adding a separate option to control index files for checkpoints, (2) remove index files along with checkpoint files (does some string manipulation along the lines of cp.it_12.file_0.h5 -> p.it_12.file_0.idx.h5 by inserting ".idx" just before the ".h5" part).
#1273: hdf5 index files created for checkpoints not deleted ------------------------------------------+--------------------------------- Reporter: wolfgang.kastaun@… | Owner: eschnett Type: defect | Status: review Priority: minor | Milestone: Component: Carpet | Version: ET_2012_11 Resolution: | Keywords: ------------------------------------------+---------------------------------
Comment (by eschnett):
I disagree with a separate option for checkpoint files. If the index files are really fast and cheap, this option should not be necessary. And after all, checkpoint files are also read, either by visualisation tools (e.g. for NaN debugging), or when restarting; in both cases, index files could be useful (depending on the reader).
The change in default value can obviously not be back-ported. The new parameter should also not be backported. Deleting checkpoints' index files should be backported as bug fix.
#1273: hdf5 index files created for checkpoints not deleted ------------------------------------------+--------------------------------- Reporter: wolfgang.kastaun@… | Owner: eschnett Type: defect | Status: closed Priority: minor | Milestone: Component: Carpet | Version: ET_2012_11 Resolution: fixed | Keywords: ------------------------------------------+--------------------------------- Changes (by rhaas):
* status: review => closed * resolution: => fixed
Comment:
Applied the bugfix as cbb04d13f1e3cca8cf3ea6c4efba783e8303c717 "CarpetIOHDF5: remove index files along with checkpoint files" in Carpet/master and cb3c87b6733abb86f7de439acb88bd84f201fa82 of Carpet/ET_2012_11 .
trac@lists.einsteintoolkit.org
-
Einstein Toolkit