[ET Trac] [Einstein Toolkit] #488: Reduce space taken by Formaline tarballs
Einstein Toolkit
trac-noreply at einsteintoolkit.org
Wed Aug 10 04:07:22 CDT 2011
#488: Reduce space taken by Formaline tarballs
-------------------------+--------------------------------------------------
Reporter: hinder | Owner:
Type: enhancement | Status: new
Priority: minor | Milestone:
Component: Cactus | Version:
Keywords: Formaline |
-------------------------+--------------------------------------------------
When syncing lightweight data of simulations from a cluster, much of the
time and disk space on the local system is taken with Formaline tarballs.
It would be good to reduce this.
I propose opportunistically replacing the generated tarballs with hard-
links to existing tarballs on the same filesystem after Formaline has
written them to the new output directory if the files compare equal.
These could be from previous restarts of the same simulation when using
simfactory. Then, if an entire simulation is rsynced with the appropriate
options, hard-links will be transferred as hard-links, and the overall
transfer time and disk space used will be significantly reduced.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/488>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
More information about the Trac
mailing list