[ET Trac] [Einstein Toolkit] #488: Reduce space taken by Formaline tarballs

Einstein Toolkit trac-noreply at einsteintoolkit.org
Wed Aug 10 04:07:22 CDT 2011


#488: Reduce space taken by Formaline tarballs
-------------------------+--------------------------------------------------
 Reporter:  hinder       |       Owner:     
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:     
Component:  Cactus       |     Version:     
 Keywords:  Formaline    |  
-------------------------+--------------------------------------------------
 When syncing lightweight data of simulations from a cluster, much of the
 time and disk space on the local system is taken with Formaline tarballs.
 It would be good to reduce this.

 I propose opportunistically replacing the generated tarballs with hard-
 links to existing tarballs on the same filesystem after Formaline has
 written them to the new output directory if the files compare equal.
 These could be from previous restarts of the same simulation when using
 simfactory.  Then, if an entire simulation is rsynced with the appropriate
 options, hard-links will be transferred as hard-links, and the overall
 transfer time and disk space used will be significantly reduced.

-- 
Ticket URL: <https://trac.einsteintoolkit.org/ticket/488>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit


More information about the Trac mailing list