#488: Reduce space taken by Formaline tarballs --------------------------+------------------------------------------------- Reporter: hinder | Owner: Type: enhancement | Status: review Priority: minor | Milestone: Component: Cactus | Version: Resolution: | Keywords: Formaline --------------------------+-------------------------------------------------
Comment (by hinder):
I currently disable syncing of Formaline tarballs because they take up so much space and time. This defeats the whole purpose of Formaline. The proposed solution in the patch only eliminates duplicated data from within a single simulation. In the case of running benchmarks, this does not help, as typically there will only be one restart per simulation. Similarly for small debugging runs. The current solution is OK, but it would be much better if the files were shared across simulations. They could live in the CACHE directory, just as executables do. Is there a reason to treat them differently? When rsyncing simulations, the CACHE directory could be synced as well, and with suitable options, rsync will respect the hard links.
Regarding the code: it makes an assumption about the name of the output directories. This should be obtained from a function which would be used throughout simfactory. I know this assumption is made frequently, but for new code, we should try to do better.
Please also see #127 if you think that simfactory 2 puts hardlinks to the executable in each restart.