[ET Trac] [Einstein Toolkit] #1721: Simfactory's test mechanism should use softlinks instead of rsync

Einstein Toolkit trac-noreply at einsteintoolkit.org
Wed Dec 10 15:04:34 CST 2014


#1721: Simfactory's test mechanism should use softlinks instead of rsync
--------------------------+-------------------------------------------------
  Reporter:  eschnett     |       Owner:                     
      Type:  enhancement  |      Status:  new                
  Priority:  minor        |   Milestone:                     
 Component:  SimFactory   |     Version:  development version
Resolution:               |    Keywords:                     
--------------------------+-------------------------------------------------

Comment (by hinder):

 The main reason I added support for running the tests using simfactory was
 so that I could run them on Kraken, where the compute nodes didn't have
 access to the home filesystem, so the copying was essential.  I am also a
 little nervous about the assumption that the source tree stays around.
 The tests may sit in the queue for a while, or you may change branch in
 the source directory.  I agree it would be good to reduce the time taken
 to copy the data, but I seem to remember that a design goal of simfactory
 was to be correct, and avoid people making mistakes, at the potential
 expense of efficiency.

 Maybe we could have a "cache" of the required files on the scratch
 filesystem, and use rsync's link-dest option, to make hard links to that
 cache. It wouldn't help the first time, but subsequent jobs would benefit.

-- 
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1721#comment:1>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit


More information about the Trac mailing list