[ET Trac] [Einstein Toolkit] #2059: SimFactory should detect the number of cores automatically

Einstein Toolkit trac-noreply at einsteintoolkit.org
Thu Sep 7 07:51:44 CDT 2017


#2059: SimFactory should detect the number of cores automatically
--------------------------+-------------------------------------------------
  Reporter:  hinder       |       Owner:                     
      Type:  enhancement  |      Status:  review             
  Priority:  minor        |   Milestone:                     
 Component:  SimFactory   |     Version:  development version
Resolution:               |    Keywords:                     
--------------------------+-------------------------------------------------

Comment (by rhaas):

 True, a very point. I attach output files to back up the stated speed
 improvement for 12 MPI ranks and 1 threads vs. 2 MPI ranks and 6 threads
 on my workstation. Speed difference is (for static_tov.par) 200Msun/hr vs.
 250Msun/hr so ~25% speedup. I also tested 12 threads (hyperthreading)
 which (keeping the parfile unchanged) makes it much slower: 10M/hr.

 Question is then: do we want this? Ie having simfactory's auto-detect
 logic set up an "unusual" setting that differs from what is typically used
 on clusters? Mostly interesting if (which I assume will happen) to set up
 a new cluster, people will start from "sim setup" on the login node.
 Typically I am not concerned with speed on individual workstations,
 reproducibility and debug-ability are much more important to me on my
 workstation (since I used it to debug and test code but not to run
 simulations).

 Testsuites may be a issue (namely that we want both multiple MPI ranks and
 multiple threads in a testsuite run) but those always can be enforced by
 passing --num-threads and --procs options to simfactory.

 So MPI only gives more speed (very nice). It is less "common" on clusters
 which may be an issue if "sim setup" is used as a base for cluster
 installations (it will have to be modified anyway).

 I tended to prefer having something closer to a cluster setup, but really
 see the advantages of having faster evolutions so could certainly live
 with it. In particular for actual laptops/workstations only. Is there
 anyone who cannot live with either option?

-- 
Ticket URL: <https://trac.einsteintoolkit.org/ticket/2059#comment:20>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit


More information about the Trac mailing list