<html>#2499: New machine thornyflat at WVU
<table style='border-spacing: 1ex 0pt; '>
<tr><td style='text-align:right'> Reporter:</td><td>Erik Schnetter</td></tr>
<tr><td style='text-align:right'> Status:</td><td>open</td></tr>
<tr><td style='text-align:right'>Milestone:</td><td></td></tr>
<tr><td style='text-align:right'> Version:</td><td>development version</td></tr>
<tr><td style='text-align:right'> Type:</td><td>enhancement</td></tr>
<tr><td style='text-align:right'> Priority:</td><td>minor</td></tr>
<tr><td style='text-align:right'>Component:</td><td>SimFactory</td></tr>
</table>
<p>Comment (by Maria):</p>
<p>Eric, I am picking up this ticket to let you know that it is not sorted out yet. I tried to run GW150914.par on 4 nodes (160 cores) and nsnstohmns.par on 1 node (40 cores), both within a PBS batch script and directly from the terminal. My jobs were either cancelled “for the following reason: no feasible locations found to run job”, or I cancelled them after more of a week of sitting in the queue. My priority, as external user, must be rather low. </p>
<p>Here is the output when starting from the terminal: </p>
<ol>
<li>for GW150914</li>
</ol>
<p>[mbh0012@trcis001 Cactus]$ simfactory/bin/sim create-submit GW150914_128 --configuration=bns --machine=thornyflat --parfile=par/GW150914.par --cores=128<br />
Warning: Current Working directory does not match Cactus sourcetree, changing to /users/mbh0012/Cactus<br />
Parameter file: /gpfs20/users/mbh0012/Cactus/par/GW150914.par<br />
Skeleton Created<br />
Job directory: "/scratch/mbh0012/simulations/GW150914_128"<br />
Executable: "/users/mbh0012/Cactus/exe/cactus_bns"<br />
Option list: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/cfg/OptionList"<br />
Submit script: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/run/SubmitScript"<br />
Run script: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/run/RunScript"<br />
Parameter file: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/par/GW150914.par"<br />
Assigned restart id: 0<br />
Warning: Total number of threads and number of threads per process are inconsistent: procs=128, num-threads=20 (procs*num-smt must be an integer multiple of num-threads)<br />
Warning: Total number of threads and number of cores per node are inconsistent: procs=128, ppn-used=40 (procs must be an integer multiple of ppn-used)<br />
Executing submit command: qsub /scratch/mbh0012/simulations/GW150914_128/output-0000/SIMFACTORY/SubmitScript<br />
Submit finished, job id is 468083</p>
<p>This is how it sits in the queue:</p>
<p>468083.trcis002.hpc.wv mbh0012 comm_sma GW150914_128-00 -- 4 160
<p>--<br/>
Ticket URL: <a href='https://bitbucket.org/einsteintoolkit/tickets/issues/2499/new-machine-thornyflat-at-wvu'>https://bitbucket.org/einsteintoolkit/tickets/issues/2499/new-machine-thornyflat-at-wvu</a></p>
</html>