Comment (by Maria):

Eric, I am picking up this ticket to let you know that it is not sorted out yet. I tried to run GW150914.par on 4 nodes (160 cores) and nsnstohmns.par on 1 node (40 cores), both within a PBS batch script and directly from the terminal. My jobs were either cancelled “for the following reason: no feasible locations found to run job”, or I cancelled them after more of a week of sitting in the queue. My priority, as external user, must be rather low.

Here is the output when starting from the terminal:

1. for GW150914

[mbh0012@trcis001 Cactus]$ simfactory/bin/sim create-submit GW150914_128 --configuration=bns --machine=thornyflat --parfile=par/GW150914.par --cores=128
Warning: Current Working directory does not match Cactus sourcetree, changing to /users/mbh0012/Cactus
Parameter file: /gpfs20/users/mbh0012/Cactus/par/GW150914.par
Skeleton Created
Job directory: "/scratch/mbh0012/simulations/GW150914_128"
Executable: "/users/mbh0012/Cactus/exe/cactus_bns"
Option list: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/cfg/OptionList"
Submit script: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/run/SubmitScript"
Run script: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/run/RunScript"
Parameter file: "/scratch/mbh0012/simulations/GW150914_128/SIMFACTORY/par/GW150914.par"
Assigned restart id: 0
Warning: Total number of threads and number of threads per process are inconsistent: procs=128, num-threads=20 (procs*num-smt must be an integer multiple of num-threads)
Warning: Total number of threads and number of cores per node are inconsistent: procs=128, ppn-used=40 (procs must be an integer multiple of ppn-used)
Executing submit command: qsub /scratch/mbh0012/simulations/GW150914_128/output-0000/SIMFACTORY/SubmitScript
Submit finished, job id is 468083

This is how it sits in the queue:

468083.trcis002.hpc.wv mbh0012 comm_sma GW150914_128-00 -- 4 160

--
Ticket URL: https://bitbucket.org/einsteintoolkit/tickets/issues/2499/new-machine-thornyflat-at-wvu