#2252: need for the updating of the submit script template for Cori
Reporter:
Status:open
Milestone:
Version:ET_2018_09
Type:bug
Priority:major
Component:SimFactory

Comment (by Roland Haas):

SystemTopology helps and produces sane layouts. This is for --procs 128 --num-smt 2 which used 2 nodes (as it should) and with srun -n 8 --threads-per-core 2 -c 8 gives:

INFO (Carpet): This process contains 16 threads, this is thread 0
INFO (Carpet): There are 128 threads in total
INFO (Carpet): There are 16 threads per process
INFO (Carpet): This process runs on host nid00671, pid=48257
INFO (Carpet): This process runs on 16 cores: 16-23, 48-55
INFO (Carpet): Thread 0 runs on 1 core: 16
INFO (Carpet): Thread 1 runs on 1 core: 48
INFO (Carpet): Thread 2 runs on 1 core: 17
INFO (Carpet): Thread 3 runs on 1 core: 49
INFO (Carpet): Thread 4 runs on 1 core: 18
INFO (Carpet): Thread 5 runs on 1 core: 50
INFO (Carpet): Thread 6 runs on 1 core: 19
INFO (Carpet): Thread 7 runs on 1 core: 51
INFO (Carpet): Thread 8 runs on 1 core: 20
INFO (Carpet): Thread 9 runs on 1 core: 52
INFO (Carpet): Thread 10 runs on 1 core: 21
INFO (Carpet): Thread 11 runs on 1 core: 53
INFO (Carpet): Thread 12 runs on 1 core: 22
INFO (Carpet): Thread 13 runs on 1 core: 54
INFO (Carpet): Thread 14 runs on 1 core: 23
INFO (Carpet): Thread 15 runs on 1 core: 55

while submitting just --procs 64 results in srun -n 4 --threads-per-core 2 -c 16 (threads per core being hardwired in the runscript) and

INFO (Carpet): This process contains 16 threads, this is thread 0
INFO (Carpet): There are 64 threads in total
INFO (Carpet): There are 16 threads per process
INFO (Carpet): This process runs on host nid00995, pid=8369
INFO (Carpet): This process runs on 16 cores: 0-15
INFO (Carpet): Thread 0 runs on 1 core: 0
INFO (Carpet): Thread 1 runs on 1 core: 1
INFO (Carpet): Thread 2 runs on 1 core: 2
INFO (Carpet): Thread 3 runs on 1 core: 3
INFO (Carpet): Thread 4 runs on 1 core: 4
INFO (Carpet): Thread 5 runs on 1 core: 5
INFO (Carpet): Thread 6 runs on 1 core: 6

--

Ticket URL: https://bitbucket.org/einsteintoolkit/tickets/issues/2252/need-for-the-updating-of-the-submit-script