Hi Ian,

I noticed that there is a CESSI-BEAST.ini. I have 24 cores on my machine, I did the following changes,

ppn             = 256
max-num-threads = 256
num-threads     = 24
nodes           = 1

While running, I see the following:

+ set -e
+ cd /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/output-0000-active
+ echo Checking:
+ pwd
+ hostname
+ date
+ echo Environment:
+ export CACTUS_NUM_PROCS=1
+ CACTUS_NUM_PROCS=1
+ export CACTUS_NUM_THREADS=24
+ CACTUS_NUM_THREADS=24
+ export GMON_OUT_PREFIX=gmon.out
+ GMON_OUT_PREFIX=gmon.out
+ export OMP_NUM_THREADS=24
+ OMP_NUM_THREADS=24
+ env
+ echo Starting:
++ date +%s
+ export CACTUS_STARTTIME=1502385989
+ CACTUS_STARTTIME=1502385989
+ mpirun -np 1 /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/exe/cactus_sim -L 3 /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/output-0000/static_tov.par

I want to get the -np of the mpirun command to be 24. How do I achieve this ?

Maitraya.

On Thu, Aug 10, 2017 at 10:21 PM, Maitraya Bhattacharyya <maitraya.linux@gmail.com> wrote:
Hi,

There isn't one, so I assume that I will have to create one ?

Maitraya.

On Thu, Aug 10, 2017 at 10:09 PM, Ian Hinder <ian.hinder@aei.mpg.de> wrote:

On 10 Aug 2017, at 11:32, Maitraya Bhattacharyya <maitraya.linux@gmail.com> wrote:

Hi Ian,

Sorry! I forgot to reply to all.

My symfactory defs.local.ini is:


[default]
user            = mkb14ip002
email           = mkb14ip002
allocation      = NO_ALLOCATION

[CESSI-BEAST]
user            = mkb14ip002
email           = mkb14ip002
allocation      = NO_ALLOCATION
basedir     = /disk1/maitraya/Einstein_Toolkit/ET_Simulations

My machine is CESSI-BEAST, something that I added later for basedir to work.

The command I typed was:  ./simfactory/bin/sim submit static_tov --parfile=par/static_tov.par --procs=20 --walltime=8:0:0

And the output:
Warning: simulation "static_tov" does not exist or is not readable
Parameter file: /disk1/maitraya/Einstein_Toolkit/Cactus/par/static_tov.par
Skeleton Created
Job directory: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov"
Executable: "/disk1/maitraya/Einstein_Toolkit/Cactus/exe/cactus_sim"
Option list: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/cfg/OptionList"
Submit script: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/run/SubmitScript"
Run script: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/run/RunScript"
Parameter file: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/par/static_tov.par"
Assigned restart id: 0
Error: Too many nodes specified: nodes=20 (maxnodes is 1)
Aborting Simfactory.

Please can you post simfactory/mdb/machines/CESSI-BEAST.ini?

You probably want to set "ppn = 20" in that file.