On 10 Aug 2017, at 11:32, Maitraya Bhattacharyya maitraya.linux@gmail.com wrote:

Hi Ian,

Sorry! I forgot to reply to all.

My symfactory defs.local.ini is:

[default] user = mkb14ip002 email = mkb14ip002 allocation = NO_ALLOCATION

[CESSI-BEAST] user = mkb14ip002 email = mkb14ip002 allocation = NO_ALLOCATION basedir = /disk1/maitraya/Einstein_Toolkit/ET_Simulations

My machine is CESSI-BEAST, something that I added later for basedir to work.

The command I typed was: ./simfactory/bin/sim submit static_tov --parfile=par/static_tov.par --procs=20 --walltime=8:0:0

And the output: Warning: simulation "static_tov" does not exist or is not readable Parameter file: /disk1/maitraya/Einstein_Toolkit/Cactus/par/static_tov.par Skeleton Created Job directory: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov" Executable: "/disk1/maitraya/Einstein_Toolkit/Cactus/exe/cactus_sim" Option list: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/cfg/OptionList" Submit script: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/run/SubmitScript" Run script: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/run/RunScript" Parameter file: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/par/static_tov.par" Assigned restart id: 0 Error: Too many nodes specified: nodes=20 (maxnodes is 1) Aborting Simfactory.

Please can you post simfactory/mdb/machines/CESSI-BEAST.ini?

You probably want to set "ppn = 20" in that file.

Hi Ian,

I noticed that there is a CESSI-BEAST.ini. I have 24 cores on my machine, I did the following changes,

ppn = 256 max-num-threads = 256 num-threads = 24 nodes = 1

While running, I see the following:

+ set -e + cd /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/output-0000-active + echo Checking: + pwd + hostname + date + echo Environment: + export CACTUS_NUM_PROCS=1 + CACTUS_NUM_PROCS=1 + export CACTUS_NUM_THREADS=24 + CACTUS_NUM_THREADS=24 + export GMON_OUT_PREFIX=gmon.out + GMON_OUT_PREFIX=gmon.out + export OMP_NUM_THREADS=24 + OMP_NUM_THREADS=24 + env + echo Starting: ++ date +%s + export CACTUS_STARTTIME=1502385989 + CACTUS_STARTTIME=1502385989 + mpirun -np 1 /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/SIMFACTORY/exe/cactus_sim -L 3 /disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/output-0000/static_tov.par

I want to get the -np of the mpirun command to be 24. How do I achieve this ?

Maitraya.

On Thu, Aug 10, 2017 at 10:21 PM, Maitraya Bhattacharyya < maitraya.linux@gmail.com> wrote:

Hi,

There isn't one, so I assume that I will have to create one ?

Maitraya.

On Thu, Aug 10, 2017 at 10:09 PM, Ian Hinder ian.hinder@aei.mpg.de wrote:

...

On 10 Aug 2017, at 11:32, Maitraya Bhattacharyya < maitraya.linux@gmail.com> wrote:

Hi Ian,

Sorry! I forgot to reply to all.

My symfactory defs.local.ini is:

[default] user = mkb14ip002 email = mkb14ip002 allocation = NO_ALLOCATION

[CESSI-BEAST] user = mkb14ip002 email = mkb14ip002 allocation = NO_ALLOCATION basedir = /disk1/maitraya/Einstein_Toolkit/ET_Simulations

My machine is CESSI-BEAST, something that I added later for basedir to work.

The command I typed was: ./simfactory/bin/sim submit static_tov --parfile=par/static_tov.par --procs=20 --walltime=8:0:0

And the output: Warning: simulation "static_tov" does not exist or is not readable Parameter file: /disk1/maitraya/Einstein_Toolk it/Cactus/par/static_tov.par Skeleton Created Job directory: "/disk1/maitraya/Einstein_Tool kit/ET_Simulations/static_tov" Executable: "/disk1/maitraya/Einstein_Toolkit/Cactus/exe/cactus_sim" Option list: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/ SIMFACTORY/cfg/OptionList" Submit script: "/disk1/maitraya/Einstein_Tool kit/ET_Simulations/static_tov/SIMFACTORY/run/SubmitScript" Run script: "/disk1/maitraya/Einstein_Toolkit/ET_Simulations/static_tov/ SIMFACTORY/run/RunScript" Parameter file: "/disk1/maitraya/Einstein_Tool kit/ET_Simulations/static_tov/SIMFACTORY/par/static_tov.par" Assigned restart id: 0 Error: Too many nodes specified: nodes=20 (maxnodes is 1) Aborting Simfactory.

Please can you post simfactory/mdb/machines/CESSI-BEAST.ini?

You probably want to set "ppn = 20" in that file.

-- Ian Hinder http://members.aei.mpg.de/ianhin

Hi Ian,

I have 24 physical cores with hyperthreading switched off.

Thanks, Maitraya.

On Fri, Aug 11, 2017 at 12:28 AM, Ian Hinder ian.hinder@aei.mpg.de wrote:

On 10 Aug 2017, at 12:29, Maitraya Bhattacharyya maitraya.linux@gmail.com wrote:

Hi Ian,

I noticed that there is a CESSI-BEAST.ini. I have 24 cores on my machine, I did the following changes,

ppn = 256 max-num-threads = 256 num-threads = 24 nodes = 1

Hi,

The terminology in simfactory is confusing, because it is quite old, and the meaning of some commonly-used terms has changed. The full details of what everything means are at http://simfactory.org/info/ documentation/userguide/processterminology.html.

Do you really have 24 physical cores, or do you have a processor with 24 hyperthreads on 12 cores? If Linux reports 24 cores, then if you have hyperthreading, you likely only have 12 cores.

Can you post the output of "lscpu"?

-- Ian Hinder http://members.aei.mpg.de/ianhin

Hi Ian,

Thanks for this. It worked.

Maitraya.

On Fri, Aug 18, 2017 at 7:10 PM, Ian Hinder ian.hinder@aei.mpg.de wrote:

On 10 Aug 2017, at 15:08, Maitraya Bhattacharyya maitraya.linux@gmail.com wrote:

Hi Ian,

I have 24 physical cores with hyperthreading switched off.

Hi,

And how many CPUs? If you have one CPU with 24 physical cores, then I think you want

ppn = 24 max-num-threads = 24 num-threads = 24 nodes = 1

If you have two CPUs, each with 12 cores, then you probably want

ppn = 24 max-num-threads = 24 num-threads = 12 nodes = 1

-- Ian Hinder http://members.aei.mpg.de/ianhin