Hi all,

After having installed the toolkit on Leonardo, CINECA, I wanted to try the TOV examples.

However, I am getting the following warnings:

Warning: Too many threads per process specified: specified num-threads=56 (ppn-used is 112)

Warning: Total number of threads and number of threads per process are inconsistent: procs=16, num-threads=56 (procs*num-smt must be an integer multiple of num-threads)

Warning: Total number of threads and number of cores per node are inconsistent: procs=16, ppn-used=112 (procs must be an integer multiple of ppn-used)

>From those, it seems that I am doing something wrong either in my machine.ini file or in the resources request when submitting the job.

Here is the command I use to run the TOV example:

./simfactory/bin/sim submit tov_ET --parfile par/tov_ET.par --cores 16 --walltime 00:20:00

And here is the ini file I am using (the "Cluster characteristics" section is identical to Bruno Giacomazzo's file:

https://github.com/piosif/einstein-toolkit-config-leonardo/blob/main/leonardo-dcgp1.ini

The job ran and completed fine, but from what I understand, it ran on 56 cores instead of the 16 that I requested.

>From what I understand, the problem is that I am requesting just 16 cores for this simple test, but due to the cluster specs in the ini file, SimFactory expects me to request a multiple of 56.

Is that so?

So, my question is the following:

I want to do some tests, running a single star e.g. on a single node using 16, 32, 64 cores (to understand the timescale required). Do I need to change my ini file?
Or is there some option to specify when submitting the job that will override the cluster specs?

I read the simfactory's terminology explanation on nodes, threads etc, but it is not clear to me how to request the cores I need.

Best,
Panayotis