<div dir="ltr">Erik<br><br>Actually, even with <span style="font-size:12.8px">--procs=2 --num-threads=1<br>I will get:<br></span><span style="font-size:12.8px">The environment variable CACTUS_NUM_PROCS is set to 2, but there are 1 MPI processes.<br></span><span style="font-size:12.8px"><br>However, with only --procs=2 can really start a simulation, and terminate due to </span><span style="font-size:12.8px">TAT/Slab limitation<br></span><span style="font-size:12.8px"><br>Is there any configuration corresponding to <br>"</span><span style="font-size:12.8px">but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism."</span><br><br><span style="font-size:12.8px">I'm using</span><br><div><span style="font-size:12.8px">optionlist ubuntu.cfg</span></div><div><span style="font-size:12.8px">submitscript generic.sub</span></div><div><span style="font-size:12.8px">runscript debian.run<br><br>Cory</span></div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Dec 23, 2016 at 9:44 PM, Erik Schnetter <span dir="ltr"><<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Cory<br>
<br>
Using "--procs=4 --num-threads=1" might help. You do not need to<br>
change the settings in the ".ini" file; only the command line<br>
parameters determine how many MPI processes are used.<br>
<span class="HOEnZb"><font color="#888888"><br>
-erik<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On Fri, Dec 23, 2016 at 8:12 AM, Cory Chu <<a href="mailto:cory.yk.chu@gmail.com">cory.yk.chu@gmail.com</a>> wrote:<br>
> Hi Ian<br>
><br>
> I'am running on VirtualBox set whit 2 Processors and 8GB RAM<br>
><br>
> When i try with this submit command<br>
><br>
> create-submit mybbh --parfile par/BBHLowRes.par --num-threads=1 --procs=2<br>
><br>
> I get following message in .err file<br>
><br>
> WARNING level 0 from host kpc-VirtualBox process 0<br>
> while executing schedule bin (none), routine (no thorn)::(no routine)<br>
> in thorn Carpet, file<br>
> /home/kuangtly/programming/ET/<wbr>forfun/Cactus/arrangements/<wbr>Carpet/Carpet/src/SetupGH.cc:<wbr>153:<br>
> -> The environment variable CACTUS_NUM_PROCS is set to 2, but there are 1<br>
> MPI processes. This may indicate a severe problem with the MPI startup<br>
> mechanism.<br>
> cactus_sim:<br>
> /home/kuangtly/programming/ET/<wbr>forfun/Cactus/arrangements/<wbr>Carpet/Carpet/src/helpers.cc:<wbr>275:<br>
> int Carpet::Abort(const cGH*, int): Assertion `0' failed.<br>
> Rank 0 with PID 15985 received signal 6<br>
> Writing backtrace to BBHLowRes/backtrace.0.txt<br>
> Aborted (core dumped)<br>
><br>
><br>
> i have change these setting in .ini file<br>
> ppn =2<br>
> max-num-threads =2<br>
> num-threads =2<br>
><br>
><br>
><br>
> On Fri, Dec 23, 2016 at 6:28 PM, Ian Hinder <<a href="mailto:ian.hinder@aei.mpg.de">ian.hinder@aei.mpg.de</a>> wrote:<br>
>><br>
>><br>
>> On 23 Dec 2016, at 10:52, Cory Chu <<a href="mailto:cory.yk.chu@gmail.com">cory.yk.chu@gmail.com</a>> wrote:<br>
>><br>
>> Erik<br>
>><br>
>> Should I simply change the .ini file in simfactory/mdb/machines<br>
>> with<br>
>> ppn = 2<br>
>> max-num-threads = 2<br>
>> num-threads = 2<br>
>><br>
>> and adding --procs = 2 on running command ?<br>
>><br>
>> sorry i just can not find a detail documentation on this part<br>
>> after i change the above setting<br>
>> the problem did not solved<br>
>><br>
>><br>
>> Hi Cory,<br>
>><br>
>> Can you give the command line you are using to submit the simulation? You<br>
>> need to ensure that the number of MPI processes you use is larger. You<br>
>> could do this by running fewer threads per process, or if you are already<br>
>> running one thread per process, by increasing the number of processes by<br>
>> increasing the number of threads. That might mean reconfiguring the machine<br>
>> definition to allow more cores to be used than you actually have. What<br>
>> machine is it; i.e. how many processors and cores do you have?<br>
>><br>
>> --<br>
>> Ian Hinder<br>
>> <a href="http://members.aei.mpg.de/ianhin" rel="noreferrer" target="_blank">http://members.aei.mpg.de/<wbr>ianhin</a><br>
>><br>
><br>
<br>
<br>
<br>
</div></div><div class="HOEnZb"><div class="h5">--<br>
Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu">schnetter@cct.lsu.edu</a>><br>
<a href="http://www.perimeterinstitute.ca/personal/eschnetter/" rel="noreferrer" target="_blank">http://www.perimeterinstitute.<wbr>ca/personal/eschnetter/</a><br>
</div></div></blockquote></div><br></div>