<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:#000000">Sorry, fixed the typo (though error is still there - having tried different parallel environments). I've attached a chunk of the output but killed it before it carried on until error. Do you need further output? </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:#000000"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:#000000">The double comment is ignored - will confirm though...</div></div><div class="gmail_extra"><br><div class="gmail_quote">On 20 October 2015 at 13:24, Ian Hinder <span dir="ltr"><<a href="mailto:ian.hinder@aei.mpg.de" target="_blank">ian.hinder@aei.mpg.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<br>
<div><span class="">
<div>On 20 Oct 2015, at 13:44, Geraint Pratten <<a href="mailto:g.pratten@sussex.ac.uk" target="_blank">g.pratten@sussex.ac.uk</a>> wrote:</div>
<br>
</span><blockquote type="cite">
<div dir="ltr">
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi,</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br>
</div><span class="">
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">So I'm getting a problem passing the correct number of MPI processes through to Carpet. I'm not sure what I've messed up in the configurations, the error I am getting is:</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
<blockquote type="cite" style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:13px">
<div dir="ltr">
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
<div style="margin:0px;font-size:11px;font-family:Menlo;color:rgb(245,245,245);background-color:rgb(0,0,0)">
The environment variable CACTUS_NUM_PROCS is set to 4, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism.</div>
</div>
</div>
</blockquote>
</div>
<div class="gmail_extra">
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">I've attached the .run and .sub scripts that I use. Can anyone see anything obviously wrong? The local cluster uses the UNIVA Grid Engine for submission scripts. </div>
</div>
</span></div>
</blockquote>
<div><br>
</div>
<div>Hi Geraint,</div>
<div><br>
</div>
<div>In your submission script, you have</div>
<div><br>
</div>
<div>
<div>#! /bin/bash</div>
<div>#$ -cwd</div>
<div>#$ -j y</div>
<div>#$ -o output/@SIMULATION_NAME@.out</div>
<div>#$ -e output/@SIMULATION_NAME@.err</div>
<div><br>
</div>
<div>## Error and ouput</div>
<div>#$ -m abe</div>
<div>#$ -M <a href="mailto:geraint.pratten@gmail.com" target="_blank">geraint.pratten@gmail.com</a></div>
<div><br>
</div>
<div>## Set up parallel environment</div>
<div>##$ -pe openmpi_mixed_32 @PROCS_REQUESTED@</div>
<div>#$ -pe mpich @PROC_REQUESTEDS@</div>
<div><br>
</div>
<div>## Request queue and job class</div>
<div>#$ -q mps.q</div>
<div>#$ -jc mps.medium</div>
<div><br>
</div>
<div>## Walltime, simulation name and memory</div>
<div>#$ -l h_rt=@WALLTIME@</div>
<div>#$ -N @SHORT_SIMULATION_NAME@</div>
<div><br>
</div>
<div><br>
</div>
<div>Specifically, you say @PROC_REQUESTED@ instead of @PROCS_REQUESTED@. i.e. a missing S on PROCS. Can you also post your output and error files? It would be good if simfactory could detect errors like this. It would also be good if the queuing system
on that machine would complain if it got a number of procs that it doesn't understand. Maybe it does complain, but it's only a warning?</div>
<div><br>
</div>
<div>I'm also not sure what happens if you do a double comment ##. It may treat it as a single comment, and use the first pe that you specify.</div>
<div><br>
</div>
</div>
</div><span class="">
<div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div>-- </div>
<div>Ian Hinder</div>
<div><a href="http://members.aei.mpg.de/ianhin" target="_blank">http://members.aei.mpg.de/ianhin</a></div>
</div>
</div>
</div>
</div>
</div>
<br>
</span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><span style="background-color:rgb(255,255,255)"><font color="#444444">Geraint Pratten</font></span></div><div dir="ltr"><span style="background-color:rgb(255,255,255)"><font color="#444444">Postdoctoral Research Associate<br><br>Mobile: +44(0) 7581709282<br>E-mail: <a href="mailto:G.Pratten@sussex.ac.uk" target="_blank">G.Pratten@sussex.ac.uk</a><br>Skype: geraint.pratten<br><br>School of Mathematical and Physical Sciences<br>Pevensey 3 Building<br>University of Sussex<br>Falmer Campus<br>Brighton</font></span><div><span style="background-color:rgb(255,255,255)"><font color="#444444">BN1 9QH<br>United Kingdom</font></span><br></div></div></div></div></div></div></div>
</div>