<div dir="ltr">Hi Ian and Erik,<div><br></div><div>Thanks for your patience with this. Yes, I've moved on to larger simulations, so please consider the scaling issues resolved.</div><div><br></div><div>Whether or not you decide to look into the problem with Carpet doesn't really matter to me, but if you do, it would be interesting to hear what was going wrong.</div><div><br></div><div>Gwyneth</div><div><br></div><div class="gmail_extra"><div class="gmail_quote">On Tue, Mar 7, 2017 at 3:32 PM, Ian Hinder <span dir="ltr"><<a href="mailto:ian.hinder@aei.mpg.de" target="_blank">ian.hinder@aei.mpg.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<br>
<div>
<div>On 23 Feb 2017, at 15:47, Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>> wrote:</div>
<br class="m_-4548073019904262485Apple-interchange-newline">
<blockquote type="cite">
<div dir="ltr">Regarding OpenMP:
<div><br>
</div>
<div>Cactus usually tries to optimize which treads run on which cores. If there are multiple independent processes running on a node, then Cactus must not do that, since this will slow down both applications a lot. In particular, must not set "CACTUS_SET_THREAD_BINDINGS=1"
(not setting it or setting it to 0 is fine).</div>
<div><br>
</div>
<div>As Ian mentioned, you can either build without OpenMP support, or choose to use a single thread at run time, both will work.</div>
<div><br>
</div>
<div>At this time, it might be best to post your complete setup, i.e. all the options and scripts you are using to configure and build and submit and run, so that others can have a look and cross-check.</div>
<div><br>
</div>
<div>Of course, all of this is independent of any nans you encounter. Those are still due to a bug. I don't think it makes much sense at this point to debug this -- instead, you will want to run a larger simulations.</div>
</div>
</blockquote>
<div><br>
</div>
<div>Hi Erik,</div>
<div><br>
</div>
<div>Are you suggesting that it is not worth us debugging the problem with Carpet which is giving wrong results if too many processes are used? This could be triggered in other situations; we don't know what the origin is.</div>
<div><br>
</div>
<div>If you mean that Gwyneth would be better off focusing on larger simulations than trying to get this one to work on so many processes, then I agree.</div><span class="HOEnZb"><font color="#888888">
<div><br>
</div>
</font></span></div><span class="HOEnZb"><font color="#888888">
<div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">
<div>-- </div>
<div>Ian Hinder</div>
<div><a href="http://members.aei.mpg.de/ianhin" target="_blank">http://members.aei.mpg.de/<wbr>ianhin</a></div>
</div>
</div>
</div>
</div>
</div>
<br>
Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at <a href="http://www.uct.ac.za/about/policies/emaildisclaimer/" target="_blank">http://www.uct.ac.za/about/<wbr>policies/emaildisclaimer/</a> or obtainable from <a href="tel:+27%2021%20650%209111" value="+27216509111" target="_blank">+27 21 650 9111</a>. If this e-mail is not related to the business
of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via <a href="mailto:csirt@uct.ac.za" target="_blank">csirt@uct.ac.za</a>
</font></span></div>
<br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@einsteintoolkit.org">Users@einsteintoolkit.org</a><br>
<a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.<wbr>org/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>