<div dir="ltr">Hi Erik, Ian, Frank:<div><br></div><div>Thankfully, I managed to get Open MPI working on my laptop and can now run things again! </div><div><br></div><div>I tried running the parameter file that produces the error on the HPC. Previously, the error did not appear on my laptop, but now it does (when running on two processes). I don't think there's an issue with a very small domain and a very large number of MPI processes here.</div><div><br></div><div>I get: </div><div><br></div><div>Assertion failed: (all(stride == other.stride)), function binary_operator, file /Users/gwynethallwright/Cactus/arrangements/Carpet/CarpetLib/src/bboxset2.hh, line 261.</div><div><br></div><div>The simulation seems to abort immediately after TwoPunctures finishes setting up the initial data and the actual evolution begins.<br></div><div><br></div><div>Should I try compiling with -DCARPET_DISABLE_BBOXSET2 on my laptop?</div><div><br></div><div>Gwyneth</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 13, 2017 at 2:49 PM, Ian Hinder <span dir="ltr"><<a href="mailto:ian.hinder@aei.mpg.de" target="_blank">ian.hinder@aei.mpg.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
On 13 Mar 2017, at 13:14, Gwyneth Allwright <<a href="mailto:allgwy001@myuct.ac.za">allgwy001@myuct.ac.za</a>> wrote:<br>
<br>
> Hi Ian, Frank, Erik,<br>
><br>
> Thanks for the comments!<br>
><br>
> Ian, I'm using my full cluster core allocation for simulations at the moment, but should be able to get back to you about adjusting CPPFLAGS in a few days' time. The same goes for changing the number of MPI processes (I was indeed using a much higher number of processes when running on the cluster).<br>
<br>
</span>Does the problem appear immediately? Can you run on your laptop with the same number of MPI processes as you were using on the cluster when you saw the error?<br>
<span class=""><br>
> Frank, I haven't been able to find a (direct and obvious) indication of which bboxset implementation is used in the output. But I've attached it to the ticket, so you're welcome to have a look. (Erik did say that it was bboxset2.)<br>
<br>
</span>The error indicates that it is definitely using bboxset2 on the cluster. The question is what is used on your laptop. The logic that decides which implementation to use is in<br>
<br>
arrangements/Carpet/CarpetLib/<wbr>src/defs.hh:<br>
<br>
// Disable bboxset2 if C++11 is not supported<br>
#if !defined(HAVE_CCTK_CXX_AUTO_<wbr>SPECIFIER) || \<br>
!defined(HAVE_CCTK_CXX_LAMBDA) || !defined(HAVE_CCTK_CXX_RANGE_<wbr>BASED_FOR)<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_WARN_DISABLE_BBOXSET2<br>
#endif<br>
#undef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_DISABLE_BBOXSET2<br>
#endif<br>
<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_ENABLE_BBOXSET2<br>
#define CARPET_USE_BBOXSET2<br>
#endif<br>
<br>
Assuming that you are using gcc on your laptop, you could add compile-time output which will tell you which is being used:<br>
<br>
// Disable bboxset2 if C++11 is not supported<br>
#if !defined(HAVE_CCTK_CXX_AUTO_<wbr>SPECIFIER) || \<br>
!defined(HAVE_CCTK_CXX_LAMBDA) || !defined(HAVE_CCTK_CXX_RANGE_<wbr>BASED_FOR)<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_WARN_DISABLE_BBOXSET2<br>
#endif<br>
#undef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_DISABLE_BBOXSET2<br>
#pragma message "bboxset2 disabled"<br>
#endif<br>
<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_ENABLE_BBOXSET2<br>
#define CARPET_USE_BBOXSET2<br>
#pragma message "bboxset2 enabled"<br>
#pragma message "bboxset2 used"<br>
#endif<br>
<br>
(the only changes are to add the pragma lines).<br>
<br>
On my laptop, this gives<br>
<br>
COMPILING arrangements/Carpet/CarpetLib/<wbr>src/bboxset1.cc<br>
In file included from /Users/ian/Cactus/<wbr>EinsteinToolkitGit/<wbr>arrangements/Carpet/CarpetLib/<wbr>src/bboxset1.cc:9:0:<br>
/Users/ian/Cactus/<wbr>EinsteinToolkitGit/<wbr>arrangements/Carpet/CarpetLib/<wbr>src/defs.hh:34:17: note: #pragma message: bboxset2 enabled<br>
#pragma message "bboxset2 enabled"<br>
^<br>
/Users/ian/Cactus/<wbr>EinsteinToolkitGit/<wbr>arrangements/Carpet/CarpetLib/<wbr>src/defs.hh:35:17: note: #pragma message: bboxset2 used<br>
#pragma message "bboxset2 used"<br>
<div class="HOEnZb"><div class="h5"><br>
<br>
--<br>
Ian Hinder<br>
<a href="http://members.aei.mpg.de/ianhin" rel="noreferrer" target="_blank">http://members.aei.mpg.de/<wbr>ianhin</a><br>
<br>
Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at <a href="http://www.uct.ac.za/about/policies/emaildisclaimer/" rel="noreferrer" target="_blank">http://www.uct.ac.za/about/<wbr>policies/emaildisclaimer/</a> or obtainable from <a href="tel:%2B27%2021%20650%209111" value="+27216509111">+27 21 650 9111</a>. If this e-mail is not related to the business of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via <a href="mailto:csirt@uct.ac.za">csirt@uct.ac.za</a><br>
</div></div></blockquote></div><br></div>