<div dir="ltr">Hi Erik,<div><br></div><div>I get:</div><div><br></div><div><div>Backtrace from rank 0 pid 94588:</div><div>Backtrace not available!</div></div><div><br></div><div>in the backtrace file. Is there anything I can try to get it working?</div><div><br></div><div>I've attached the output with <span style="font-size:12.800000190734863px">Carpet::veryverbose = yes to the trac ticket. Let me know if there's anything else you'd like me to send you.</span></div><div><span style="font-size:12.800000190734863px"><br></span></div><div><span style="font-size:12.800000190734863px">Gwyneth</span></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 21, 2017 at 10:51 PM, Erik Schnetter <span dir="ltr"><<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div dir="ltr">Gwyneth
<div><br>
</div>
<div>Can you produce a stack backtrace? Or can you show more output, in particular while setting Carpet::veryverbose = yes?</div>
<div><br>
</div>
<div>I don't think this error is related to the bboxset class, so disabling bboxset2 is unlikely to help.</div><span class="HOEnZb"><font color="#888888">
<div><br>
</div>
<div>-erik</div>
<div><br>
</div>
</font></span></div>
<div class="gmail_extra"><div><div class="h5"><br>
<div class="gmail_quote">On Tue, Mar 21, 2017 at 4:32 PM, Gwyneth Allwright <span dir="ltr">
<<a href="mailto:allgwy001@myuct.ac.za" target="_blank">allgwy001@myuct.ac.za</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Erik, Ian, Frank:
<div><br>
</div>
<div>Thankfully, I managed to get Open MPI working on my laptop and can now run things again! </div>
<div><br>
</div>
<div>I tried running the parameter file that produces the error on the HPC. Previously, the error did not appear on my laptop, but now it does (when running on two processes). I don't think there's an issue with a very small domain and a very large number of
MPI processes here.</div>
<div><br>
</div>
<div>I get: </div>
<div><br>
</div>
<div>Assertion failed: (all(stride == other.stride)), function binary_operator, file /Users/gwynethallwright/Cactus<wbr>/arrangements/Carpet/CarpetLib<wbr>/src/bboxset2.hh, line 261.</div>
<div><br>
</div>
<div>The simulation seems to abort immediately after TwoPunctures finishes setting up the initial data and the actual evolution begins.<br>
</div>
<div><br>
</div>
<div>Should I try compiling with -DCARPET_DISABLE_BBOXSET2 on my laptop?</div>
<span class="m_1389065319625850085HOEnZb"><font color="#888888">
<div><br>
</div>
<div>Gwyneth</div>
<div><br>
</div>
</font></span></div>
<div class="gmail_extra"><br>
<div class="gmail_quote">
<div>
<div class="m_1389065319625850085h5">On Mon, Mar 13, 2017 at 2:49 PM, Ian Hinder <span dir="ltr"><<a href="mailto:ian.hinder@aei.mpg.de" target="_blank">ian.hinder@aei.mpg.de</a>></span> wrote:<br>
</div>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div class="m_1389065319625850085h5"><span><br>
On 13 Mar 2017, at 13:14, Gwyneth Allwright <<a href="mailto:allgwy001@myuct.ac.za" target="_blank">allgwy001@myuct.ac.za</a>> wrote:<br>
<br>
> Hi Ian, Frank, Erik,<br>
><br>
> Thanks for the comments!<br>
><br>
> Ian, I'm using my full cluster core allocation for simulations at the moment, but should be able to get back to you about adjusting CPPFLAGS in a few days' time. The same goes for changing the number of MPI processes (I was indeed using a much higher number
of processes when running on the cluster).<br>
<br>
</span>Does the problem appear immediately? Can you run on your laptop with the same number of MPI processes as you were using on the cluster when you saw the error?<br>
<span><br>
> Frank, I haven't been able to find a (direct and obvious) indication of which bboxset implementation is used in the output. But I've attached it to the ticket, so you're welcome to have a look. (Erik did say that it was bboxset2.)<br>
<br>
</span>The error indicates that it is definitely using bboxset2 on the cluster. The question is what is used on your laptop. The logic that decides which implementation to use is in<br>
<br>
arrangements/Carpet/CarpetLib/<wbr>src/defs.hh:<br>
<br>
// Disable bboxset2 if C++11 is not supported<br>
#if !defined(HAVE_CCTK_CXX_AUTO_SP<wbr>ECIFIER) || \<br>
!defined(HAVE_CCTK_CXX_LAMBDA) || !defined(HAVE_CCTK_CXX_RANGE_B<wbr>ASED_FOR)<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_WARN_DISABLE_BBOXSET2<br>
#endif<br>
#undef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_DISABLE_BBOXSET2<br>
#endif<br>
<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_ENABLE_BBOXSET2<br>
#define CARPET_USE_BBOXSET2<br>
#endif<br>
<br>
Assuming that you are using gcc on your laptop, you could add compile-time output which will tell you which is being used:<br>
<br>
// Disable bboxset2 if C++11 is not supported<br>
#if !defined(HAVE_CCTK_CXX_AUTO_SP<wbr>ECIFIER) || \<br>
!defined(HAVE_CCTK_CXX_LAMBDA) || !defined(HAVE_CCTK_CXX_RANGE_B<wbr>ASED_FOR)<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_WARN_DISABLE_BBOXSET2<br>
#endif<br>
#undef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_DISABLE_BBOXSET2<br>
#pragma message "bboxset2 disabled"<br>
#endif<br>
<br>
#ifndef CARPET_DISABLE_BBOXSET2<br>
#define CARPET_ENABLE_BBOXSET2<br>
#define CARPET_USE_BBOXSET2<br>
#pragma message "bboxset2 enabled"<br>
#pragma message "bboxset2 used"<br>
#endif<br>
<br>
(the only changes are to add the pragma lines).<br>
<br>
On my laptop, this gives<br>
<br>
COMPILING arrangements/Carpet/CarpetLib/<wbr>src/bboxset1.cc<br>
In file included from /Users/ian/Cactus/EinsteinTool<wbr>kitGit/arrangements/Carpet/Car<wbr>petLib/src/bboxset1.cc:9:0:<br>
/Users/ian/Cactus/EinsteinTool<wbr>kitGit/arrangements/Carpet/Car<wbr>petLib/src/defs.hh:34:17: note: #pragma message: bboxset2 enabled<br>
#pragma message "bboxset2 enabled"<br>
^<br>
/Users/ian/Cactus/EinsteinTool<wbr>kitGit/arrangements/Carpet/Car<wbr>petLib/src/defs.hh:35:17: note: #pragma message: bboxset2 used<br>
#pragma message "bboxset2 used"<br>
</div>
</div>
<div class="m_1389065319625850085m_-2869099576210038362HOEnZb">
<div class="m_1389065319625850085m_-2869099576210038362h5">
<div>
<div class="m_1389065319625850085h5"><br>
<br>
--<br>
Ian Hinder<br>
<a href="http://members.aei.mpg.de/ianhin" rel="noreferrer" target="_blank">http://members.aei.mpg.de/ianh<wbr>in</a><br>
<br>
</div>
</div>
<span>Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at
<a href="http://www.uct.ac.za/about/policies/emaildisclaimer/" rel="noreferrer" target="_blank">
http://www.uct.ac.za/about/pol<wbr>icies/emaildisclaimer/</a> or obtainable from <a href="tel:%2B27%2021%20650%209111" value="+27216509111" target="_blank">
+27 21 650 9111</a>. If this e-mail is not related to the business of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via
<a href="mailto:csirt@uct.ac.za" target="_blank">csirt@uct.ac.za</a><br>
</span></div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div></div></div><span class="">
-- <br>
<div class="m_1389065319625850085gmail_signature" data-smartmail="gmail_signature">Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
<a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.<wbr>ca/personal/eschnetter/</a></div>
</span></div><span class="">
Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at <a href="http://www.uct.ac.za/about/policies/emaildisclaimer/" target="_blank">http://www.uct.ac.za/about/<wbr>policies/emaildisclaimer/</a> or obtainable from <a href="tel:+27%2021%20650%209111" value="+27216509111" target="_blank">+27 21 650 9111</a>. If this e-mail is not related to the business
of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via <a href="mailto:csirt@uct.ac.za" target="_blank">csirt@uct.ac.za</a>
</span></div>
</blockquote></div><br></div>