<div dir="ltr"><div class="gmail_default" style="font-family:comic sans ms,sans-serif">Hi everyone,</div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif">I&#39;ve managed to get this compiling and have just completed the example BBH run simulating the system of the first detection, however now that I have left it for a few weeks and come back, naturally nothing works.</div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif">The error I now have is with MPI_UB and dh.cc when building through simfactory. I get the following output:</div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif">In file included from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dist.hh:12,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/vect.hh:13,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/bbox.hh:11,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:10:<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc: In function ‘ompi_datatype_t* mpi_datatype(const dh::light_dboxes&amp;)’:<br>/opt/openmpi4/include/mpi.h:337:63: error: expected ‘}’ before ‘;’ token<br> #define THIS_SYMBOL_WAS_REMOVED_IN_MPI30(symbol, new_symbol) 0; static_assert(0, #symbol &quot; was removed in MPI-3.0.  Use &quot; #new_symbol &quot; instead.&quot;)<br>                                                               ^<br>/opt/openmpi4/include/mpi.h:1131:24: note: in expansion of macro ‘THIS_SYMBOL_WAS_REMOVED_IN_MPI30’<br> #        define MPI_UB THIS_SYMBOL_WAS_REMOVED_IN_MPI30(MPI_UB, MPI_Type_create_resized);<br>                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:23: note: in expansion of macro ‘MPI_UB’<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>                       ^~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:9: note: to match this ‘{’<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>         ^<br>In file included from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dist.hh:12,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/vect.hh:13,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/bbox.hh:11,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:10:<br>/opt/openmpi4/include/mpi.h:337:63: error: expected ‘}’ before ‘;’ token<br> #define THIS_SYMBOL_WAS_REMOVED_IN_MPI30(symbol, new_symbol) 0; static_assert(0, #symbol &quot; was removed in MPI-3.0.  Use &quot; #new_symbol &quot; instead.&quot;)<br>                                                               ^<br>/opt/openmpi4/include/mpi.h:1131:24: note: in expansion of macro ‘THIS_SYMBOL_WAS_REMOVED_IN_MPI30’<br> #        define MPI_UB THIS_SYMBOL_WAS_REMOVED_IN_MPI30(MPI_UB, MPI_Type_create_resized);<br>                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:23: note: in expansion of macro ‘MPI_UB’<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>                       ^~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2188:46: note: to match this ‘{’<br>     dist::mpi_struct_descr_t const descr[] = {<br>                                              ^<br>In file included from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dist.hh:12,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/vect.hh:13,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/bbox.hh:11,<br>                 from /maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:10:<br>/opt/openmpi4/include/mpi.h:337:79: error: static assertion failed: MPI_UB was removed in MPI-3.0.  Use MPI_Type_create_resized instead.<br> #define THIS_SYMBOL_WAS_REMOVED_IN_MPI30(symbol, new_symbol) 0; static_assert(0, #symbol &quot; was removed in MPI-3.0.  Use &quot; #new_symbol &quot; instead.&quot;)<br>                                                                               ^<br>/opt/openmpi4/include/mpi.h:1131:24: note: in expansion of macro ‘THIS_SYMBOL_WAS_REMOVED_IN_MPI30’<br> #        define MPI_UB THIS_SYMBOL_WAS_REMOVED_IN_MPI30(MPI_UB, MPI_Type_create_resized);<br>                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:23: note: in expansion of macro ‘MPI_UB’<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>                       ^~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:29: error: expected primary-expression before ‘,’ token<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>                             ^<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2188:36: warning: unused variable ‘descr’ [-Wunused-variable]<br>     dist::mpi_struct_descr_t const descr[] = {<br>                                    ^~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2177:23: warning: unused variable ‘newtype’ [-Wunused-variable]<br>   static MPI_Datatype newtype;<br>                       ^~~~~~~<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2195:50: warning: no return statement in function returning non-void [-Wreturn-type]<br>         {1, sizeof s, MPI_UB, &quot;MPI_UB&quot;, &quot;MPI_UB&quot;}};<br>                                                  ^<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc: At global scope:<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2197:5: error: ‘newtype’ does not name a type; did you mean ‘iswctype’?<br>     newtype = dist::create_mpi_datatype(sizeof descr / sizeof descr[0], descr,<br>     ^~~~~~~<br>     iswctype<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2208:5: error: ‘initialised’ does not name a type; did you mean ‘MPI_Initialized’?<br>     initialised = true;<br>     ^~~~~~~~~~~<br>     MPI_Initialized<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2209:3: error: expected declaration before ‘}’ token<br>   }<br>   ^<br>/maybehome/cstevens/Cactus/arrangements/Carpet/CarpetLib/src/dh.cc:2177:23: warning: ‘newtype’ defined but not used [-Wunused-variable]<br>   static MPI_Datatype newtype;<br>                       ^~~~~~~<br>make[3]: *** [/maybehome/cstevens/Cactus/configs/CTGD_Testing/config-data/make.config.rules:281: dh.cc.o] Error 1<br>make[2]: *** [/maybehome/cstevens/Cactus/lib/make/make.thornlib:113: make.checked] Error 2<br>make[1]: *** [/maybehome/cstevens/Cactus/lib/make/make.configuration:181: /maybehome/cstevens/Cactus/configs/CTGD_Testing/lib/libthorn_CarpetLib.a] Error 2<br>make: *** [Makefile:260: CTGD_Testing] Error 2<br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif">I did find the following thread:</div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><a href="http://lists.einsteintoolkit.org/pipermail/users/2018-October/006566.html" target="_blank">http://lists.einsteintoolkit.org/pipermail/users/2018-October/006566.html</a><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif">and I&#39;ve done a clean compilation but same deal. I&#39;m using OpenMPI 4.0.5 and gcc/g++ etc 8.3.1. I&#39;ve confirmed which mpicc etc points to the right place, and what I think the relevant lines in the option list file are:</div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><div style="color:rgb(212,212,212);background-color:rgb(30,30,30);font-family:&quot;Droid Sans Mono&quot;,monospace,monospace,&quot;Droid Sans Fallback&quot;;font-size:14px;line-height:19px;white-space:pre"><div><span style="color:rgb(86,156,214)">CPPFLAGS</span> = -DOMPI_SKIP_MPICXX</div><div><span style="color:rgb(86,156,214)">FPPFLAGS</span> = -traditional</div><div><span style="color:rgb(86,156,214)">CFLAGS</span>   = -g3 -<span style="color:rgb(86,156,214)">std</span>=gnu11 -Wunused-variable</div><div><span style="color:rgb(86,156,214)">CXXFLAGS</span> = -g3 -<span style="color:rgb(86,156,214)">std</span>=gnu++11 -Wunused-variable</div><div><span style="color:rgb(86,156,214)">F77FLAGS</span> = -g3 -fcray-pointer -ffixed-line-length-none</div><div><span style="color:rgb(86,156,214)">F90FLAGS</span> = -g3 -fcray-pointer -ffixed-line-length-none<span style="color:rgb(106,153,85)"># -Wextra -Wimplicit-interface#-fallow-argument-mismatch</span></div></div></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><br></div><div class="gmail_default" style="font-family:comic sans ms,sans-serif"><div style="color:rgb(212,212,212);background-color:rgb(30,30,30);font-family:&quot;Droid Sans Mono&quot;,monospace,monospace,&quot;Droid Sans Fallback&quot;;font-size:14px;line-height:19px;white-space:pre"><div><span style="color:rgb(86,156,214)">MPI_DIR</span> = /opt/openmpi4/</div><div><span style="color:rgb(86,156,214)">MPI_LIB_DIRS</span> = /opt/openmpi4/lib</div><div><span style="color:rgb(86,156,214)">MPI_INC_DIRS</span> = /opt/openmpi4/include</div><div><span style="color:rgb(86,156,214)">MPI_LIBS</span>     = mpi open-rte open-pal</div></div></div><div><br></div><div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">I have added CPP = ... CXX = ... etc which point to the appropriate places.</div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif"><br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">I also have</div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif"><br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">cstevens@skynet:~/Cactus$ mpic++ --showme<br>g++ -I/opt/openmpi4/include -pthread -Wl,-rpath -Wl,/opt/openmpi4/lib -Wl,--enable-new-dtags -L/opt/openmpi4/lib -lmpi<br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif"><br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">Any help would be greatly appreciated.</div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif"><br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">Thanks,</div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif"><br></div><div class="gmail_default" style="font-family:&quot;comic sans ms&quot;,sans-serif">Chris</div><br></div>-- <br><div dir="ltr" data-smartmail="gmail_signature"><div dir="ltr"><span><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><pre cols="72">Dr Chris Stevens<br>Postdoctoral Fellow<br>Rm 310A<br>Department of Mathematics and Statistics<br>University of Otago<br>Ph: +64 3 479 4567<br><br><a href="http://www.chrisdoesmaths.com" target="_blank">http://www.chrisdoesmaths.com</a><br><a href="http://gravity.otago.ac.nz" target="_blank">http://gravity.otago.ac.nz</a><br></pre>
</div></div></div></div></div></div></div></div></div></div></div></div></div></div></span></div></div></div>