<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I tried this on another cluster and got the results below. I didn’t use simfactory on it either.<div class=""><br class=""></div><div class="">-DG<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Mar 20, 2018, at 11:47 AM, Roland Haas <<a href="mailto:roland.haas@physics.gatech.edu" class="">roland.haas@physics.gatech.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">Hello DG,<br class=""><br class="">it could be that something failed while MPI was compiled. Would you mind attaching the following files from inside of your Cactus tree, please?<br class=""><br class="">configs/sim/bindings/Configuration/Capabilities/make.MPI.defn<br class=""></div></div></blockquote><div><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">INC_DIRS += $(MPI_INC_DIRS)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">INC_DIRS_F += $(MPI_LIB_DIRS)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_BUILD = 1</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_INSTALL_DIR = </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HWLOC_DIR = </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">CCTK_MPI = 1</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_DIR = /home/garrison/Cactus/configs/fixedmhd/scratch/external/MPI</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_INC_DIRS = /home/garrison/Cactus/configs/fixedmhd/scratch/external/MPI/include</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_LIB_DIRS = /home/garrison/Cactus/configs/fixedmhd/scratch/external/MPI/lib</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_LIBS = mpi_usempif08 mpi_usempi_ignore_tkr mpi_mpifh mpi_cxx mpi open-rte open-pal rt util</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HAVE_CAPABILITY_MPI = 1</span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><blockquote type="cite" class=""><div class=""><div class="">configs/sim/bindings/Configuration/Capabilities/make.HDF5.defn<br class=""></div></div></blockquote><div><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">include /home/garrison/Cactus/configs/fixedmhd/bindings/Configuration/Capabilities/make.MPI.defn</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">include /home/garrison/Cactus/configs/fixedmhd/bindings/Configuration/Capabilities/make.ZLIB.defn</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">INC_DIRS += $(HDF5_INC_DIRS)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">INC_DIRS_F += $(HDF5_INC_DIRS)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_BUILD = 1</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_ENABLE_CXX = no</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_ENABLE_FORTRAN = yes</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">LIBSZ_DIR = </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">LIBZ_DIR = </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_INSTALL_DIR = </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_DIR = /home/garrison/Cactus/configs/fixedmhd/scratch/external/HDF5</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_ENABLE_CXX = no</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_ENABLE_FORTRAN = yes</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_INC_DIRS = /home/garrison/Cactus/configs/fixedmhd/scratch/external/HDF5/lib /home/garrison/Cactus/configs/fixedmhd/scratch/external/HDF5/include /home/garrison/Cactus/configs/fixedmh</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">d/scratch/external/HDF5/lib </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_LIB_DIRS = /home/garrison/Cactus/configs/fixedmhd/scratch/external/HDF5/lib </span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HDF5_LIBS = hdf5hl_fortran hdf5_fortran hdf5_hl hdf5 m z</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">HAVE_CAPABILITY_HDF5 = 1</span></div><blockquote type="cite" class=""><div class=""><div class=""><br class="">configs/sim/bindings/Configuration/Capabilities/make.HDF5.deps<br class=""></div></div></blockquote><div><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">include /home/garrison/Cactus/configs/fixedmhd/bindings/Configuration/Capabilities/make.MPI.deps</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">include /home/garrison/Cactus/configs/fixedmhd/bindings/Configuration/Capabilities/make.ZLIB.deps</span></div><blockquote type="cite" class=""><div class=""><div class=""><br class="">as well as<br class=""><br class="">confis/sim/config-info (as well as the option list that you used)?<br class=""></div></div></blockquote><div><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># CONFIGURATION : fixedmhd</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># CONFIG-DATE : Sun Mar 18 02:24:53 2018 (GMT)</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># CONFIG-HOST : singularity.cluster.internal</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># CONFIG-STATUS : 0</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># CONFIG-OPTIONS :</span></div><div style="margin: 0px; font-stretch: normal; font-size: 10px; line-height: normal; font-family: Monaco; background-color: rgb(255, 255, 255);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPI_DIR=BUILD</span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><blockquote type="cite" class=""><div class=""><div class=""><br class="">If possible also the full output of:<br class=""><br class="">export VERBOSE=yes<br class="">simfactory/bin/sim build 2>&1 | tee make.log<br class=""><br class="">or <br class=""><br class="">export VERBOSE=yes<br class="">make sim 2>&1 | tee make.log<br class=""><br class="">(depending on whether you used simfactory or not), please?<br class=""><br class="">Yours,<br class="">Roland<br class=""><br class=""><blockquote type="cite" class="">Hello,<br class=""><br class="">Every time I try to compile my code I get the following error. <br class=""><br class="">COMPILING arrangements/CactusPUGHIO/IOHDF5Util/src/Startup.c<br class="">/share/apps/hdf5-1.8.12/include/H5public.h(61): catastrophic error: cannot open source file "mpi.h"<br class=""> # include <mpi.h><br class=""><br class="">This is new as of the most recent versions of Cactus. Previous compilations of the same code on the same cluster did not result in this error. Any help is appreciated.<br class=""><br class="">I used the config option: MPI_DIR = BUILD<br class=""><br class="">-DG<br class=""><br class="">Sent from my iPhone<br class="">_______________________________________________<br class="">Users mailing list<br class=""><a href="mailto:Users@einsteintoolkit.org" class="">Users@einsteintoolkit.org</a><br class="">http://lists.einsteintoolkit.org/mailman/listinfo/users<br class=""></blockquote><br class=""><br class="">Yours,<br class="">Roland<br class=""><br class=""><br class="">-- <br class="">My email is as private as my paper mail. I therefore support encrypting<br class="">and signing email messages. Get my PGP key from <a href="http://pgp.mit.edu" class="">http://pgp.mit.edu</a> .<br class=""></div></div></blockquote></div><br class=""></div></body></html>