[Users] M1 Mac

Roland Haas rhaas at illinois.edu
Mon Apr 4 08:23:09 CDT 2022


Hello David,

Yes, Cactus has been used successfully on M1 macOS, at least using
MacPorts. I am not personally aware of whether HomeBrew will work or
not at this point.

You will have to check HomeBrew's homepage to check on their current M1
support.

However you will need to use at least version ET_2021_11 (Johnson) to
get all required support for M1.

Note that from the looks of your output configure identified the
systems as an x86 (Intel) system which is incorrect. Modern versions of
Cactus recognize the arm architecture instead.

This could be caused by not having a new enough version of the Einstein
Toolkit, or by not using a fresh, from scratch installtion of Homebrew
/ MacPorts after a transition from x86 to M1 CPUs (eg when restoring a
backup).

You had questions and issues with M1 macOS before (bash at that time),
were you not able to compile at that time after all?

Note that for some information I had to guess, eg I do not know the
version of Cactus you are using and am guessing you use homebrew based
on paths in the make output you provided.

You may take a look at

http://einsteintoolkit.org/support.html#general-guidelines-for-questions

about information that is usually helpful to provide (eg make.log will
contain the Cactus version).

Yours,
Roland

> Hello,
> 
> Has anyone successfully built Cactus on an M1 Mac?  I get errors that seem to imply that it is unaware of the correct architecture.
> 
> Updating /Users/garrison/Applications/Cactus/configs/specgrmhd/lib/libthorn_CactusBindings.a
> Creating cactus_specgrmhd in /Users/garrison/Applications/Cactus/exe from ExternalLibraries/BLAS CactusBase/Boundary Carpet/Carpet Carpet/CarpetIOASCII Carpet/CarpetIOBasic Carpet/CarpetIOScalar Carpet/CarpetInterp2 Carpet/CarpetLib Carpet/CarpetReduce Carpet/CarpetRegrid2 Carpet/CarpetSlab CactusBase/CartGrid3D CactusBase/CoordBase ExternalLibraries/FFTW3 CactusBase/Fortran CactusBase/IOUtil CactusBase/InitBase CactusNumerical/InterpToArray ExternalLibraries/LAPACK CactusNumerical/LocalInterp2 CactusNumerical/LocalReduce SpecCosmo/MHD_Analysis SpecCosmo/MHD_INIT ExternalLibraries/MPI SpecCosmo/MoL CactusUtils/NaNChecker CactusUtils/Nice CactusNumerical/Noise CactusNumerical/Norms Carpet/PeriodicCarpet CactusNumerical/Slab SpecCosmo/SpecGRMHD CactusBase/SymBase CactusUtils/SystemStatistics CactusBase/Time CactusUtils/TimerReport Carpet/Timers CactusUtils/Vectors ExternalLibraries/zlib
> ld: warning: directory not found for option '-L/opt/intel/oneapi/compiler/latest/mac/bin/lib'
> ld: warning: ignoring file /opt/homebrew/Cellar/fftw/3.3.10/lib/libfftw3_mpi.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64
> ld: warning: ignoring file /opt/homebrew/Cellar/fftw/3.3.10/lib/libfftw3.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64
> ld: warning: ignoring file /opt/homebrew/Cellar/open-mpi/4.1.2/lib/libmpi.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64
> Undefined symbols for architecture x86_64:
>   "_MPI_Abort", referenced from:
>       _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       __ZN6Carpet5AbortEPK4_cGHi in libthorn_Carpet.a(helpers.cc.o)
>   "_MPI_Allgather", referenced from:
>       _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o)
>       __ZN6Carpet7SetupGHEP12tFleshConfigiP4_cGH in libthorn_Carpet.a(SetupGH.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>       ...
>   "_MPI_Allgatherv", referenced from:
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Allreduce", referenced from:
>       __ZN12CarpetReduce8FinaliseEPK4_cGHiiPviPKvS5_PKNS_9reductionE in libthorn_CarpetReduce.a(reduce.cc.o)
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>       __ZN17_INTERNAL9b1d428a6Carpet12do_terminateEPK4_cGH in libthorn_Carpet.a(Evolve.cc.o)
>       __ZN9CarpetLib4dist25collect_total_num_threadsEv in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Alltoall", referenced from:
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZN13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o)
>       ...
>   "_MPI_Alltoallv", referenced from:
>       __ZN13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib16alltoallv_stringEP19ompi_communicator_tRKNSt3__16vectorINS2_12basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEENS7_IS9_EEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Barrier", referenced from:
>       __ZN6Carpet7BarrierEPK4_cGH in libthorn_Carpet.a(helpers.cc.o)
>       _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o)
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist7barrierEP19ompi_communicator_tiPKc in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Bcast", referenced from:
>       __ZN13CarpetIOASCII7IOASCIIILi0EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi1EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi2EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi3EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOBasic12TimeToOutputEPK4_cGH in libthorn_CarpetIOBasic.a(iobasic.cc.o)
>       __ZN17_INTERNAL7d87f69e14CarpetIOScalar12TimeToOutputEPK4_cGHi in libthorn_CarpetIOScalar.a(ioscalar.cc.o)
>       __ZN12CarpetReduce12ReduceArraysEPK4_cGHiiPKiiPKPKviiPviPKNS_9reductionEi in libthorn_CarpetReduce.a(reduce.cc.o)
>       ...
>   "_MPI_Comm_rank", referenced from:
>       _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       __ZN9CarpetLib4dist4rankEv in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       __ZN6Carpet6MyProcEPK4_cGH in libthorn_Carpet.a(helpers.cc.o)
>       __ZN9CarpetLib4dist4rankEv in libthorn_Carpet.a(helpers.cc.o)
>       __ZN9CarpetLib4dist4rankEv in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN9CarpetLib4dist4rankEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZN9CarpetLib4dist4rankEv in libthorn_CarpetLib.a(memstat.cc.o)
>       ...
>   "_MPI_Comm_size", referenced from:
>       _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       __ZN9CarpetLib4dist4sizeEv in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       __ZN6Carpet6nProcsEPK4_cGH in libthorn_Carpet.a(helpers.cc.o)
>       __ZN9CarpetLib4dist4sizeEv in libthorn_CarpetLib.a(memstat.cc.o)
>       __ZN9CarpetLib4dist4sizeEv in libthorn_CarpetLib.a(timestat.cc.o)
>       _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o)
>       ...
>   "_MPI_Comm_split", referenced from:
>       __ZN6Carpet13SplitUniverseEP19ompi_communicator_tNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEERS1_b in libthorn_Carpet.a(MultiModel.cc.o)
>   "_MPI_Error_string", referenced from:
>       _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o)
>       _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o)
>       _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       _CactusDefaultExit in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o)
>   "_MPI_Finalize", referenced from:
>       _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o)
>       _CactusDefaultExit in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       __ZN9CarpetLib4dist8finalizeEv in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Finalized", referenced from:
>       _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o)
>   "_MPI_Gather", referenced from:
>       _CarpetLib_printmemstats in libthorn_CarpetLib.a(memstat.cc.o)
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>       __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Gatherv", referenced from:
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>       __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Get_count", referenced from:
>       __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Get_processor_name", referenced from:
>       __ZN6Carpet7SetupGHEP12tFleshConfigiP4_cGH in libthorn_Carpet.a(SetupGH.cc.o)
>   "_MPI_Init", referenced from:
>       __ZN9CarpetLib4dist4initERiRPPc in libthorn_CarpetLib.a(dist.cc.o)
>      (maybe you meant: _CactusBindingsVariables_MPI_Initialise, _CactusBindingsVarIndex_MPI_Initialise )
>   "_MPI_Init_thread", referenced from:
>       _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o)
>   "_MPI_Initialized", referenced from:
>       _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o)
>   "_MPI_Irecv", referenced from:
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o)
>       ...
>   "_MPI_Isend", referenced from:
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib10comm_state17commit_send_spaceEjil in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o)
>       ...
>   "_MPI_Op_create", referenced from:
>       __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Pcontrol", referenced from:
>       __ZN9CarpetLib5Timer5startEv in libthorn_CarpetLib.a(timestat.cc.o)
>       __ZN9CarpetLib5Timer4stopEd in libthorn_CarpetLib.a(timestat.cc.o)
>   "_MPI_Probe", referenced from:
>       __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Recv", referenced from:
>       __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Reduce", referenced from:
>       __ZN12CarpetReduce8FinaliseEPK4_cGHiiPviPKvS5_PKNS_9reductionE in libthorn_CarpetReduce.a(reduce.cc.o)
>   "_MPI_Send", referenced from:
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib11send_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Ssend", referenced from:
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>   "_MPI_Type_commit", referenced from:
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Type_contiguous", referenced from:
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Type_create_resized", referenced from:
>       __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Type_create_struct", referenced from:
>       __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o)
>   "_MPI_Type_size", referenced from:
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib4distlsERNSt3__113basic_ostreamIcNS1_11char_traitsIcEEEERKNS0_18mpi_struct_descr_tE in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o)
>   "_MPI_Waitall", referenced from:
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o)
>       ...
>   "__ZNKSt3__113basic_ostreamIcNS_11char_traitsIcEEE6sentrycvbEv", referenced from:
>       __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE4gptrEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o)
>       ...
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE4pptrEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o)
>       ...
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5ebackEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       ...
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5egptrEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5epptrEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5pbaseEv", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE4fillEv", referenced from:
>       __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE5rdbufEv", referenced from:
>       __ZNSt3__119ostreambuf_iteratorIcNS_11char_traitsIcEEEC1ERNS_13basic_ostreamIcS2_EE in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE5widenEc", referenced from:
>       __ZNSt3__14endlIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_ in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNSt3__115basic_streambufIcNS_11char_traitsIcEEE7__pbumpEl", referenced from:
>       __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEE5clearEj", referenced from:
>       __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE4openEPKcj in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEE8setstateEj", referenced from:
>       __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE4openEPKcj in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE5closeEv in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o)
>   "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEEC2Ev", referenced from:
>       __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEEC2Ev in libthorn_CarpetLib.a(backtrace.cc.o)
>       __ZNSt3__118basic_stringstreamIcNS_11char_traitsIcEENS_9allocatorIcEEEC2Ej in libthorn_CarpetLib.a(backtrace.cc.o)
>   "_fftw_mpi_cleanup", referenced from:
>       _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o)
>       ...
>   "_fftw_mpi_init", referenced from:
>       _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o)
>       ...
>   "_fftw_mpi_local_size_1d", referenced from:
>       _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_4D_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Vector2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Vector_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector_1d.c.o)
>       ...
>   "_fftw_mpi_local_size_3d", referenced from:
>       _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_4D in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D.c.o)
>       _SpecDeriv_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(SpecDeriv_Vector.c.o)
>       ...
>   "_fftw_mpi_plan_dft_1d", referenced from:
>       _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_4D_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Vector2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Vector_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector_1d.c.o)
>       ...
>   "_fftw_mpi_plan_dft_3d", referenced from:
>       _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor_4D in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D.c.o)
>       _SpecDeriv_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(SpecDeriv_Vector.c.o)
>       ...
>   "_lam_mpi_comm_world", referenced from:
>       _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o)
>       _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o)
>       ...
>   "_ompi_mpi_char", referenced from:
>       _CarpetMPIDatatype in libthorn_Carpet.a(helpers.cc.o)
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>       __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o)
>       __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o)
>       __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>       __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o)
>       ...
>   "_ompi_mpi_comm_null", referenced from:
>       _Carpet_GetMPICommUniverse in libthorn_Carpet.a(helpers.cc.o)
>       _Carpet_GetMPICommWorld in libthorn_Carpet.a(helpers.cc.o)
>       __ZN9CarpetLib4dist8goodcommEv in libthorn_Carpet.a(helpers.cc.o)
>       __ZN6Carpet13comm_universeE in libthorn_Carpet.a(variables.cc.o)
>       __ZN6Carpet10comm_worldE in libthorn_Carpet.a(variables.cc.o)
>       __ZN9CarpetLib4dist5comm_E in libthorn_CarpetLib.a(dist.cc.o)
>   "_ompi_mpi_comm_world", referenced from:
>       _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o)
>       __ZN6Carpet5AbortEPK4_cGHi in libthorn_Carpet.a(helpers.cc.o)
>       __ZN9CarpetLib4dist8goodcommEv in libthorn_Carpet.a(helpers.cc.o)
>       _CarpetMultiModelStartup in libthorn_Carpet.a(CarpetStartup.cc.o)
>       __ZN17_INTERNAL63b030c812get_mpi_commEPK4_cGH in libthorn_Slab.a(slab.cc.o)
>       ...
>   "_ompi_mpi_datatype_null", referenced from:
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib10comm_state11typebufdescC1Ev in libthorn_CarpetLib.a(commstate.cc.o)
>       __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist12mpi_complex8E in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist13mpi_complex16E in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist13mpi_complex32E in libthorn_CarpetLib.a(dist.cc.o)
>       ...
>   "_ompi_mpi_double", referenced from:
>       __ZN9CarpetLib4dist12mpi_datatypeERKd in libthorn_Carpet.a(helpers.cc.o)
>       _CarpetLib_printmemstats in libthorn_CarpetLib.a(memstat.cc.o)
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeIdEEP15ompi_datatype_tv in libthorn_CarpetInterp2.a(fasterp.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeERKd in libthorn_CarpetLib.a(commstate.cc.o)
>       ...
>   "_ompi_mpi_float", referenced from:
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeERKf in libthorn_CarpetLib.a(dist.cc.o)
>   "_ompi_mpi_int", referenced from:
>       __ZN9CarpetLib4dist12mpi_datatypeIiEEP15ompi_datatype_tv in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeERKi in libthorn_Carpet.a(helpers.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi0EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi1EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi2EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       __ZN13CarpetIOASCII7IOASCIIILi3EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o)
>       ...
>   "_ompi_mpi_long", referenced from:
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>   "_ompi_mpi_long_double", referenced from:
>       _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o)
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeERKe in libthorn_CarpetLib.a(dist.cc.o)
>   "_ompi_mpi_long_long_int", referenced from:
>       _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o)
>       __ZN9CarpetLib4dist12mpi_datatypeIxEEP15ompi_datatype_tv in libthorn_CarpetLib.a(dh.cc.o)
>   "_ompi_mpi_op_lor", referenced from:
>       __ZN17_INTERNAL9b1d428a6Carpet12do_terminateEPK4_cGH in libthorn_Carpet.a(Evolve.cc.o)
>   "_ompi_mpi_op_max", referenced from:
>       __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o)
>   "_ompi_mpi_op_null", referenced from:
>       __ZN9CarpetLib4dist7mpi_maxE in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist7mpi_minE in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist8mpi_prodE in libthorn_CarpetLib.a(dist.cc.o)
>       __ZN9CarpetLib4dist7mpi_sumE in libthorn_CarpetLib.a(dist.cc.o)
>   "_ompi_mpi_op_sum", referenced from:
>       __ZN9CarpetLib4dist25collect_total_num_threadsEv in libthorn_CarpetLib.a(dist.cc.o)
>   "_ompi_mpi_short", referenced from:
>       __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o)
>   "_ompi_request_null", referenced from:
>       __ZN9CarpetLib10comm_state9push_backERNSt3__16vectorIP14ompi_request_tNS1_9allocatorIS4_EEEE in libthorn_CarpetLib.a(commstate.cc.o)
> ld: symbol(s) not found for architecture x86_64
> make[2]: *** [/Users/garrison/Applications/Cactus/exe/cactus_specgrmhd] Error 1
> make[1]: *** [specgrmhd] Error 2
> make: *** [specgrmhd-rebuild] Error 2
> David-Garrisons-MacBook-Air:Cactus garrison$
> 
> --
> David Garrison, Ph.D.
> Interim Associate Dean for the College of Science and Engineering, Professor and Former Chair of Physics
> University of Houston-Clear Lake
> Bayou 3611
> Houston, TX 77058
> 
> Tel: 281-283-3796
> Fax: 281-283-3709
> https://urldefense.com/v3/__http://sce.uhcl.edu/garrison__;!!DZ3fjg!ree-1xZUvfCsDubAnUcHF_Y-V1zkpWiO6SXrL2eQPFzBkDDYta_UPNRvr_60ZMyc$ 
> https://urldefense.com/v3/__http://www.uhcl.edu/physics__;!!DZ3fjg!ree-1xZUvfCsDubAnUcHF_Y-V1zkpWiO6SXrL2eQPFzBkDDYta_UPNRvr7opXZxa$ 
> 
> "If we knew what it was we were doing, it would not be called research,
> would it?" ‹ Albert Einstein.
> 
> 
> 
> 



-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://keys.gnupg.net.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
Url : http://lists.einsteintoolkit.org/pipermail/users/attachments/20220404/ef3aa180/attachment-0001.bin 


More information about the Users mailing list