Users

users@lists.einsteintoolkit.org

3 participants
3984 discussions

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 04 Apr '22

04 Apr '22

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

2022 North American Einstein Toolkit School Registration Reminder
by Rosa Werneck, Leo (leonardo＠uidaho.edu) 04 Apr '22

04 Apr '22

Dear colleagues, This is a friendly reminder that the deadline to register for the 2022 North American Einstein Toolkit School is May 1, 2022. The school—held at the University of Idaho June 13-17, 2022—will provide an opportunity for researchers and students to gather and learn about the Einstein Toolkit. To register for the event, please visit: https://einsteintoolkit.github.io/et2022uidaho/register.html This will be a fully hybrid meeting with both in-person and remote participation fully welcome. Please select the in-person option at registration in case you are undecided about whether you will be able to attend in person. A nominal registration fee will be required for participants who attend in person. A limited amount of travel support will be available for participants who wish to attend in person, including waiver of registration fee. Please indicate during registration if you would like to be considered for this support. This year, a special field trip will be offered for in-person participants to nearby LIGO Hanford, whose direct observation of the gravitational waves from a coalescing pair of black holes led to the 2017 Nobel Prize in Physics. During the visit, LIGO Hanford will be gearing up for the start of O4 (Observing Run 4), due to start at the end of this year. On the same day, virtual participants will have the opportunity to attend an Einstein Toolkit hackathon. For more information, please visit our website: https://einsteintoolkit.github.io/et2022uidaho/ If you have any questions, please contact the organizers at workshop(a)einsteintoolkit.org. Sincerely, The Scientific Organizing Committee 2022 North American Einstein Toolkit Summer School Gabrielle Allen Steven Brandt Zachariah Etienne Roland Haas Christiana Pantelidou Leonardo Werneck Helvi Witek ------ Leonardo Werneck, Ph.D. Postdoctoral researcher Office EP 314 | Department of Physics | University of Idaho 875 Perimeter Dr. MS 0903 Moscow, ID 83844-0903, USA leonardo(a)uidaho.edu<mailto:leonardo@uidaho.edu> https://leowerneck.github.io

1 0

M1 Mac
by Garrison, David 04 Apr '22

04 Apr '22

Hello, Has anyone successfully built Cactus on an M1 Mac? I get errors that seem to imply that it is unaware of the correct architecture. Updating /Users/garrison/Applications/Cactus/configs/specgrmhd/lib/libthorn_CactusBindings.a Creating cactus_specgrmhd in /Users/garrison/Applications/Cactus/exe from ExternalLibraries/BLAS CactusBase/Boundary Carpet/Carpet Carpet/CarpetIOASCII Carpet/CarpetIOBasic Carpet/CarpetIOScalar Carpet/CarpetInterp2 Carpet/CarpetLib Carpet/CarpetReduce Carpet/CarpetRegrid2 Carpet/CarpetSlab CactusBase/CartGrid3D CactusBase/CoordBase ExternalLibraries/FFTW3 CactusBase/Fortran CactusBase/IOUtil CactusBase/InitBase CactusNumerical/InterpToArray ExternalLibraries/LAPACK CactusNumerical/LocalInterp2 CactusNumerical/LocalReduce SpecCosmo/MHD_Analysis SpecCosmo/MHD_INIT ExternalLibraries/MPI SpecCosmo/MoL CactusUtils/NaNChecker CactusUtils/Nice CactusNumerical/Noise CactusNumerical/Norms Carpet/PeriodicCarpet CactusNumerical/Slab SpecCosmo/SpecGRMHD CactusBase/SymBase CactusUtils/SystemStatistics CactusBase/Time CactusUtils/TimerReport Carpet/Timers CactusUtils/Vectors ExternalLibraries/zlib ld: warning: directory not found for option '-L/opt/intel/oneapi/compiler/latest/mac/bin/lib' ld: warning: ignoring file /opt/homebrew/Cellar/fftw/3.3.10/lib/libfftw3_mpi.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64 ld: warning: ignoring file /opt/homebrew/Cellar/fftw/3.3.10/lib/libfftw3.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64 ld: warning: ignoring file /opt/homebrew/Cellar/open-mpi/4.1.2/lib/libmpi.dylib, building for macOS-x86_64 but attempting to link with file built for macOS-arm64 Undefined symbols for architecture x86_64: "_MPI_Abort", referenced from: _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o) __ZN6Carpet5AbortEPK4_cGHi in libthorn_Carpet.a(helpers.cc.o) "_MPI_Allgather", referenced from: _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o) __ZN6Carpet7SetupGHEP12tFleshConfigiP4_cGH in libthorn_Carpet.a(SetupGH.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) ... "_MPI_Allgatherv", referenced from: __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Allreduce", referenced from: __ZN12CarpetReduce8FinaliseEPK4_cGHiiPviPKvS5_PKNS_9reductionE in libthorn_CarpetReduce.a(reduce.cc.o) __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) __ZN17_INTERNAL9b1d428a6Carpet12do_terminateEPK4_cGH in libthorn_Carpet.a(Evolve.cc.o) __ZN9CarpetLib4dist25collect_total_num_threadsEv in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Alltoall", referenced from: __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZN13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o) ... "_MPI_Alltoallv", referenced from: __ZN13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE5setupEPK4_cGHRKNS_15fasterp_llocs_tE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib16alltoallv_stringEP19ompi_communicator_tRKNSt3__16vectorINS2_12basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEENS7_IS9_EEEE in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Barrier", referenced from: __ZN6Carpet7BarrierEPK4_cGH in libthorn_Carpet.a(helpers.cc.o) _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o) _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist7barrierEP19ompi_communicator_tiPKc in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Bcast", referenced from: __ZN13CarpetIOASCII7IOASCIIILi0EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi1EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi2EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi3EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOBasic12TimeToOutputEPK4_cGH in libthorn_CarpetIOBasic.a(iobasic.cc.o) __ZN17_INTERNAL7d87f69e14CarpetIOScalar12TimeToOutputEPK4_cGHi in libthorn_CarpetIOScalar.a(ioscalar.cc.o) __ZN12CarpetReduce12ReduceArraysEPK4_cGHiiPKiiPKPKviiPviPKNS_9reductionEi in libthorn_CarpetReduce.a(reduce.cc.o) ... "_MPI_Comm_rank", referenced from: _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o) __ZN9CarpetLib4dist4rankEv in libthorn_PeriodicCarpet.a(periodic.cc.o) __ZN6Carpet6MyProcEPK4_cGH in libthorn_Carpet.a(helpers.cc.o) __ZN9CarpetLib4dist4rankEv in libthorn_Carpet.a(helpers.cc.o) __ZN9CarpetLib4dist4rankEv in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN9CarpetLib4dist4rankEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZN9CarpetLib4dist4rankEv in libthorn_CarpetLib.a(memstat.cc.o) ... "_MPI_Comm_size", referenced from: _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o) __ZN9CarpetLib4dist4sizeEv in libthorn_PeriodicCarpet.a(periodic.cc.o) __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) __ZN6Carpet6nProcsEPK4_cGH in libthorn_Carpet.a(helpers.cc.o) __ZN9CarpetLib4dist4sizeEv in libthorn_CarpetLib.a(memstat.cc.o) __ZN9CarpetLib4dist4sizeEv in libthorn_CarpetLib.a(timestat.cc.o) _Slab_MultiTransfer_Init in libthorn_Slab.a(slab.cc.o) ... "_MPI_Comm_split", referenced from: __ZN6Carpet13SplitUniverseEP19ompi_communicator_tNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEERS1_b in libthorn_Carpet.a(MultiModel.cc.o) "_MPI_Error_string", referenced from: _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o) _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o) _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o) _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o) _CactusDefaultExit in libthorn_Cactus.a(CactusDefaultComm.c.o) _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o) "_MPI_Finalize", referenced from: _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o) _CactusDefaultExit in libthorn_Cactus.a(CactusDefaultComm.c.o) __ZN9CarpetLib4dist8finalizeEv in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Finalized", referenced from: _CCTKi_ShutdownCactus in libthorn_Cactus.a(ShutdownCactus.c.o) "_MPI_Gather", referenced from: _CarpetLib_printmemstats in libthorn_CarpetLib.a(memstat.cc.o) __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Gatherv", referenced from: __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Get_count", referenced from: __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Get_processor_name", referenced from: __ZN6Carpet7SetupGHEP12tFleshConfigiP4_cGH in libthorn_Carpet.a(SetupGH.cc.o) "_MPI_Init", referenced from: __ZN9CarpetLib4dist4initERiRPPc in libthorn_CarpetLib.a(dist.cc.o) (maybe you meant: _CactusBindingsVariables_MPI_Initialise, _CactusBindingsVarIndex_MPI_Initialise ) "_MPI_Init_thread", referenced from: _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o) "_MPI_Initialized", referenced from: _CCTKi_ProcessEnvironment in libthorn_Cactus.a(ProcessEnvironment.c.o) "_MPI_Irecv", referenced from: __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o) ... "_MPI_Isend", referenced from: __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib10comm_state17commit_send_spaceEjil in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o) ... "_MPI_Op_create", referenced from: __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Pcontrol", referenced from: __ZN9CarpetLib5Timer5startEv in libthorn_CarpetLib.a(timestat.cc.o) __ZN9CarpetLib5Timer4stopEd in libthorn_CarpetLib.a(timestat.cc.o) "_MPI_Probe", referenced from: __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Recv", referenced from: __ZN9CarpetLib11recv_stringEP19ompi_communicator_ti in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Reduce", referenced from: __ZN12CarpetReduce8FinaliseEPK4_cGHiiPviPKvS5_PKNS_9reductionE in libthorn_CarpetReduce.a(reduce.cc.o) "_MPI_Send", referenced from: __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib11send_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Ssend", referenced from: __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) "_MPI_Type_commit", referenced from: _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Type_contiguous", referenced from: _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Type_create_resized", referenced from: __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Type_create_struct", referenced from: __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o) "_MPI_Type_size", referenced from: __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib4distlsERNSt3__113basic_ostreamIcNS1_11char_traitsIcEEEERKNS0_18mpi_struct_descr_tE in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(mpi_string.cc.o) "_MPI_Waitall", referenced from: __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKNSt3__16vectorIiNS6_9allocatorIiEEEERNS7_IPdNS8_ISD_EEEE in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib10comm_state4stepEv in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib10alltoallv1INS_23sendrecv_pseudoregion_tEEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_CarpetLib.a(region.cc.o) ... "__ZNKSt3__113basic_ostreamIcNS_11char_traitsIcEEE6sentrycvbEv", referenced from: __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE4gptrEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o) ... "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE4pptrEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o) ... "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5ebackEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9pbackfailEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) ... "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5egptrEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE9underflowEv in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5epptrEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__115basic_streambufIcNS_11char_traitsIcEEE5pbaseEv", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE4syncEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNKSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE3strEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE7seekoffExNS_8ios_base7seekdirEj in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE4fillEv", referenced from: __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE5rdbufEv", referenced from: __ZNSt3__119ostreambuf_iteratorIcNS_11char_traitsIcEEEC1ERNS_13basic_ostreamIcS2_EE in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNKSt3__19basic_iosIcNS_11char_traitsIcEEE5widenEc", referenced from: __ZNSt3__14endlIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_ in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNSt3__115basic_streambufIcNS_11char_traitsIcEEE7__pbumpEl", referenced from: __ZNSt3__113basic_filebufIcNS_11char_traitsIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__115basic_stringbufIcNS_11char_traitsIcEENS_9allocatorIcEEE8overflowEi in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEE5clearEj", referenced from: __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE4openEPKcj in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEE8setstateEj", referenced from: __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE4openEPKcj in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEE5closeEv in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__124__put_character_sequenceIcNS_11char_traitsIcEEEERNS_13basic_ostreamIT_T0_EES7_PKS4_m in libthorn_CarpetLib.a(backtrace.cc.o) "__ZNSt3__19basic_iosIcNS_11char_traitsIcEEEC2Ev", referenced from: __ZNSt3__114basic_ofstreamIcNS_11char_traitsIcEEEC2Ev in libthorn_CarpetLib.a(backtrace.cc.o) __ZNSt3__118basic_stringstreamIcNS_11char_traitsIcEENS_9allocatorIcEEEC2Ej in libthorn_CarpetLib.a(backtrace.cc.o) "_fftw_mpi_cleanup", referenced from: _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o) _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o) _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o) _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o) _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o) _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o) ... "_fftw_mpi_init", referenced from: _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o) _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o) _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o) _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o) _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o) _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o) ... "_fftw_mpi_local_size_1d", referenced from: _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o) _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor_4D_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D_1d.c.o) _SpecDeriv_SpecGalMethod_Vector2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector2_1d.c.o) _SpecDeriv_SpecGalMethod_Vector_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector_1d.c.o) ... "_fftw_mpi_local_size_3d", referenced from: _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o) _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o) _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o) _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o) _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o) _SpecDeriv_SpecGalMethod_Tensor_4D in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D.c.o) _SpecDeriv_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(SpecDeriv_Vector.c.o) ... "_fftw_mpi_plan_dft_1d", referenced from: _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o) _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor_4D_1d in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D_1d.c.o) _SpecDeriv_SpecGalMethod_Vector2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector2_1d.c.o) _SpecDeriv_SpecGalMethod_Vector_1d in libthorn_SpecGRMHD.a(SpecDeriv_Vector_1d.c.o) ... "_fftw_mpi_plan_dft_3d", referenced from: _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o) _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o) _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o) _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o) _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o) _SpecDeriv_SpecGalMethod_Tensor_4D in libthorn_SpecGRMHD.a(SpecDeriv_Tensor_4D.c.o) _SpecDeriv_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(SpecDeriv_Vector.c.o) ... "_lam_mpi_comm_world", referenced from: _Calculate_A_SpecGalMethod_Vector in libthorn_SpecGRMHD.a(Calc_A.c.o) _SpecDeriv_SpecGalMethod_Scalar in libthorn_SpecGRMHD.a(SpecDeriv_Scalar.c.o) _SpecDeriv_SpecGalMethod_Scalar2 in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2.c.o) _SpecDeriv_SpecGalMethod_Scalar2_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar2_1d.c.o) _SpecDeriv_SpecGalMethod_Scalar_1d in libthorn_SpecGRMHD.a(SpecDeriv_Scalar_1d.c.o) _SpecDeriv_SpecGalMethod_Tensor in libthorn_SpecGRMHD.a(SpecDeriv_Tensor.c.o) _SpecDeriv_SpecGalMethod_Tensor2 in libthorn_SpecGRMHD.a(SpecDeriv_Tensor2.c.o) ... "_ompi_mpi_char", referenced from: _CarpetMPIDatatype in libthorn_Carpet.a(helpers.cc.o) __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) __ZN9CarpetLib11allgatherv1INS_4vectIiLi3EEEEENSt3__16vectorIT_NS3_9allocatorIS5_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetRegrid2.a(amr.cc.o) __ZN9CarpetLib10allgathervINS_2dh12light_dboxesEEENSt3__16vectorINS4_IT_NS3_9allocatorIS5_EEEENS6_IS8_EEEEP19ompi_communicator_tRKS8_ in libthorn_CarpetLib.a(dh.cc.o) __ZN9CarpetLib13gather_stringEP19ompi_communicator_tiRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) __ZN9CarpetLib16allgather_stringEP19ompi_communicator_tRKNSt3__112basic_stringIcNS2_11char_traitsIcEENS2_9allocatorIcEEEE in libthorn_CarpetLib.a(mpi_string.cc.o) ... "_ompi_mpi_comm_null", referenced from: _Carpet_GetMPICommUniverse in libthorn_Carpet.a(helpers.cc.o) _Carpet_GetMPICommWorld in libthorn_Carpet.a(helpers.cc.o) __ZN9CarpetLib4dist8goodcommEv in libthorn_Carpet.a(helpers.cc.o) __ZN6Carpet13comm_universeE in libthorn_Carpet.a(variables.cc.o) __ZN6Carpet10comm_worldE in libthorn_Carpet.a(variables.cc.o) __ZN9CarpetLib4dist5comm_E in libthorn_CarpetLib.a(dist.cc.o) "_ompi_mpi_comm_world", referenced from: _CactusDefaultMyProc in libthorn_Cactus.a(CactusDefaultComm.c.o) _CactusDefaultnProcs in libthorn_Cactus.a(CactusDefaultComm.c.o) _CactusDefaultAbort in libthorn_Cactus.a(CactusDefaultComm.c.o) __ZN6Carpet5AbortEPK4_cGHi in libthorn_Carpet.a(helpers.cc.o) __ZN9CarpetLib4dist8goodcommEv in libthorn_Carpet.a(helpers.cc.o) _CarpetMultiModelStartup in libthorn_Carpet.a(CarpetStartup.cc.o) __ZN17_INTERNAL63b030c812get_mpi_commEPK4_cGH in libthorn_Slab.a(slab.cc.o) ... "_ompi_mpi_datatype_null", referenced from: _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib10comm_state11typebufdescC1Ev in libthorn_CarpetLib.a(commstate.cc.o) __ZN9CarpetLib4dist10pseudoinitEP19ompi_communicator_t in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist19create_mpi_datatypeEmPKNS0_18mpi_struct_descr_tEPKcm in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist12mpi_complex8E in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist13mpi_complex16E in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist13mpi_complex32E in libthorn_CarpetLib.a(dist.cc.o) ... "_ompi_mpi_double", referenced from: __ZN9CarpetLib4dist12mpi_datatypeERKd in libthorn_Carpet.a(helpers.cc.o) _CarpetLib_printmemstats in libthorn_CarpetLib.a(memstat.cc.o) _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) __ZN9CarpetLib4dist12mpi_datatypeIdEEP15ompi_datatype_tv in libthorn_CarpetInterp2.a(fasterp.cc.o) __ZN9CarpetLib4dist12mpi_datatypeERKd in libthorn_CarpetLib.a(commstate.cc.o) ... "_ompi_mpi_float", referenced from: _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist12mpi_datatypeERKf in libthorn_CarpetLib.a(dist.cc.o) "_ompi_mpi_int", referenced from: __ZN9CarpetLib4dist12mpi_datatypeIiEEP15ompi_datatype_tv in libthorn_PeriodicCarpet.a(periodic.cc.o) __ZN9CarpetLib10alltoallv1I10xferinfo_tEENSt3__16vectorIT_NS2_9allocatorIS4_EEEEP19ompi_communicator_tRKNS3_IS7_NS5_IS7_EEEE in libthorn_PeriodicCarpet.a(periodic.cc.o) __ZN9CarpetLib4dist12mpi_datatypeERKi in libthorn_Carpet.a(helpers.cc.o) __ZN13CarpetIOASCII7IOASCIIILi0EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi1EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi2EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) __ZN13CarpetIOASCII7IOASCIIILi3EE12TimeToOutputEPK4_cGHi in libthorn_CarpetIOASCII.a(ioascii.cc.o) ... "_ompi_mpi_long", referenced from: __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) "_ompi_mpi_long_double", referenced from: _Slab_InitMPIDatatypes in libthorn_Slab.a(slab.cc.o) __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist12mpi_datatypeERKe in libthorn_CarpetLib.a(dist.cc.o) "_ompi_mpi_long_long_int", referenced from: _Slab_MultiTransfer_Apply in libthorn_Slab.a(slab.cc.o) __ZN9CarpetLib4dist12mpi_datatypeIxEEP15ompi_datatype_tv in libthorn_CarpetLib.a(dh.cc.o) "_ompi_mpi_op_lor", referenced from: __ZN17_INTERNAL9b1d428a6Carpet12do_terminateEPK4_cGH in libthorn_Carpet.a(Evolve.cc.o) "_ompi_mpi_op_max", referenced from: __ZN11TimerReport16CollectTimerInfoEPK4_cGHRNS_11timer_statsE in libthorn_TimerReport.a(Output.cc.o) "_ompi_mpi_op_null", referenced from: __ZN9CarpetLib4dist7mpi_maxE in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist7mpi_minE in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist8mpi_prodE in libthorn_CarpetLib.a(dist.cc.o) __ZN9CarpetLib4dist7mpi_sumE in libthorn_CarpetLib.a(dist.cc.o) "_ompi_mpi_op_sum", referenced from: __ZN9CarpetLib4dist25collect_total_num_threadsEv in libthorn_CarpetLib.a(dist.cc.o) "_ompi_mpi_short", referenced from: __ZN17_INTERNAL63b030c88mpi_typeEi in libthorn_Slab.a(slab.cc.o) "_ompi_request_null", referenced from: __ZN9CarpetLib10comm_state9push_backERNSt3__16vectorIP14ompi_request_tNS1_9allocatorIS4_EEEE in libthorn_CarpetLib.a(commstate.cc.o) ld: symbol(s) not found for architecture x86_64 make[2]: *** [/Users/garrison/Applications/Cactus/exe/cactus_specgrmhd] Error 1 make[1]: *** [specgrmhd] Error 2 make: *** [specgrmhd-rebuild] Error 2 David-Garrisons-MacBook-Air:Cactus garrison$ -- David Garrison, Ph.D. Interim Associate Dean for the College of Science and Engineering, Professor and Former Chair of Physics University of Houston-Clear Lake Bayou 3611 Houston, TX 77058 Tel: 281-283-3796 Fax: 281-283-3709 http://sce.uhcl.edu/garrison http://www.uhcl.edu/physics "If we knew what it was we were doing, it would not be called research, would it?" ‹ Albert Einstein.

2 1

number of thesis using the Einstein Toolkit codes
by Roland Haas 01 Apr '22

01 Apr '22

Hello all, for a report to the NSF I am trying to obtain an idea of who many student thesis were using (were enabled by) the Einstein Toolkit. So if you are a student or are working with a student and have used the Einstein Toolkit as part of your thesis work in between 2021-07-01 and 2022-06-30 it would be great if you could let me know. You do not have to have defended in this period, just having used the toolkit. Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://keys.gnupg.net.

1 0

Number of processors and ppn used
by Nisa Amir 31 Mar '22

31 Mar '22

Hello all, When I submit my simulation %%bash # start simulation segment ./simfactory/bin/sim submit NH --cores=1 --ppn-used=8 --walltime=0:2:00 Also tried this %%bash ./simfactory/bin/sim submit NH --cores=2 --num-threads=1 --walltime=0:20:00 again it gives the same warning it gives the warning that Total number of threads and number of cores per node are inconsistent: procs=1, ppn-used=8 (procs must be an integer multiple of ppn-used) and after that when i run the parameter file it does not run completely and shows only half or more than half output. How can I resolve this issue so that I get the complete output.

2 10

Meeting minutes for 2022-03-31
by Leonardo Rosa Werneck 31 Mar '22

31 Mar '22

ET Meeting Minutes - March 31, 2022 Chair : Roland Haas Minutes: Leo Werneck Present: Steve Brandt, Peter Diener, Zach Etienne, Bill Gabella, Miguel Garcia, Bruno Giacomazzo, Roland Haas, Atul Kedia, Leo Werneck, Yosef Zlochower Nothing specific added to the agenda. * Next ET Release: - Nothing happens until tomorrow when Kranc, NRPy+, and mathematica generated thorns will be regenerated. - Is FLRW solver in master yet? Probably not, but Roland will look into it. - Roland is testing the toolkit in various clusters. - Proposed name of next release: Riemann. Need male name to maintain the alternating name scheme. Suggestions should be added to: https://docs.einsteintoolkit.org/et-docs/Release_Details#Release_names * Unanswered questions in mailing list: - There is a question regarding segmentation faults when performing reductions after setting the number of ghostzones in Carpet to 1. No further details are given and no parfile is available. Bruno has volunteered to reply requesting the parfile and/or more details. http://lists.einsteintoolkit.org/pipermail/users/2022-March/008451.html * No new open tickets * No new issues for review * 2022 NA ET Summer School is happening in June at the University of Idaho! - Website : https://einsteintoolkit.github.io/et2022uidaho/index.html - Register at: https://einsteintoolkit.github.io/et2022uidaho/register.html - Leo will send a reminder to the mailing list. - We will update the website with hotel information as well. Next week chair : Peter Diener Next week minutes: Bill Gabella Cheers, Leo ------ Leonardo Werneck, Ph.D. Postdoctoral researcher Office EP 314 | Department of Physics | University of Idaho 875 Perimeter Dr. MS 0903 Moscow, ID 83844-0903, USA leonardo(a)uidaho.edu <mailto:leonardo@uidaho.edu> https://leowerneck.github.io <https://leowerneck.github.io/>

1 0

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 30 Mar '22

30 Mar '22

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Einstein Toolkit GPU support
by Santiago Jaraba 29 Mar '22

29 Mar '22

Hi all, I would like to know whether it is currently possible to run the Einstein Toolkit in a GPU-only cluster, since my group is planning to apply for a cluster like this. In particular, I would like to know if I would be able to run a BBH simulation like the example in the gallery. I know there was this question in http://lists.einsteintoolkit.org/pipermail/users/2020-July/007508.html some time ago, focused on the development of CarpetX, but I'm not sure what's the current status or if this means that simulations using Carpet wouldn't run on a GPU. Thanks in advance! Santiago

2 2

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 28 Mar '22

28 Mar '22

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

sim build problems
by Lorenzo Bertassi 24 Mar '22

24 Mar '22

Hi, I'm trying to build the EinsteinToolkit running the command: ./simfactory/bin/sim build -j2 --thornlist ../einsteintoolkit.th. on my mac but the result, after nearly 1h, is the following: Undefined symbols for architecture x86_64: "_GOMP_loop_nonmonotonic_dynamic_next", referenced from: __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKSt6vectorIiSaIiEERS6_IPdSaISB_EE._omp_fn.0 in fasterp.cc.o __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKSt6vectorIiSaIiEERS6_IPdSaISB_EE._omp_fn.0 in fasterp.cc.o __ZN10NaNChecker10CHECK_DATAIfEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o __ZN10NaNChecker10CHECK_DATAIdEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o __ZN10NaNChecker10CHECK_DATAIeEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o _SetMatrix_JFD._omp_fn.0 in FuncAndJacobian.c.o _J_times_dv._omp_fn.0 in FuncAndJacobian.c.o ... "_GOMP_loop_nonmonotonic_dynamic_start", referenced from: __ZNK13CarpetInterp219fasterp_setup_gen_tINS_17fasterp_src_loc_tEE11interpolateEPK4_cGHRKSt6vectorIiSaIiEERS6_IPdSaISB_EE._omp_fn.0 in fasterp.cc.o __ZNK13CarpetInterp219fasterp_setup_gen_tINS_22fasterp_eno2_src_loc_tEE11interpolateEPK4_cGHRKSt6vectorIiSaIiEERS6_IPdSaISB_EE._omp_fn.0 in fasterp.cc.o __ZN10NaNChecker10CHECK_DATAIfEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o __ZN10NaNChecker10CHECK_DATAIdEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o __ZN10NaNChecker10CHECK_DATAIeEEvPKT_iPKdPKNS_17t_nanchecker_infoERiiiiiPKS5_PKcRK16GROUPDYNAMICDATAi._omp_fn.0 in NaNCheck.cc.o _SetMatrix_JFD._omp_fn.0 in FuncAndJacobian.c.o _J_times_dv._omp_fn.0 in FuncAndJacobian.c.o ... "_GOMP_loop_nonmonotonic_guided_next", referenced from: ___noexcision_mod_MOD_multiply._omp_fn.0 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.0 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.1 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.2 in NoExcision_mod.F90.o "_GOMP_loop_nonmonotonic_guided_start", referenced from: ___noexcision_mod_MOD_multiply._omp_fn.0 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.0 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.1 in NoExcision_mod.F90.o ___noexcision_mod_MOD_residual._omp_fn.2 in NoExcision_mod.F90.o "_GOMP_parallel", referenced from: _ADMDerivatives_CalcDerivatives in calc_derivs.cc.o _Baikal_zero_rhss in zero_rhss.c.o _Baikal_floor_the_lapse in floor_the_lapse.c.o _Baikal_ADM_to_BSSN in ADM_to_BSSN.c.o _Baikal_BSSN_to_ADM in BSSN_to_ADM.c.o _Baikal_BSSN_Ricci_FD_order_2 in BSSN_Ricci_FD_order_2.c.o _Baikal_BSSN_Ricci_FD_order_4 in BSSN_Ricci_FD_order_4.c.o ... "__gfortran_os_error_at", referenced from: _ahfinder_ in AHFinder.F.o _ahfinder_dis_ in AHFinder_dis.F.o _ahfinder_int_ in AHFinder_int.F.o _linmin_ in AHFinder_pow.F.o _ahfinder_initguess_ in AHFinder_initguess.F.o _ahfinder_gau_ in AHFinder_gau.F.o ___carpet_boxtypes_MOD_splitregionsrecursive in carpet_boxtypes.F90.o ... ld: symbol(s) not found for architecture x86_64 collect2: error: ld returned 1 exit status make[1]: *** [/Users/lorenzo/Cactus/exe/cactus_sim] Error 1 make: *** [sim] Error 2 Is there a way to make it work? I'm using a macbook air (2017) with macOs monterey 12.3 and xcode 13.3. the gcc version is the following: Apple clang version 13.1.6 (clang-1316.0.21.2) Target: x86_64-apple-darwin21.4.0 Thread model: posix InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin Best regards, Lorenzo.

3 2

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users