nid00592 nid00592 nid00592 nid00592 nid00596 nid00596 nid00596 nid00596 nid00595 nid00595 nid00595 nid00595 nid00597 nid00597 nid00597 nid00597 nid00599 nid00594 nid00593 nid00598 nid00599 nid00599 nid00599 nid00594 nid00594 nid00594 nid00593 nid00593 nid00593 nid00598 nid00598 nid00598 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.10.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.10.0 Compile date: Aug 13 2021 (21:30:52) Run date: Aug 20 2021 (11:13:01+0200) Run host: nid00592 (pid=3689) Working directory: /lustre/tetyda/home/topolski/Cactus Executable: /home/topolski/Cactus/exe/cactus_okeanos_custom Parameter file: /home/topolski/Cactus/BHNS_GRHydro_10th.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ML_ADMConstraints ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetInterp CarpetInterp2 CarpetLib CarpetReduce CarpetRegrid2 CarpetTracker CartGrid3D CoordBase CoordGauge Coordinates GlobalDerivative hwloc IOUtil InitBase Interpolate2 QuasiLocalMeasures KadathImporter LocalInterp LoopControl MoL NaNChecker PunctureTracker Slab SpaceMask SphericalSurface StaticConformal SummationByParts SymBase SystemStatistics SystemTopology TerminationTrigger TensorTypes Time TmunuBase Vectors ML_BSSN ML_BSSN_Helper NewRad GenericFD WeylScal4 Multipole ADMDerivatives HydroBase GRHydro EOS_Omni HDF5 MPI Timers Boost CycleClock HRSCCore TGRtensor zlib LAPACK Fortran CPPUtils FDCore BLAS KadathThorn EOS_Thermal EOS_Thermal_Idealgas EOS_Base EOS_Polytrope GSL EOS_Hybrid EOS_IdealFluid Dissipation CarpetMask<--- Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMDerivatives...Success -> active implementation ADMDerivatives Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boost...Success -> active implementation Boost Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetInterp2...Success -> active implementation interp2 Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetMask...Success -> active implementation CarpetMask Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetTracker...Success -> active implementation CarpetTracker Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn Coordinates...Success -> active implementation Coordinates Activating thorn CPPUtils...Success -> active implementation CPPUtils Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Hybrid...Success -> active implementation EOS_Hybrid Activating thorn EOS_IdealFluid...Success -> active implementation EOS_Ideal_Fluid Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn EOS_Polytrope...Success -> active implementation EOS_2d_Polytrope Activating thorn EOS_Thermal...Success -> active implementation EOS_Thermal Activating thorn EOS_Thermal_Idealgas...Success -> active implementation EOS_Thermal_Idealgas Activating thorn FDCore...Success -> active implementation FDCore Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GlobalDerivative...Success -> active implementation GlobalDerivative Activating thorn GRHydro...Success -> active implementation GRHydro Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn HRSCCore...Success -> active implementation HRSCCore Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn InitBase...Success -> active implementation InitBase Activating thorn Interpolate2...Success -> active implementation Interpolate Activating thorn IOUtil...Success -> active implementation IO Activating thorn KadathImporter...Success -> active implementation KadathImporter Activating thorn KadathThorn...Success -> active implementation Kadath Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn PunctureTracker...Success -> active implementation PunctureTracker Activating thorn QuasiLocalMeasures...Success -> active implementation QuasiLocalMeasures Activating thorn Slab...Success -> active implementation Slab Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn SystemTopology...Success -> active implementation SystemTopology Activating thorn TensorTypes...Success -> active implementation TensorTypes Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn TGRtensor...Success -> active implementation TGRtensor Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine Coordinates::Coordinates_ChoosePatchSystem: [meta] Choose patch system CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Timers::Timer_Startup: Prepare hierarchical timers CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles SystemTopology::ST_system_topology: Output and/or modify system topology and hardware locality Carpet::Driver_Startup: Startup routine EOS_Polytrope::EOS_Polytrope_Startup: Setup the polytropic EOS EOS_IdealFluid::EOS_Ideal_Fluid_Startup: Setup EOS test in Fortran EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff EOS_Hybrid::EOS_Hybrid_Startup: Setup the EOS used by Dimmelmeier et al. in core collapse GRHydro::GRHydro_RegisterMask: Register the hydro masks HRSCCore::HRSCC_Startup: [global] Register banner HydroBase::HydroBase_StartUp: Startup banner IOUtil::IOUtil_Startup: Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration GRHydro::GRHydro_Startup: Startup banner GRHydro::GRHydro_ClearLastMoLPostStep: [global] Initialize InLastMoLPostStep to zero HRSCCore::HRSCC_GetGridCoordinates: [global] Store the Cactus indices of the grid coordinates and weights HRSCCore::HRSCC_GetMetric: [global] Store the Cactus indices of the diagonal components of the metric and the lapse ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL GRHydro::GRHydro_Register: Register variables for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries Coordinates::Coordinates_RegisterSymmetry: [meta] Register inter-patch boundaries as symmetries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetMask::CarpetSurfaceParamCheck: [global] Check parameters CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Coordinates::Coordinates_ParamCheck: Check thorn parameters for consistency. Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly GRHydro::GRHydro_ParamCheck: Check parameters GlobalDerivative::GlobalDeriv_ParamCheck: [global] Check parameters HRSCCore::HRSCC_ParamCheck: [global] Check consistency of the parameters ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters QuasiLocalMeasures::qlm_paramcheck: [global] Check quasi-local parameter settings SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. kadathimporter::KadathImporter_check_parameters: Check parameters Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP MultiPatch_SpatialCoordinates: Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetGlobalCoords: [local] Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetJacobian: [local] Fill in the Jacobian matrices for Thornburg04 coordinates. Coordinates::Coordinates_SetInverseJacobian: [local] Numerically evaluate the inverse Jacobian matrices. Coordinates::Coordinates_SetVolumeForm: [local] Set weight mask (for Carpet reduction operators) Dissipation::setup_epsdis: Setup spatially varying dissipation SpaceMask::MaskOne: Set mask to one GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GROUP GRHydro_PrimitiveBoundaries: Apply boundary conditions to all primitives GRHydro::GRHydro_SelectPrimitiveBoundaries: [level] Select primitive variables for boundary conditions GROUP GRHydro_ApplyPrimitiveBCs: Apply boundary conditions to all primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_ExcisionMaskSetup: Set up hydro excision mask HydroBase::HydroBase_InitExcisionMask: Initialize hydro excision mask to 'no excision everywhere' GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GRHydro::GRHydro_SetupMask: Initialize the atmosphere mask [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: [singlemap] Set up ranges for spatial 3D Cartesian coordinates (on all maps) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures GROUP MultiPatch_SpatialCoordinates: Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetGlobalCoords: [local] Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetJacobian: [local] Fill in the Jacobian matrices for Thornburg04 coordinates. Coordinates::Coordinates_SetInverseJacobian: [local] Numerically evaluate the inverse Jacobian matrices. Coordinates::Coordinates_SetVolumeForm: [local] Set weight mask (for Carpet reduction operators) Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones GRHydro::GRHydro_Reset_Execution_Flags: [global] Initially set execution flags to 'YEAH, Execute'! GRHydro::GRHydro_check_Jacobian_state: [global] Test state of Jacobians GRHydro::GRHydro_InitSymBound: Schedule symmetries and check shift state GRHydro::reset_GRHydro_C2P_failed: Initialise the mask function that contains the points where C2P has failed (at BASEGRID) HRSCCore::HRSCC_ParamStore: [global] Store parameters in private namespace Interpolate2::Interpolate2Init: Initialise interpolating inter-patch boundaries GROUP Interpolate2Test: Test interpolating inter-patch boundaries Interpolate2::Interpolate2TestInit: Test: Initialise test grid function Interpolate2::Interpolate2TestSelectBCs: [level] Test: Interpolate test grid function GROUP Interpolate2TestApplyBCs: Test: Interpolate test grid function GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Interpolate2::Interpolate2TestCheck: Test: Check test grid function ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer TerminationTrigger::TerminationTrigger_CreateFile: Create termination file Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set fixed timestep WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GRHydro::GRHydro_EOSHandle: [global] Set the EOS number CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GRHydro::GRHydro_Rho_Minima_Setup: Set up minimum for the rest-mass density in the atmosphere (before intial data) GRHydro::GRHydro_SetupMask: Initialize the atmosphere mask GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points GROUP HydroBase_Initial: HydroBase initial data group GROUP GRHydro_Initial: GRHydro initial data group GROUP HydroBase_ExcisionMaskSetup: Set up hydro excision mask HydroBase::HydroBase_InitExcisionMask: Initialize hydro excision mask to 'no excision everywhere' kadathimporter::KadathImporter: Set up black hole neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GRHydro::GRHydroTransformADMToLocalBasis: Transform ADM metric, extr. curv. and shift to local tensor basis. GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg GRHydro::GRHydroTransformPrimToLocalBasis: Transform primitive vars to local tensor basis. GRHydro::GRHydro_InitialAtmosphereReset: Use mask to enforce atmosphere at initial time ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control PunctureTracker::PunctureTracker_Init: [global] Calculate initial location of punctures QuasiLocalMeasures::qlm_init: [global] Initialise quasi-local calculations GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GRHydro::Primitive2ConservativeCells: Convert initial data given in primive variables to conserved variables [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GRHydro::GRHydro_Scalar_Setup: Set up and check scalars for efficiency GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth: WeylScal4_psis_calc_Nth GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_invars_calc_Nth_group: WeylScal4_invars_calc_Nth WeylScal4::WeylScal4_invars_calc_Nth: WeylScal4_invars_calc_Nth SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] GRHydro::GRHydro_Rho_Minima_Setup_Final: Set the value of the rest-mass density of the atmosphere which will be used during the evolution GRHydro::GRHydro_InitialAtmosphereReset: Use mask to enforce atmosphere at initial time GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) GROUP SetTmunu: Calculate the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor GROUP ADMConstraintsGroup: Evaluate ADM constraints, and perform symmetry boundary conditions [CCTK_POSTSTEP] GROUP ADMDerivatives_Group: Group for ADMDerivatives computations. ADMDerivatives::ADMDerivatives_CalcDerivatives: [local] Calculate requested derivatives of ADM lapse, shift, 3-metric ADMDerivatives::ADMDerivatives_radial_SelectBC: [level] Selecting BC for metric radial derivatives ADMDerivatives::ADMDerivatives_time_SelectBC: [level] Selecting BC for metric time derivatives GROUP ADMDerivatives_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces GRHydro::GRHydro_RefinementLevel: Calculate current refinement level (for the check of the C2P mask) GRHydro::check_GRHydro_C2P_failed: Check the mask function that contains the points where C2P has failed and report an error in case a failure is found GROUP HydroBase_ExcisionHasBeenSet: Group to schedule thorns changing the mask before and thorns using the mask after GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found PunctureTracker::PunctureTracker_SetPositions: [global] Copy puncture positions to spherical surfaces SpaceMask::CheckMask: Ensure that all mask values are legal Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: [singlemap] Set up ranges for spatial 3D Cartesian coordinates (on all maps) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures GROUP MultiPatch_SpatialCoordinates: Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetGlobalCoords: [local] Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetJacobian: [local] Fill in the Jacobian matrices for Thornburg04 coordinates. Coordinates::Coordinates_SetInverseJacobian: [local] Numerically evaluate the inverse Jacobian matrices. Coordinates::Coordinates_SetVolumeForm: [local] Set weight mask (for Carpet reduction operators) Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones GRHydro::GRHydro_Reset_Execution_Flags: [global] Initially set execution flags to 'YEAH, Execute'! GRHydro::GRHydro_check_Jacobian_state: [global] Test state of Jacobians GRHydro::GRHydro_InitSymBound: Schedule symmetries and check shift state GRHydro::reset_GRHydro_C2P_failed: Initialise the mask function that contains the points where C2P has failed (at BASEGRID) HRSCCore::HRSCC_ParamStore: [global] Store parameters in private namespace Interpolate2::Interpolate2Init: Initialise interpolating inter-patch boundaries GROUP Interpolate2Test: Test interpolating inter-patch boundaries Interpolate2::Interpolate2TestInit: Test: Initialise test grid function Interpolate2::Interpolate2TestSelectBCs: [level] Test: Interpolate test grid function GROUP Interpolate2TestApplyBCs: Test: Interpolate test grid function GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Interpolate2::Interpolate2TestCheck: Test: Check test grid function ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer TerminationTrigger::TerminationTrigger_CreateFile: Create termination file Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set fixed timestep WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] GROUP ADMDerivatives_Group: Group for ADMDerivatives computations. ADMDerivatives::ADMDerivatives_CalcDerivatives: [local] Calculate requested derivatives of ADM lapse, shift, 3-metric ADMDerivatives::ADMDerivatives_radial_SelectBC: [level] Selecting BC for metric radial derivatives ADMDerivatives::ADMDerivatives_time_SelectBC: [level] Selecting BC for metric time derivatives GROUP ADMDerivatives_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GRHydro::GRHydro_EOSHandle: [global] Set the EOS number GRHydro::GRHydroCopyIntegerMask: Initialize the real valued atmosphere mask after checkpoint recovery GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg GROUP HydroBase_ExcisionMaskSetup: Set up hydro excision mask HydroBase::HydroBase_InitExcisionMask: Initialize hydro excision mask to 'no excision everywhere' GROUP MoL_PostStep: Ensure that everything is correct after recovery ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired EOS_Hybrid::Check_Poly_Contrib: Output the polytropic and thermal contributions LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior Multipole::Multipole_Calc: [global] Calculate Multipoles QuasiLocalMeasures::qlm_calculate: [global] Calculate quasi-local quantities SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file endif Output grid variables do loop over timesteps [CCTK_PREREGRID] CarpetTracker::CarpetTracker_SetPositions: [global] Set positions of refined regions Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP MultiPatch_SpatialCoordinates: Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetGlobalCoords: [local] Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetJacobian: [local] Fill in the Jacobian matrices for Thornburg04 coordinates. Coordinates::Coordinates_SetInverseJacobian: [local] Numerically evaluate the inverse Jacobian matrices. Coordinates::Coordinates_SetVolumeForm: [local] Set weight mask (for Carpet reduction operators) Dissipation::setup_epsdis: Setup spatially varying dissipation SpaceMask::MaskOne: Set mask to one GROUP GRHydro_PrimitiveBoundaries: Apply boundary conditions to all primitives GRHydro::GRHydro_SelectPrimitiveBoundaries: [level] Select primitive variables for boundary conditions GROUP GRHydro_ApplyPrimitiveBCs: Apply boundary conditions to all primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_ExcisionMaskSetup: Set up hydro excision mask HydroBase::HydroBase_InitExcisionMask: Initialize hydro excision mask to 'no excision everywhere' GRHydro::GRHydro_SetupMask: Initialize the atmosphere mask GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration GRHydro::reset_GRHydro_C2P_failed: Reset the mask function that contains the points where C2P has failed (at PRESTEP) LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here GRHydro::GRHydro_Scalar_Setup: Set up and check scalars for efficiency MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables if (GRHydro::execute_MoL_Step) GROUP GRHydroRHS: Calculate the update terms GRHydro::SourceTerms: Source term calculation GRHydro::GRHydroStartLoop: [level] Set the flux_direction variable while (GRHydro::flux_direction) GROUP FluxTerms: Calculation of intercell fluxes GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::Reconstruct: Reconstruct the functions at the cell boundaries GRHydro::Riemann: Solve the local Riemann problems GRHydro::UpdateCalcul: Calculate the update term from the fluxes GRHydro::GRHydroAdvanceLoop: [level] Decrement the flux_direction variable end while GRHydro::GRHydroUpdateAtmosphereMask: Alter the update terms if inside the atmosphere region ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GlobalDerivative::GlobalDeriv_Dissipation: [local] Apply global dissipation to registered variables GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GRHydro::GRHydro_ClearLastMoLPostStep: [level] Reset InLastMoLPostStep to zero MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GRHydro::sync_GRHydro_C2P_failed: Syncronise the mask function that contains the points where C2P has failed GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth: WeylScal4_psis_calc_Nth GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_invars_calc_Nth_group: WeylScal4_invars_calc_Nth WeylScal4::WeylScal4_invars_calc_Nth: WeylScal4_invars_calc_Nth PunctureTracker::PunctureTracker_Track: [global] Calculate new location of punctures Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] GROUP ADMDerivatives_Group: Group for ADMDerivatives computations. ADMDerivatives::ADMDerivatives_CalcDerivatives: [local] Calculate requested derivatives of ADM lapse, shift, 3-metric ADMDerivatives::ADMDerivatives_radial_SelectBC: [level] Selecting BC for metric radial derivatives ADMDerivatives::ADMDerivatives_time_SelectBC: [level] Selecting BC for metric time derivatives GROUP ADMDerivatives_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces GRHydro::GRHydro_RefinementLevel: Calculate current refinement level (for the check of the C2P mask) GRHydro::check_GRHydro_C2P_failed: Check the mask function that contains the points where C2P has failed and report an error in case a failure is found GROUP HydroBase_ExcisionHasBeenSet: Group to schedule thorns changing the mask before and thorns using the mask after GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found PunctureTracker::PunctureTracker_SetPositions: [global] Copy puncture positions to spherical surfaces SpaceMask::CheckMask: Ensure that all mask values are legal Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired EOS_Hybrid::Check_Poly_Contrib: Output the polytropic and thermal contributions LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior Multipole::Multipole_Calc: [global] Calculate Multipoles QuasiLocalMeasures::qlm_calculate: [global] Calculate quasi-local quantities SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP MultiPatch_SpatialCoordinates: Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetGlobalCoords: [local] Determine the global coordinates of each gridpoint. Coordinates::Coordinates_SetJacobian: [local] Fill in the Jacobian matrices for Thornburg04 coordinates. Coordinates::Coordinates_SetInverseJacobian: [local] Numerically evaluate the inverse Jacobian matrices. Coordinates::Coordinates_SetVolumeForm: [local] Set weight mask (for Carpet reduction operators) Dissipation::setup_epsdis: Setup spatially varying dissipation SpaceMask::MaskOne: Set mask to one GROUP GRHydro_PrimitiveBoundaries: Apply boundary conditions to all primitives GRHydro::GRHydro_SelectPrimitiveBoundaries: [level] Select primitive variables for boundary conditions GROUP GRHydro_ApplyPrimitiveBCs: Apply boundary conditions to all primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_ExcisionMaskSetup: Set up hydro excision mask HydroBase::HydroBase_InitExcisionMask: Initialize hydro excision mask to 'no excision everywhere' GRHydro::GRHydro_SetupMask: Initialize the atmosphere mask GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GRHydro::GRHydro_RefinementLevel: Calculate current refinement level GRHydro::GRHydro_SetLastMoLPostStep: [level] Set grid scalar InLastMoLPostStep if this is the last MoL PostStep call GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards if (GRHydro::execute_MoL_Step) GRHydro::GRHydroTransformADMToLocalBasis: Transform metric and shift to local tensor basis. GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP GRHydro_AtmosphereMaskBoundaries: Apply boundary conditions to primitives GRHydro::GRHydro_SelectAtmosphereMaskBoundaries: [level] Select atmosphere mask for boundary conditions GROUP GRHydro_ApplyAtmosphereMaskBCs: Apply boundary conditions to real-valued atmosphere mask GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP GRHydro_PostStep: Post step tasks for GRHydro GRHydro::GRHydroPostSyncAtmosphereMask: Set integer atmosphere mask from synchronized real atmosphere mask if (GRHydro::InLastMoLPostStep) GRHydro::GRHydro_AtmosphereReset: Reset the atmosphere if (GRHydro::InLastMoLPostStep) GROUP GRHydro_PrimitiveInitialGuessesBoundaries: Apply boundary conditions to those primitives used as initial guesses GRHydro::GRHydro_SelectPrimitiveInitialGuessesBoundaries: [level] Select initial guess primitive variables for boudary conditions GROUP GRHydro_ApplyPrimitiveInitialGuessBCs: Apply boundary conditions to initial guess primitive variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP Do_GRHydro_Boundaries: GRHydro Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydro_Bound: [level] Select GRHydro boundary conditions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables if (GRHydro::execute_MoL_Step) GRHydro::GRHydro_SqrtSpatialDeterminant: Calculate sdetg if (GRHydro::execute_MoL_PostStep) GRHydro::Con2Prim: Convert back to primitive variables (general) if (GRHydro::execute_MoL_PostStep) GRHydro::GRHydroTransformPrimToGlobalBasis: Transform primitive vars to global tensor basis. GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here GRHydro::GRHydro_Tmunu: Compute the energy-momentum tensor WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psis_calc_Nth_bc_group: WeylScal4_psis_calc_Nth WeylScal4::WeylScal4_psis_calc_Nth_SelectBCs: [level] WeylScal4_psis_calc_Nth_SelectBCs GROUP WeylScal4_psis_calc_Nth_ApplyBCs: Apply BCs for groups set in WeylScal4_psis_calc_Nth GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Interpolate2::Interpolate2ApplyBC: [level] Apply interpolating inter-patch boundaries Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: processes 0-31: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" Current core file size limit: hard=[unlimited], soft=[unlimited] Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=124800 MB, soft=124800 MB INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.3846 ns per clock tick (2.6001 GHz) INFO (hwloc): library version 2.0.4, API version 0x20000 INFO (SystemTopology): MPI process-to-host mapping: This is MPI process 0 of 32 MPI hosts: 0: nid00592 1: nid00593 2: nid00594 3: nid00595 4: nid00596 5: nid00597 6: nid00598 7: nid00599 This MPI process runs on host 0 of 8 On this host, this is MPI process 0 of 4 INFO (SystemTopology): Topology support: Discovery support: discovery->pu : yes CPU binding support: cpubind->set_thisproc_cpubind : yes cpubind->get_thisproc_cpubind : yes cpubind->set_proc_cpubind : yes cpubind->get_proc_cpubind : yes cpubind->set_thisthread_cpubind : yes cpubind->get_thisthread_cpubind : yes cpubind->set_thread_cpubind : yes cpubind->get_thread_cpubind : yes cpubind->get_thisproc_last_cpu_location : yes cpubind->get_proc_last_cpu_location : yes cpubind->get_thisthread_last_cpu_location: yes Memory binding support: membind->set_thisproc_membind : no membind->get_thisproc_membind : no membind->set_proc_membind : no membind->get_proc_membind : no membind->set_thisthread_membind : yes membind->get_thisthread_membind : yes membind->set_area_membind : yes membind->get_area_membind : yes membind->alloc_membind : yes membind->firsttouch_membind : yes membind->bind_membind : yes membind->interleave_membind : yes membind->nexttouch_membind : no membind->migrate_membind : yes INFO (SystemTopology): Hardware objects in this node: Machine L#0: (P#0, total=131898220KB, DMIProductName=Cascade, DMIProductVersion=1, DMIBoardVendor="Cray Inc. ", DMIBoardName=Cascade, DMIBoardVersion=N/A, DMIBoardAssetTag=N/A, DMIChassisVendor="Cray Inc.", DMIChassisType=3, DMIChassisVersion=1, DMIChassisAssetTag=N/A, DMIBIOSVendor="American Megatrends Inc.", DMIBIOSVersion=5.6.5, DMIBIOSDate=08/21/2019, DMISysVendor="Cray Inc.", Backend=Linux, LinuxCgroup=/slurm/uid_8472/job_754403/step_1, OSName=Linux, OSRelease=4.12.14-150.17_5.0.86-cray_ari_c, OSVersion="#1 SMP Fri Oct 25 19:00:37 UTC 2019 (34aca61)", HostName=nid00592, Architecture=x86_64, hwlocVersion=2.0.4, ProcessName=cactus_okeanos_custom) Package L#0: (P#0, total=65842996KB, CPUVendor=GenuineIntel, CPUFamilyNumber=6, CPUModelNumber=63, CPUModel="Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz", CPUStepping=2) L3Cache L#0: (P#-1, size=30720KB, linesize=64, ways=20, Inclusive=1) L2Cache L#0: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#0: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#0: (P#0) PU L#0: (P#0) PU L#1: (P#24) L2Cache L#1: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#1: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#1: (P#1) PU L#2: (P#1) PU L#3: (P#25) L2Cache L#2: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#2: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#2: (P#2) PU L#4: (P#2) PU L#5: (P#26) L2Cache L#3: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#3: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#3: (P#3) PU L#6: (P#3) PU L#7: (P#27) L2Cache L#4: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#4: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#4: (P#4) PU L#8: (P#4) PU L#9: (P#28) L2Cache L#5: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#5: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#5: (P#5) PU L#10: (P#5) PU L#11: (P#29) L2Cache L#6: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#6: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#6: (P#8) PU L#12: (P#6) PU L#13: (P#30) L2Cache L#7: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#7: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#7: (P#9) PU L#14: (P#7) PU L#15: (P#31) L2Cache L#8: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#8: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#8: (P#10) PU L#16: (P#8) PU L#17: (P#32) L2Cache L#9: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#9: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#9: (P#11) PU L#18: (P#9) PU L#19: (P#33) L2Cache L#10: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#10: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#10: (P#12) PU L#20: (P#10) PU L#21: (P#34) L2Cache L#11: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#11: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#11: (P#13) PU L#22: (P#11) PU L#23: (P#35) Package L#1: (P#1, total=66055224KB, CPUVendor=GenuineIntel, CPUFamilyNumber=6, CPUModelNumber=63, CPUModel="Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz", CPUStepping=2) L3Cache L#1: (P#-1, size=30720KB, linesize=64, ways=20, Inclusive=1) L2Cache L#12: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#12: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#12: (P#0) PU L#24: (P#12) PU L#25: (P#36) L2Cache L#13: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#13: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#13: (P#1) PU L#26: (P#13) PU L#27: (P#37) L2Cache L#14: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#14: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#14: (P#2) PU L#28: (P#14) PU L#29: (P#38) L2Cache L#15: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#15: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#15: (P#3) PU L#30: (P#15) PU L#31: (P#39) L2Cache L#16: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#16: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#16: (P#4) PU L#32: (P#16) PU L#33: (P#40) L2Cache L#17: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#17: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#17: (P#5) PU L#34: (P#17) PU L#35: (P#41) L2Cache L#18: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#18: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#18: (P#8) PU L#36: (P#18) PU L#37: (P#42) L2Cache L#19: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#19: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#19: (P#9) PU L#38: (P#19) PU L#39: (P#43) L2Cache L#20: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#20: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#20: (P#10) PU L#40: (P#20) PU L#41: (P#44) L2Cache L#21: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#21: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#21: (P#11) PU L#42: (P#21) PU L#43: (P#45) L2Cache L#22: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#22: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#22: (P#12) PU L#44: (P#22) PU L#45: (P#46) L2Cache L#23: (P#-1, size=256KB, linesize=64, ways=8, Inclusive=0) L1dCache L#23: (P#-1, size=32KB, linesize=64, ways=8, Inclusive=0) Core L#23: (P#13) PU L#46: (P#23) PU L#47: (P#47) INFO (SystemTopology): Thread CPU bindings: MPI process 0 on host 0 (process 0 of 4 on this host) OpenMP thread 0: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 1: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 2: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 3: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 4: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 5: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 6: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 7: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 8: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 9: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 10: PU set L#{0-11} P#{0-5,24-29} OpenMP thread 11: PU set L#{0-11} P#{0-5,24-29} MPI process 1 on host 0 (process 1 of 4 on this host) OpenMP thread 0: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 1: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 2: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 3: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 4: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 5: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 6: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 7: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 8: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 9: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 10: PU set L#{24-35} P#{12-17,36-41} OpenMP thread 11: PU set L#{24-35} P#{12-17,36-41} MPI process 2 on host 0 (process 2 of 4 on this host) OpenMP thread 0: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 1: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 2: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 3: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 4: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 5: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 6: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 7: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 8: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 9: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 10: PU set L#{12-23} P#{6-11,30-35} OpenMP thread 11: PU set L#{12-23} P#{6-11,30-35} MPI process 3 on host 0 (process 3 of 4 on this host) OpenMP thread 0: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 1: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 2: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 3: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 4: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 5: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 6: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 7: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 8: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 9: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 10: PU set L#{36-47} P#{18-23,42-47} OpenMP thread 11: PU set L#{36-47} P#{18-23,42-47} INFO (SystemTopology): Setting thread CPU bindings: INFO (SystemTopology): Thread CPU bindings: MPI process 0 on host 0 (process 0 of 4 on this host) OpenMP thread 0: PU set L#{0} P#{0} OpenMP thread 1: PU set L#{1} P#{24} OpenMP thread 2: PU set L#{2} P#{1} OpenMP thread 3: PU set L#{3} P#{25} OpenMP thread 4: PU set L#{4} P#{2} OpenMP thread 5: PU set L#{5} P#{26} OpenMP thread 6: PU set L#{6} P#{3} OpenMP thread 7: PU set L#{7} P#{27} OpenMP thread 8: PU set L#{8} P#{4} OpenMP thread 9: PU set L#{9} P#{28} OpenMP thread 10: PU set L#{10} P#{5} OpenMP thread 11: PU set L#{11} P#{29} MPI process 1 on host 0 (process 1 of 4 on this host) OpenMP thread 0: PU set L#{12} P#{6} OpenMP thread 1: PU set L#{13} P#{30} OpenMP thread 2: PU set L#{14} P#{7} OpenMP thread 3: PU set L#{15} P#{31} OpenMP thread 4: PU set L#{16} P#{8} OpenMP thread 5: PU set L#{17} P#{32} OpenMP thread 6: PU set L#{18} P#{9} OpenMP thread 7: PU set L#{19} P#{33} OpenMP thread 8: PU set L#{20} P#{10} OpenMP thread 9: PU set L#{21} P#{34} OpenMP thread 10: PU set L#{22} P#{11} OpenMP thread 11: PU set L#{23} P#{35} MPI process 2 on host 0 (process 2 of 4 on this host) OpenMP thread 0: PU set L#{24} P#{12} OpenMP thread 1: PU set L#{25} P#{36} OpenMP thread 2: PU set L#{26} P#{13} OpenMP thread 3: PU set L#{27} P#{37} OpenMP thread 4: PU set L#{28} P#{14} OpenMP thread 5: PU set L#{29} P#{38} OpenMP thread 6: PU set L#{30} P#{15} OpenMP thread 7: PU set L#{31} P#{39} OpenMP thread 8: PU set L#{32} P#{16} OpenMP thread 9: PU set L#{33} P#{40} OpenMP thread 10: PU set L#{34} P#{17} OpenMP thread 11: PU set L#{35} P#{41} MPI process 3 on host 0 (process 3 of 4 on this host) OpenMP thread 0: PU set L#{36} P#{18} OpenMP thread 1: PU set L#{37} P#{42} OpenMP thread 2: PU set L#{38} P#{19} OpenMP thread 3: PU set L#{39} P#{43} OpenMP thread 4: PU set L#{40} P#{20} OpenMP thread 5: PU set L#{41} P#{44} OpenMP thread 6: PU set L#{42} P#{21} OpenMP thread 7: PU set L#{43} P#{45} OpenMP thread 8: PU set L#{44} P#{22} OpenMP thread 9: PU set L#{45} P#{46} OpenMP thread 10: PU set L#{46} P#{23} OpenMP thread 11: PU set L#{47} P#{47} INFO (SystemTopology): Extracting CPU/cache/memory properties: There are 2 PUs per core (aka hardware SMT threads) There are 2 threads per core (aka SMT threads used) Cache (unknown name) has type "data" depth 1 size 32768 linesize 64 associativity 8 stride 4096, for 2 PUs Cache (unknown name) has type "unified" depth 2 size 262144 linesize 64 associativity 8 stride 32768, for 2 PUs Cache (unknown name) has type "unified" depth 3 size 31457280 linesize 64 associativity 20 stride 1572864, for 24 PUs INFO (Vectors): Using vector size 4 for architecture AVX (64-bit precision) -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HRSCCore: HRSC for Cactus -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 32 processes INFO (Carpet): This is process 0 INFO (Carpet): OpenMP is enabled INFO (Carpet): This process contains 12 threads, this is thread 0 INFO (Carpet): There are 384 threads in total INFO (Carpet): There are 12 threads per process INFO (Carpet): This process runs on host nid00592, pid=3689 INFO (Carpet): This process runs on 12 cores: 0-5, 24-29 INFO (Carpet): Thread 0 runs on 1 core: 0 INFO (Carpet): Thread 1 runs on 1 core: 24 INFO (Carpet): Thread 2 runs on 1 core: 1 INFO (Carpet): Thread 3 runs on 1 core: 25 INFO (Carpet): Thread 4 runs on 1 core: 2 INFO (Carpet): Thread 5 runs on 1 core: 26 INFO (Carpet): Thread 6 runs on 1 core: 3 INFO (Carpet): Thread 7 runs on 1 core: 27 INFO (Carpet): Thread 8 runs on 1 core: 4 INFO (Carpet): Thread 9 runs on 1 core: 28 INFO (Carpet): Thread 10 runs on 1 core: 5 INFO (Carpet): Thread 11 runs on 1 core: 29 INFO (Carpet): This simulation is running in 3 dimensions INFO (Carpet): Boundary specification for map 0: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,4]] INFO (Carpet): CoordBase domain specification for map 0: physical extent: [-61.6,-61.6,-61.6] : [61.6,61.6,61.6] ([123.2,123.2,123.2]) interior extent: [-66.4,-66.4,-66.4] : [66.4,66.4,66.4] ([132.8,132.8,132.8]) exterior extent: [-74.4,-74.4,-74.4] : [74.4,74.4,74.4] ([148.8,148.8,148.8]) base_spacing : [1.6,1.6,1.6] INFO (Carpet): Adapted domain specification for map 0: convergence factor: 2 convergence level : 0 physical extent : [-61.6,-61.6,-61.6] : [61.6,61.6,61.6] ([123.2,123.2,123.2]) interior extent : [-66.4,-66.4,-66.4] : [66.4,66.4,66.4] ([132.8,132.8,132.8]) exterior extent : [-74.4,-74.4,-74.4] : [74.4,74.4,74.4] ([148.8,148.8,148.8]) spacing : [1.6,1.6,1.6] INFO (Carpet): Base grid specification for map 0: number of grid points : [94,94,94] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 1: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 1: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 1: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 1: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 2: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 2: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 2: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 2: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 3: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 3: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 3: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 3: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 4: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 4: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 4: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 4: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 5: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 5: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 5: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 5: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Boundary specification for map 6: nboundaryzones: [[5,5,5],[5,5,5]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[4,4,4],[4,4,0]] INFO (Carpet): CoordBase domain specification for map 6: physical extent: [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent: [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent: [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) base_spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Adapted domain specification for map 6: convergence factor: 2 convergence level : 0 physical extent : [-0.785398,-0.785398,61.6] : [0.785398,0.785398,2200.8] ([1.5708,1.5708,2139.2]) interior extent : [-0.953698,-0.953698,56.8] : [0.953698,0.953698,2199.2] ([1.9074,1.9074,2142.4]) exterior extent : [-1.2342,-1.2342,48.8] : [1.2342,1.2342,2207.2] ([2.46839,2.46839,2158.4]) spacing : [0.0560999,0.0560999,1.6] INFO (Carpet): Base grid specification for map 6: number of grid points : [45,45,1350] number of coarse grid ghost points: [[5,5,5],[5,5,5]] INFO (Carpet): Buffer zone counts (excluding ghosts): [0]: [[0,0,0],[0,0,0]] [1]: [[15,15,15],[15,15,15]] [2]: [[15,15,15],[15,15,15]] [3]: [[15,15,15],[15,15,15]] [4]: [[15,15,15],[15,15,15]] [5]: [[15,15,15],[15,15,15]] INFO (Carpet): Overlap zone counts: [0]: [[0,0,0],[0,0,0]] [1]: [[0,0,0],[0,0,0]] [2]: [[0,0,0],[0,0,0]] [3]: [[0,0,0],[0,0,0]] [4]: [[0,0,0],[0,0,0]] [5]: [[0,0,0],[0,0,0]] INFO (Carpet): Group and variable statistics: INFO (Carpet): There are 1260 grid functions in 169 groups INFO (Carpet): There are 541 grid scalars in 94 groups INFO (Carpet): There are 130 1-dimensional grid arrays in 13 groups INFO (Carpet): There are 72 2-dimensional grid arrays in 18 groups INFO (Carpet): There are 1 3-dimensional grid arrays in 1 groups INFO (Carpet): (The number of variables counts all time levels) INFO (CarpetIOHDF5): I/O Method 'IOHDF5' registered: AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): Periodic AMR output requested for: GRID::x GRID::y GRID::z GRID::r ML_BSSN::phi WEYLSCAL4::Psi4r WEYLSCAL4::Psi4i WEYLSCAL4::curvIr WEYLSCAL4::curvIi WEYLSCAL4::curvJr WEYLSCAL4::curvJi INFO (CarpetIOHDF5): I/O Method 'IOHDF5_0D' registered: 0D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): I/O Method 'IOHDF5_1D' registered: 1D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): I/O Method 'IOHDF5_2D' registered: 2D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): Periodic 2D AMR output requested for: ADMBASE::alp ADMBASE::betax ADMBASE::betay ADMBASE::betaz GRID::x GRID::y GRID::z GRID::r ML_BSSN::phi ML_BSSN::trK ML_BSSN::alpha ML_BSSN::H WEYLSCAL4::Psi4r WEYLSCAL4::Psi4i INFO (CarpetIOHDF5): I/O Method 'IOHDF5_3D' registered: 3D AMR output of grid variables to HDF5 files INFO (CarpetIOScalar): Periodic scalar output requested for: HYDROBASE::rho HYDROBASE::w_lorentz ML_BSSN::H SYSTEMSTATISTICS::maxrss_mb SYSTEMSTATISTICS::majflt_mb SYSTEMSTATISTICS::arena_mb SYSTEMSTATISTICS::ordblks_mb SYSTEMSTATISTICS::hblks_mb SYSTEMSTATISTICS::hblkhd_mb SYSTEMSTATISTICS::uordblks_mb SYSTEMSTATISTICS::fordblks_mb SYSTEMSTATISTICS::keepcost_mb SYSTEMSTATISTICS::swap_used_mb INFO (CarpetIOASCII): I/O Method 'IOASCII_0D' registered: 0D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): Periodic 0D AMR output requested for: CARPET::physical_time_per_hour CARPET::current_physical_time_per_hour CARPET::time_total CARPET::time_evolution CARPET::time_computing CARPET::time_communicating CARPET::time_io CARPET::evolution_steps_count CARPET::local_grid_points_per_second CARPET::total_grid_points_per_second CARPET::local_grid_point_updates_count CARPET::total_grid_point_updates_count CARPET::local_interior_points_per_second CARPET::total_interior_points_per_second CARPET::local_interior_point_updates_count CARPET::total_interior_point_updates_count CARPET::io_per_second CARPET::io_bytes_per_second CARPET::io_bytes_ascii_per_second CARPET::io_bytes_binary_per_second CARPET::io_count CARPET::io_bytes_count CARPET::io_bytes_ascii_count CARPET::io_bytes_binary_count CARPET::comm_per_second CARPET::comm_bytes_per_second CARPET::comm_count CARPET::comm_bytes_count CARPET::time_levels CARPET::current_walltime CARPET::syncs_count PUNCTURETRACKER::pt_loc_t[0] PUNCTURETRACKER::pt_loc_t[1] PUNCTURETRACKER::pt_loc_t[2] PUNCTURETRACKER::pt_loc_t[3] PUNCTURETRACKER::pt_loc_t[4] PUNCTURETRACKER::pt_loc_t[5] PUNCTURETRACKER::pt_loc_t[6] PUNCTURETRACKER::pt_loc_t[7] PUNCTURETRACKER::pt_loc_t[8] PUNCTURETRACKER::pt_loc_t[9] PUNCTURETRACKER::pt_loc_x[0] PUNCTURETRACKER::pt_loc_x[1] PUNCTURETRACKER::pt_loc_x[2] PUNCTURETRACKER::pt_loc_x[3] PUNCTURETRACKER::pt_loc_x[4] PUNCTURETRACKER::pt_loc_x[5] PUNCTURETRACKER::pt_loc_x[6] PUNCTURETRACKER::pt_loc_x[7] PUNCTURETRACKER::pt_loc_x[8] PUNCTURETRACKER::pt_loc_x[9] PUNCTURETRACKER::pt_loc_y[0] PUNCTURETRACKER::pt_loc_y[1] PUNCTURETRACKER::pt_loc_y[2] PUNCTURETRACKER::pt_loc_y[3] PUNCTURETRACKER::pt_loc_y[4] PUNCTURETRACKER::pt_loc_y[5] PUNCTURETRACKER::pt_loc_y[6] PUNCTURETRACKER::pt_loc_y[7] PUNCTURETRACKER::pt_loc_y[8] PUNCTURETRACKER::pt_loc_y[9] PUNCTURETRACKER::pt_loc_z[0] PUNCTURETRACKER::pt_loc_z[1] PUNCTURETRACKER::pt_loc_z[2] PUNCTURETRACKER::pt_loc_z[3] PUNCTURETRACKER::pt_loc_z[4] PUNCTURETRACKER::pt_loc_z[5] PUNCTURETRACKER::pt_loc_z[6] PUNCTURETRACKER::pt_loc_z[7] PUNCTURETRACKER::pt_loc_z[8] PUNCTURETRACKER::pt_loc_z[9] INFO (CarpetIOASCII): I/O Method 'IOASCII_1D' registered: 1D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): Periodic 1D AMR output requested for: ML_BSSN::phi ML_BSSN::trK WEYLSCAL4::Psi4r INFO (CarpetIOASCII): I/O Method 'IOASCII_2D' registered: 2D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): I/O Method 'IOASCII_3D' registered: 3D AMR output of grid variables to ASCII files INFO (CarpetRegrid2): Initialising position of centre 0 to [17.3774,0,0] INFO (CarpetRegrid2): Initialising position of centre 1 to [-13.7668,0,0] INFO (MoL): Using Runge-Kutta 4 as the time integrator. INFO (SymBase): Symmetry on lower x-face: multipatch INFO (SymBase): Symmetry on upper x-face: multipatch INFO (SymBase): Symmetry on lower y-face: multipatch INFO (SymBase): Symmetry on upper y-face: multipatch INFO (SymBase): Symmetry on lower z-face: multipatch INFO (SymBase): Symmetry on upper z-face: multipatch INFO (MoL): The maximum number of evolved variables is 1193. 30 are registered. INFO (MoL): The maximum number of slow evolved variables is 1193. 0 are registered. INFO (MoL): The maximum number of constrained variables is 1193. 37 are registered. INFO (MoL): The maximum number of SandR variables is 1193. 0 are registered. INFO (MoL): The maximum number of evolved array variables is 1193. 0 are registered. INFO (MoL): The maximum number of constrained array variables is 1193. 0 are registered. INFO (MoL): The maximum number of SandR array variables is 1193. 0 are registered. INFO (MoL): The maximum size of any array variables is 0. INFO (Vectors): Testing vectorisation... [errors may result in segfaults] INFO (Vectors): 2311/2311 tests passed INFO (kadathimporter): Checking ID parameters INFO (CarpetRegrid2): Centre 1 is at position [17.3774,0,0] with 6 levels INFO (CarpetRegrid2): Centre 2 is at position [-13.7668,0,0] with 6 levels INFO (CarpetRegrid2): Regridding level 0 map 0 at iteration 0 time 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 1 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Regridding level 0 map 1 at iteration 0 time 0 INFO (CarpetRegrid2): Regridding level 0 map 2 at iteration 0 time 0 INFO (CarpetRegrid2): Regridding level 0 map 3 at iteration 0 time 0 INFO (CarpetRegrid2): Regridding level 0 map 4 at iteration 0 time 0 INFO (CarpetRegrid2): Regridding level 0 map 5 at iteration 0 time 0 INFO (CarpetRegrid2): Regridding level 0 map 6 at iteration 0 time 0 INFO (Carpet): Grid structure (superregions, grid points): [0][0][0] exterior: [0,0,0] : [93,93,93] ([94,94,94] + PADDING) 830584 [1][0][0] exterior: [29,46,46] : [161,140,140] ([133,95,95] + PADDING) 1200325 [2][0][0] exterior: [106,140,140] : [275,232,232] ([170,93,93] + PADDING) 1470330 [3][0][0] exterior: [416,329,329] : [502,415,415] ([87,87,87] + PADDING) 658503 [3][0][1] exterior: [259,327,327] : [348,417,417] ([90,91,91] + PADDING) 745290 [4][0][0] exterior: [879,705,705] : [957,783,783] ([79,79,79] + PADDING) 493039 [4][0][1] exterior: [565,702,702] : [648,786,786] ([84,85,85] + PADDING) 606900 [5][0][0] exterior: [1806,1458,1458] : [1866,1518,1518] ([61,61,61] + PADDING) 226981 [5][0][1] exterior: [1177,1452,1452] : [1249,1524,1524] ([73,73,73] + PADDING) 389017 INFO (Carpet): Grid structure (superregions, coordinates): [0][0][0] exterior: [-74.4,-74.4,-74.4] : [74.4,74.4,74.4] : [1.6,1.6,1.6] [1][0][0] exterior: [-51.2,-37.6,-37.6] : [54.4,37.6,37.6] : [0.8,0.8,0.8] [2][0][0] exterior: [-32,-18.4,-18.4] : [35.6,18.4,18.4] : [0.4,0.4,0.4] [3][0][0] exterior: [8.8,-8.60000000000001,-8.60000000000001] : [26,8.59999999999999,8.59999999999999] : [0.2,0.2,0.2] [3][0][1] exterior: [-22.6,-9,-9] : [-4.8,9,9] : [0.2,0.2,0.2] [4][0][0] exterior: [13.5,-3.90000000000001,-3.90000000000001] : [21.3,3.90000000000001,3.90000000000001] : [0.1,0.1,0.1] [4][0][1] exterior: [-17.9,-4.2,-4.2] : [-9.60000000000001,4.2,4.2] : [0.1,0.1,0.1] [5][0][0] exterior: [15.9,-1.5,-1.5] : [18.9,1.5,1.5] : [0.05,0.05,0.05] [5][0][1] exterior: [-15.55,-1.8,-1.8] : [-11.95,1.8,1.8] : [0.05,0.05,0.05] INFO (Carpet): Grid structure (superregions, grid points): [0][1][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][1][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][2][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][2][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][3][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][3][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][4][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][4][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][5][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][5][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][6][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][6][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Global grid structure statistics: INFO (Carpet): GF: rhs: 551k active, 1214k owned (+121%), 2644k total (+118%), 32 steps/time INFO (Carpet): GF: vars: 409, pts: 5003M active, 6639M owned (+33%), 12557M total (+89%), 1.0 comp/proc INFO (Carpet): GA: vars: 688, pts: 18M active, 18M total (+0%) INFO (Carpet): Total required memory: 100.042 GByte (for GAs and currently active GFs) INFO (Carpet): Load balance: min avg max sdv max/avg-1 INFO (Carpet): Level 0: 121M 133M 135M 3M owned 1% INFO (Carpet): Level 1: 15M 15M 16M 0M owned 4% INFO (Carpet): Level 2: 18M 19M 19M 0M owned 2% INFO (Carpet): Level 3: 18M 18M 18M 0M owned 2% INFO (Carpet): Level 4: 13M 14M 15M 0M owned 7% INFO (Carpet): Level 5: 7M 8M 8M 0M owned 6% INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>1.6000000e+00 dy=>1.6000000e+00 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-74.400,74.400] y=>[-74.400,74.400] z=>[-74.400,74.400] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,93] y=>[0,93] z=>[0,93] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>5.6099869e-02 dy=>5.6099869e-02 dz=>1.6000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-1.234, 1.234] y=>[-1.234, 1.234] z=>[48.800,2207.200] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,44] y=>[0,44] z=>[0,1349] INFO (AHFinderDirect): setting up AHFinderDirect data structures INFO (AHFinderDirect): to search for 1 horizon on 32 processors INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (0,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (HRSCCore): Using FD. Method ID = 18. INFO (Interpolate2): Setting up interpolation for level 0 INFO (SphericalSurface): SphericalSurface[0]: finest refinement-level that fully contains this surface: sf_maxreflevel = 0 INFO (SphericalSurface): SphericalSurface[0]: finest refinement-level that overlaps with this surface : sf_minreflevel = 0 INFO (SphericalSurface): SphericalSurface[0]: sf_delta_theta = 0.084908, sf_delta_phi = 0.082673 INFO (SphericalSurface): SphericalSurface[1]: finest refinement-level that fully contains this surface: sf_maxreflevel = 0 INFO (SphericalSurface): SphericalSurface[1]: finest refinement-level that overlaps with this surface : sf_minreflevel = 0 INFO (SphericalSurface): SphericalSurface[1]: sf_delta_theta = 0.084908, sf_delta_phi = 0.082673 INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Trying to get EOS handles INFO (GRHydro): Trying to get EOS handles INFO (GRHydro): GRHydro will use the Ideal_Fluid equation of state. INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 851.772 sec INFO (PunctureTracker): Initializing PunctureTracker INFO (QuasiLocalMeasures): Initialising Quasi-Local Measure calculations INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 151.593 sec INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 173.344 sec INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 173.918 sec INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 176.459 sec INFO (TerminationTrigger): Reminding you every 30 minutes about remaining walltime INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (kadathimporter): Setting up KADATH initial data INFO (kadathimporter): Setting up coordinates INFO (kadathimporter): Starting data import INFO (kadathimporter): Moving Matter Data to output vars INFO (kadathimporter): Filling took 264.599 sec INFO (AHFinderDirect): proc 0: searching for horizon 1/1 INFO (TerminationTrigger): *********************************************************** INFO (TerminationTrigger): Remaining wallclock time for your job is 561.367 minutes INFO (TerminationTrigger): *********************************************************** -------------------------------------------------------------------------------------------------------------------------------------- Iteration Time | *me_per_hour | ML_BSSN::phi | ML_BSSN::H | *TISTICS::maxrss_mb | *TICS::swap_used_mb | | minimum maximum | minimum maximum | minimum maximum | minimum maximum -------------------------------------------------------------------------------------------------------------------------------------- 0 0.000 | 0.0000000 | 0.1315662 0.9984772 | -9.2302249 7.5649336 | 2757 3140 | 0 0 --------------------------------------------------------------------------------------------------------------------------------------------------------- Time Time Imblnc Timer gettimeof getrusage cycle cycle[avg cycle[sdv cycle[min cycle[max percent secs percent secs secs secs secs secs secs secs --------------------------------------------------------------------------------------------------------------------------------------------------------- 100.0% 2444.6 0.0% Initialise 2445 3014 6.356e+12 6.356e+12 0 6.356e+12 6.356e+12 5.3% 129.6 0.0% |_CallAnalysis 129.6 574.2 3.37e+11 3.37e+11 0 3.37e+11 3.37e+11 5.2% 128.0 0.0% | |_OutputGH 127.9 564.6 3.326e+11 5.544e+10 2.874e+11 1.448e+09 3.178e+11 5.2% 128.0 0.0% | | |_OutputGH 127.9 564.6 3.326e+11 5.544e+10 2.874e+11 1.448e+09 3.178e+11 4.9% 120.6 1.4% | | | |_IOHDF5::IOHDF5_2D [2] 122.4 553.1 3.182e+11 5.303e+10 2.816e+11 1.409e+09 3.101e+11 4.9% 120.6 1.4% | | | | |_OutputGH<2> 122.4 553.1 3.182e+11 5.303e+10 2.816e+11 1.409e+09 3.101e+11 94.5% 2310.1 0.0% |_CallInitial 2310 2386 6.006e+12 6.006e+12 0 6.006e+12 6.006e+12 1.1% 25.7 73.0% | |_CCTK_BASEGRID 2.622 21.47 6.817e+09 1.136e+09 5.353e+09 9.892e+07 6.019e+09 1.1% 25.7 73.0% | | |_CallFunction 2.619 21.44 6.81e+09 2.27e+07 5.34e+09 2562 5.338e+09 1.0% 23.2 75.0% | | | |_syncs 0.1226 1.342 3.188e+08 5.313e+07 2.22e+08 2.896e+06 2.55e+08 1.0% 23.2 75.0% | | | | |_Sync 0.1221 1.336 3.174e+08 5.29e+07 2.214e+08 2.783e+06 2.543e+08 1.0% 23.2 75.0% | | | | | |_comm_state[6].state_do_some_work.step 0.114 1.252 2.964e+08 4.94e+07 2.187e+08 1.624e+05 2.479e+08 84.7% 2071.3 9.7% | |_CCTK_INITIAL 2108 2139 5.481e+12 9.135e+11 1.554e+12 4.128e+11 2.215e+12 84.7% 2071.3 9.7% | | |_CallFunction 2108 2139 5.481e+12 3.806e+10 2.497e+12 3447 2.215e+12 8.3% 203.2 48.6% | | | |_syncs 316.1 332.2 8.219e+11 1.37e+11 4.241e+11 9.349e+06 4.897e+11 5.5% 135.6 56.6% | | | | |_Prolongate 266.6 275.3 6.932e+11 1.155e+11 3.771e+11 4282 4.168e+11 4.9% 118.8 59.3% | | | | | |_comm_state[6].state_do_some_work.step 263.9 270.3 6.86e+11 1.372e+11 3.579e+11 7941 4.168e+11 0.7% 16.8 86.9% | | | | | |_comm_state[8].state_empty_recv_buffers 2.712 4.65 7.052e+09 1.41e+09 6.308e+09 1.097e+04 7.052e+09 2.8% 67.6 57.2% | | | | |_Sync 49.5 56.86 1.287e+11 2.145e+10 6.359e+10 3.342e+06 7.291e+10 2.8% 67.6 57.2% | | | | | |_comm_state[6].state_do_some_work.step 49.49 56.74 1.287e+11 2.145e+10 6.359e+10 8.225e+05 7.291e+10 76.4% 1868.1 13.8% | | | |_thorns 1792 1806 4.659e+12 4.275e+10 2.44e+12 1.614e+04 2.215e+12 76.4% 1867.8 13.8% | | | | |_KadathImporter 1792 1803 4.658e+12 7.764e+11 1.592e+12 3.941e+11 2.215e+12 8.6% 210.2 45.8% | |_CCTK_POSTINITIAL 196.6 217.6 5.11e+11 8.517e+10 4.645e+11 2.527e+08 5.092e+11 8.6% 210.2 45.8% | | |_CallFunction 196.6 217.5 5.11e+11 1.092e+09 4.906e+11 4653 4.909e+11 7.7% 189.1 49.5% | | | |_syncs 0.4873 5.482 1.267e+09 2.346e+07 1.759e+08 9.121e+05 1.466e+08 5.3% 129.5 64.8% | | | | |_Prolongate 0.3768 4.238 9.798e+08 1.814e+07 1.498e+08 3429 1.222e+08 4.7% 114.3 68.9% | | | | | |_comm_state[6].state_do_some_work.step 0.08348 0.9068 2.171e+08 4.825e+06 3.484e+07 5733 1.944e+07 0.6% 15.0 93.4% | | | | | |_comm_state[8].state_empty_recv_buffers 0.00933 0.1262 2.426e+07 5.391e+05 1.736e+07 5797 1.643e+07 2.4% 59.6 74.2% | | | | |_Sync 0.1096 1.235 2.85e+08 5.277e+06 4.22e+07 8.768e+05 3.065e+07 2.4% 59.5 74.3% | | | | | |_comm_state[6].state_do_some_work.step 0.04852 0.54 1.263e+08 2.339e+06 2.475e+07 4.933e+04 1.583e+07 0.9% 21.1 89.3% | | | |_thorns 196 211.4 5.097e+11 1.101e+09 4.906e+11 1.217e+04 4.909e+11 0.8% 20.5 89.5% | | | | |_Interpolate2ApplyBC 195.6 207.1 5.085e+11 7.705e+09 4.872e+11 5595 4.909e+11 0.8% 19.8 89.9% | | | | | |_WaitAll_Irecvs 195 201.1 5.069e+11 5.632e+10 4.609e+11 5.51e+06 4.907e+11 --------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------------------------------------------------------------------- Time Time Imblnc Timer gettimeof getrusage cycle cycle[avg cycle[sdv cycle[min cycle[max percent secs percent secs secs secs secs secs secs secs --------------------------------------------------------------------------------------------------------------------------------------------------------- 100.0% 2446.1 0.0% meta mode 2446 3018 6.36e+12 2.12e+12 5.193e+12 4.118e+04 6.36e+12 99.9% 2444.6 0.0% |_meta mode 2445 3014 6.356e+12 2.119e+12 5.19e+12 4.135e+04 6.356e+12 99.9% 2444.5 0.0% | |_global mode 2445 3013 6.356e+12 9.347e+10 3.075e+12 1.836e+04 2.725e+12 48.1% 1176.1 0.0% | | |_level(0) 1176 1626 3.057e+12 2.73e+10 2.277e+12 6606 2.215e+12 6.5% 160.0 0.1% | | |_level(1) 160.1 179.6 4.164e+11 1.157e+10 4.08e+11 6310 4.138e+11 7.7% 187.2 0.0% | | |_level(2) 187.2 205.6 4.867e+11 1.352e+10 4.773e+11 5992 4.841e+11 8.2% 201.7 0.0% | | |_level(3) 201.7 219.2 5.244e+11 1.457e+10 5.094e+11 5920 5.168e+11 8.5% 208.8 20.0% | | |_level(4) 261 274.4 6.786e+11 1.885e+10 6.672e+11 5820 6.767e+11 20.7% 506.3 7.4% | | |_level(5) 454.1 468.1 1.181e+12 1.663e+10 1.17e+12 5792 1.178e+12 --------------------------------------------------------------------------------------------------------------------------------------------------------- INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Regridding level 0 map 0 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 1 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 2 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 3 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 4 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 5 at iteration 1 time 0 INFO (CarpetRegrid2): Regridding level 0 map 6 at iteration 1 time 0 INFO (Carpet): Grid structure (superregions, grid points): [0][0][0] exterior: [0,0,0] : [93,93,93] ([94,94,94] + PADDING) 830584 INFO (Carpet): Grid structure (superregions, coordinates): [0][0][0] exterior: [-74.4,-74.4,-74.4] : [74.4,74.4,74.4] : [1.6,1.6,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][1][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][1][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][2][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][2][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][3][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][3][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][4][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][4][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][5][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][5][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Grid structure (superregions, grid points): [0][6][0] exterior: [0,0,0] : [44,44,1349] ([45,45,1350] + PADDING) 2733750 INFO (Carpet): Grid structure (superregions, coordinates): [0][6][0] exterior: [-1.23419711391028,-1.23419711391028,48.8] : [1.23419711391028,1.23419711391028,2207.2] : [0.0560998688141034,0.0560998688141034,1.6] INFO (Carpet): Global grid structure statistics: INFO (Carpet): GF: rhs: 29797k active, 29797k owned (+0%), 50815k total (+71%), 2.85 steps/time INFO (Carpet): GF: vars: 409, pts: 4271M active, 4271M owned (+0%), 7283M total (+71%), 1.0 comp/proc INFO (Carpet): GA: vars: 688, pts: 18M active, 18M total (+0%) INFO (Carpet): Total required memory: 58.110 GByte (for GAs and currently active GFs) INFO (Carpet): Load balance: min avg max sdv max/avg-1 INFO (Carpet): Level 0: 121M 133M 135M 3M owned 1% INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (GRHydro): Setting up the atmosphere mask: all points are not_atmosphere INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 16 0.350 | 167.0222312 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 32 0.701 | 185.5614056 | -nan -nan | -nan -nan | 2936 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 48 1.051 | 192.0652342 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 64 1.402 | 196.2311337 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 80 1.752 | 198.5367686 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 96 2.103 | 200.5613065 | -nan -nan | -nan -nan | 2936 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 112 2.453 | 201.3769877 | -nan -nan | -nan -nan | 2936 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 128 2.803 | 202.4616174 | -nan -nan | -nan -nan | 2936 3358 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 144 3.154 | 203.0769909 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 160 3.504 | 203.7471741 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 176 3.855 | 204.1467670 | -nan -nan | -nan -nan | 2936 3358 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 192 4.205 | 205.0251776 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 208 4.556 | 205.0403591 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 224 4.906 | 205.4730914 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 240 5.257 | 203.3334220 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetTracker): Refined region #1 (depending on surface #0) is inactive INFO (CarpetTracker): Refined region #2 (depending on surface #1) is inactive INFO (CarpetRegrid2): Centre 1 is not active INFO (CarpetRegrid2): Centre 2 is not active INFO (CarpetRegrid2): Refined regions have not changed sufficiently; skipping regridding INFO (PunctureTracker): Tracking punctures... INFO (AHFinderDirect): proc 0: searching for horizon 1/1 INFO (NaNChecker): Write out NaN mask using the 'IOHDF5' I/O method 256 5.607 | 201.5352506 | -nan -nan | -nan -nan | 2937 3359 | 0 0 INFO (CarpetIOHDF5): --------------------------------------------------------- INFO (CarpetIOHDF5): Dumping termination checkpoint at iteration 256, simulation time 5.60694 INFO (CarpetIOHDF5): --------------------------------------------------------- --------------------------------------------------------------------------------------------------------------------------------------------------------- Time Time Imblnc Timer gettimeof getrusage cycle cycle[avg cycle[sdv cycle[min cycle[max percent secs percent secs secs secs secs secs secs secs --------------------------------------------------------------------------------------------------------------------------------------------------------- 100.0% 101.4 0.0% Evolve 101.4 1090 2.636e+11 2.636e+11 0 2.636e+11 2.636e+11 24.3% 24.7 2.9% |_CallAnalysis 25.41 269.7 6.606e+10 2.581e+08 1.647e+10 3056 6.709e+09 3.7% 3.7 1.2% | |_CCTK_POSTSTEP 3.782 40.3 9.833e+09 6.146e+08 1.434e+09 5.05e+08 2.002e+09 3.7% 3.7 1.2% | | |_CallFunction 3.779 40.26 9.825e+09 1.981e+07 1.666e+09 2.101e+04 1.094e+09 3.4% 3.4 7.6% | | | |_thorns 3.681 38.78 9.57e+09 1.617e+07 1.676e+09 1.012e+04 1.094e+09 0.8% 0.8 29.3% | | | | |_ADMDerivatives_CalcDerivatives 0.5763 6.871 1.499e+09 9.366e+07 1.119e+06 9.325e+07 9.429e+07 1.4% 1.5 21.5% | | | | |_Interpolate2ApplyBC 1.843 20.78 4.791e+09 2.994e+08 1.63e+07 2.927e+08 3.042e+08 0.4% 0.4 62.4% | | | | | |_WaitAll_Irecvs 0.9128 10.14 2.373e+09 1.483e+08 9.283e+07 1.128e+08 1.683e+08 20.1% 20.4 2.8% | |_OutputGH 20.98 222.3 5.454e+10 3.409e+09 2.897e+09 2.861e+09 6.132e+09 20.1% 20.4 2.8% | | |_OutputGH 20.98 222.3 5.454e+10 3.409e+09 2.897e+09 2.861e+09 6.132e+09 1.0% 1.0 24.1% | | | |_IOHDF5::IOHDF5 [10] 0.3243 3.37 8.432e+08 5.27e+07 2.172e+08 6.633e+05 1.485e+08 1.0% 1.0 24.1% | | | | |_OutputGH 0.3242 3.369 8.428e+08 5.268e+07 2.172e+08 6.535e+05 1.485e+08 18.1% 18.4 2.1% | | | |_IOHDF5::IOHDF5_2D [2] 18.62 197.6 4.842e+10 3.026e+09 2.839e+09 2.517e+09 5.725e+09 18.1% 18.4 2.1% | | | | |_OutputGH<2> 18.62 197.6 4.842e+10 3.026e+09 2.839e+09 2.517e+09 5.725e+09 72.3% 73.3 0.0% |_CallEvol 73.32 790.4 1.906e+11 7.447e+08 4.615e+10 3037 1.225e+10 72.3% 73.3 0.0% | |_CCTK_EVOL 73.29 790.2 1.906e+11 1.191e+10 3.846e+08 1.182e+10 1.225e+10 71.7% 72.7 0.1% | | |_CallFunction 72.76 784.7 1.892e+11 3.519e+07 8.381e+09 1.568e+04 1.084e+09 2.9% 2.9 49.5% | | | |_syncs 1.174 12.88 3.052e+09 8.669e+06 2.732e+08 7.722e+05 7.474e+07 2.9% 2.9 49.5% | | | | |_Sync 1.167 12.8 3.035e+09 8.621e+06 2.731e+08 7.442e+05 7.468e+07 2.3% 2.3 50.2% | | | | | |_comm_state[6].state_do_some_work.step 0.4741 5.261 1.234e+09 3.507e+06 1.398e+08 5866 3.831e+07 68.0% 68.9 3.7% | | | |_thorns 70.82 762.9 1.841e+11 3.425e+07 8.39e+09 1.016e+04 1.084e+09 1.5% 1.6 1.3% | | | | |_Con2Prim 1.456 17.18 3.786e+09 5.915e+07 2.914e+06 5.887e+07 6.159e+07 0.9% 0.9 8.7% | | | | |_GRHydroTransformADMToLocalBasis 0.8261 9.746 2.149e+09 2.686e+07 1.413e+07 2.25e+07 2.799e+07 1.2% 1.2 9.7% | | | | |_GlobalDeriv_Dissipation 1.012 11.92 2.633e+09 4.113e+07 2.318e+07 3.832e+07 4.968e+07 27.1% 27.5 33.9% | | | | |_Interpolate2ApplyBC 41.6 425.1 1.082e+11 2.331e+08 6.713e+09 6145 1.084e+09 1.0% 1.0 10.5% | | | | | |_Gather 0.5956 6.481 1.551e+09 4.617e+06 9.294e+07 2.983e+05 1.287e+07 3.4% 3.5 55.1% | | | | | |_Interpolate 7.762 87.5 2.018e+10 1.201e+07 5.108e+08 5.458e+05 4.789e+07 3.7% 3.8 13.7% | | | | | |_PostIrecvs 1.522 16.2 3.956e+09 1.177e+07 2.983e+08 5.09e+05 4.574e+07 6.5% 6.5 74.7% | | | | | |_WaitAll_Irecvs 25.81 245.7 6.71e+10 1.997e+08 4.212e+09 3.379e+06 7.929e+08 0.4% 0.4 71.2% | | | | | |_WaitAll_Isend 1.099 12.59 2.859e+09 8.509e+06 1.548e+08 6098 3.623e+07 12.1% 12.3 | | | | | |_untimed 0.9% 0.9 26.2% | | | | |_ML_ADMConstraints_evaluate 0.4782 5.63 1.243e+09 7.771e+07 4.876e+05 7.749e+07 7.791e+07 1.3% 1.3 12.9% | | | | |_ML_BSSN_ADMBaseInterior 0.8538 9.957 2.221e+09 3.47e+07 2.458e+06 3.364e+07 3.505e+07 1.1% 1.1 8.9% | | | | |_ML_BSSN_ConstraintsInterior 0.6396 7.628 1.663e+09 1.04e+08 7.755e+05 1.037e+08 1.043e+08 3.0% 3.0 9.8% | | | | |_ML_BSSN_EvolutionInteriorSplitBy1 1.82 21.5 4.734e+09 7.397e+07 5.248e+06 7.347e+07 7.903e+07 4.5% 4.5 8.9% | | | | |_ML_BSSN_EvolutionInteriorSplitBy2 2.663 31.6 6.924e+09 1.082e+08 1.526e+06 1.077e+08 1.089e+08 5.7% 5.7 6.0% | | | | |_ML_BSSN_EvolutionInteriorSplitBy3 3.176 37.79 8.259e+09 1.291e+08 2.703e+06 1.285e+08 1.31e+08 4.3% 4.4 10.2% | | | | |_MoL_Add 3.004 33.56 7.811e+09 1.221e+08 6.746e+07 1.135e+08 1.346e+08 1.1% 1.1 5.9% | | | | |_MoL_InitRHS 0.8823 8.591 2.295e+09 3.586e+07 1.279e+08 3.204e+07 1.627e+08 8.5% 8.7 4.6% | | | | |_Reconstruct 6.667 76.13 1.734e+10 9.029e+07 6.271e+08 4.58e+07 1.935e+08 1.4% 1.4 4.4% | | | | |_Riemann 1.201 13.36 3.124e+09 1.627e+07 2.084e+07 1.459e+07 2.935e+07 0.9% 0.9 8.3% | | | | |_SourceTerms 0.853 10.05 2.219e+09 3.466e+07 1.127e+07 3.407e+07 4.502e+07 0.9% 0.9 9.7% | | | | |_WeylScal4_psis_calc_Nth 0.5704 6.775 1.483e+09 9.271e+07 5.459e+05 9.252e+07 9.296e+07 2.6% 2.6 2.5% |_CallRegrid 2.658 29.48 6.911e+09 4.32e+08 6.601e+09 4.937e+06 6.823e+09 2.5% 2.6 0.2% | |_CCTK_POSTREGRID 2.578 29.06 6.703e+09 2.234e+09 4.193e+07 2.212e+09 2.268e+09 2.5% 2.6 0.2% | | |_CallFunction 2.574 29.02 6.694e+09 2.425e+07 1.167e+09 2.037e+04 4.485e+08 2.4% 2.4 5.3% | | | |_thorns 2.486 27.9 6.464e+09 2.199e+07 1.174e+09 1.015e+04 4.485e+08 1.6% 1.7 14.2% | | | | |_Interpolate2ApplyBC 1.926 21.52 5.007e+09 1.391e+08 8.394e+08 6139 4.485e+08 0.7% 0.7 31.0% |_DoTerminate 0.000677 0.007715 1.795e+06 6985 2.209e+05 3031 7.435e+04 --------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------------------------------------------------------------------- Time Time Imblnc Timer gettimeof getrusage cycle cycle[avg cycle[sdv cycle[min cycle[max percent secs percent secs secs secs secs secs secs secs --------------------------------------------------------------------------------------------------------------------------------------------------------- 100.0% 2550.6 0.0% meta mode 2551 4110 6.632e+12 1.105e+12 5.761e+12 4.118e+04 6.36e+12 99.9% 2549.2 0.0% |_meta mode 2549 4106 6.628e+12 1.105e+12 5.758e+12 4.135e+04 6.356e+12 99.9% 2547.6 0.0% | |_global mode 2548 4104 6.626e+12 3.852e+10 3.13e+12 1.836e+04 2.725e+12 50.1% 1277.8 0.0% | | |_level(0) 1278 2697 3.322e+12 1.85e+09 2.294e+12 6606 2.215e+12 6.3% 160.0 0.1% | | |_level(1) 160.1 179.6 4.164e+11 1.157e+10 4.08e+11 6310 4.138e+11 7.3% 187.2 0.0% | | |_level(2) 187.2 205.6 4.867e+11 1.352e+10 4.773e+11 5992 4.841e+11 7.9% 201.7 0.0% | | |_level(3) 201.7 219.2 5.244e+11 1.457e+10 5.094e+11 5920 5.168e+11 8.2% 208.8 20.0% | | |_level(4) 261 274.4 6.786e+11 1.885e+10 6.672e+11 5820 6.767e+11 19.9% 506.3 7.4% | | |_level(5) 454.1 468.1 1.181e+12 1.663e+10 1.17e+12 5792 1.178e+12 --------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Done.