Simulation name: nsns30 Running simulation nsns30 Preparing: Checking: /home2/mallick/simulations/nsns30/output-0000-active n132 Sun Aug 8 13:35:35 IST 2021 Environment: Starting: CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:06+0530) Run host: n133 (pid=2258) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.38456 ns per clock tick (2.60038 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2253) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2262) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2259) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2249) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2251) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2255) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2252) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2254) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2261) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessINFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384586 ns per clock tick (2.6002 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384588 ns per clock tick (2.60019 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2263) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2264) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2256) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessINFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384594 ns per clock tick (2.60015 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] CMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2257) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...SuccessCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2260) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Success -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsIntCMA: unable to open RDMA device INFO (Cactus): Increased logging level from 0 to 3 -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.9.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.9.0 Compile date: Jan 05 2021 (18:22:13) Run date: Aug 08 2021 (13:33:07+0530) Run host: n133 (pid=2250) Working directory: /home2/mallick/simulations/nsns30/output-0000 Executable: /home2/mallick/simulations/nsns30/SIMFACTORY/exe/cactus_sim Parameter file: /home2/mallick/simulations/nsns30/output-0000/nsns_vlr_mass_diff.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->ADMBase ADMCoupling ADMMacros AEILocalInterp AHFinderDirect Boundary Carpet CarpetInterp CarpetIOASCII CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetLib CarpetReduce CarpetRegrid2 CarpetSlab CartGrid3D CoordBase CoordGauge CycleClock Dissipation EOS_Base EOS_Omni Fortran GenericFD GSL HDF5 HydroBase InitBase IOUtil LocalInterp LocalReduce LoopControl ML_ADMConstraints ML_BSSN ML_BSSN_Helper MoL MPI NaNChecker NewRad Slab SpaceMask SphericalSurface StaticConformal SymBase SystemStatistics TerminationTrigger Time Timers TmunuBase Vectors zlib Meudon_Bin_NS IllinoisGRMHD ID_converter_ILGRMHD Lorene SummationByParts VolumeIntegrals_GRMHD particle_tracerET smallbPoynET convert_to_HydroBase WeylScal4 Multipole<--- Thorn LoopControl requests automatic activation of hwloc Thorn Lorene requests automatic activation of BLAS Thorn Lorene requests automatic activation of LAPACK Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activating thorn BLAS...Success -> active implementation BLAS Activating thorn Boundary...Success -> active implementation boundary Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activating thorn CarpetIOBasic...Success -> active implementation IOBasic Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activating thorn CarpetIOScalar...Success -> active implementation IOScalar Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn convert_to_HydroBase...Success -> active implementation Convert_to_HydroBase Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn CycleClock...Success -> active implementation CycleClock Activating thorn Dissipation...Success -> active implementation Dissipation Activating thorn EOS_Base...Success -> active implementation EOS_Base Activating thorn EOS_Omni...Success -> active implementation EOS_Omni Activating thorn Fortran...Success -> active implementation Fortran Activating thorn GenericFD...Success -> active implementation GenericFD Activating thorn GSL...Successerior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384593 ns per clock tick (2.60015 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384594 ns per clock tick (2.60015 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384593 ns per clock tick (2.60015 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] -> active implementation GSL Activating thorn HDF5...Success -> active implementation HDF5 Activating thorn hwloc...Success -> active implementation hwloc Activating thorn HydroBase...Success -> active implementation HydroBase Activating thorn ID_converter_ILGRMHD...Success -> active implementation ID_converter_ILGRMHD Activating thorn IllinoisGRMHD...Success -> active implementation IllinoisGRMHD Activating thorn InitBase...Success -> active implementation InitBase Activating thorn IOUtil...Success -> active implementation IO Activating thorn LAPACK...Success -> active implementation LAPACK Activating thorn LocalInterp...Success -> active implementation LocalInterp Activating thorn LocalReduce...Success -> active implementation LocalReduce Activating thorn LoopControl...Success -> active implementation LoopControl Activating thorn Lorene...Success -> active implementation LORENE Activating thorn Meudon_Bin_NS...Success -> active implementation Meudon_Bin_NS Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn MPI...Success -> active implementation MPI Activating thorn Multipole...Success -> active implementation multipole Activating thorn NaNChecker...Success -> active implementation NaNChecker Activating thorn NewRad...Success -> active implementation NewRad Activating thorn particle_tracerET...Success -> active implementation particle_tracerET Activating thorn Slab...Success -> active implementation Slab Activating thorn smallbPoynET...Success -> active implementation smallbPoynET Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn SummationByParts...Success -> active implementation SummationByParts Activating thorn SymBase...Success -> active implementation SymBase Activating thorn SystemStatistics...Success -> active implementation SystemStatistics Activating thorn TerminationTrigger...Success -> active implementation TerminationTrigger Activating thorn Time...Success -> active implementation time Activating thorn Timers...Success -> active implementation Timers Activating thorn TmunuBase...Success -> active implementation TmunuBase Activating thorn Vectors...Success -> active implementation Vectors Activating thorn VolumeIntegrals_GRMHD...Success -> active implementation VolumeIntegrals_GRMHD Activating thorn WeylScal4...Success -> active implementation WeylScal4 Activating thorn zlib...Success -> active implementation zlib WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:384: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:388: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' WARNING level 1 from host n133 process 0 in thorn IOUtil, file nsns_vlr_mass_diff.par:392: -> Unknown add operator: - Interpreting as literal string with value 'ABEoutput_directory-nsns_vlr_mass_diff' INFO (IOUtil): Recovery directory 'ABEoutput_directory-nsns_vlr_mass_diff' doesn't exist -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CycleClock::CycleClock_Setup: Set up CycleClock LoopControl::lc_setup: Set up LoopControl ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Timers::Timer_Startup: Prepare hierarchical timers Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetInterp::CarpetInterpStartup: Startup routine CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators EOS_Omni::EOS_Omni_Startup: [global] Set up conversion factors and other fun stuff HydroBase::HydroBase_StartUp: Startup banner CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LocalReduce::LocalReduce_Startup: Startup routine CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase TerminationTrigger::TerminationTrigger_StartSignalHandler: Start signal handler CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine Vectors::Vectors_Startup: Print startup message WeylScal4::WeylScal4_Startup: [meta] create banner GROUP hwloc_startup: hwloc startup group hwloc::hwloc_version: Output hwloc version Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration ML_BSSN_Helper::ML_BSSN_ParamCompat: [meta] Handle parameter backward compatibility MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable GROUP MoL_Register: The group where physics thorns register variables with MoL IllinoisGRMHD::IllinoisGRMHD_RegisterVars: [meta] Register evolved, rhs variables in IllinoisGRMHD for MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained WeylScal4::WeylScal4_RegisterVars: [meta] Register Variables for MoL Slab::Slab_InitTimers: Initialise timers SpaceMask::MaskSym: [global] Set grid symmetries for mask SpaceMask::MaskSym_emask: [global] Set grid symmetries for emask (compatibility mode) GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::CartGrid3D_RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries WeylScal4::WeylScal4_RegisterSymmetries: [meta] register symmetries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly ML_BSSN_Helper::ML_BSSN_ParamCheck: [meta] Check parameters MoL::MoL_ParamCheck: Basic parameter checking Multipole::Multipole_ParamCheck: [global] Check Multipole parameters SphericalSurface::SphericalSurface_ParamCheck: [global] Check that all surface names are unique TerminationTrigger::TerminationTrigger_ParamCheck: Check consitency of parameters TmunuBase::TmunuBase_ParamCheck: [global] Check that no deprecated parameters are used. Vectors::Vectors_Test: Run correctness tests. Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine GROUP HydroBase_Initial: HydroBase initial data group HydroBase::HydroBase_Zero: Set up vacuum hydro initial data HydroBase::HydroBase_Avec_zero: Set vector potential to 0 HydroBase::HydroBase_Aphi_zero: Set vector potential Phi to 0 Meudon_Bin_NS::Meudon_Bin_NS_initialise: Set up binary neutron star initial data GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise GROUP HydroBase_Prim2ConInitial: Recover the conservative variables from the primitive variables GROUP IllinoisGRMHD_ID_Converter: Translate ET-generated, HydroBase-compatible initial data and convert into variables used by IllinoisGRMHD ID_converter_ILGRMHD::first_initialdata: [local] Convert HydroBase initial data (ID) to ID that IllinoisGRMHD can read. ID_converter_ILGRMHD::third_initialdata: Schedule symmetries -- Actually just a placeholder function to ensure prolongation / processor syncs are done BEFORE the primitives solver. ID_converter_ILGRMHD::fourth_initialdata: Compute B and B_stagger from A ID_converter_ILGRMHD::fifth_initialdata: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. ML_BSSN::ML_BSSN_InitialADMBase1Everywhere: ML_BSSN_InitialADMBase1Everywhere ML_BSSN::ML_BSSN_InitialADMBase2Interior: ML_BSSN_InitialADMBase2Interior ML_BSSN::ML_BSSN_InitialADMBase2BoundaryScalar: ML_BSSN_InitialADMBase2BoundaryScalar ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift MoL::MoL_StartLoop: [level] Initialise the step size control Convert_to_HydroBase::Convert_to_HydroBase: Convert IllinoisGRMHD-native variables to HydroBase VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero particle_tracerET::particle_tracerET_file_output_routine_Startup: Create directory for file output. [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) GROUP Con2Prim: Convert from conservative to primitive variables (might be redundant) GROUP IllinoisGRMHD_PostPostInitial: HydroBase_Con2Prim in CCTK_POSTPOSTINITIAL sets conserv to prim then outer boundaries (OBs, which are technically disabled). The post OB SYNCs actually reprolongate the conservative variables, making cons and prims INCONSISTENT. So here we redo the con2prim, avoiding the SYNC afterward, then copy the result to other timelevels IllinoisGRMHD::postid: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::compute_b: Compute B and B_stagger from A SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::mhdpostid: Compute post-initialdata quantities [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::SpatialSpacings: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones IllinoisGRMHD::IllinoisGRMHD_InitSymBound: Schedule symmetries ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SpaceMask::MaskZero: Initialise mask to zero SpaceMask::MaskOne: Set old style mask to one SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently TerminationTrigger::TerminationTrigger_ResetTrigger: Clear trigger state TerminationTrigger::TerminationTrigger_StartTimer: Start timer Time::Time_Initialise: [global] Initialise Time variables Time::TemporalSpacings: [singlemap] Set timestep based on Courant condition (courant_static) WeylScal4::WeylScal4_CheckBoundaries: [meta] check boundaries treatment [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found TerminationTrigger::TerminationTrigger_ResetMinutes: [global] Reset Watchtime VolumeIntegrals_GRMHD::VI_GRMHD_file_output_routine_Startup: Create directory for VI GRMHD file output. VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounterToZero: [global] Initialize IntegralCounter variable to zero endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables do loop over timesteps [CCTK_PREREGRID] Change grid hierarchy [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration LoopControl::lc_steer: [meta] Update LoopControl algorithm preferences NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used MoL::MoL_AllocateScratchSpace: [level] Allocate storage for scratch levels GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_AllocateScratch: Allocate sufficient space for array scratch variables MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP HydroBase_RHS: Groups for scheduling tasks for calculating RHS of hydro variables IllinoisGRMHD::IllinoisGRMHD_RHS_eval: Evaluate RHSs of GR Hydro & GRMHD equations ML_BSSN::ML_BSSN_EvolutionBoundaryScalar: ML_BSSN_EvolutionBoundaryScalar GROUP ML_BSSN_EvolutionInteriorSplitBy: ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy1: ML_BSSN_EvolutionInteriorSplitBy1 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy2: ML_BSSN_EvolutionInteriorSplitBy2 ML_BSSN::ML_BSSN_EvolutionInteriorSplitBy3: ML_BSSN_EvolutionInteriorSplitBy3 ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_EnforceEverywhere: ML_BSSN_EnforceEverywhere GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state MoL::MoL_FreeScratchSpace: [level] Free storage for scratch levels end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_evaluate_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate: ML_ADMConstraints_evaluate GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere: ML_BSSN_ConstraintsEverywhere GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior: ML_BSSN_ConstraintsInterior GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th: WeylScal4_psi4_calc_4th GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP zzz_NaNChecker_NaNCheck: Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_NaNCheck_Prepare: [level] Prepare data structures to check for NaNs NaNChecker::NaNChecker_NaNCheck_Check: [local] Check for NaNs NaNChecker::NaNChecker_NaNCheck_Finish: [level] Count NaNs in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found SpaceMask::CheckMask: Ensure that all mask values are legal GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces Dissipation::setup_epsdis: Setup spatially varying dissipation if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine endif if (analysis) [CCTK_ANALYSIS] VolumeIntegrals_GRMHD::VI_GRMHD_InitializeIntegralCounter: [global] Initialize IntegralCounter variable while (VolumeIntegrals_GRMHD::IntegralCounter) GROUP VI_GRMHD_VolumeIntegralGroup: Evaluate all volume integrals VolumeIntegrals_GRMHD::VI_GRMHD_ComputeIntegrand: [global] [loop-local] Compute Integrand VolumeIntegrals_GRMHD::VI_GRMHD_DoSum: [global] Do Sum VolumeIntegrals_GRMHD::VI_GRMHD_DecrementIntegralCounter: [global] Decrement IntegralCounter variable end while Convert_to_HydroBase::Convert_to_HydroBase: [global] [loop-local] Convert IllinoisGRMHD-native variables to HydroBase LoopControl::lc_statistics_analysis: [meta] Output LoopControl statistics GROUP ML_BSSN_EvolutionAnalysis: Calculate RHS at analysis ML_BSSN::ML_BSSN_EvolutionAnalysisInit: ML_BSSN_EvolutionAnalysisInit ML_BSSN::ML_BSSN_EvolutionAnalysisInterior: ML_BSSN_EvolutionAnalysisInterior ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS Multipole::Multipole_Calc: [global] Calculate Multipoles SystemStatistics::SystemStatistics_Collect: [global] Collect system statistics TerminationTrigger::TerminationTrigger_CheckWalltime: Check elapsed job walltime TerminationTrigger::TerminationTrigger_CheckSignal: Check if we received a termination signal TerminationTrigger::TerminationTrigger_CheckFile: Check termination file CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired VolumeIntegrals_GRMHD::VI_GRMHD_file_output: [global] Output VolumeIntegral results to disk particle_tracerET::convert_to_MHD_3velocity: [global] [loop-local] Convert to MHD 3 velocity GROUP particle_tracerET: Particle tracerET subroutines particle_tracerET::InitializeRK4IterationCounterToOne: [global] Initialize RK4IterationCounter variable to one particle_tracerET::InitializeParticlePositions: [global] Initialize particle positions particle_tracerET::DoOneRK4StepForParticleTracerET: [global] Do one RK4 step for particle tracerET particle_tracerET::particle_tracerET_file_output: [global] Output particle tracerET data to disk smallbPoynET::compute_bi_b2_Poyn_fluxET: [global] [loop-local] Set b^mu, b^2, and Poynting flux gridfunctions. endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine LoopControl::lc_statistics_terminate: [meta] Output LoopControl statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays Shutdown routines [CCTK_SHUTDOWN] Timers::Timer_Shutdown: Prepare hierarchical timers Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] SpaceMask::MaskZero: Initialise mask to zero CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMaskInternal: Set up the integer weight function (schedule other routines in here) CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions ML_BSSN::ML_BSSN_ADMBaseInterior: ML_BSSN_ADMBaseInterior ML_BSSN::ML_BSSN_ADMBaseBoundaryScalar: ML_BSSN_ADMBaseBoundaryScalar ML_BSSN::ML_BSSN_ADMBaseEverywhere: ML_BSSN_ADMBaseEverywhere ML_BSSN_Helper::ML_BSSN_ADMBase_SelectBCs: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ADMBase_ApplyBCs: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP HydroBase_PostStep: Post step tasks for hydro thorns GROUP HydroBase_Boundaries: HydroBase-internal Boundary conditions group GROUP HydroBase_Select_Boundaries: Group to schedule the boundary condition functions GROUP HydroBase_ApplyBCs: Apply the boundary conditions of HydroBase GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions IllinoisGRMHD::Boundary_SYNCs: Schedule symmetries -- Actually just a placeholder function to ensure prolongations / processor syncs are done BEFORE outer boundaries are updated. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_A_mu: Apply linear extrapolation BCs on A_{mu}, so that BCs are flat on B^i. IllinoisGRMHD::IllinoisGRMHD_compute_B_and_Bstagger_from_A: Compute B and B_stagger from A, SYNC: grmhd_primitives_Bi,grmhd_primitives_Bi_stagger GROUP HydroBase_Con2Prim: Convert from conservative to primitive variables GROUP SetTmunu: Group for calculating the stress-energy tensor TmunuBase::TmunuBase_ZeroTmunu: Initialise the stress-energy tensor to zero GROUP AddToTmunu: Add to the stress-energy tensor here IllinoisGRMHD::IllinoisGRMHD_conserv_to_prims: Compute primitive variables from conservatives. This is non-trivial, requiring a Newton-Raphson root-finder. IllinoisGRMHD::IllinoisGRMHD_outer_boundaries_on_P_rho_b_vx_vy_vz: Apply outflow-only, flat BCs on {P,rho_b,vx,vy,vz}. Outflow only == velocities pointed inward from outer boundary are set to zero. WeylScal4::WeylScal4_SelectBoundConds: [level] select boundary conditions GROUP WeylScal4_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_evaluate_bc_group: ML_ADMConstraints_evaluate ML_ADMConstraints::ML_ADMConstraints_evaluate_SelectBCs: [level] ML_ADMConstraints_evaluate_SelectBCs GROUP ML_ADMConstraints_evaluate_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints_evaluate GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsEverywhere_bc_group: ML_BSSN_ConstraintsEverywhere ML_BSSN::ML_BSSN_ConstraintsEverywhere_SelectBCs: [level] ML_BSSN_ConstraintsEverywhere_SelectBCs GROUP ML_BSSN_ConstraintsEverywhere_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsEverywhere GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ConstraintsInterior_bc_group: ML_BSSN_ConstraintsInterior ML_BSSN::ML_BSSN_ConstraintsInterior_SelectBCs: [level] ML_BSSN_ConstraintsInterior_SelectBCs GROUP ML_BSSN_ConstraintsInterior_ApplyBCs: Apply BCs for groups set in ML_BSSN_ConstraintsInterior GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP WeylScal4_psi4_calc_4th_bc_group: WeylScal4_psi4_calc_4th WeylScal4::WeylScal4_psi4_calc_4th_SelectBCs: [level] WeylScal4_psi4_calc_4th_SelectBCs GROUP WeylScal4_psi4_calc_4th_ApplyBCs: Apply BCs for groups set in WeylScal4_psi4_calc_4th GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SpaceMask::MaskOne: Set mask to one AHFinderDirect::AHFinderDirect_maybe_do_masks: set mask(s) based on apparent horizon position(s) -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: process 0: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was -148 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current addres space size limit: hard=[unlimited], soft=[unlimited] Current data segment size limit: hard=[unlimited], soft=[unlimited] Current resident set size limit: hard=[unlimited], soft=[unlimited] INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384594 ns per clock tick (2.60014 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384587 ns per clock tick (2.60019 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384589 ns per clock tick (2.60018 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384584 ns per clock tick (2.60021 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384581 ns per clock tick (2.60023 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384593 ns per clock tick (2.60015 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384595 ns per clock tick (2.60014 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.384589 ns per clock tick (2.60018 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. INFO (CycleClock): Measuring CycleClock tick via OpenMP... INFO (CycleClock): Calibrated CycleClock: 0.38459 ns per clock tick (2.60017 GHz) INFO (Vectors): Using vector size 2 for architecture SSE2 (64-bit precision) INFO (hwloc): library version 2.0.4, API version 0x20000 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- HydroBase: Let it flow. -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- WeylScal4 -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 1 processes WARNING level 0 from host n133 process 0 in thorn Carpet, file /home2/mallick/ET/Cactus/configs/sim/build/Carpet/SetupGH.cc:148: -> The environment variable CACTUS_NUM_PROCS is set to 32, but there are 1 MPI processes. This may indicate a severe problem with the MPI startup mechanism. APPLICATION TERMINATED WITH THE EXIT STRING: Aborted (signal 6) Simfactory Done at date: Sun 08 Aug 2021 01:35:39 PM IST