-------------------------------------- Running PBS prologue script -------------------------------------- User and Job Data: -------------------------------------- Job ID: 595922.qb2 Username: ettest24 Group: lsuusers Date: 13-Jan-2012 16:46 Node: qb517 (2063) -------------------------------------- PBS has allocated the following nodes: qb517 qb516 qb515 qb513 A total of 32 processors on 4 nodes allocated --------------------------------------------- Check nodes and clean them of stray processes --------------------------------------------- Checking node qb517 16:46:54 Checking node qb516 16:46:56 Checking node qb515 16:46:58 Checking node qb513 16:47:00 Done clearing all the allocated nodes ------------------------------------------------------ Concluding PBS prologue script - 13-Jan-2012 16:47:00 ------------------------------------------------------ Simulation name: qc0-mclachlan Running simulation qc0-mclachlan Preparing: Checking: /scratch/ettest24/simulations/qc0-mclachlan/output-0001-active qb517 Fri Jan 13 16:47:02 CST 2012 Environment: Starting: INFO (Cactus): INFO (Cactus): INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): INFO (Cactus): -------------------------------------------------------------------------------- 10 1 0101 ************************ 01 1010 10 The Cactus Code V4.0 1010 1101 011 www.cactuscode.org 1001 100101 ************************ 00010101 100011 (c) Copyright The Authors 0100 GNU Licensed. No Warranty 0101 -------------------------------------------------------------------------------- Cactus version: 4.0.0 Compile date: Jan 10 2012 (17:29:31) Run date: Jan 13 2012 (16:47:13-0600) Run host: qb517 (pid=2677) Working directory: /work/ettest24/simulations/qc0-mclachlan/output-0001 Executable: /scratch/ettest24/simulations/qc0-mclachlan/SIMFACTORY/exe/cactus_sim Parameter file: /scratch/ettest24/simulations/qc0-mclachlan/output-0001/qc0-mclachlan.par -------------------------------------------------------------------------------- Activating thorn Cactus...Success -> active implementation Cactus Activation requested for --->IOUtil<--- Activating thorn IOUtil...Success -> active implementation IO Activation requested for --->AEILocalInterp<--- Activating thorn AEILocalInterp...Success -> active implementation AEILocalInterp Activation requested for --->BLAS LAPACK<--- Activating thorn BLAS...Success -> active implementation BLAS Activating thorn LAPACK...Success -> active implementation LAPACK Activation requested for --->Fortran<--- Activating thorn Fortran...Success -> active implementation Fortran Activation requested for --->GSL<--- Activating thorn GSL...Success -> active implementation GSL Activation requested for --->GenericFD<--- Activating thorn GenericFD...Success -> active implementation GenericFD Activation requested for --->HDF5<--- Activating thorn HDF5...Success -> active implementation HDF5 Activation requested for --->LocalInterp<--- Activating thorn LocalInterp...Success -> active implementation LocalInterp Activation requested for --->LoopControl<--- Activating thorn LoopControl...Success -> active implementation LoopControl Activation requested for --->Slab<--- Activating thorn Slab...Success -> active implementation Slab Activation requested for --->SummationByParts<--- Activating thorn SummationByParts...Success -> active implementation SummationByParts Activation requested for --->InitBase<--- Activating thorn InitBase...Success -> active implementation InitBase Activation requested for --->Carpet CarpetLib CarpetInterp CarpetReduce CarpetSlab<--- Activating thorn Carpet...Success -> active implementation Driver Activating thorn CarpetInterp...Success -> active implementation interp Activating thorn CarpetLib...Success -> active implementation CarpetLib Activating thorn CarpetReduce...Success -> active implementation reduce Activating thorn CarpetSlab...Success -> active implementation Hyperslab Activation requested for --->NaNChecker<--- Activating thorn NaNChecker...Success -> active implementation NaNChecker Activation requested for --->Boundary CartGrid3D CoordBase ReflectionSymmetry RotatingSymmetry180 SymBase<--- Activating thorn Boundary...Success -> active implementation boundary Activating thorn CartGrid3D...Success -> active implementation grid Activating thorn CoordBase...Success -> active implementation CoordBase Activating thorn ReflectionSymmetry...Success -> active implementation ReflectionSymmetry Activating thorn RotatingSymmetry180...Success -> active implementation RotatingSymmetry180 Activating thorn SymBase...Success -> active implementation SymBase Activation requested for --->SphericalSurface<--- Activating thorn SphericalSurface...Success -> active implementation SphericalSurface Activation requested for --->CarpetMask<--- Activating thorn CarpetMask...Success -> active implementation CarpetMask Activation requested for --->CarpetRegrid2 CarpetTracker<--- Activating thorn CarpetRegrid2...Success -> active implementation CarpetRegrid2 Activating thorn CarpetTracker...Success -> active implementation CarpetTracker Activation requested for --->MoL Time<--- Activating thorn MoL...Success -> active implementation MethodOfLines Activating thorn Time...Success -> active implementation time Activation requested for --->ADMBase ADMCoupling ADMMacros CoordGauge SpaceMask StaticConformal TmunuBase<--- Activating thorn ADMBase...Success -> active implementation ADMBase Activating thorn ADMCoupling...Success -> active implementation ADMCoupling Activating thorn ADMMacros...Success -> active implementation ADMMacros Activating thorn CoordGauge...Success -> active implementation CoordGauge Activating thorn SpaceMask...Success -> active implementation SpaceMask Activating thorn StaticConformal...Success -> active implementation StaticConformal Activating thorn TmunuBase...Success -> active implementation TmunuBase Activation requested for --->TwoPunctures<--- Activating thorn TwoPunctures...Success -> active implementation TwoPunctures Activation requested for --->ML_BSSN ML_BSSN_Helper NewRad<--- Activating thorn ML_BSSN...Success -> active implementation ML_BSSN Activating thorn ML_BSSN_Helper...Success -> active implementation ML_BSSN_Helper Activating thorn NewRad...Success -> active implementation NewRad Activation requested for --->Dissipation<--- Activating thorn Dissipation...Success -> active implementation Dissipation Activation requested for --->ML_ADMConstraints<--- Activating thorn ML_ADMConstraints...Success -> active implementation ML_ADMConstraints Activation requested for --->AHFinderDirect<--- Activating thorn AHFinderDirect...Success -> active implementation AHFinderDirect Activation requested for --->CarpetIOBasic<--- Activating thorn CarpetIOBasic...Success -> active implementation IOBasic INFO (Cactus): INFO (Cactus): INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3Activation requested for --->CarpetIOScalar<--- Increasing logging level from 0 to 3Increasing logging level from 0 to 3Activating thorn CarpetIOScalar... Success -> active implementation IOScalar Activation requested for --->CarpetIOASCII<--- Activating thorn CarpetIOASCII...Success -> active implementation IOASCII Activation requested for --->CarpetIOHDF5<--- Activating thorn CarpetIOHDF5...Success -> active implementation IOHDF5 Activation requested for --->Formaline<--- Activating thorn Formaline...Success -> active implementation Formaline Activation requested for --->TimerReport<--- Activating thorn TimerReport...Success -> active implementation timerreport INFO (Cactus): INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3 Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3INFO (Cactus): Increasing logging level from 0 to 3INFO (Cactus): Increasing logging level from 0 to 3 INFO (Cactus): INFO (Cactus): INFO (Cactus): Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3Increasing logging level from 0 to 3 INFO (Cactus): Increasing logging level from 0 to 3INFO (Cactus): Increasing logging level from 0 to 3INFO (Cactus): Increasing logging level from 0 to 3 INFO (Cactus): Increasing logging level from 0 to 3 INFO (CarpetIOHDF5): Recovering parameters from checkpoint file 'qc0-mclachlan/checkpoint.chkpt.it_51200.file_0.h5' -------------------------------------------------------------------------------- if (recover initial data) Recover parameters endif Startup routines [CCTK_STARTUP] Carpet::MultiModel_Startup: Multi-model Startup routine CarpetLib::CarpetLib_registercycleclock: [global] Register cycle based timer ML_BSSN_Helper::ML_BSSN_SetGroupTags: [meta] Set checkpointing and prolongation group tags Carpet::Driver_Startup: Startup routine IOUtil::IOUtil_Startup: Startup routine CarpetIOHDF5::CarpetIOHDF5_Startup: Startup routine CarpetIOScalar::CarpetIOScalarStartup: [global] Startup routine CarpetInterp::CarpetInterpStartup: Startup routine AEILocalInterp::AEILocalInterp_U_Startup: register CCTK_InterpLocalUniform() interpolation operators CarpetReduce::CarpetReduceStartup: Startup routine CartGrid3D::SymmetryStartup: Register GH Extension for GridSymmetry CoordBase::CoordBase_Startup: Register a GH extension to store the coordinate system handles Formaline::Formaline_PrintIDs: [meta] Print the build and simulation ids CarpetIOASCII::CarpetIOASCIIStartup: [global] Startup routine LocalInterp::LocalInterp_Startup: register LocalInterp's interpolation operators LoopControl::lc_check_type_sizes: [meta] Check that sizes of control structures are identical in C and Fortran ML_ADMConstraints::ML_ADMConstraints_Startup: [meta] create banner ML_BSSN::ML_BSSN_Startup: [meta] create banner ML_BSSN_Helper::ML_BSSN_RegisterSlicing: [meta] Register slicing CarpetIOBasic::CarpetIOBasicStartup: [global] Startup routine MoL::MoL_Startup: Startup banner Slab::Slab_InitMPIDatatypes: Create MPI datatypes for complex variables in C SymBase::SymBase_Startup: Register GH Extension for SymBase Startup routines which need an existing grid hierarchy [CCTK_WRAGH] ADMBase::Einstein_InitSymBound: [global] Set up GF symmetries Boundary::Boundary_RegisterBCs: [global] Register boundary conditions that this thorn provides CarpetRegrid2::CarpetRegrid2_Initialise: [global] Initialise locations of refined regions CartGrid3D::RegisterCartGrid3DCoords: [meta] Register coordinates for the Cartesian grid CoordGauge::Einstein_ActivateSlicing: Initialize slicing, setup priorities for mixed slicings CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration Formaline::Formaline_OutputSource: Output Cactus source tree Formaline::Formaline_RegisterWarnings: [meta] Register to receive warnings and info messages from the flesh Formaline::Formaline_AnnounceInitial: [global] Put some meta information about the current run into permanent storage MoL::MoL_SetupIndexArrays: Set up the MoL bookkeeping index arrays MoL::MoL_SetScheduleStatus: [global] Set the flag so it is ok to register with MoL GROUP MoL_Register: The group where physics thorns register variables with MoL ML_ADMConstraints::ML_ADMConstraints_RegisterVars: [meta] Register Variables for MoL ML_BSSN::ML_BSSN_RegisterVars: [meta] Register Variables for MoL ML_BSSN_Helper::ML_BSSN_RegisterConstrained: [meta] Register ADMBase variables as constrained MoL::MoL_ReportNumberVariables: [meta] Report how many of each type of variable there are Slab::Slab_InitTimers: Initialise timers GROUP SymBase_Wrapper: Wrapper group for SymBase GROUP SymmetryRegister: Register your symmetries here CartGrid3D::RegisterSymmetryBoundaries: [meta] Register symmetry boundaries ML_ADMConstraints::ML_ADMConstraints_RegisterSymmetries: [meta] register symmetries ML_BSSN::ML_BSSN_RegisterSymmetries: [meta] register symmetries ReflectionSymmetry::ReflectionSymmetry_Register: Register reflection symmetry boundaries RotatingSymmetry180::Rot180_RegisterSymmetry: Register symmetry boundaries SymBase::SymBase_Statistics: Print symmetry boundary face descriptions Parameter checking routines [CCTK_PARAMCHECK] ADMBase::ADMBase_ParamCheck: [global] Check consistency of parameters Boundary::Boundary_Check: Check dimension of grid variables Carpet::CarpetParamCheck: Parameter checking routine CarpetLib::CarpetLib_test_prolongate_3d_rf2: [global] Test prolongation operators CarpetMask::CarpetSurfaceParamCheck: [global] Check parameters CarpetRegrid2::CarpetRegrid2_ParamCheck: Check parameters CartGrid3D::ParamCheck_CartGrid3D: Check coordinates for CartGrid3D Dissipation::dissipation_paramcheck: Check dissipation parameters for consistency Fortran::CheckFortranParameters: Test whether Fortran parameters work correctly MoL::MoL_ParamCheck: Basic parameter checking RotatingSymmetry180::Rot180_CheckTensorTypes: Check tensor type definitions for consistency TwoPunctures::TwoPunctures_ParamCheck: Check parameters and thorn needs Initialisation if (NOT (recover initial data AND recovery_mode is 'strict')) [CCTK_PREREGRIDINITIAL] Set up grid hierarchy [CCTK_POSTREGRIDINITIAL] AHFinderDirect::AHFinderDirect_maybe_do_masks: [global] [loop-local] set mask(s) based on apparent horizon position(s) CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::CartGrid3D_SetRanges: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently Time::Time_Initialise: [global] Initialise Time variables Time::Time_Simple: [singlemap] Set timestep based on Courant condition (courant_static) TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable [CCTK_INITIAL] StaticConformal::StaticConformal_InitialiseState: Set the conformal_state variable to 0 GROUP ADMBase_InitialData: Schedule group for calculating ADM initial data GROUP TwoPunctures_Group: TwoPunctures initial data group TwoPunctures::TwoPunctures: Create puncture black hole initial data TwoPunctures::TwoPunctures_Metadata: [global] Output TwoPunctures metadata GROUP ADMBase_InitialGauge: Schedule group for the ADM initial gauge condition ADMBase::ADMBase_ShiftZero: Set the shift to 0 at all points ADMBase::ADMBase_DtLapseZero: Set the dtlapse to 0 at all points ADMBase::ADMBase_DtShiftZero: Set the dtshift to 0 at all points GROUP ADMBase_PostInitial: Schedule group for modifying the ADM initial data, such as e.g. adding noise ML_BSSN::ML_BSSN_InitGamma: ML_BSSN_InitGamma ML_BSSN::ML_BSSN_convertFromADMBase: ML_BSSN_convertFromADMBase ML_BSSN::ML_BSSN_convertFromADMBaseGamma: ML_BSSN_convertFromADMBaseGamma MoL::MoL_StartLoop: [level] Initialise the step size control MoL::MoL_SetInitialTime: [level] Ensure the correct time and timestep are used - initial ML_BSSN_Helper::ML_BSSN_ExtrapolateGammas: Extrapolate Gammas and time derivatives of lapse and shift [CCTK_POSTINITIAL] CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [global] Close all filereader input files GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_enforce: ML_BSSN_enforce GROUP MoL_PostStep: Ensure that everything is correct after the initial data have been set up ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints: ML_ADMConstraints GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1: ML_BSSN_constraints1 GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2: ML_BSSN_constraints2 GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions SummationByParts::SBP_CheckGridSizes: Check grid sizes and ghost zones Initialise finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICTINITIAL] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTPOSTINITIAL] [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: [global] [loop-local] set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces NaNChecker::zzz_NaNChecker_NaNCheck: [local] Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function endif if (recover initial data) [CCTK_BASEGRID] ADMBase::ADMBase_SetShiftStateOn: Set the shift_state variable to 1 ADMBase::ADMBase_SetDtLapseStateOn: Set the dtlapse_state variable to 1 ADMBase::ADMBase_SetDtShiftStateOn: Set the dtshift_state variable to 1 ADMMacros::ADMMacros_SetLocalSpatialOrder: Initialize the local_spatial_order CartGrid3D::CartGrid3D_SetRanges: Set up ranges for spatial 3D Cartesian coordinates (on all grids) CarpetIOASCII::CarpetIOASCIIInit: [global] Initialisation routine CarpetIOBasic::CarpetIOBasicInit: [global] Initialisation routine CarpetIOHDF5::CarpetIOHDF5_Init: [global] Initialisation routine CarpetIOScalar::CarpetIOScalarInit: [global] Initialisation routine CartGrid3D::SpatialCoordinates: Set up spatial 3D Cartesian coordinates on the GH SphericalSurface::SphericalSurface_SetupRes: [global] [loop-local] Set surface resolution automatically AHFinderDirect::AHFinderDirect_setup: [global] setup data structures Dissipation::dissipation_basegrid: Ensure that there are enough ghost zones ML_ADMConstraints::ML_ADMConstraints_CheckBoundaries: [meta] check boundaries treatment ML_BSSN::ML_BSSN_CheckBoundaries: [meta] check boundaries treatment NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter SphericalSurface::SphericalSurface_Setup: [global] Calculate surface coordinate descriptors GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function SphericalSurface::SphericalSurface_Set: [global] Set surface radii to be used for initial setup in other thorns GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces SummationByParts::SBP_SetNormMask: Setup the mask for the calculation of the norm SymBase::SymBase_Check: Check whether the driver set up the grid consistently Time::Time_Initialise: [global] Initialise Time variables Time::Time_Simple: [singlemap] Set timestep based on Courant condition (courant_static) TmunuBase::TmunuBase_SetStressEnergyState: [global] Set the stress_energy_state variable [CCTK_RECOVER_VARIABLES] IOUtil::IOUtil_RecoverGH: [level] Checkpoint recovery routine [CCTK_POST_RECOVER_VARIABLES] AHFinderDirect::AHFinderDirect_recover: [global] import horizon data from Cactus variables CarpetIOHDF5::CarpetIOHDF5_InitCheckpointingIntervals: [global] Initialisation of checkpointing intervals after recovery CarpetIOHDF5::CarpetIOHDF5_CloseFiles: [meta] Close all initial data checkpoint files after recovery GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function GROUP MoL_PostStep: Ensure that everything is correct after recovery ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt NaNChecker::zzz_NaNChecker_NaNCheck: [local] Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found endif if (checkpoint initial data) [CCTK_CPINITIAL] CarpetIOHDF5::CarpetIOHDF5_InitialDataCheckpoint: [meta] Initial data checkpoint routine endif if (analysis) [CCTK_ANALYSIS] CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired Formaline::Formaline_AnnounceUpdate: [global] Put some meta information about the current run into permanent storage LoopControl::lc_printstats_analysis: [meta] Output loop control statistics ML_BSSN::ML_BSSN_InitRHS: ML_BSSN_InitRHS GROUP ML_BSSN_evolCalcGroup: Calculate BSSN RHS ML_BSSN::ML_BSSN_RHS1: ML_BSSN_RHS1 ML_BSSN::ML_BSSN_RHS2: ML_BSSN_RHS2 ML_BSSN::ML_BSSN_Dissipation: ML_BSSN_Dissipation ML_BSSN::ML_BSSN_Advect: ML_BSSN_Advect ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS TimerReport::zzz_TimerReport_Output: [global] Print the timer report endif Output grid variables do loop over timesteps [CCTK_PREREGRID] CarpetTracker::CarpetTracker_SetPositions: [global] Set positions of refined regions Change grid hierarchy [CCTK_POSTREGRID] AHFinderDirect::AHFinderDirect_maybe_do_masks: [global] [loop-local] set mask(s) based on apparent horizon position(s) CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Rotate timelevels iteration = iteration+1 t = t+dt [CCTK_PRESTEP] CoordGauge::Einstein_SetNextSlicing: Identify the slicing for the next iteration NaNChecker::NaNChecker_ResetCounter: [global] Reset the NaNChecker::NaNsFound counter [CCTK_EVOL] MoL::MoL_StartLoop: [level] Initialise the step size control while (MoL::MoL_Stepsize_Bad) GROUP MoL_Evolution: A single Cactus evolution step using MoL GROUP MoL_StartStep: MoL internal setup for the evolution step MoL::MoL_SetCounter: [level] Set the counter for the ODE method to loop over MoL::MoL_SetTime: [level] Ensure the correct time and timestep are used GROUP MoL_PreStep: Physics thorns can schedule preloop setup routines in here MoL::MoL_InitialCopy: Ensure the data is in the correct timelevel while (MoL::MoL_Intermediate_Step) GROUP MoL_Step: The loop over the intermediate steps for the ODE integrator MoL::MoL_InitRHS: Initialise the RHS functions GROUP MoL_CalcRHS: Physics thorns schedule the calculation of the discrete spatial operator in here GROUP ML_BSSN_evolCalcGroup: Calculate BSSN RHS ML_BSSN::ML_BSSN_RHS1: ML_BSSN_RHS1 ML_BSSN::ML_BSSN_RHS2: ML_BSSN_RHS2 ML_BSSN::ML_BSSN_Dissipation: ML_BSSN_Dissipation ML_BSSN::ML_BSSN_Advect: ML_BSSN_Advect ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS GROUP MoL_PostRHS: Modify RHS functions Dissipation::dissipation_add: Add Kreiss-Oliger dissipation to the right hand sides GROUP MoL_RHSBoundaries: Any 'final' modifications to the RHS functions (boundaries etc.) MoL::MoL_Add: Updates calculated with the efficient Runge-Kutta 4 method GROUP MoL_PostStepModify: The group for physics thorns to schedule enforcing constraints ML_BSSN::ML_BSSN_enforce: ML_BSSN_enforce MoL::MoL_DecrementCounter: [level] Alter the counter number MoL::MoL_ResetTime: [level] If necessary, change the time GROUP MoL_PostStep: The group for physics thorns to schedule boundary calls etc. ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt MoL::MoL_ResetDeltaTime: [level] If necessary, change the timestep end while MoL::MoL_FinishLoop: [level] Control the step size MoL::MoL_RestoreSandR: Restoring the Save and Restore variables to the original state end while GROUP MoL_PseudoEvolution: Calculate pseudo-evolved quantities GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP ML_ADMConstraints_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints: ML_ADMConstraints GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1: ML_BSSN_constraints1 GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2: ML_BSSN_constraints2 GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions Evolve finer grids recursively Restrict from finer grids [CCTK_POSTRESTRICT] GROUP MoL_PostStep: Ensure that everything is correct after restriction ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions [CCTK_POSTSTEP] AHFinderDirect::AHFinderDirect_import_mask: [global] [loop-local] import the excision mask AHFinderDirect::AHFinderDirect_find_horizons: [global] find apparent horizon(s) after this time step AHFinderDirect::AHFinderDirect_store: [global] store apparent horizon(s) into spherical surface(s) AHFinderDirect::AHFinderDirect_save: [global] save apparent horizon(s) into Cactus variables AHFinderDirect::AHFinderDirect_maybe_do_masks: [global] [loop-local] set mask(s) based on apparent horizon position(s) SphericalSurface::SphericalSurface_Set: [global] Set surface radii GROUP SphericalSurface_HasBeenSet: Set the spherical surfaces before this group, and use it afterwards SphericalSurface::SphericalSurface_CheckState: [global] Test the state of the spherical surfaces NaNChecker::zzz_NaNChecker_NaNCheck: [local] Check for NaNs and count them in NaNChecker::NaNsFound NaNChecker::NaNChecker_TakeAction: [global] [loop-level] Output NaNChecker::NaNmask and take action according to NaNChecker::action_if_found Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function if (checkpoint) [CCTK_CHECKPOINT] CarpetIOHDF5::CarpetIOHDF5_EvolutionCheckpoint: [meta] Evolution checkpoint routine TimerReport::zzz_TimerReport_Checkpoint: [global] Print the timer report endif if (analysis) [CCTK_ANALYSIS] CarpetLib::CarpetLib_printtimestats: [global] Print timing statistics if desired CarpetLib::CarpetLib_printmemstats: [global] Print memory statistics if desired Formaline::Formaline_AnnounceUpdate: [global] Put some meta information about the current run into permanent storage LoopControl::lc_printstats_analysis: [meta] Output loop control statistics ML_BSSN::ML_BSSN_InitRHS: ML_BSSN_InitRHS GROUP ML_BSSN_evolCalcGroup: Calculate BSSN RHS ML_BSSN::ML_BSSN_RHS1: ML_BSSN_RHS1 ML_BSSN::ML_BSSN_RHS2: ML_BSSN_RHS2 ML_BSSN::ML_BSSN_Dissipation: ML_BSSN_Dissipation ML_BSSN::ML_BSSN_Advect: ML_BSSN_Advect ML_BSSN_Helper::ML_BSSN_NewRad: Apply NewRad boundary conditions to RHS TimerReport::zzz_TimerReport_Output: [global] Print the timer report endif Output grid variables enddo Termination routines [CCTK_TERMINATE] CarpetIOHDF5::CarpetIOHDF5_TerminationCheckpoint: [meta] Termination checkpoint routine Formaline::Formaline_AnnounceFinal: [global] Put some meta information about the current run into permanent storage LoopControl::lc_printstats_terminate: [meta] Output loop control statistics MoL::MoL_FreeIndexArrays: Free the MoL bookkeeping index arrays TimerReport::zzz_TimerReport_Output: [global] Print the timer report Shutdown routines [CCTK_SHUTDOWN] Routines run after changing the grid hierarchy: [CCTK_POSTREGRID] AHFinderDirect::AHFinderDirect_maybe_do_masks: [global] [loop-local] set mask(s) based on apparent horizon position(s) CartGrid3D::SpatialCoordinates: Set Coordinates after regridding GROUP MaskBase_SetupMask: Set up the weight function GROUP MaskBase_SetupMaskAll: Set up the weight function CarpetReduce::MaskBase_AllocateMask: [global] Allocate the weight function CarpetReduce::MaskBase_InitMask: [global] [loop-local] Initialise the weight function GROUP SetupIMask: Set up the integer weight function (schedule other routines in here) CarpetMask::CarpetExcludedSetup: [global] [loop-local] Set up the weight function for the excluded regions CarpetMask::CarpetSurfaceSetup: [global] [loop-local] Set up the weight function for the excluded spherical surfaces CarpetReduce::CoordBase_SetupMask: [global] [loop-local] Set up the outer boundaries of the weight function CarpetReduce::CarpetMaskSetup: [global] [loop-singlemap] Set up the weight function for the restriction regions CarpetReduce::MaskBase_SetMask: [global] [loop-local] Set the weight function GROUP SetupMask: Set up the real weight function (schedule other routines in here) CarpetReduce::MaskBase_TestMask: [global] Test the weight function Dissipation::setup_epsdis: Setup spatially varying dissipation GROUP MoL_PostStep: Ensure that everything is correct after regridding ML_BSSN::ML_BSSN_SelectBoundConds: [level] select boundary conditions ML_ADMConstraints::ML_ADMConstraints_SelectBoundConds: [level] select boundary conditions GROUP ML_ADMConstraints_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_ApplyBCs: Apply boundary conditions controlled by thorn Boundary GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_convertToADMBaseGroupWrapper: Calculate ADM variables GROUP ML_BSSN_convertToADMBaseGroup: Calculate ADM variables ML_BSSN::ML_BSSN_convertToADMBase: ML_BSSN_convertToADMBase ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShift: ML_BSSN_convertToADMBaseDtLapseShift ML_BSSN::ML_BSSN_convertToADMBaseDtLapseShiftBoundary: ML_BSSN_convertToADMBaseDtLapseShiftBoundary ML_BSSN_Helper::ML_BSSN_SelectBCsADMBase: [level] Select boundary conditions for ADMBase variables GROUP ML_BSSN_ApplyBCsADMBase: Apply boundary conditions to ADMBase variables GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ADMBase_SetADMVars: Set the ADM variables before this group, and use them afterwards GROUP MoL_OldBdry_Wrap: Wrapper group, do not schedule directly into this group MoL::MoL_OldBdry_SetDt: [level] Store and change dt GROUP MoL_OldStyleBoundaries: Place old style boundary routines here MoL::MoL_OldBdry_ResetDt: [level] Reset dt GROUP MoL_PseudoEvolutionBoundaries: Apply boundary conditions to pseudo-evolved quantities GROUP ML_ADMConstraints_bc_group: ML_ADMConstraints ML_ADMConstraints::ML_ADMConstraints_SelectBCs: [level] ML_ADMConstraints_SelectBCs GROUP ML_ADMConstraints_ApplyBCs: Apply BCs for groups set in ML_ADMConstraints GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints1_bc_group: ML_BSSN_constraints1 ML_BSSN::ML_BSSN_constraints1_SelectBCs: [level] ML_BSSN_constraints1_SelectBCs GROUP ML_BSSN_constraints1_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints1 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions GROUP ML_BSSN_constraints2_bc_group: ML_BSSN_constraints2 ML_BSSN::ML_BSSN_constraints2_SelectBCs: [level] ML_BSSN_constraints2_SelectBCs GROUP ML_BSSN_constraints2_ApplyBCs: Apply BCs for groups set in ML_BSSN_constraints2 GROUP BoundaryConditions: Execute all boundary conditions Boundary::Boundary_ApplyPhysicalBCs: Apply all requested local physical boundary conditions CartGrid3D::CartGrid3D_ApplyBC: Apply symmetry boundary conditions ReflectionSymmetry::ReflectionSymmetry_Apply: Apply reflection symmetries RotatingSymmetry180::Rot180_ApplyBC: Apply 180 degree rotational symmetry boundary condition Boundary::Boundary_ClearSelection: [level] Unselect all grid variables for boundary conditions -------------------------------------------------------------------------------- INFO (Carpet): Multi-Model listing: model 0: "world" INFO (Carpet): Multi-Model process distribution: processes 0-31: model 0 "world" INFO (Carpet): Multi-Model: This is process 0, model 0 "world" INFO (CarpetLib): Process startup time was 46.7 seconds Current core file size limit: hard=[unlimited], soft=0 MB Current memory size limit: hard=[unlimited], soft=[unlimited] INFO (Formaline): Configuration id: config-sim-qb4.loni.org-home-ettest24-Cactus INFO (Formaline): Build id: build-sim-qb4.loni.org-ettest24-2012.01.10-23.29.20-9417 INFO (Formaline): Simulation id: run-qc0-mclachlan-qb517-ettest24-2012.01.13-22.47.50-2677 INFO (Formaline): Run id: run-qc0-mclachlan-qb517-ettest24-2012.01.13-22.47.50-2677 -------------------------------------------------------------------------------- AMR driver provided by Carpet -------------------------------------------------------------------------------- AMR HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 0D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 1D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 2D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR 3D HDF5 I/O provided by CarpetIOHDF5 -------------------------------------------------------------------------------- AMR scalar I/O provided by CarpetIOScalar -------------------------------------------------------------------------------- AMR 0D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 1D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 2D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- AMR 3D ASCII I/O provided by CarpetIOASCII -------------------------------------------------------------------------------- ML_ADMConstraints -------------------------------------------------------------------------------- ML_BSSN -------------------------------------------------------------------------------- AMR info I/O provided by CarpetIOBasic -------------------------------------------------------------------------------- MoL: Generalized time integration. -------------------------------------------------------------------------------- INFO (Carpet): MPI is enabled INFO (Carpet): Carpet is running on 32 processes INFO (Carpet): This is process 0 INFO (Carpet): OpenMP is enabled INFO (Carpet): This process contains 1 threads INFO (Carpet): There are 32 threads in total INFO (Carpet): There are 1 threads per process INFO (Carpet): This process runs on host qb517, pid=2677 INFO (Carpet): This process runs on cores 0-7 INFO (Carpet): This simulation is running in 3 dimensions INFO (Carpet): [tl=0] Boundary specification for map 0: nboundaryzones: [[3,3,3],[3,3,3]] is_internal : [[0,0,0],[0,0,0]] is_staggered : [[0,0,0],[0,0,0]] shiftout : [[1,0,1],[0,0,0]] INFO (Carpet): [tl=0] CoordBase domain specification for map 0: physical extent: [0,-120,0] : [120,120,120] ([120,240,120]) interior extent: [0,-118,0] : [118,118,118] ([118,236,118]) exterior extent: [-6,-124,-6] : [124,124,124] ([130,248,130]) base_spacing : [2,2,2] INFO (Carpet): [tl=0] Adapted domain specification for map 0: convergence factor: 2 convergence level : 0 physical extent : [0,-120,0] : [120,120,120] ([120,240,120]) interior extent : [0,-118,0] : [118,118,118] ([118,236,118]) exterior extent : [-6,-124,-6] : [124,124,124] ([130,248,130]) spacing : [2,2,2] INFO (Carpet): [tl=0] Base grid specification for map 0: number of grid points : [66,125,66] number of coarse grid ghost points: [[3,3,3],[3,3,3]] INFO (Carpet): Group and variable statistics: INFO (Carpet): There are 353 grid functions in 58 groups INFO (Carpet): There are 517 grid scalars in 55 groups INFO (Carpet): There are 75 1-dimensional grid arrays in 6 groups INFO (Carpet): There are 7 2-dimensional grid arrays in 2 groups INFO (Carpet): There are 6 3-dimensional grid arrays in 1 groups INFO (Carpet): (The number of variables counts all time levels) INFO (CarpetIOHDF5): I/O Method 'IOHDF5' registered: AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): Periodic scalar output requested for: ADMBASE::gxx ADMBASE::gxy ADMBASE::gxz ADMBASE::gyy ADMBASE::gyz ADMBASE::gzz ADMBASE::kxx ADMBASE::kxy ADMBASE::kxz ADMBASE::kyy ADMBASE::kyz ADMBASE::kzz ADMBASE::alp ADMBASE::betax ADMBASE::betay ADMBASE::betaz ADMBASE::dtalp ADMBASE::dtbetax ADMBASE::dtbetay ADMBASE::dtbetaz CARPETREDUCE::weight ML_ADMCONSTRAINTS::H ML_ADMCONSTRAINTS::M1 ML_ADMCONSTRAINTS::M2 ML_ADMCONSTRAINTS::M3 INFO (CarpetIOHDF5): I/O Method 'IOHDF5_0D' registered: 0D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): I/O Method 'IOHDF5_1D' registered: 1D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): I/O Method 'IOHDF5_2D' registered: 2D AMR output of grid variables to HDF5 files INFO (CarpetIOHDF5): I/O Method 'IOHDF5_3D' registered: 3D AMR output of grid variables to HDF5 files INFO (CarpetIOScalar): Periodic scalar output requested for: ADMBASE::gxx ADMBASE::gxy ADMBASE::gxz ADMBASE::gyy ADMBASE::gyz ADMBASE::gzz ADMBASE::kxx ADMBASE::kxy ADMBASE::kxz ADMBASE::kyy ADMBASE::kyz ADMBASE::kzz ADMBASE::alp ADMBASE::betax ADMBASE::betay ADMBASE::betaz ADMBASE::dtalp ADMBASE::dtbetax ADMBASE::dtbetay ADMBASE::dtbetaz CARPETREDUCE::weight ML_ADMCONSTRAINTS::H ML_ADMCONSTRAINTS::M1 ML_ADMCONSTRAINTS::M2 ML_ADMCONSTRAINTS::M3 SPHERICALSURFACE::sf_radius[0] SPHERICALSURFACE::sf_radius[1] SPHERICALSURFACE::sf_radius[2] SPHERICALSURFACE::sf_radius[3] SPHERICALSURFACE::sf_radius[4] SPHERICALSURFACE::sf_radius[5] INFO (CarpetIOASCII): I/O Method 'IOASCII_0D' registered: 0D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): Periodic 0D AMR output requested for: ADMBASE::gxx ADMBASE::gxy ADMBASE::gxz ADMBASE::gyy ADMBASE::gyz ADMBASE::gzz ADMBASE::kxx ADMBASE::kxy ADMBASE::kxz ADMBASE::kyy ADMBASE::kyz ADMBASE::kzz ADMBASE::alp ADMBASE::betax ADMBASE::betay ADMBASE::betaz ADMBASE::dtalp ADMBASE::dtbetax ADMBASE::dtbetay ADMBASE::dtbetaz CARPET::physical_time_per_hour CARPET::current_physical_time_per_hour CARPET::time_total CARPET::time_evolution CARPET::time_computing CARPET::time_communicating CARPET::time_io CARPET::evolution_steps_count CARPET::local_grid_points_per_second CARPET::total_grid_points_per_second CARPET::local_grid_point_updates_count CARPET::total_grid_point_updates_count CARPET::io_per_second CARPET::io_bytes_per_second CARPET::io_bytes_ascii_per_second CARPET::io_bytes_binary_per_second CARPET::io_count CARPET::io_bytes_count CARPET::io_bytes_ascii_count CARPET::io_bytes_binary_count CARPET::comm_per_second CARPET::comm_bytes_per_second CARPET::comm_count CARPET::comm_bytes_count CARPET::time_levels CARPETREDUCE::weight ML_ADMCONSTRAINTS::H ML_ADMCONSTRAINTS::M1 ML_ADMCONSTRAINTS::M2 ML_ADMCONSTRAINTS::M3 SPHERICALSURFACE::sf_active[0] SPHERICALSURFACE::sf_active[1] SPHERICALSURFACE::sf_active[2] SPHERICALSURFACE::sf_active[3] SPHERICALSURFACE::sf_active[4] SPHERICALSURFACE::sf_active[5] SPHERICALSURFACE::sf_valid[0] SPHERICALSURFACE::sf_valid[1] SPHERICALSURFACE::sf_valid[2] SPHERICALSURFACE::sf_valid[3] SPHERICALSURFACE::sf_valid[4] SPHERICALSURFACE::sf_valid[5] SPHERICALSURFACE::sf_area[0] SPHERICALSURFACE::sf_area[1] SPHERICALSURFACE::sf_area[2] SPHERICALSURFACE::sf_area[3] SPHERICALSURFACE::sf_area[4] SPHERICALSURFACE::sf_area[5] SPHERICALSURFACE::sf_mean_radius[0] SPHERICALSURFACE::sf_mean_radius[1] SPHERICALSURFACE::sf_mean_radius[2] SPHERICALSURFACE::sf_mean_radius[3] SPHERICALSURFACE::sf_mean_radius[4] SPHERICALSURFACE::sf_mean_radius[5] SPHERICALSURFACE::sf_centroid_x[0] SPHERICALSURFACE::sf_centroid_x[1] SPHERICALSURFACE::sf_centroid_x[2] SPHERICALSURFACE::sf_centroid_x[3] SPHERICALSURFACE::sf_centroid_x[4] SPHERICALSURFACE::sf_centroid_x[5] SPHERICALSURFACE::sf_centroid_y[0] SPHERICALSURFACE::sf_centroid_y[1] SPHERICALSURFACE::sf_centroid_y[2] SPHERICALSURFACE::sf_centroid_y[3] SPHERICALSURFACE::sf_centroid_y[4] SPHERICALSURFACE::sf_centroid_y[5] SPHERICALSURFACE::sf_centroid_z[0] SPHERICALSURFACE::sf_centroid_z[1] SPHERICALSURFACE::sf_centroid_z[2] SPHERICALSURFACE::sf_centroid_z[3] SPHERICALSURFACE::sf_centroid_z[4] SPHERICALSURFACE::sf_centroid_z[5] SPHERICALSURFACE::sf_quadrupole_xx[0] SPHERICALSURFACE::sf_quadrupole_xx[1] SPHERICALSURFACE::sf_quadrupole_xx[2] SPHERICALSURFACE::sf_quadrupole_xx[3] SPHERICALSURFACE::sf_quadrupole_xx[4] SPHERICALSURFACE::sf_quadrupole_xx[5] SPHERICALSURFACE::sf_quadrupole_xy[0] SPHERICALSURFACE::sf_quadrupole_xy[1] SPHERICALSURFACE::sf_quadrupole_xy[2] SPHERICALSURFACE::sf_quadrupole_xy[3] SPHERICALSURFACE::sf_quadrupole_xy[4] SPHERICALSURFACE::sf_quadrupole_xy[5] SPHERICALSURFACE::sf_quadrupole_xz[0] SPHERICALSURFACE::sf_quadrupole_xz[1] SPHERICALSURFACE::sf_quadrupole_xz[2] SPHERICALSURFACE::sf_quadrupole_xz[3] SPHERICALSURFACE::sf_quadrupole_xz[4] SPHERICALSURFACE::sf_quadrupole_xz[5] SPHERICALSURFACE::sf_quadrupole_yy[0] SPHERICALSURFACE::sf_quadrupole_yy[1] SPHERICALSURFACE::sf_quadrupole_yy[2] SPHERICALSURFACE::sf_quadrupole_yy[3] SPHERICALSURFACE::sf_quadrupole_yy[4] SPHERICALSURFACE::sf_quadrupole_yy[5] SPHERICALSURFACE::sf_quadrupole_yz[0] SPHERICALSURFACE::sf_quadrupole_yz[1] SPHERICALSURFACE::sf_quadrupole_yz[2] SPHERICALSURFACE::sf_quadrupole_yz[3] SPHERICALSURFACE::sf_quadrupole_yz[4] SPHERICALSURFACE::sf_quadrupole_yz[5] SPHERICALSURFACE::sf_quadrupole_zz[0] SPHERICALSURFACE::sf_quadrupole_zz[1] SPHERICALSURFACE::sf_quadrupole_zz[2] SPHERICALSURFACE::sf_quadrupole_zz[3] SPHERICALSURFACE::sf_quadrupole_zz[4] SPHERICALSURFACE::sf_quadrupole_zz[5] SPHERICALSURFACE::sf_min_radius[0] SPHERICALSURFACE::sf_min_radius[1] SPHERICALSURFACE::sf_min_radius[2] SPHERICALSURFACE::sf_min_radius[3] SPHERICALSURFACE::sf_min_radius[4] SPHERICALSURFACE::sf_min_radius[5] SPHERICALSURFACE::sf_max_radius[0] SPHERICALSURFACE::sf_max_radius[1] SPHERICALSURFACE::sf_max_radius[2] SPHERICALSURFACE::sf_max_radius[3] SPHERICALSURFACE::sf_max_radius[4] SPHERICALSURFACE::sf_max_radius[5] SPHERICALSURFACE::sf_min_x[0] SPHERICALSURFACE::sf_min_x[1] SPHERICALSURFACE::sf_min_x[2] SPHERICALSURFACE::sf_min_x[3] SPHERICALSURFACE::sf_min_x[4] SPHERICALSURFACE::sf_min_x[5] SPHERICALSURFACE::sf_min_y[0] SPHERICALSURFACE::sf_min_y[1] SPHERICALSURFACE::sf_min_y[2] SPHERICALSURFACE::sf_min_y[3] SPHERICALSURFACE::sf_min_y[4] SPHERICALSURFACE::sf_min_y[5] SPHERICALSURFACE::sf_min_z[0] SPHERICALSURFACE::sf_min_z[1] SPHERICALSURFACE::sf_min_z[2] SPHERICALSURFACE::sf_min_z[3] SPHERICALSURFACE::sf_min_z[4] SPHERICALSURFACE::sf_min_z[5] SPHERICALSURFACE::sf_max_x[0] SPHERICALSURFACE::sf_max_x[1] SPHERICALSURFACE::sf_max_x[2] SPHERICALSURFACE::sf_max_x[3] SPHERICALSURFACE::sf_max_x[4] SPHERICALSURFACE::sf_max_x[5] SPHERICALSURFACE::sf_max_y[0] SPHERICALSURFACE::sf_max_y[1] SPHERICALSURFACE::sf_max_y[2] SPHERICALSURFACE::sf_max_y[3] SPHERICALSURFACE::sf_max_y[4] SPHERICALSURFACE::sf_max_y[5] SPHERICALSURFACE::sf_max_z[0] SPHERICALSURFACE::sf_max_z[1] SPHERICALSURFACE::sf_max_z[2] SPHERICALSURFACE::sf_max_z[3] SPHERICALSURFACE::sf_max_z[4] SPHERICALSURFACE::sf_max_z[5] SPHERICALSURFACE::sf_radius[0] SPHERICALSURFACE::sf_radius[1] SPHERICALSURFACE::sf_radius[2] SPHERICALSURFACE::sf_radius[3] SPHERICALSURFACE::sf_radius[4] SPHERICALSURFACE::sf_radius[5] SPHERICALSURFACE::sf_origin_x[0] SPHERICALSURFACE::sf_origin_x[1] SPHERICALSURFACE::sf_origin_x[2] SPHERICALSURFACE::sf_origin_x[3] SPHERICALSURFACE::sf_origin_x[4] SPHERICALSURFACE::sf_origin_x[5] SPHERICALSURFACE::sf_origin_y[0] SPHERICALSURFACE::sf_origin_y[1] SPHERICALSURFACE::sf_origin_y[2] SPHERICALSURFACE::sf_origin_y[3] SPHERICALSURFACE::sf_origin_y[4] SPHERICALSURFACE::sf_origin_y[5] SPHERICALSURFACE::sf_origin_z[0] SPHERICALSURFACE::sf_origin_z[1] SPHERICALSURFACE::sf_origin_z[2] SPHERICALSURFACE::sf_origin_z[3] SPHERICALSURFACE::sf_origin_z[4] SPHERICALSURFACE::sf_origin_z[5] SPHERICALSURFACE::sf_origin_theta[0] SPHERICALSURFACE::sf_origin_theta[1] SPHERICALSURFACE::sf_origin_theta[2] SPHERICALSURFACE::sf_origin_theta[3] SPHERICALSURFACE::sf_origin_theta[4] SPHERICALSURFACE::sf_origin_theta[5] SPHERICALSURFACE::sf_origin_phi[0] SPHERICALSURFACE::sf_origin_phi[1] SPHERICALSURFACE::sf_origin_phi[2] SPHERICALSURFACE::sf_origin_phi[3] SPHERICALSURFACE::sf_origin_phi[4] SPHERICALSURFACE::sf_origin_phi[5] SPHERICALSURFACE::sf_delta_theta[0] SPHERICALSURFACE::sf_delta_theta[1] SPHERICALSURFACE::sf_delta_theta[2] SPHERICALSURFACE::sf_delta_theta[3] SPHERICALSURFACE::sf_delta_theta[4] SPHERICALSURFACE::sf_delta_theta[5] SPHERICALSURFACE::sf_delta_phi[0] SPHERICALSURFACE::sf_delta_phi[1] SPHERICALSURFACE::sf_delta_phi[2] SPHERICALSURFACE::sf_delta_phi[3] SPHERICALSURFACE::sf_delta_phi[4] SPHERICALSURFACE::sf_delta_phi[5] INFO (CarpetIOASCII): I/O Method 'IOASCII_1D' registered: 1D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): Periodic 1D AMR output requested for: ADMBASE::gxx ADMBASE::gxy ADMBASE::gxz ADMBASE::gyy ADMBASE::gyz ADMBASE::gzz ADMBASE::kxx ADMBASE::kxy ADMBASE::kxz ADMBASE::kyy ADMBASE::kyz ADMBASE::kzz ADMBASE::alp ADMBASE::betax ADMBASE::betay ADMBASE::betaz ADMBASE::dtalp ADMBASE::dtbetax ADMBASE::dtbetay ADMBASE::dtbetaz CARPETREDUCE::weight ML_ADMCONSTRAINTS::H ML_ADMCONSTRAINTS::M1 ML_ADMCONSTRAINTS::M2 ML_ADMCONSTRAINTS::M3 SPHERICALSURFACE::sf_radius[0] SPHERICALSURFACE::sf_radius[1] SPHERICALSURFACE::sf_radius[2] SPHERICALSURFACE::sf_radius[3] SPHERICALSURFACE::sf_radius[4] SPHERICALSURFACE::sf_radius[5] INFO (CarpetIOASCII): I/O Method 'IOASCII_2D' registered: 2D AMR output of grid variables to ASCII files INFO (CarpetIOASCII): Periodic 2D AMR output requested for: SPHERICALSURFACE::sf_radius[0] SPHERICALSURFACE::sf_radius[1] SPHERICALSURFACE::sf_radius[2] SPHERICALSURFACE::sf_radius[3] SPHERICALSURFACE::sf_radius[4] SPHERICALSURFACE::sf_radius[5] INFO (CarpetIOASCII): I/O Method 'IOASCII_3D' registered: 3D AMR output of grid variables to ASCII files INFO (CarpetRegrid2): Initialising position of centre 0 to [1.16864,0,0] INFO (CarpetRegrid2): Initialising position of centre 1 to [-1.16864,0,0] INFO (CarpetRegrid2): Initialising position of centre 2 to [0,0,0] -------------------------------------------------------------------------------- INFO (Formaline): Writing tarballs with the Cactus sources into the directory "qc0-mclachlan/cactus-source" INFO (MoL): Using Runge-Kutta 4 as the time integrator. INFO (MoL): The maximum number of evolved variables is 25. 25 are registered. INFO (MoL): The maximum number of constrained variables is 20. 20 are registered. INFO (MoL): The maximum number of SandR variables is 0. 0 are registered. INFO (MoL): The maximum number of evolved complex variables is 0. 0 are registered. INFO (MoL): The maximum number of constrained complex variables is 0. 0 are registered. INFO (MoL): The maximum number of SandR complex variables is 0. 0 are registered. INFO (MoL): The maximum number of evolved array variables is 0. 0 are registered. INFO (MoL): The maximum number of constrained array variables is 0. 0 are registered. INFO (MoL): The maximum number of SandR array variables is 0. 0 are registered. INFO (MoL): The maximum number of evolved complex array variables is 0. 0 are registered. INFO (MoL): The maximum number of constrained complex array variables is 0. 0 are registered. INFO (MoL): The maximum number of SandR complex array variables is 0. 0 are registered. INFO (MoL): The maximum size of any array variables is 0. INFO (SymBase): Symmetry on lower x-face: rotating_symmetry_180 INFO (SymBase): Symmetry on lower z-face: reflection_symmetry INFO (ADMMacros): Spatial finite differencing order: 4 INFO (CartGrid3D): Grid Spacings: INFO (CartGrid3D): dx=>2.0000000e+00 dy=>2.0000000e+00 dz=>2.0000000e+00 INFO (CartGrid3D): Computational Coordinates: INFO (CartGrid3D): x=>[-6.000,124.000] y=>[-124.000,124.000] z=>[-6.000,124.000] INFO (CartGrid3D): Indices of Physical Coordinates: INFO (CartGrid3D): x=>[0,65] y=>[0,124] z=>[0,65] INFO (AHFinderDirect): setting up AHFinderDirect data structures INFO (AHFinderDirect): to search for 6 horizons on 32 processors INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (1.16864,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (-1.16864,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (0,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (0,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (0,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (AHFinderDirect): constructing full sphere patch system INFO (AHFinderDirect): at origin (0,0,0) INFO (AHFinderDirect): with 18 angular zones per right angle INFO (AHFinderDirect): ==> 2166 nominal, 3174 ghosted angular grid points INFO (Time): Timestep set to 0.5 (courant_static) INFO (CarpetIOHDF5): recovering grid structure INFO (Carpet): Grid structure (superregions, grid points): [0][0][0] exterior: [0,0,0] : [65,124,65] ([66,125,66] + PADDING) 544500 [1][0][0] exterior: [3,51,3] : [79,197,79] ([77,147,77] + PADDING) 871563 [2][0][0] exterior: [9,207,9] : [53,289,53] ([45,83,45] + PADDING) 168075 [3][0][0] exterior: [21,455,21] : [65,537,65] ([45,83,45] + PADDING) 168075 [4][0][0] exterior: [45,951,45] : [89,1033,89] ([45,83,45] + PADDING) 168075 [5][0][0] exterior: [93,1943,93] : [137,2025,137] ([45,83,45] + PADDING) 168075 [6][0][0] exterior: [189,3927,189] : [233,4009,233] ([45,83,45] + PADDING) 168075 INFO (Carpet): Grid structure (superregions, coordinates): [0][0][0] exterior: [-6,-124,-6] : [124,124,124] : [2,2,2] [1][0][0] exterior: [-3,-73,-3] : [73,73,73] : [1,1,1] [2][0][0] exterior: [-1.5,-20.5,-1.5] : [20.5,20.5,20.5] : [0.5,0.5,0.5] [3][0][0] exterior: [-0.75,-10.25,-0.75] : [10.25,10.25,10.25] : [0.25,0.25,0.25] [4][0][0] exterior: [-0.375,-5.125,-0.375] : [5.125,5.125,5.125] : [0.125,0.125,0.125] [5][0][0] exterior: [-0.1875,-2.5625,-0.1875] : [2.5625,2.5625,2.5625] : [0.0625,0.0625,0.0625] [6][0][0] exterior: [-0.09375,-1.28125,-0.09375] : [1.28125,1.28125,1.28125] : [0.03125,0.03125,0.03125] INFO (Carpet): Global grid structure statistics: INFO (Carpet): GF: rhs: 168k active, 322k owned (+92%), 792k total (+146%), 128 steps/time INFO (Carpet): GF: vars: 218, pts: 289M active, 428M owned (+48%), 900M total (+110%), 1.0 comp/proc INFO (Carpet): GA: vars: 598, pts: 1M active, 1M total (+0%) INFO (Carpet): Total required memory: 7.174 GByte (for GAs and currently active GFs) INFO (Carpet): Load balance: min avg max sdv max/avg-1 INFO (Carpet): Level 0: 2M 3M 3M 0M active 18% INFO (Carpet): Level 1: 2M 4M 6M 1M active 54% INFO (Carpet): Level 2: 0M 0M 1M 0M active 117% INFO (Carpet): Level 3: 0M 0M 1M 0M active 117% INFO (Carpet): Level 4: 0M 0M 1M 0M active 117% INFO (Carpet): Level 5: 0M 0M 1M 0M active 117% INFO (Carpet): Level 6: 0M 0M 1M 0M active 117% INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 0 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 0 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.5 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 1 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 1 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.25 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 2 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 2 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.125 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 3 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 3 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.0625 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 4 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 4 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.03125 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 5 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 5 at iteration 51200 (simulation time 100) INFO (ADMMacros): Spatial finite differencing order: 4 INFO (Time): Timestep set to 0.015625 (courant_static) INFO (CarpetIOHDF5): reading grid variables on mglevel 0 reflevel 6 INFO (CarpetIOHDF5): restarting simulation on mglevel 0 reflevel 6 at iteration 51200 (simulation time 100) INFO (CarpetReduce): Simulation domain volume: 432000 INFO (CarpetReduce): Reduction weight sum: 431999.943068504 WARNING level 1 in thorn CarpetReduce processor 0 host qb517 (line 120 of /home/ettest24/Cactus/arrangements/Carpet/CarpetReduce/src/mask_test.c): -> Simulation domain volume and reduction weight sum differ INFO (CarpetIOHDF5): --------------------------------------------------------- INFO (CarpetIOHDF5): Dumping initial checkpoint at iteration 51200, simulation time 100 INFO (CarpetIOHDF5): --------------------------------------------------------- Memory statistics from CarpetLib: Current number of objects: 1503 Current allocated memory: 192 MB Maximum number of objects: 1.52e+03 Maximum allocated memory: 193 MB Current administrative memory: 0.969 MB Total allocated used system memory: 227 MB Total allocated free system memory: 43.2 MB gh::allmemory: 215944 dh::allmemory: 370164 th::allmemory: 13648 ggf::allmemory: 267024 gdata::allmemory: 101968 INFO (TimerReport): Timer Report at iteration 51200 time 100 INFO (TimerReport): Top timers at iteration 51200 time 100 ====================================================================== % Time/s Min/s Max/s Timer (gettimeofday) ====================================================================== 100.0 134.217 133.961 134.402 CCTK total time 49.2 65.977 65.959 65.991 main/Initialise/CallAnalysis/CCTK_CPINITIAL 49.2 65.976 65.959 65.990 [0116] CarpetIOHDF5: CarpetIOHDF5_InitialDataCheckpoint in CCTK_CPINITIAL 49.2 65.976 65.959 65.990 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction 49.2 65.975 65.958 65.980 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction/thorns 49.2 65.975 65.958 65.980 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction/thorns/CarpetIOHDF5_InitialDataCheckpoint 26.9 36.080 35.741 36.384 main/Initialise/CallRecoverVariables 26.2 35.130 34.504 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES 26.2 35.124 34.494 35.967 [0089] IOUtil: IOUtil_RecoverGH in CCTK_RECOVER_VARIABLES 26.2 35.124 34.494 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction 26.2 35.124 34.493 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction/thorns 26.2 35.124 34.493 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction/thorns/IOUtil_RecoverGH 19.3 25.889 25.757 26.031 main/Initialise/CallAnalysis/OutputGH 8.7 11.680 11.660 11.701 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_1D [6] 8.7 11.680 11.660 11.701 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_1D [6]/OutputGH<1> 8.4 11.331 11.141 11.512 main/Initialise/CallAnalysis/OutputGH/IOHDF5::IOHDF5 [10] 8.4 11.331 11.141 11.512 main/Initialise/CallAnalysis/OutputGH/IOHDF5::IOHDF5 [10]/OutputGH 8.2 11.005 0.750 17.925 [0000] Carpet: MultiModel_Startup in CCTK_STARTUP 2.1 2.824 2.718 3.137 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_0D [5] 2.1 2.824 2.718 3.137 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_0D [5]/OutputGH<0> ====================================================================== ------------------------------------------------- Iteration Time | *me_per_hour | *STRAINTS::H | | norm2 ------------------------------------------------- 51200 100.000 | 0.0000000 | 0.0000243 INFO (CarpetIOHDF5): --------------------------------------------------------- INFO (CarpetIOHDF5): Termination checkpoint already dumped as last evolution checkpoint at iteration 51200 INFO (CarpetIOHDF5): --------------------------------------------------------- LoopControl timing statistics: Loop #0 "ML_BSSN_InitRHS": total count: 7 total setup: 2.31266e-05 total calc: 0.634159 avg calc: 0.0905941 avg first calc: 0.150101 avg improvement: 13% saved: 0.416546 seconds Loop #1 "ML_BSSN_convertToADMBaseDtLapseShift": total count: 7 total setup: 2.57492e-05 total calc: 0.0507691 avg calc: 0.00725273 avg first calc: 0.0112534 avg improvement: -3% saved: 0.0280044 seconds Loop #2 "ML_BSSN_convertToADMBase": total count: 7 total setup: 2.09808e-05 total calc: 0.433541 avg calc: 0.0619344 avg first calc: 0.0952126 avg improvement: 0% saved: 0.232948 seconds Total calculation time: 1.18404 seconds; total saved time: 0.677498 seconds INFO (TimerReport): Timer Report before terminating at iteration 51200 time 100 INFO (TimerReport): Top timers at iteration 51200 time 100 ====================================================================== % Time/s Min/s Max/s Timer (gettimeofday) ====================================================================== 100.0 142.332 142.263 142.351 main 98.6 140.391 140.345 140.438 CCTK total time 98.6 140.270 140.226 140.314 main/Initialise 69.6 99.031 99.023 99.039 main/Initialise/CallAnalysis 46.4 65.977 65.959 65.991 main/Initialise/CallAnalysis/CCTK_CPINITIAL 46.4 65.976 65.959 65.990 [0116] CarpetIOHDF5: CarpetIOHDF5_InitialDataCheckpoint in CCTK_CPINITIAL 46.4 65.976 65.959 65.990 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction 46.4 65.975 65.958 65.980 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction/thorns 46.4 65.975 65.958 65.980 main/Initialise/CallAnalysis/CCTK_CPINITIAL/CallFunction/thorns/CarpetIOHDF5_InitialDataCheckpoint 25.3 36.080 35.741 36.384 main/Initialise/CallRecoverVariables 24.7 35.130 34.504 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES 24.7 35.124 34.494 35.967 [0089] IOUtil: IOUtil_RecoverGH in CCTK_RECOVER_VARIABLES 24.7 35.124 34.494 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction 24.7 35.124 34.493 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction/thorns 24.7 35.124 34.493 35.967 main/Initialise/CallRecoverVariables/CCTK_RECOVER_VARIABLES/CallFunction/thorns/IOUtil_RecoverGH 22.1 31.498 31.357 31.648 main/Initialise/CallAnalysis/OutputGH 9.9 14.136 13.872 14.366 main/Initialise/CallAnalysis/OutputGH/IOHDF5::IOHDF5 [10] 9.9 14.136 13.872 14.366 main/Initialise/CallAnalysis/OutputGH/IOHDF5::IOHDF5 [10]/OutputGH 9.2 13.082 13.053 13.111 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_1D [6] 9.2 13.082 13.052 13.110 main/Initialise/CallAnalysis/OutputGH/IOASCII::IOASCII_1D [6]/OutputGH<1> ====================================================================== -------------------------------------------------------------------------------- Done. Stopping: Fri Jan 13 16:50:13 CST 2012 Done. Fri Jan 13 16:50:13 CST 2012 Simfactory Done at date: 0 ------------------------------------------------------ Running PBS epilogue script - 13-Jan-2012 16:50:14 ------------------------------------------------------ Checking node qb517 (MS) Checking node qb513 ok Checking node qb515 ok Checking node qb516 ok Checking node qb517 ok ------------------------------------------------------ Concluding PBS epilogue script - 13-Jan-2012 16:50:22 ------------------------------------------------------ Exit Status: Job ID: 595922.qb2 Username: ettest24 Group: lsuusers Job Name: qc0-mclachlan-0 Session Id: 2062 Resource Limits: ncpus=1,nodes=4:ppn=8,walltime=08:00:00 Resources Used: cput=00:15:10,mem=2849420kb,vmem=5003156kb,walltime=00:03:14 Queue Used: checkpt Account String: loni_cactus07 Node: qb517 Process id: 2704 ------------------------------------------------------