<div dir="ltr"><div>Hi all</div><div><br></div><div>I&#39;m currently trying to run a BHNS simulation with initial data generated by Kadath elliptic solver (Fuka branch). <br></div><div><br></div><div>After initial data import, I&#39;m getting an error from THC: <br></div><div><b>WARNING level 0 from host nid00462 process 0<br>  while executing schedule bin HydroBase_Select_Boundaries, routine THC_Core::THC_SelectBC<br>  in thorn THC_Core, file /lustre/tetyda/home/topolski/Cactus/arrangements/THCCore/THC_Core/src/thc_select_bc.cc:76:<br>  -&gt; Failed to select the BCs</b></div><div><br></div><div>The simulation uses the following thorns NOT included with the official release of ET:</div><div><br></div><div>HRSCCore</div><div>Boost<br></div><div>KadathImporter</div><div>THCBase/CPPUtils, THCBase/FDCore ,THCBase/HRSCCore</div><div>THCExtra/EOS_Barotropic, THCExtra/EOS_Thermal, THCExtra/EOS_Thermal_Idealgas<br></div><div><br></div><div>Here&#39;s the parameter file. If I can provide more info, please let me know (also, if to upload it to a somewhat more convenient place).</div><div><br></div><div>Best regards</div><div>Konrad<br></div><div><br></div><div># The following is a modification of the ETK Gallery par file to utilize<br># Kadath initial data for a binary system of BH-NS<br><br>################################################################################<br># Active thorns<br>################################################################################<br><br>ActiveThorns = &quot;<br>ADMBase ML_ADMConstraints ADMCoupling ADMMacros<br>AEILocalInterp AHFinderDirect Boundary Carpet CarpetIOASCII<br>CarpetIOBasic CarpetIOHDF5 CarpetIOScalar CarpetInterp<br>CarpetInterp2 CarpetLib CarpetReduce  CarpetRegrid2<br>CarpetTracker CartGrid3D CoordBase Coordinates<br>CoordinatesSymmetry GlobalDerivative hwloc<br>IOUtil InitBase Interpolate2 QuasiLocalMeasures<br>KadathImporter LocalInterp LoopControl MoL<br>NaNChecker PunctureTracker Slab SpaceMask<br>SphericalSurface StaticConformal SummationByParts<br>SymBase SystemStatistics SystemTopology TerminationTrigger<br>TensorTypes Time TmunuBase Vectors ML_BSSN<br>ML_BSSN_Helper NewRad GenericFD WeylScal4<br>Multipole ADMDerivatives CarpetSlab CoordGauge<br>Dissipation EOS_Barotropic EOS_Thermal EOS_Thermal_Idealgas<br>HydroBase HRSCCore ML_ADMConstraints THC_Core<br>TimerReport BLAS  LAPACK  GSL Boost CPPUtils<br>FDCore HDF5 MPI Timers CycleClock TGRtensor<br>zlib Fortran VolumeIntegrals_GRMHD<br>CarpetMask ReflectionSymmetry</div><div># currently turned off <br></div><div>#GRHydro<br>#PizzaBase<br>#PizzaIDBase<br>#PizzaNumUtils<br>#NSTracker <br>#Hydro_Analysis<br>&quot;<br><br>################################################################################<br># Grid structure<br>################################################################################<br><br>#------------------------------------------------------------------------------<br># Diagnostic parameters:<br>#------------------------------------------------------------------------------<br>Carpet::output_timers_every = 0<br>Carpet::storage_verbose   = &quot;no&quot;<br>Carpet::verbose           = &quot;no&quot;<br>Carpet::veryverbose       = &quot;no&quot;<br>Carpet::grid_structure_filename   = &quot;carpet-grid-structure&quot;<br>Carpet::grid_coordinates_filename = &quot;carpet-grid-coordinates&quot;<br><br>CarpetLib::output_bboxes  = &quot;no&quot;<br><br>CarpetMask::verbose    = &quot;no&quot;<br>CarpetReduce::verbose  = &quot;no&quot;<br>CarpetRegrid2::verbose = &quot;no&quot;<br>CarpetRegrid2::veryverbose    = &quot;no&quot;<br>CarpetTracker::verbose = &quot;no&quot;<br><br><br>TimerReport::out_every    = 4096<br>TimerReport::out_filename = &quot;TimerReport&quot;<br>TimerReport::output_all_timers          = &quot;yes&quot;<br>TimerReport::output_all_timers_together = &quot;yes&quot;<br>TimerReport::output_all_timers_readable = &quot;yes&quot;<br>TimerReport::n_top_timers               = 40<br><br><br>QuasiLocalMeasures::verbose   = &quot;no&quot;<br>SphericalSurface::verbose   = &quot;no&quot;<br><br><br>Carpet::domain_from_multipatch          = yes<br>CartGrid3D::type                        = &quot;multipatch&quot;<br>CartGrid3D::set_coordinate_ranges_on    = &quot;all maps&quot;<br>Coordinates::coordinate_system          = &quot;Thornburg04&quot;<br>Coordinates::h_cartesian                = 1.5574825174818182<br>Coordinates::h_radial                   = 1.5574825174818182<br><br>Coordinates::sphere_inner_radius        = 51.3969230769<br>Coordinates::sphere_outer_radius        = 2194.15912088<br>Coordinates::n_angular                  = 28<br><br>Driver::ghost_size                      = 5<br>Coordinates::patch_boundary_size        = 5<br>Coordinates::additional_overlap_size    = 3<br>Coordinates::outer_boundary_size        = 5<br><br>CoordinatesSymmetry::reflection_z       = yes<br>CoordinatesSymmetry::stagger            = no<br>Coordinates::symmetry                   = &quot;+z bitant&quot;<br>Coordinates::additional_symmetry_size   = 1<br>Coordinates::verbose                    = no<br><br>Time::timestep_method                   = &quot;given&quot;<br>Time::timestep                          = 0.3504335664334091<br>Carpet::time_refinement_factors         = &quot;[1,1,2,4,8,16,32,64,128,256]&quot;<br><br><br># General Carpet parameters:<br>Carpet::enable_all_storage       = &quot;no&quot;<br>Carpet::use_buffer_zones         = &quot;yes&quot;<br>Carpet::schedule_barriers        = &quot;no&quot;<br><br>Carpet::poison_new_timelevels    = &quot;yes&quot;<br>Carpet::check_for_poison         = &quot;no&quot;<br><br>Carpet::init_3_timelevels        = &quot;no&quot;<br>Carpet::init_fill_timelevels     = &quot;yes&quot;<br><br>CarpetLib::poison_new_memory         = &quot;yes&quot;<br>CarpetLib::poison_value              = 114<br>CarpetLib::check_bboxes              = &quot;no&quot;<br>CarpetLib::interleave_communications = &quot;yes&quot;<br>CarpetLib::combine_sends             = &quot;yes&quot;<br><br>CarpetInterp::tree_search = &quot;yes&quot;<br>CarpetInterp::check_tree_search = &quot;no&quot;<br><br>CarpetRegrid2::freeze_unaligned_levels = &quot;yes&quot;<br>CarpetRegrid2::freeze_unaligned_parent_levels = &quot;yes&quot;<br>CarpetRegrid2::ensure_proper_nesting   = &quot;yes&quot;<br>CarpetRegrid2::snap_to_coarse          = &quot;yes&quot;<br>CarpetRegrid2::symmetry_rotating180    = &quot;no&quot;<br><br><br>###############################################################################<br># SpaceMask - only needed for GRHydro<br>###############################################################################<br><br>#SpaceMask::use_mask = &quot;yes&quot;<br><br>################################################################################<br># Mesh refinement<br>################################################################################<br><br>Carpet::max_refinement_levels           = 9<br>CarpetRegrid2::num_centres              = 2<br>CarpetRegrid2::num_levels_1             = 7<br>CarpetRegrid2::position_x_1             = +17.37737<br>CarpetRegrid2::radius_1                 = [0,21.267692,10.633846,5.316923,2.658462,1.329231,0.664615]<br>CarpetRegrid2::num_levels_2             = 7<br>CarpetRegrid2::position_x_2             = -13.76685<br>CarpetRegrid2::radius_2                 = [0,17.132308,8.566154,4.283077,2.141538,1.070769,0.535385]<br><br>Carpet::prolongation_order_space        = 5<br>Carpet::prolongation_order_time         = 2<br><br>CarpetRegrid2::regrid_every             = 128<br><br>################################################################################<br># Initial data<br>################################################################################<br><br>HydroBase::timelevels        = 3<br>HydroBase::prolongation_type =&quot;None&quot;<br>ADMBase::metric_type                                =        &quot;physical&quot;<br><br>ADMBase::initial_data                   = &quot;Kadath&quot;<br>ADMBase::initial_lapse                  = &quot;Kadath&quot;<br>ADMBase::initial_shift                  = &quot;Kadath&quot;<br>ADMBase::initial_dtlapse                = &quot;Kadath&quot;<br>ADMBase::initial_dtshift                = &quot;Kadath&quot;<br>HydroBase::initial_hydro                = &quot;Kadath&quot;<br><br># Kadath BNS file<br>KadathImporter::type = &quot;BHNS&quot;<br>#PizzaIDBase::eos_file = &quot;gam2.polytrope&quot;<br># Geometric unit system for initial data, specified by length unit.<br># use CACTUS units<br>#PizzaBase::length_unit          = 1476.7161818921163<br>KadathImporter::filename = &quot;/home/topolski/Cactus/BHNS_par/BHNS.info&quot;<br>KadathImporter::puncture_lapse = yes<br><br>InitBase::initial_data_setup_method     = &quot;init_single_level&quot;<br><br># ============================================================================<br># Templated hydrodynamics code<br># =============================================================================<br>HydroBase::evolution_method             = &quot;THCode&quot;<br>HydroBase::initial_entropy                                  = &quot;THCode&quot;<br><br>THC_Core::physics                       = &quot;GRHD&quot;<br>THC_Core::eos_type                      = &quot;ideal&quot;<br>THC_Core::bc_type                       = &quot;none&quot;<br>THC_Core::atmo_rho                      = 1e-13<br><br>HRSCCore::scheme                        = &quot;FV&quot;<br>HRSCCore::reconstruction                = &quot;MP5&quot;<br>HRSCCore::riemann_solver                = &quot;HLLE&quot;<br><br>THC_Core::c2a_BH_alp            = 0.15<br>THC_Core::c2a_rho_strict                = 2.0e-5<br>THC_Core::c2a_set_to_nan_on_failure             = &quot;no&quot;<br>THC_Core::c2a_fix_conservatives         = &quot;yes&quot;<br>THC_Core::c2a_kill_on_failure           = &quot;no&quot;<br><br>EOS_Thermal::evol_eos_name = &quot;IdealGas&quot;<br>EOS_Thermal_IdealGas::index_n = 1<br>EOS_Thermal_IdealGas::eps_min = 1e-8<br><br><br>################################################################################<br># Evolution and boundary<br>################################################################################<br><br>GenericFD::jacobian_group = &quot;Coordinates::jacobian&quot;<br>GenericFD::jacobian_derivative_group = &quot;Coordinates::jacobian2&quot;<br>GenericFD::jacobian_identity_map = 0<br><br>ADMBase::evolution_method         = &quot;ML_BSSN&quot;<br>ADMBase::lapse_evolution_method   = &quot;ML_BSSN&quot;<br>ADMBase::shift_evolution_method   = &quot;ML_BSSN&quot;<br>ADMBase::dtlapse_evolution_method = &quot;ML_BSSN&quot;<br>ADMBase::dtshift_evolution_method = &quot;ML_BSSN&quot;<br><br>ADMBase::lapse_timelevels               = 3<br>ADMBase::shift_timelevels               = 3<br>ADMBase::metric_timelevels              = 3<br><br>TmunuBase::prolongation_type            = &quot;none&quot;<br>TmunuBase::stress_energy_storage                = &quot;yes&quot;<br>TmunuBase::stress_energy_at_RHS         = &quot;yes&quot;<br>TmunuBase::support_old_CalcTmunu_mechanism      = &quot;no&quot;<br><br><br>ML_BSSN::timelevels                     = 3<br>ML_BSSN::fdOrder             = 8<br>THC_Core::fd_order                      = 4<br><br># 1+log slicing requires harmonicN = 1 and harmonicF = 2.0<br>ML_BSSN::harmonicN           = 1<br>ML_BSSN::harmonicF           = 2.0<br><br>ML_BSSN::ShiftGammaCoeff     = 0.75<br>ML_BSSN::evolveA                        = 1<br>ML_BSSN::evolveB                        = 1<br>ML_BSSN::AlphaDriver            = 0.0<br>ML_BSSN::BetaDriver                     = 0.7    # ~ 1/M<br>ML_BSSN::advectLapse         = 1<br>ML_BSSN::advectShift         = 1<br><br>ML_BSSN::MinimumLapse        = 1.0e-8<br><br># conformalaMethod = 1 for W, 0 for phi<br>ML_BSSN::conformalMethod     = 1<br><br># We apply dissipation using GlobalDerivaitive so disable it here<br>ML_BSSN::epsDiss             = 0.0<br><br>ML_BSSN::dt_lapse_shift_method = &quot;noLapseShiftAdvection&quot;<br><br>ML_BSSN::initial_boundary_condition = &quot;extrapolate-gammas&quot;<br>ML_BSSN::rhs_boundary_condition     = &quot;NewRad&quot;<br>Boundary::radpower                  = 2<br><br>ML_BSSN::ML_log_confac_bound            = &quot;none&quot;<br>ML_BSSN::ML_metric_bound                = &quot;none&quot;<br>ML_BSSN::ML_Gamma_bound         = &quot;none&quot;<br>ML_BSSN::ML_trace_curv_bound            = &quot;none&quot;<br>ML_BSSN::ML_curv_bound          = &quot;none&quot;<br>ML_BSSN::ML_lapse_bound         = &quot;none&quot;<br>ML_BSSN::ML_dtlapse_bound               = &quot;none&quot;<br>ML_BSSN::ML_shift_bound         = &quot;none&quot;<br>ML_BSSN::ML_dtshift_bound               = &quot;none&quot;<br><br>Dissipation::order                      = 5<br>Dissipation::epsdis                     = 0.1<br>Dissipation::vars                       = &quot;<br>ML_BSSN::ML_log_confac<br>ML_BSSN::ML_metric<br>ML_BSSN::ML_curv<br>ML_BSSN::ML_trace_curv<br>ML_BSSN::ML_Gamma<br>ML_BSSN::ML_lapse<br>ML_BSSN::ML_shift<br>&quot;<br><br><br>################################################################################<br># BH and NS tracking (currently using VolumeIntegrals_GRMHD for tracking the <br># neutron star, will switch to NSTracker some time in the future) <br># BH is at x&gt;0, NS at x&lt;0<br>################################################################################<br><br>CarpetTracker::surface                      [0] = 0<br>CarpetTracker::surface                      [1] = 1<br>#PunctureTracker::track                      [0] = yes<br>#PunctureTracker::initial_x                  [0] = -13.76685<br>#PunctureTracker::which_surface_to_store_info[0] = 0<br>PunctureTracker::track                      [0] = yes<br>PunctureTracker::initial_x                  [0] = +17.37737<br>PunctureTracker::which_surface_to_store_info[0] = 1<br><br><br>VolumeIntegrals_GRMHD::verbose = 1<br>VolumeIntegrals_GRMHD::VolIntegral_out_every = 32 <br>VolumeIntegrals_GRMHD::NumIntegrals = 4<br># Integrate the entire volume with an integrand of 1. (used for testing/validation purposes only).<br>VolumeIntegrals_GRMHD::Integration_quantity_keyword[1] = &quot;one&quot;<br># To compute the center of mass in an integration volume originally centered at (x,y,z) = (-13.76685,0,0) <br>#with a coordinate radius of 13.5. Also use the center of mass integral result to set the ZEROTH AMR center.<br>VolumeIntegrals_GRMHD::Integration_quantity_keyword[2] = &quot;centerofmass&quot; <br>VolumeIntegrals_GRMHD::volintegral_sphere__center_x_initial         [2] = -13.76685<br>VolumeIntegrals_GRMHD::volintegral_inside_sphere__radius            [2] =  9.10722<br>VolumeIntegrals_GRMHD::amr_centre__tracks__volintegral_inside_sphere[2] =  0<br># Same as above, except use the integrand=1 (for validation purposes, to ensure the integration volume is approximately 4/3*pi*13.5^3).<br>VolumeIntegrals_GRMHD::Integration_quantity_keyword[3] = &quot;one&quot;<br>VolumeIntegrals_GRMHD::volintegral_sphere__center_x_initial         [3] = -13.76685<br>VolumeIntegrals_GRMHD::volintegral_inside_sphere__radius            [3] =  9.10722<br># Perform rest-mass integrals over entire volume.<br>VolumeIntegrals_GRMHD::Integration_quantity_keyword[4] = &quot;restmass&quot;<br>VolumeIntegrals_GRMHD::enable_file_output = 1<br>VolumeIntegrals_GRMHD::outVolIntegral_dir = &quot;volume_integration&quot;<br>VolumeIntegrals_GRMHD::CoM_integrand_GAMMA_SPEED_LIMIT = 1e4<br><br><br>########################<br># Setting up NS Tracker and Hydro_Analysis<br>#########################<br><br>#Hydro_Analysis::Hydro_Analysis_comp_rho_max = &quot;true&quot;<br>#Hydro_Analysis::Hydro_Analysis_rho_max_loc_only_positive_x = &quot;true&quot;<br>#Hydro_Analysis::Hydro_Analysis_comp_rho_max_origin_distance = &quot;yes&quot;<br>#Hydro_Analysis::Hydro_Analysis_average_multiple_maxima_locations = &quot;yes&quot;<br>#Hydro_Analysis::Hydro_Analysis_interpolator_name = &quot;Lagrange polynomial interpolation (tensor product)&quot;<br><br>#NSTracker::NSTracker_SF_Name          = &quot;Lefthand NS&quot;<br>#NSTracker::NSTracker_SF_Index          = 0<br>#NSTracker::NSTracker_max_distance = 3<br>#NSTracker::NSTracker_tracked_location = &quot;Hydro_Analysis::Hydro_Analysis_rho_max_loc&quot; # location of maximum<br>#position_x[NSTracker_SF_Index] = Hydro_Analysis_rho_max_loc<br>#position_x[NSTracker_SF_Index_Opposite] = - Hydro_Analysis_rho_max_loc<br>#NSTracker::NSTracker_tracked_location = &quot;Hydro_Analysis::Hydro_Analysis_rho_core_center_volume_weighted&quot; # center of mass<br>#NSTracker::NSTracker_stop_time = -1<br><br><br>################################################################################<br># Spatial finite differencing<br>################################################################################<br><br>SummationByParts::order                              = 8<br><br># Drop order instead of using upwinded stencils, only for advection derivatives<br>SummationByParts::sbp_upwind_deriv = no<br><br>SummationByParts::sbp_1st_deriv                      = yes<br>SummationByParts::sbp_2nd_deriv                      = no<br>SummationByParts::onesided_interpatch_boundaries     = no<br>SummationByParts::onesided_outer_boundaries          = yes<br>SummationByParts::use_dissipation                    = no<br>GlobalDerivative::use_dissipation                    = yes<br>SummationByParts::scale_with_h                       = yes<br>SummationByParts::dissipation_type                   = &quot;Kreiss-Oliger&quot;<br>SummationByParts::epsdis                             = 0.15<br><br># Because dt/dx is half that of the other levels we also need half the dissipation<br>GlobalDerivative::epsdis_for_level               [0] = 0.075<br><br># Variables for dissipation<br>SummationByParts::vars                               = &quot;<br>ML_BSSN::ML_log_confac<br>ML_BSSN::ML_metric<br>ML_BSSN::ML_trace_curv<br>ML_BSSN::ML_curv<br>ML_BSSN::ML_Gamma<br>ML_BSSN::ML_lapse<br>ML_BSSN::ML_shift<br>ML_BSSN::ML_dtlapse<br>ML_BSSN::ML_dtshift<br>&quot;<br><br>################################################################################<br># Time integration<br>################################################################################<br><br>MoL::ODE_Method                         = &quot;rk4&quot;<br>MoL::MoL_Intermediate_Steps             = 4<br>MoL::MoL_Num_Scratch_Levels             = 1<br><br>################################################################################<br># Interpolation<br>################################################################################<br><br># Use 5-th order interpatch interpolation on the Llama grid<br>Interpolate::interpolator_order         = 5<br><br>################################################################################<br># Psi4 computation<br>################################################################################<br><br>WeylScal4::fdOrder                   = 8<br>WeylScal4::calc_scalars              = &quot;psis&quot;<br>WeylScal4::calc_invariants           = &quot;always&quot;<br><br>################################################################################<br># Psi4 mode decomposition<br>################################################################################<br><br># Radii are chosen to be evenly spaced in 1/r as that is the variable<br># extrapolation is performed in<br>Multipole::nradii       = 7<br>Multipole::radius[0]    = 100<br>Multipole::radius[1]    = 115<br>Multipole::radius[2]    = 136<br>Multipole::radius[3]    = 167<br>Multipole::radius[4]    = 214<br>Multipole::radius[5]    = 300<br>Multipole::radius[6]    = 500<br>Multipole::ntheta       = 120<br>Multipole::nphi         = 240<br>Multipole::variables    = &quot;WeylScal4::Psi4r{sw=-2 cmplx=&#39;WeylScal4::Psi4i&#39; name=&#39;psi4&#39;}&quot;<br>Multipole::out_every    = 256<br>Multipole::l_max        = 8<br>Multipole::output_hdf5  = yes<br><br># Disable ASCII output to avoid creating a large number of files<br>Multipole::output_ascii = no<br><br>################################################################################<br># Apparent Horizons<br>################################################################################<br><br>AHFinderDirect::N_horizons                               = 2<br>AHFinderDirect::find_every                               = 256<br>AHFinderDirect::output_h_every                           = 0<br>AHFinderDirect::max_Newton_iterations__initial           = 50<br>AHFinderDirect::max_Newton_iterations__subsequent        = 50<br>AHFinderDirect::max_allowable_Theta_growth_iterations    = 10<br>AHFinderDirect::max_allowable_Theta_nonshrink_iterations = 10<br>AHFinderDirect::geometry_interpolator_name               = &quot;Lagrange polynomial interpolation&quot;<br>AHFinderDirect::geometry_interpolator_pars               = &quot;order=4&quot;<br>AHFinderDirect::surface_interpolator_name                = &quot;Lagrange polynomial interpolation&quot;<br>AHFinderDirect::surface_interpolator_pars                = &quot;order=4&quot;<br>AHFinderDirect::verbose_level                            = &quot;physics details&quot;<br>AHFinderDirect::move_origins                             = yes<br><br><br>AHFinderDirect::origin_x                             [1] = +17.37737<br>AHFinderDirect::initial_guess__coord_sphere__x_center[1] = +17.37737<br>AHFinderDirect::initial_guess__coord_sphere__radius  [1] = 0.73<br>AHFinderDirect::which_surface_to_store_info          [1] = 2<br>AHFinderDirect::set_mask_for_individual_horizon      [1] = no<br>AHFinderDirect::reset_horizon_after_not_finding      [1] = no<br>AHFinderDirect::track_origin_from_grid_scalar        [1] = yes<br>AHFinderDirect::track_origin_source_x                [1] = &quot;PunctureTracker::pt_loc_x[0]&quot;<br>AHFinderDirect::track_origin_source_y                [1] = &quot;PunctureTracker::pt_loc_y[0]&quot;<br>AHFinderDirect::track_origin_source_z                [1] = &quot;PunctureTracker::pt_loc_z[0]&quot;<br>AHFinderDirect::max_allowable_horizon_radius         [1] = 3<br><br>#AHFinderDirect::origin_x                             [2] = -5.53846153846<br>#AHFinderDirect::initial_guess__coord_sphere__x_center[2] = -5.53846153846<br>#AHFinderDirect::initial_guess__coord_sphere__radius  [2] = 0.535384615385<br>#AHFinderDirect::which_surface_to_store_info          [2] = 3<br>#AHFinderDirect::set_mask_for_individual_horizon      [2] = no<br>#AHFinderDirect::reset_horizon_after_not_finding      [2] = no<br>#AHFinderDirect::track_origin_from_grid_scalar        [2] = yes<br>#AHFinderDirect::track_origin_source_x                [2] = &quot;PunctureTracker::pt_loc_x[1]&quot;<br>#AHFinderDirect::track_origin_source_y                [2] = &quot;PunctureTracker::pt_loc_y[1]&quot;<br>#AHFinderDirect::track_origin_source_z                [2] = &quot;PunctureTracker::pt_loc_z[1]&quot;<br>#AHFinderDirect::max_allowable_horizon_radius         [2] = 3<br><br>AHFinderDirect::origin_x                             [2] = 0<br>AHFinderDirect::find_after_individual                [2] = 371902<br>AHFinderDirect::initial_guess__coord_sphere__x_center[2] = 0<br>AHFinderDirect::initial_guess__coord_sphere__radius  [2] = 1.67<br>AHFinderDirect::which_surface_to_store_info          [2] = 4<br>AHFinderDirect::set_mask_for_individual_horizon      [2] = no<br>AHFinderDirect::max_allowable_horizon_radius         [2] = 6<br><br>################################################################################<br># Spherical surfaces<br>################################################################################<br><br>SphericalSurface::nsurfaces             = 4<br>SphericalSurface::maxntheta             = 66<br>SphericalSurface::maxnphi               = 124<br><br># Surfaces 0 and 1 are used by PunctureTracker<br><br># Horizon 1<br>SphericalSurface::ntheta            [2] = 41<br>SphericalSurface::nphi              [2] = 80<br>SphericalSurface::nghoststheta      [2] = 2<br>SphericalSurface::nghostsphi        [2] = 2<br><br># Horizon 2<br>#SphericalSurface::ntheta            [3] = 41<br>#SphericalSurface::nphi              [3] = 80<br>#SphericalSurface::nghoststheta      [3] = 2<br>#SphericalSurface::nghostsphi        [3] = 2<br><br># Common horizon<br>SphericalSurface::ntheta            [3] = 41<br>SphericalSurface::nphi              [3] = 80<br>SphericalSurface::nghoststheta      [3] = 2<br>SphericalSurface::nghostsphi        [3] = 2<br><br>################################################################################<br># Isolated Horizons<br>################################################################################<br><br>QuasiLocalMeasures::veryverbose            = no<br>QuasiLocalMeasures::interpolator           = &quot;Lagrange polynomial interpolation&quot;<br>QuasiLocalMeasures::interpolator_options   = &quot;order=4&quot;<br>QuasiLocalMeasures::spatial_order          = 4<br>QuasiLocalMeasures::num_surfaces           = 3<br>QuasiLocalMeasures::surface_index      [0] = 2<br>QuasiLocalMeasures::surface_index      [1] = 3<br>#QuasiLocalMeasures::surface_index      [2] = 4<br>QuasiLocalMeasures::output_vtk_every       = 0<br><br>################################################################################<br># Correctness checking<br>################################################################################<br><br><br>NaNChecker::check_every                 = 256<br>NanChecker::check_after                 = 0<br>NaNChecker::report_max                  = 10<br>NaNChecker::verbose                     = &quot;all&quot;<br>NaNChecker::action_if_found             = terminate<br>NaNChecker::out_NaNmask                 = yes<br>NaNChecker::check_vars                  = &quot;<br>ML_BSSN::ML_log_confac<br>HydroBase::w_lorentz<br>ADMBase::curv <br>ADMBase::metric <br>ADMBase::lapse <br>ADMBase::shift <br>HydroBase::rho <br>HydroBase::eps <br>HydroBase::press <br>HydroBase::vel<br>&quot;<br><br>################################################################################<br># Timers<br>################################################################################<br><br>Carpet::output_timer_tree_every         = 1024<br>Carpet::output_initialise_timer_tree    = yes<br><br>################################################################################<br># Output<br>################################################################################<br><br>IO::out_dir                             = &quot;data&quot;<br>CarpetIOScalar::all_reductions_in_one_file    = &quot;no&quot;<br>CarpetIOScalar::one_file_per_group            = &quot;no&quot;<br>CarpetIOASCII::one_file_per_group             = &quot;no&quot;<br>CarpetIOHDF5::one_file_per_group              = &quot;no&quot;<br><br><br>IOBasic::outInfo_every                  = 1<br>IOBasic::outInfo_reductions             = &quot;minimum maximum&quot;<br>IOBasic::outInfo_vars                   = &quot;<br>ML_BSSN::ML_Ham<br>ML_BSSN::ML_log_confac<br>Carpet::physical_time_per_hour<br>SystemStatistics::maxrss_mb<br>SystemStatistics::swap_used_mb<br>Carpet::physical_time_per_hour<br>HydroBase::rho<br>#GRHydro::dens{reductions = &#39;sum maximum&#39;}<br>HydroBase::w_lorentz<br>&quot;<br><br>IOScalar::outScalar_every               = 256<br>IOScalar::outScalar_reductions          = &quot;minimum maximum average&quot;<br>IOScalar::outScalar_vars                = &quot;<br>SystemStatistics::process_memory_mb<br>ML_BSSN::ML_Ham{ reductions = &#39;maximum&#39; }<br>&quot;<br><br>IOASCII::out0D_every                    = 256<br>IOASCII::out0D_vars                     = &quot;<br>Carpet::physical_time_per_hour<br>Carpet::timing<br>PunctureTracker::pt_loc<br>QuasiLocalMeasures::qlm_scalars{out_every = 256}<br>&quot;<br><br>IOASCII::out1D_every                    = 0<br>IOASCII::out1D_d                        = no<br>IOASCII::out1D_x                        = yes<br>IOASCII::out1D_y                        = no<br>IOASCII::out1D_z                        = yes<br>IOASCII::out1D_vars                     = &quot;<br>ML_BSSN::ML_log_confac<br>ML_BSSN::ML_trace_curv<br>WeylScal4::Psi4r<br>&quot;<br><br>IOASCII::out2D_every                    = 0<br>IOASCII::out2D_vars                     = &quot;<br>&quot;<br><br>IOHDF5::out_every                       = 0<br>IOHDF5::out_vars                        = &quot;<br>Grid::Coordinates{out_every=1000000000 refinement_levels={0}}<br>ML_BSSN::ML_log_confac<br>WeylScal4::Psi4r<br>WeylScal4::Psi4i<br>WeylScal4::curvIr{refinement_levels={3 5}}<br>WeylScal4::curvIi{refinement_levels={3 5}}<br>WeylScal4::curvJr{refinement_levels={3 5}}<br>WeylScal4::curvJi{refinement_levels={3 5}}<br>&quot;<br><br>IOHDF5::out2D_every                     = 64 <br>IOHDF5::out2D_vars                      = &quot;<br>Grid::Coordinates{out_every=1000000000 refinement_levels={0}}<br>ML_BSSN::ML_Ham<br>ML_BSSN::alpha<br>ML_BSSN::phi<br>ML_BSSN::trK<br>WeylScal4::Psi4r<br>WeylScal4::Psi4i<br>HydroBase::rho<br>HydroBase::press<br>HydroBase::w_lorentz<br>&quot;<br><br><br>################################################################################<br># Checkpointing and recovery<br>################################################################################<br><br>#CarpetIOHDF5::checkpoint                    = yes<br>IOHDF5::checkpoint                          = &quot;yes&quot;<br>IO::checkpoint_ID                           = &quot;yes&quot;<br>IO::recover                                 = &quot;autoprobe&quot;<br>IO::checkpoint_every_walltime_hours = 1.5<br>IO::checkpoint_keep=2<br>IO::checkpoint_on_terminate         = &quot;yes&quot;<br>IO::out_mode                                = &quot;onefile&quot;<br>IO::checkpoint_dir                          = &quot;../checkpoints&quot;<br>IO::recover_dir                             = &quot;../checkpoints&quot;<br>IO::abort_on_io_errors                      = yes<br>CarpetIOHDF5::open_one_input_file_at_a_time = yes<br>CarpetIOHDF5::compression_level             = 0<br><br>################################################################################<br># Run termination<br>################################################################################<br><br>TerminationTrigger::max_walltime                 = 48<br># Trigger termination 30 minutes before the walltime is reached<br>TerminationTrigger::on_remaining_walltime        = 30<br>TerminationTrigger::output_remtime_every_minutes = 30<br>TerminationTrigger::termination_from_file        = yes<br>TerminationTrigger::termination_file             = &quot;terminate.txt&quot;<br>TerminationTrigger::create_termination_file      = yes<br><br>Cactus::terminate                               = time<br>Cactus::cctk_final_time                         = 1900.0<br><br><br><br></div></div>