<div dir="auto">Thanks Sir. But I am still confused about, why changing "itlast" generated that issue as it only controls "last iteration"?</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Aug 28, 2020, 12:28 AM Roland Haas <<a href="mailto:rhaas@illinois.edu">rhaas@illinois.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello Bilal,<br>
<br>
following up on the private conversation we had:<br>
<br>
hmm.<br>
<br>
So you may not want to change itlast.<br>
<br>
Note that CT_MultiLevel is an elliptic solver, so you are constructing<br>
initial data.<br>
<br>
Looking at:<br>
<br>
repos/ctthorns/CT_MultiLevel/schedule.cc<br>
<br>
there is only:<br>
<br>
schedule CT_MultiLevel AT CCTK_INITIAL after CT_ScalarField_setConfRho<br>
{<br>
LANG: C<br>
OPTIONS: GLOBAL-LATE<br>
} "Main MultiLevel function"<br>
<br>
ie only in INITIAL which is for itlast=0.<br>
<br>
To the actually run an evolution (the black holes actually moving) you<br>
would have to read in the data produced by CT_MultiLevel into an<br>
evolution simulation. This would involve using a parameter file similar<br>
to the one that Zach pointed you to and a thorn like the<br>
ReadInterpolate thorn to read in the results data from CT_MultiLevel<br>
into the evolution simulation.<br>
<br>
How to do that is not fully trivial, unfortunately. You would have to<br>
ask someone on the mailing list if they have an example parameter file.<br>
Possible the CT_MultiLevel author, who had used my thorn before.<br>
<br>
Yours,<br>
Roland<br>
<br>
> Thanks Zach.<br>
> <br>
> On Thu, Aug 27, 2020, 11:50 PM Zach Etienne <<a href="mailto:zachetie@gmail.com" target="_blank" rel="noreferrer">zachetie@gmail.com</a>> wrote:<br>
> <br>
> > Hi Bilal,<br>
> ><br>
> > You are under-resolving the black holes. For stability you will<br>
> > need gridspacing of at least ~1/16 around each black hole (M/16, where M=1<br>
> > for this binary), and here your gridspacing is 1.25. I would suggest<br>
> > starting by trying to reproduce the binary black hole gallery example:<br>
> > <a href="https://einsteintoolkit.org/gallery/bbh/index.html" rel="noreferrer noreferrer" target="_blank">https://einsteintoolkit.org/gallery/bbh/index.html</a><br>
> ><br>
> > and adding small adjustments until you get it working according to your<br>
> > needs.<br>
> ><br>
> > -Zach<br>
> ><br>
> > * * *<br>
> > Prof. Zachariah Etienne<br>
> > Physics & Astronomy Dept.<br>
> > West Virginia University<br>
> > <a href="http://astro.phys.wvu.edu/zetienne/" rel="noreferrer noreferrer" target="_blank">http://astro.phys.wvu.edu/zetienne/</a><br>
> > <a href="http://blackholesathome.net" rel="noreferrer noreferrer" target="_blank">http://blackholesathome.net</a><br>
> > <<a href="https://blackholesathome.net" rel="noreferrer noreferrer" target="_blank">https://blackholesathome.net</a>><br>
> ><br>
> ><br>
> > On Thu, Aug 27, 2020 at 2:38 PM Bilal Hameed <<a href="mailto:bilalhameedawan962@gmail.com" target="_blank" rel="noreferrer">bilalhameedawan962@gmail.com</a>><br>
> > wrote:<br>
> > <br>
> >> Dear Users.<br>
> >><br>
> >> I am runing --parfile repos/ctthorns/CT_MultiLevel/par/twopunctures.par.<br>
> >><br>
> >> ######################################<br>
> >> # Flesh parameters<br>
> >> ######################################<br>
> >><br>
> >> Cactus::cctk_run_title = "Solving the Hamiltonian constraint for two<br>
> >> punctures with CT_MultiLevel (multigrid setup, FMG) and with TwoPunctures"<br>
> >><br>
> >> Cactus::cctk_full_warnings = yes<br>
> >> Cactus::highlight_warning_messages = no<br>
> >> Cactus::cctk_timer_output = "off"<br>
> >><br>
> >> Cactus::terminate = "any"<br>
> >> Cactus::cctk_initial_time = 0<br>
> >> Cactus::cctk_final_time = 30<br>
> >> Cactus::cctk_itlast = 200<br>
> >><br>
> >><br>
> >><br>
> >> #############################################################################################<br>
> >> ActiveThorns = "Boundary CartGrid3D CoordBase Slab SymBase"<br>
> >><br>
> >> #############################################################################################<br>
> >><br>
> >> CoordBase::domainsize = "minmax"<br>
> >><br>
> >> CoordBase::xmin = -40.00<br>
> >> CoordBase::ymin = -40.00<br>
> >> CoordBase::zmin = -40.00<br>
> >> CoordBase::xmax = +40.00<br>
> >> CoordBase::ymax = +40.00<br>
> >> CoordBase::zmax = +40.00<br>
> >> CoordBase::dx = 10<br>
> >> CoordBase::dy = 10<br>
> >> CoordBase::dz = 10<br>
> >><br>
> >> CoordBase::boundary_size_x_lower = 3<br>
> >> CoordBase::boundary_size_y_lower = 3<br>
> >> CoordBase::boundary_size_z_lower = 3<br>
> >> CoordBase::boundary_size_x_upper = 3<br>
> >> CoordBase::boundary_size_y_upper = 3<br>
> >> CoordBase::boundary_size_z_upper = 3<br>
> >><br>
> >> CoordBase::boundary_shiftout_x_lower = 1<br>
> >> CoordBase::boundary_shiftout_y_lower = 1<br>
> >> CoordBase::boundary_shiftout_z_lower = 1<br>
> >> CoordBase::boundary_shiftout_x_upper = 1<br>
> >> CoordBase::boundary_shiftout_y_upper = 1<br>
> >> CoordBase::boundary_shiftout_z_upper = 1<br>
> >><br>
> >> CartGrid3D::type = "coordbase"<br>
> >><br>
> >><br>
> >> ##################################################################################<br>
> >> ActiveThorns = "IOUtil Carpet CarpetLib CarpetInterp LoopControl<br>
> >> CarpetReduce CarpetSlab"<br>
> >><br>
> >> ##################################################################################<br>
> >><br>
> >> Carpet::adaptive_stepsize = "no"<br>
> >><br>
> >> Carpet::schedule_barriers = no<br>
> >> CarpetLib::output_bboxes = no<br>
> >> Carpet::init_fill_timelevels = "yes"<br>
> >><br>
> >> Carpet::domain_from_coordbase = yes<br>
> >> Carpet::max_refinement_levels = 5<br>
> >><br>
> >> driver::ghost_size = 3<br>
> >> Carpet::use_buffer_zones = yes<br>
> >><br>
> >> Carpet::prolongation_order_space = 5<br>
> >> Carpet::prolongation_order_time = 2<br>
> >><br>
> >> Carpet::convergence_level = 0<br>
> >><br>
> >> Carpet::poison_new_timelevels = yes<br>
> >> CarpetLib::poison_new_memory = yes<br>
> >><br>
> >> Carpet::output_timers_every = 0<br>
> >> CarpetLib::print_timestats_every = 0<br>
> >> CarpetLib::print_memstats_every = 0<br>
> >><br>
> >> CarpetLib::max_allowed_memory_MB = 12288<br>
> >><br>
> >> ##################################################################<br>
> >> ActiveThorns = "CarpetRegrid2"<br>
> >> ##################################################################<br>
> >><br>
> >> Carpet::grid_structure_filename = "grid_structure.asc"<br>
> >> Carpet::grid_coordinates_filename = "grid_coordinates.asc"<br>
> >><br>
> >> CarpetRegrid2::num_centres = 1<br>
> >> CarpetRegrid2::num_levels_1 = 4<br>
> >> CarpetRegrid2::radius_1[1] = 50<br>
> >> CarpetRegrid2::radius_1[2] = 25<br>
> >> CarpetRegrid2::radius_1[3] = 12<br>
> >> #CarpetRegrid2::radius_1[4] = 50<br>
> >> #CarpetRegrid2::radius_1[5] = 25<br>
> >> #CarpetRegrid2::radius_1[6] = 12<br>
> >> #CarpetRegrid2::radius_1[7] = 6<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "AEILocalInterp"<br>
> >> ActiveThorns = "BLAS LAPACK"<br>
> >> ActiveThorns = "Fortran"<br>
> >> ActiveThorns = "GenericFD"<br>
> >> ActiveThorns = "HDF5"<br>
> >> ActiveThorns = "InitBase"<br>
> >> ActiveThorns = "LocalInterp"<br>
> >> #################################<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "MoL Time"<br>
> >> #################################<br>
> >><br>
> >> MoL::ODE_Method = "RK4"<br>
> >> MoL::MoL_Intermediate_Steps = 4<br>
> >> MoL::MoL_Num_Scratch_Levels = 1<br>
> >><br>
> >> Time::dtfac = 0.2<br>
> >><br>
> >><br>
> >> ###################################################################################################<br>
> >> ActiveThorns = "CT_MultiLevel CT_Analytic ADMBase ML_BSSN ML_BSSN_Helper<br>
> >> CoordGauge StaticConformal TmunuBase ADMCoupling ADMMacros TwoPunctures"<br>
> >><br>
> >> ###################################################################################################<br>
> >><br>
> >> ADMBase::metric_timelevels = 3<br>
> >> ADMBase::lapse_timelevels = 3<br>
> >> ADMBase::shift_timelevels = 3<br>
> >><br>
> >> ADMBase::metric_type = "physical"<br>
> >><br>
> >> ADMBase::initial_data = "twopunctures"<br>
> >> ADMBase::initial_lapse = "twopunctures-averaged"<br>
> >> ADMBase::initial_shift = "zero"<br>
> >> ADMBase::initial_dtlapse = "zero"<br>
> >> ADMBase::initial_dtshift = "zero"<br>
> >><br>
> >> ADMBase::evolution_method = "ML_BSSN"<br>
> >> ADMBase::lapse_evolution_method = "ML_BSSN"<br>
> >> ADMBase::shift_evolution_method = "ML_BSSN"<br>
> >> ADMBase::dtlapse_evolution_method = "ML_BSSN"<br>
> >> ADMBase::dtshift_evolution_method = "ML_BSSN"<br>
> >><br>
> >> ADMBase::admbase_boundary_condition = "none"<br>
> >><br>
> >> TwoPunctures::par_b = 1.168642873<br>
> >> TwoPunctures::par_m_plus = 0.453<br>
> >> TwoPunctures::par_m_minus = 0.453<br>
> >> TwoPunctures::par_P_plus [1] = +0.3331917498<br>
> >> TwoPunctures::par_P_minus[1] = -0.3331917498<br>
> >><br>
> >> #TwoPunctures::grid_setup_method = "evaluation"<br>
> >><br>
> >> TwoPunctures::TP_epsilon = 1.0e-2<br>
> >> TwoPunctures::TP_Tiny = 1.0e-2<br>
> >><br>
> >> TwoPunctures::keep_u_around = "yes"<br>
> >><br>
> >> CT_MultiLevel::cycle_type = "FMG cycle"<br>
> >> CT_MultiLevel::tol = 1e-12<br>
> >> CT_MultiLevel::omega = 1<br>
> >> CT_MultiLevel::fd_order = 4<br>
> >> CT_MultiLevel::output_norms = "yes"<br>
> >> CT_MultiLevel::output_walk = "yes"<br>
> >> CT_MultiLevel::nrelsteps_down = 700<br>
> >> CT_MultiLevel::nrelsteps_up = 650<br>
> >> CT_MultiLevel::nrelsteps_bottom = 700<br>
> >> CT_MultiLevel::nrelsteps_top = 650<br>
> >> CT_MultiLevel::topMGlevel = 4<br>
> >> CT_MultiLevel::number_of_equations = 1<br>
> >> CT_MultiLevel::number_of_auxiliaries = 1<br>
> >> CT_MultiLevel::fill_ADM = "yes"<br>
> >> CT_MultiLevel::fill_Aij = "Analytic Aij"<br>
> >> CT_MultiLevel::boundary_conditions = "TwoPunctures"<br>
> >><br>
> >> CT_MultiLevel::compare_to_exact = "yes"<br>
> >> CT_MultiLevel::exact_solution_gfname[0] = "TwoPunctures::puncture_u"<br>
> >> CT_MultiLevel::exact_offset = -1.0<br>
> >><br>
> >> CT_MultiLevel::inipsi_gfname[0] = "CT_Analytic::testinipsi"<br>
> >> CT_MultiLevel::cxx_gfname[0] = "CT_Analytic::testcxx"<br>
> >> CT_MultiLevel::cyy_gfname[0] = "CT_Analytic::testcyy"<br>
> >> CT_MultiLevel::czz_gfname[0] = "CT_Analytic::testczz"<br>
> >> CT_MultiLevel::n0[0] = -7<br>
> >> CT_MultiLevel::c0_gfname[0] = "CT_MultiLevel::ct_auxiliary[0]"<br>
> >> CT_MultiLevel::a0_gfname[0] = "CT_Analytic::testa0"<br>
> >><br>
> >> CT_MultiLevel::model = "Bowen-York"<br>
> >> CT_Analytic::free_data = "Bowen-York"<br>
> >> CT_Analytic::ampI = 1<br>
> >> CT_Analytic::ampC = 1<br>
> >> CT_Analytic::massa = 0.453<br>
> >> CT_Analytic::massb = 0.453<br>
> >> CT_Analytic::xa = 1.168642873<br>
> >> CT_Analytic::xb = -1.168642873<br>
> >> CT_Analytic::Pay = 0.3331917498<br>
> >> CT_Analytic::Pby = -0.3331917498<br>
> >><br>
> >> CT_Analytic::other_timelevels = 3<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "CarpetIOBasic"<br>
> >> #################################<br>
> >><br>
> >> IOBasic::outInfo_every = 1<br>
> >> IOBasic::outInfo_reductions = "norm2"<br>
> >> IOBasic::outInfo_vars = "<br>
> >> CT_MultiLevel::psi<br>
> >> Carpet::physical_time_per_hour<br>
> >> "<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "CarpetIOScalar"<br>
> >> #################################<br>
> >><br>
> >> IO::out_dir = $parfile<br>
> >><br>
> >> IOScalar::one_file_per_group = yes<br>
> >><br>
> >> IOScalar::outScalar_every = 0<br>
> >> IOScalar::outScalar_vars = "<br>
> >> "<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "CarpetIOASCII"<br>
> >> #################################<br>
> >><br>
> >> IOASCII::one_file_per_group = yes<br>
> >><br>
> >> IOASCII::output_symmetry_points = yes<br>
> >> IOASCII::out3D_ghosts = yes<br>
> >><br>
> >> IOASCII::out0D_criterion = "divisor"<br>
> >> IOASCII::out0D_every = 0<br>
> >> IOASCII::out0D_vars = "<br>
> >> "<br>
> >><br>
> >> IOASCII::output_all_timelevels = "no"<br>
> >> IOASCII::out1D_criterion = "divisor"<br>
> >> IOASCII::out1D_every = 1<br>
> >> IOASCII::out1D_vars = "<br>
> >> CT_MultiLevel::psi<br>
> >> CT_MultiLevel::residual<br>
> >> CT_MultiLevel::err<br>
> >> ADMBase::metric<br>
> >> ADMBase::curv<br>
> >> ML_BSSN::ML_log_confac<br>
> >> ML_BSSN::ML_ham<br>
> >> TwoPunctures::puncture_u<br>
> >> "<br>
> >><br>
> >> IOASCII::out2D_every = 0<br>
> >> IOASCII::out2D_criterion = "divisor"<br>
> >> IOASCII::out2D_vars = "<br>
> >> "<br>
> >><br>
> >> IOASCII::out3D_every = 0<br>
> >> IOASCII::out3D_criterion = "divisor"<br>
> >> IOASCII::out3D_vars = "<br>
> >> CT_MultiLevel::psi<br>
> >> CT_MultiLevel::coeffs<br>
> >> "<br>
> >><br>
> >> #################################<br>
> >> Activethorns = "CarpetIOHDF5"<br>
> >> #################################<br>
> >><br>
> >> IOHDF5::out_criterion = "divisor"<br>
> >> IOHDF5::out_every = 1<br>
> >> IOHDF5::one_file_per_group = yes<br>
> >> IOHDF5::compression_level = 0<br>
> >> IOHDF5::out_vars = "<br>
> >> CT_MultiLevel::psi<br>
> >> CT_MultiLevel::err<br>
> >> CT_MultiLevel::residual<br>
> >> ML_BSSN::ML_log_confac<br>
> >> ML_BSSN::ML_ham<br>
> >> TwoPunctures::puncture_u<br>
> >> "<br>
> >><br>
> >> IOHDF5::checkpoint = "no"<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "Formaline"<br>
> >> #################################<br>
> >><br>
> >> #################################<br>
> >> ActiveThorns = "TimerReport"<br>
> >> #################################<br>
> >><br>
> >> TimerReport::out_every = 512<br>
> >> TimerReport::out_filename = "TimerReport"<br>
> >><br>
> >> *My ouput shows -nan after first itration. *<br>
> >><br>
> >> 0 0.000 | 1.0013688 | 0.0000000<br>
> >> 2 0.250 | -nan | 1.128073e+03<br>
> >> 4 0.500 | -nan | 1.382569e+03<br>
> >> 6 0.750 | -nan | 1.318078e+03<br>
> >> 8 1.000 | -nan | 1.399377e+03<br>
> >> 10 1.250 | -nan | 1.336436e+03<br>
> >> 12 1.500 | -nan | 1.395822e+03<br>
> >> 14 1.750 | -nan | 1.364895e+03<br>
> >> 16 2.000 | -nan | 1.398991e+03<br>
> >> 18 2.250 | -nan | 1.359115e+03<br>
> >> 20 2.500 | -nan | 1.393235e+03<br>
> >> I set refinement levels, radius, topMG. no error found in running.<br>
> >><br>
> >> Kindly,<br>
> >><br>
> >> _______________________________________________<br>
> >> Users mailing list<br>
> >> <a href="mailto:Users@einsteintoolkit.org" target="_blank" rel="noreferrer">Users@einsteintoolkit.org</a><br>
> >> <a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
> >> <br>
> > <br>
<br>
<br>
-- <br>
My email is as private as my paper mail. I therefore support encrypting<br>
and signing email messages. Get my PGP key from <a href="http://pgp.mit.edu" rel="noreferrer noreferrer" target="_blank">http://pgp.mit.edu</a> .<br>
</blockquote></div>