<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">Hi everyone,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">I&#39;ve been playing around with grids under the assumption that there is no reflection symmetry and I seem to be hitting a problem when Carpet goes to regrid. The system evolves for ~ 80M quite happily but it hits a point where it attempts to regrid levels 1 and up causing all sorts of havoc, notably the measure of the Hamiltonian constraint blows up until the simulation gracefully terminates due to NaNs. </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">I&#39;ve attached a portion of the output for the simulation where it is initially evolving quite happily and then the simulation regrids (line 1560+) and becomes unstable (see 4th column of line 1689 for *STRAINTS::H  maximum, this eventually just goes off to ~ 10^{230} and dies). </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">I&#39;m presuming that when it tries to regrid levels 1 and up it&#39;s introducing some bad data along the way?</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">The other issue that I&#39;m not completely sure on is related to the warning being thrown up by QuasiLocalMeasures:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 3 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_transport.F90:123:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Did not manage to find an eigenvector with the eigenvalue 1</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">WARNING level 2 from host <a href="http://i23r01c06s07.sm.lrz.de">i23r01c06s07.sm.lrz.de</a> process 0</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  while executing schedule bin CCTK_ANALYSIS, routine QuasiLocalMeasures::qlm_calculate</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  in thorn QuasiLocalMeasures, file qlm_killing_normalisation.F90:96:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">  -&gt; Integration path starts out too steep </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">Can anyone help with this or has anyone seen similar issues before? Something is clearly not set up correctly but I can&#39;t see where my error is. If you need any other information, just let me know!</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">Thanks in advance! Any help is very much appreciated!</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">Geraint</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">------------------</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)">For reference, the various Carpet settings that I use are as follows:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;color:rgb(0,0,0)"><div class="gmail_default">#------</div><div class="gmail_default"># Grid:</div><div class="gmail_default">#------</div><div class="gmail_default"><br></div><div class="gmail_default">Time::dtfac                 = 0.25</div><div class="gmail_default">MoL::ODE_Method             = &quot;rk4&quot;</div><div class="gmail_default">MoL::MoL_Intermediate_Steps = 4</div><div class="gmail_default">MoL::MoL_Num_Scratch_Levels = 1</div><div class="gmail_default"><br></div><div class="gmail_default">#------------------------------</div><div class="gmail_default"># Carpet Coord. Grid 3D</div><div class="gmail_default">#------------------------------</div><div class="gmail_default">CartGrid3D::type            = &quot;coordbase&quot;</div><div class="gmail_default">CartGrid3D::domain          = &quot;full&quot;</div><div class="gmail_default">CartGrid3D::avoid_origin    = &quot;no&quot;</div><div class="gmail_default"><br></div><div class="gmail_default">#------------------------------</div><div class="gmail_default"># Carpet Coord. Base</div><div class="gmail_default">#------------------------------</div><div class="gmail_default">CoordBase::domainsize       = &quot;minmax&quot;</div><div class="gmail_default">CoordBase::spacing          = &quot;gridspacing&quot;  # &quot;gridspacing&quot; or &quot;numcells&quot;</div><div class="gmail_default"><br></div><div class="gmail_default">CoordBase::xmin = -614.40</div><div class="gmail_default">CoordBase::ymin = -614.40</div><div class="gmail_default">CoordBase::zmin = -614.40</div><div class="gmail_default">CoordBase::xmax =  614.40</div><div class="gmail_default">CoordBase::ymax =  614.40</div><div class="gmail_default">CoordBase::zmax =  614.40</div><div class="gmail_default">CoordBase::dx   =   15.36  # dx or ncells_x, nx = 80</div><div class="gmail_default">CoordBase::dy   =   15.36  # dy or ncells_y, nx = 80 </div><div class="gmail_default">CoordBase::dz   =   15.36  # dz or ncells_z, nx = 80</div><div class="gmail_default"><br></div><div class="gmail_default">CoordBase::boundary_size_x_lower        = 5</div><div class="gmail_default">CoordBase::boundary_size_y_lower        = 5</div><div class="gmail_default">CoordBase::boundary_size_z_lower        = 5</div><div class="gmail_default">CoordBase::boundary_size_x_upper        = 5</div><div class="gmail_default">CoordBase::boundary_size_y_upper        = 5</div><div class="gmail_default">CoordBase::boundary_size_z_upper        = 5</div><div class="gmail_default">CoordBase::boundary_shiftout_x_lower    = 0</div><div class="gmail_default">CoordBase::boundary_shiftout_y_lower    = 0</div><div class="gmail_default">CoordBase::boundary_shiftout_z_lower    = 0</div><div class="gmail_default">CoordBase::boundary_shiftout_x_upper    = 0</div><div class="gmail_default">CoordBase::boundary_shiftout_y_upper    = 0</div><div class="gmail_default">CoordBase::boundary_shiftout_z_upper    = 0</div><div class="gmail_default"><br></div><div class="gmail_default">#------------------------------</div><div class="gmail_default"># Driver: Ghost Size</div><div class="gmail_default">#------------------------------</div><div class="gmail_default">Driver::ghost_size                      = 5</div><div class="gmail_default"><br></div><div class="gmail_default">#------------------------------</div><div class="gmail_default"># Specify Reflection Symmetries</div><div class="gmail_default">#------------------------------</div><div class="gmail_default">ReflectionSymmetry::reflection_x   = &quot;no&quot;</div><div class="gmail_default">ReflectionSymmetry::reflection_y   = &quot;no&quot;</div><div class="gmail_default">ReflectionSymmetry::reflection_z   = &quot;no&quot;</div><div class="gmail_default">ReflectionSymmetry::avoid_origin_x = &quot;no&quot;</div><div class="gmail_default">ReflectionSymmetry::avoid_origin_y = &quot;no&quot;</div><div class="gmail_default">ReflectionSymmetry::avoid_origin_z = &quot;no&quot;</div><div class="gmail_default"><br></div><div class="gmail_default"><br></div><div class="gmail_default">#------------------------------</div><div class="gmail_default"># General Carpet Parameters</div><div class="gmail_default">#------------------------------</div><div class="gmail_default">Carpet::domain_from_coordbase    = &quot;yes&quot;</div><div class="gmail_default">Carpet::enable_all_storage             = &quot;no&quot;</div><div class="gmail_default">Carpet::use_buffer_zones               = &quot;yes&quot;</div><div class="gmail_default">Carpet::schedule_barriers              = &quot;no&quot;</div><div class="gmail_default"><br></div><div class="gmail_default">Carpet::poison_new_timelevels    = &quot;yes&quot;</div><div class="gmail_default">Carpet::check_for_poison             = &quot;no&quot;</div><div class="gmail_default">#Carpet::poison_value                  = 113 # git version only!</div><div class="gmail_default"><br></div><div class="gmail_default">Carpet::init_3_timelevels        = &quot;no&quot;</div><div class="gmail_default">Carpet::init_fill_timelevels       = &quot;yes&quot;</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetLib::poison_new_memory            = &quot;yes&quot;</div><div class="gmail_default">CarpetLib::poison_value                         = 114</div><div class="gmail_default">CarpetLib::check_bboxes                       = &quot;no&quot;</div><div class="gmail_default">CarpetLib::interleave_communications  = &quot;yes&quot;</div><div class="gmail_default">#CarpetLib::vary_tags                             = &quot;yes&quot; # git version only!</div><div class="gmail_default">CarpetLib::combine_sends                     = &quot;yes&quot;</div><div class="gmail_default">#CarpetLib::reduce_mpi_waitall             = &quot;yes&quot; # git version only!</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetInterp::tree_search            = &quot;yes&quot;</div><div class="gmail_default">CarpetInterp::check_tree_search = &quot;no&quot;</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetRegrid2::freeze_unaligned_levels  = &quot;yes&quot;</div><div class="gmail_default">#CarpetRegrid2::snap_to_coarse             = &quot;yes&quot;</div><div class="gmail_default">CarpetRegrid2::symmetry_rotating180     = &quot;no&quot;</div><div class="gmail_default">CarpetRegrid2::min_fraction                     = 1</div><div class="gmail_default"><br></div><div class="gmail_default"># System specific Carpet parameters</div><div class="gmail_default">Carpet::time_refinement_factors  = &quot;[1, 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024]&quot; # Should check this...?</div><div class="gmail_default">Carpet::max_refinement_levels     = 12</div><div class="gmail_default">Carpet::prolongation_order_space  = 5</div><div class="gmail_default">Carpet::prolongation_order_time   = 2</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetRegrid2::regrid_every = 64</div><div class="gmail_default">CarpetRegrid2::num_centres  = 2</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetRegrid2::num_levels_1 = 12</div><div class="gmail_default">CarpetRegrid2::position_x_1 = 2.00393</div><div class="gmail_default">CarpetRegrid2::radius_1[ 1]         = 307.2 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 2]         = 230.4 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 3]         = 153.6 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 4]         = 105.6 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 5]         =  38.4 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 6]         =  14.4 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 7]         =   4.8 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 8]         =   2.4 </div><div class="gmail_default">CarpetRegrid2::radius_1[ 9]         =   1.2 </div><div class="gmail_default">CarpetRegrid2::radius_1[10]         =   0.6</div><div class="gmail_default">CarpetRegrid2::radius_1[11]         =   0.3 </div><div class="gmail_default">CarpetRegrid2::movement_threshold_1 =   0.075</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetRegrid2::num_levels_2 = 12</div><div class="gmail_default">CarpetRegrid2::position_x_2 = -6.01178</div><div class="gmail_default">CarpetRegrid2::radius_2[ 1]         = 307.2 </div><div class="gmail_default">CarpetRegrid2::radius_2[ 2]         = 230.4</div><div class="gmail_default">CarpetRegrid2::radius_2[ 3]         = 153.6</div><div class="gmail_default">CarpetRegrid2::radius_2[ 4]         = 105.6</div><div class="gmail_default">CarpetRegrid2::radius_2[ 5]         =  38.4</div><div class="gmail_default">CarpetRegrid2::radius_2[ 6]         =  14.4</div><div class="gmail_default">CarpetRegrid2::radius_2[ 7]         =   4.8</div><div class="gmail_default">CarpetRegrid2::radius_2[ 8]         =   2.4</div><div class="gmail_default">CarpetRegrid2::radius_2[ 9]         =   1.2</div><div class="gmail_default">CarpetRegrid2::radius_2[10]         =   0.6</div><div class="gmail_default">CarpetRegrid2::radius_2[11]         =   0.3</div><div class="gmail_default">CarpetRegrid2::movement_threshold_2 =   0.075</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetMask::excluded_surface       [0] = 0</div><div class="gmail_default">CarpetMask::excluded_surface_factor[0] = 1.0</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetMask::excluded_surface       [1] = 1</div><div class="gmail_default">CarpetMask::excluded_surface_factor[1] = 1.0</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetMask::excluded_surface       [2] = 2</div><div class="gmail_default">CarpetMask::excluded_surface_factor[2] = 1.0</div><div class="gmail_default"><br></div><div class="gmail_default">CarpetTracker::surface[0] = 0</div><div class="gmail_default">CarpetTracker::surface[1] = 1</div></div><div><br></div>-- <br><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><span style="background-color:rgb(255,255,255)"><font color="#444444">Geraint Pratten</font></span></div><div dir="ltr"><span style="background-color:rgb(255,255,255)"><font color="#444444">Postdoctoral Research Associate<br><br>Mobile: <a href="tel:%2B44%280%29%207581709282" value="+447581709282" target="_blank">+44(0) 7581709282</a><br>E-mail: <a href="mailto:G.Pratten@sussex.ac.uk" target="_blank">G.Pratten@sussex.ac.uk</a><br>Skype: geraint.pratten<br><br>School of Mathematical and Physical Sciences<br>Pevensey 3 Building<br>University of Sussex<br>Falmer Campus<br>Brighton</font></span><div><span style="background-color:rgb(255,255,255)"><font color="#444444">BN1 9QH<br>United Kingdom</font></span><br></div></div></div></div></div></div></div>
</div>