<html><head></head><body style="color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div><div>Hi all.</div><div><br></div><div>At Erik's suggestion (off-list), I resolved some checkpoint recovery issues by moving from "Curie" to the new ETK release. However, my old grid specifications seem no longer to work.</div><div><br></div><div>The parameters are for a 2:1 mass-ratio BHB evolution. I've used three "centres" -- one each for the punctures, and one centred at the origin. Below is what I used to have in CarpetRegrid2, which worked with the last "Curie" release of ETK (the full grid is [-2048,2048] in size). </div><div><br></div><div>-------------------------------------------------------------------</div><div><div># Parameters of thorn CarpetRegrid2 (implementing CarpetRegrid2)</div><div>CarpetRegrid2::freeze_unaligned_levels = "yes"</div><div>CarpetRegrid2::num_centres = 3</div><div><br></div><div><div><div>CarpetRegrid2::num_levels_1 = 12</div></div><div><div>CarpetRegrid2::position_x_1 = -3.3333333333333333333</div></div><div>CarpetRegrid2::movement_threshold_1 = 0.10</div></div><div>CarpetRegrid2::radius_1[5] = 40</div><div>CarpetRegrid2::radius_1[6] = 20</div><div>CarpetRegrid2::radius_1[7] = 10</div><div>CarpetRegrid2::radius_1[8] = 5</div><div>CarpetRegrid2::radius_1[9] = 2.5</div><div>CarpetRegrid2::radius_1[10] = 1.25</div><div>CarpetRegrid2::radius_1[11] = 0.625</div><div><div><br></div><div>CarpetRegrid2::num_levels_2 = 13</div><div>CarpetRegrid2::position_x_2 = 6.6666666666666666667</div></div><div>CarpetRegrid2::movement_threshold_2 = 0.05</div><div>CarpetRegrid2::radius_2[5] = 40</div><div>CarpetRegrid2::radius_2[6] = 20</div><div>CarpetRegrid2::radius_2[7] = 10</div><div>CarpetRegrid2::radius_2[8] = 5</div><div>CarpetRegrid2::radius_2[9] = 2.5</div><div>CarpetRegrid2::radius_2[10] = 1.25</div><div>CarpetRegrid2::radius_2[11] = 0.625</div><div>CarpetRegrid2::radius_2[12] = 0.3125</div><div><br></div><div>CarpetRegrid2::num_levels_3 = 6</div><div>CarpetRegrid2::radius_3[1] = 1024</div><div>CarpetRegrid2::radius_3[2] = 512</div><div>CarpetRegrid2::radius_3[3] = 256</div><div>CarpetRegrid2::radius_3[4] = 160</div><div>CarpetRegrid2::radius_3[5] = 96</div><div>CarpetRegrid2::regrid_every = 60</div><div>CarpetRegrid2::verbose = "yes"</div></div><div>-------------------------------------------------------------------</div><div><br></div><div>This doesn't work now, however. Current ETK complains that some entries in radius_1 and radius_2 are unspecified, and it sets them to zero with catastrophic results.</div><div><br></div><div>To resolve this, I am now explicitly setting the missing levels:</div><div><br></div><div><div>CarpetRegrid2::radius_1[1] = 1024</div><div>CarpetRegrid2::radius_1[2] = 512</div><div>CarpetRegrid2::radius_1[3] = 256</div><div>CarpetRegrid2::radius_1[4] = 160</div></div><div><br></div><div><div>CarpetRegrid2::radius_2[1] = 1024</div><div>CarpetRegrid2::radius_2[2] = 512</div><div>CarpetRegrid2::radius_2[3] = 256</div><div>CarpetRegrid2::radius_2[4] = 160</div></div><div><br></div><div>This runs, but complains every time step about mismatched "simulated domain volume" and "reduction weight sum":</div><div><br></div><div>----------------------------------------------------------------------------------</div><div><div>INFO (CarpetReduce): Simulation domain volume: 442368</div><div>INFO (CarpetReduce): Reduction weight sum: 442367.999999072</div><div>WARNING level 1 in thorn CarpetReduce processor 0 host r186i2n12.p4.nas.nasa.gov</div><div> (line 120 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetReduce/mask_test.c):</div><div> -> Simulation domain volume and reduction weight sum differ</div></div><div>----------------------------------------------------------------------------------</div><div><br></div><div>After a short evolution time (7.25 M, or more than 1700 time steps), the run crashes. First there are several messages of the form:</div><div><br></div><div>----------------------------------------------------------------------------------</div><div><div>INFO (CarpetReduce): Simulation domain volume: 442368</div><div>INFO (CarpetReduce): Reduction weight sum: 442367.999991311</div><div>INFO (CarpetRegrid2): Centre 1 is at position [-3.29831,-0.331478,7.81462e-15] with 12 levels</div><div>INFO (CarpetRegrid2): Centre 2 is at position [6.58787,0.867484,8.98107e-15] with 13 levels</div><div>INFO (CarpetRegrid2): Centre 3 is not active</div><div>INFO (CarpetRegrid2): Regridding</div><div>INFO (CarpetRegrid2): Regridding levels 10 and up</div><div>WARNING level 1 in thorn CarpetLib processor 58 host r186i3n7.p4.nas.nasa.gov</div><div> (line 182 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc):</div><div>[...]</div><div> -></div><div>/home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc:948:</div><div> [ml=0 rl=10 c=59] The following grid structure consistency check failed:</div><div> Synchronisation and boundary prolongation: All points must have been received</div><div> needrecv.empty()</div></div><div>[...]</div><div>WARNING level 0 in thorn CarpetLib processor 94 host r186i3n12.p4.nas.nasa.gov</div><div>12676 (line 1973 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc):</div><div>12677 -> The grid structure is inconsistent. It is impossible to continue.</div><div>--------------------------------------</div><div><br></div><div>I'm attaching my current parameter file in full. I'm reluctant to post the entire STDOUT/STDERR, since it's around a MB in size.</div><div><br></div><div>Any ideas would be appreciated. I would turn to the copious documentation on CarpetRegrid2, but as noted before, there is none.</div><div><br></div><div>Thanks, Bernard</div><div><br></div><div><div><div><div>----------------------------------------------------------------------------- </div><div>Bernard Kelly -- CRESST Research Associate, NASA/GSFC</div><div> </div><div>Phone: +1 (301) 286-7243</div><div>E-Mail: <a href="mailto:bernard.j.kelly@nasa.gov">bernard.j.kelly@nasa.gov</a></div><div>Web: <a href="http://science.gsfc.nasa.gov/sed/index.cfm?fuseAction=people.jumpBio&iphonebookid=13052">http://science.gsfc.nasa.gov/sed/index.cfm?fuseAction=people.jumpBio&iphonebookid=13052</a></div><div>-----------------------------------------------------------------------------</div></div><div><br></div></div></div></div></div></body></html>