<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On 16 Jun 2010, at 04:34, Erik Schnetter wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>On Jun 14, 2010, at 11:07 , Ian Hinder wrote:<br><br><blockquote type="cite">Hi all,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I have written some test cases for the McLachlan evolution code.<br></blockquote><br>Yay! Thanks!<br><font class="Apple-style-span" color="#006312"><font class="Apple-style-span" color="#144FAE"><br></font></font><blockquote type="cite">For the exact solution I only output 3D of the admbase gxx and kxx variables. If this is considered too large, we can omit the 3D HDF5 output for now, as it is not used in the current Cactus testsuite mechanism.<br></blockquote><br>I would omit them. I did include a lot of test result output in IsolatedHorizon, and I received many complaints from people about the time it takes to download the thorn, and the disk space it uses. I don't really agree with these sentiments, but I now think that extensive output should be stored somewhere else -- maybe in a special repository that one checks out only when test cases fail.<br></div></blockquote><div><br></div><div>I agree - I also don't like to have to download a large amount of testsuite data, or have it taking up home directory quota space. If we have 200 thorns, and each of them are using 10 MB for testsuites, that is 2 GB per source tree.</div><div><br></div><div>I have modified the tests to output only 1D ASCII data in the x, y and z directions. This should be enough to catch regressions, since all the points on the grid will couple to each other in a single crossing time. The ML_BSSN_Test thorn is now 1.4 MB uncompressed (125 KB compressed)</div><div><br></div><blockquote type="cite"><div><blockquote type="cite">I have put the test suites in the existing ML_BSSN_Helper thorn, as this seemed the easiest solution, since ML_BSSN is automatically generated.<br></blockquote><br>Actually, the ML_BSSN_Helper thorns are also generated automatically since they are all very similar. Their source is in the "prototype" subdirectory. This process would overwrite your test cases. You could introduce a new thorn, e.g. ML_BSSN_Test.<br></div></blockquote><div><br></div><div>I have done this now.</div><div><br></div><blockquote type="cite"><div><blockquote type="cite">The test does not test the shift terms. For that I would use the shifted gauge wave solution, but as far as I know the harmonic shift gauge condition is not implemented in McLachlan.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The tests are run on 2 processes as CarpetIOASCII output is used, so the output depends on the number of processes. If output on 1 process is better, let me know.<br></blockquote><br>I prefer output on 2 processors.<br></div></blockquote><div><br></div><div>Good.</div><br><blockquote type="cite"><div><blockquote type="cite">In principle, the number of OpenMP threads should not matter in this case. However, the tests seem to fail if I use OMP_NUM_THREADS=2 (or leave it unset on my dual-core laptop, which makes it use 2). The failure is:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Issuing mpirun -np 2 /Users/ian/Cactus/llama/exe/cactus_mcl /Users/ian/Cactus/llama/arrangements/McLachlan/ML_BSSN_Helper/test/gw3d_Exact_ord4_15.par<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"> alp.norm1.asc: differences below tolerance on 1 lines<br></blockquote><blockquote type="cite"> alp.norm2.asc: differences below tolerance on 1 lines<br></blockquote><blockquote type="cite"> alp.sum.asc: substantial differences<br></blockquote><blockquote type="cite"> significant differences on 1 (out of 2) lines<br></blockquote><blockquote type="cite"> maximum absolute difference in column 3 is 1.00044417195022e-11<br></blockquote><blockquote type="cite"> maximum relative difference in column 3 is 2.96613722781153e-15<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Failure: 12 files compared, 3 differ, 1 differ significantly<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Files which differ strongly:<br></blockquote><blockquote type="cite"> [1] alp.sum.asc<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I don't know why this fails.<br></blockquote><br><br>With N grid points, the absolute error in the sum reduction is N times larger than the absolute error in the average reduction. I usually disable this reduction operation (and some others) in test cases.<br></div></blockquote><div><br></div><div>I have removed output for the reduction, but I now get differences above tolerance in the Hamiltonian constraint:</div><div><br></div><div><div> H.x.asc: substantial differences</div><div> significant differences on 6 (out of 46) lines</div><div> maximum absolute difference in column 13 is 3.46657468355827e-12</div><div> maximum relative difference in column 13 is 9.69181535413736e-11</div><div> (insignificant differences on 9 lines)</div><div> H.y.asc: substantial differences</div><div> significant differences on 7 (out of 46) lines</div><div> maximum absolute difference in column 13 is 2.2119042708546e-12</div><div> maximum relative difference in column 13 is 4.60112943759897e-11</div><div> (insignificant differences on 8 lines)</div><div> H.z.asc: substantial differences</div><div> significant differences on 14 (out of 60) lines</div><div> maximum absolute difference in column 13 is 3.00423574906006e-12</div><div> maximum relative difference in column 13 is 6.2493109449911e-11</div><div> (insignificant differences on 7 lines)</div><div><br></div><div>The evolved variables show differences below tolerance.</div><div><br></div><div>I attach the patch which contains the testsuites. I am inclined to commit it, and warn people to use OMP_NUM_THREADS=1 when running it. At least this gives us a direct working regression test for McLachlan. But we should understand why the Hamiltonian constraint is giving these differences.</div><div><br></div><div>If we want to include this test in the release, we will need to modify the einsteintoolkit.th thornlist to include the new thorn. The test runs only on 2 processes, as specified in the test.ccl file, due to the CarpetIOASCII output being dependent on the process decomposition. I have run the test successfully on my laptop and on damiana, but not on anything more exotic.</div></div></div><br><div apple-content-edited="true"> <span class="Apple-style-span" style="font-size: 12px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>-- </div><div>Ian Hinder</div><div><a href="mailto:ian.hinder@aei.mpg.de">ian.hinder@aei.mpg.de</a></div></div></span></div></span></div></span> </div></body></html>