<html>#2892: SpacetimeX: GPU error in PunctureTracker::PunctureContainer::interpolate
<table style='border-spacing: 1ex 0pt; '>
<tr><td style='text-align:right'> Reporter:</td><td>Miren Radia</td></tr>
<tr><td style='text-align:right'> Status:</td><td>submitted</td></tr>
<tr><td style='text-align:right'>Milestone:</td><td></td></tr>
<tr><td style='text-align:right'> Version:</td><td>development version</td></tr>
<tr><td style='text-align:right'> Type:</td><td>bug</td></tr>
<tr><td style='text-align:right'> Priority:</td><td>major</td></tr>
<tr><td style='text-align:right'>Component:</td><td>CarpetX</td></tr>
</table>
<p>This issue is related to <a href="https://bitbucket.org/einsteintoolkit/tickets/issues/2890/carpetx-crash-failed-assertion-in-z4c_rhs" rel="nofollow" title="CarpetX: crash/failed assertion in Z4c_RHS" class="ap-connect-link">#2890</a> but I’ve now tried running almost the same parameter file again but with the main versions of CarpetX/SpacetimeX.</p>
<p>I am trying to run a BH binary simulation with CarpetX on <a data-is-external-link="true" href="https://epcced.github.io/dirac-docs/tursa-user-guide/hardware/" rel="nofollow">tursa</a> (Nvidia A100 GPUs) but I seem to be running into issues when the <code>PunctureTracker</code> thorn is enabled.</p>
<p>Please find attached the following:</p>
<ul>
<li>My thornlist: <code>spacetimex.th</code></li>
<li>
<p>My parameter file: <code>test-bbh.par</code> (small grid configuration to make it easier to reproduce the issue). This is more or less the same as the one in <a href="https://bitbucket.org/einsteintoolkit/tickets/issues/2890/carpetx-crash-failed-assertion-in-z4c_rhs" rel="nofollow" title="CarpetX: crash/failed assertion in Z4c_RHS" class="ap-connect-link">#2890</a> but with the following changes:</p>
<ul>
<li>
<p><code>CarpetX::poison_undefined_values = no</code> I had to disable this as when I had it set to yes, I got the following error (although it looks likely related): </p>
<p><code>ERROR from host tu-c0r0n87 process 0
in thorn CarpetX, file /mnt/lustre/tursafs1/home/dp415/dp415/dc-radi1/ETK/Cactus-CarpetX-main/arrangements/CarpetX/CarpetX/src/valid.cxx:552:
-> CallFunction iteration 0 PunctureTracker_SetupGroup: PunctureTracker::PunctureTracker_Setup checking output: Grid array "BOXINBOX::position_x[2]" has 1 nans on time level 0; expected valid
The interior is valid because: CallFunction iteration 0 PunctureTracker_SetupGroup: PunctureTracker::PunctureTracker_Setup: Mark output variables as valid.
The outer boundary is valid because: CallFunction iteration 0 PunctureTracker_SetupGroup: PunctureTracker::PunctureTracker_Setup: Mark output variab
<p><table><tr><td>attachment:</td><td><a href="https://api.bitbucket.org/2.0/repositories/einsteintoolkit/tickets/issues/2892/attachments/test-bbh.par">test-bbh.par</a></td></tr>
<tr><td>attachment:</td><td><a href="https://api.bitbucket.org/2.0/repositories/einsteintoolkit/tickets/issues/2892/attachments/tursa.cfg">tursa.cfg</a></td></tr>
<tr><td>attachment:</td><td><a href="https://api.bitbucket.org/2.0/repositories/einsteintoolkit/tickets/issues/2892/attachments/spacetimex.th">spacetimex.th</a></td></tr>
<tr><td>attachment:</td><td><a href="https://api.bitbucket.org/2.0/repositories/einsteintoolkit/tickets/issues/2892/attachments/test-bbh-debug.out">test-bbh-debug.out</a></td></tr>
</table></p>
<p>--<br/>
Ticket URL: <a href='https://bitbucket.org/einsteintoolkit/tickets/issues/2892/spacetimex-gpu-error-in-puncturetracker'>https://bitbucket.org/einsteintoolkit/tickets/issues/2892/spacetimex-gpu-error-in-puncturetracker</a></p>
</html>