Hal<div><br></div><div>You should be able to apply boundary conditions (i.e. synchronised, apply symmetry conditions) in your code. You will also need to use sufficiently many processes to ensure that periodicity is applied correctly; this circumvents the bug/missing feature in the Periodic boundary conditions.</div>
<div><br></div><div>-erik<br><br><div class="gmail_quote">On Thu, Dec 15, 2011 at 3:14 PM, Hal Finkel <span dir="ltr"><<a href="mailto:hfinkel@anl.gov">hfinkel@anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On Thu, 2011-12-15 at 11:17 -0500, Erik Schnetter wrote:<br>
> Eloisa<br>
><br>
><br>
> Thanks for digging into this.<br>
><br>
><br>
> I didn't think of syncing, but yes, syncing would be necessary, and so<br>
> would be setting all boundaries. In your case, this would be applying<br>
> periodic boundary conditions only (and not setting anything to zero<br>
> since you don't have an outer boundary). Of course, you need to use<br>
> sufficiently many processes for this because of the bug in thorn<br>
> Periodic.<br>
<br>
</div>Erik, Eloisa, et al.,<br>
<br>
Thank you very much for looking at this. Just so that I'm clear, is<br>
there a way that I can get this to work now, or am I waiting on another<br>
bug fix?<br>
<span class="HOEnZb"><font color="#888888"><br>
-Hal<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
><br>
><br>
> -erik<br>
><br>
> On Thu, Dec 15, 2011 at 9:39 AM, Eloisa Bentivegna<br>
> <<a href="mailto:bentivegna@cct.lsu.edu">bentivegna@cct.lsu.edu</a>> wrote:<br>
> On Dec 15, 2011, at 5:58 AM, Hal Finkel wrote:<br>
><br>
> > On Wed, 2011-12-14 at 19:48 -0500, Erik Schnetter wrote:<br>
> >> On Wed, Dec 14, 2011 at 6:53 PM, Hal Finkel<br>
> <<a href="mailto:hfinkel@anl.gov">hfinkel@anl.gov</a>> wrote:<br>
> >> On Wed, 2011-12-14 at 18:27 -0500, Erik Schnetter<br>
> wrote:<br>
> >>> You are not setting any values on the boundary. Is that<br>
> >> intentional?<br>
> >><br>
> >><br>
> >> Currently, this is because I am using neighboring<br>
> values in<br>
> >> the<br>
> >> calculation, so I can't do that on the boundary.<br>
> Should I do<br>
> >> that some<br>
> >> other way?<br>
> >><br>
> >><br>
> >> Setting the boundary to zero should be good enough. (The<br>
> boundary<br>
> >> values should not be used -- but I don't recall whether<br>
> this is the<br>
> >> case.)<br>
> ><br>
> > Maybe this is another problem with the periodic boundary<br>
> conditions?<br>
> > The problem seems to appear in other fields too. I've<br>
> attached some<br>
> > images from my test problem. One shows the field<br>
> configuration (this one<br>
> > looks like a ring -- it is a slice through a bubble). The<br>
> second one<br>
> > shows the T_00 computed from that. As you can see, the<br>
> values near the<br>
> > extremal indicies are wrong. At the next (half) time step,<br>
> looking at<br>
> > the field data from level 1, the same phenomonon can be seen<br>
> in the<br>
> > level 1 boxes.<br>
> ><br>
> > These were all done in Kranc, so I did not do any real<br>
> coding myself ;)<br>
> ><br>
> > What do you think?<br>
><br>
><br>
> Hi all!<br>
><br>
> I believe that what Hal is doing with the allocation of<br>
> level_mask is correct; what seems to be problematic is setting<br>
> its value.<br>
><br>
> The problem is that this function cannot be calculated<br>
> pointwise, and the way it's currently set leaves some parts of<br>
> the grid uninitialized, which then leads to poison and<br>
> ultimately to all sorts of weird behavior including nans at<br>
> the boundaries, lack of regridding when expected, and so on. I<br>
> wouldn't pay too much attention to all these symptoms<br>
> (although it would be nice of course for the AMR logic to<br>
> detect that the mask is nan and issue an error message). The<br>
> origin is in the incomplete initialization of the mask.<br>
><br>
> To convince myself of this, I switched poisoning off, and<br>
> observed no odd behavior. I then switched it back on and ran a<br>
> number of grid configurations where the mask was set pointwise<br>
> (say, to coincide with one of the evolution variables), and<br>
> again I had no trouble. As for the actual mask (based on the<br>
> derivative of a grid function), I played a long time with<br>
> scheduling the filling of interior points and boundaries, but<br>
> always observed the issue that Hal is reporting. Ideally, I'd<br>
> think that filling the interior, syncing, and finally applying<br>
> outer/symmetry boundary conditions would work, but that<br>
> doesn't seem to be the case.<br>
><br>
> Erik: when you suggest to set the boundary explicitly, do you<br>
> mean the outer boundary? Since in this case we only have a<br>
> symmetry boundary (periodic), do you mean we should populate<br>
> that part of the grid independently of the symmetry thorn?<br>
><br>
> Thanks,<br>
> Eloisa<br>
><br>
><br>
><br>
><br>
> --<br>
> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu">schnetter@cct.lsu.edu</a>><br>
> <a href="http://www.cct.lsu.edu/~eschnett/" target="_blank">http://www.cct.lsu.edu/~eschnett/</a><br>
><br>
><br>
<br>
</div></div><div class="HOEnZb"><div class="h5">--<br>
Hal Finkel<br>
Postdoctoral Appointee<br>
Leadership Computing Facility<br>
Argonne National Laboratory<br>
<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>> <a href="http://www.cct.lsu.edu/~eschnett/" target="_blank">http://www.cct.lsu.edu/~eschnett/</a><br>
<br>
</div>