<div dir="ltr">Vassilios<div><br></div><div>You cannot synchronize in local mode. Different processes may execute local-mode functions different number of times, which would lead to a deadlock. For example, if process 0 holds 1 large component, while process 1 holds 2 smaller components, then process 0 would synchronize once, while process 1 would synchronize twice. Since synchronization is a global operation for which all processes need to participate, this would fail.</div><div><br></div><div>Also -- what should it mean for a process to synchronize in this case? Synchronization fills ghost points with valid data from other components. If a process holds 2 components, and you synchronize after calculating the first component, then it is not possible to obtain valid data for points from the second component, since this component has not been calculated yet.</div><div><br></div><div>Synchronization in local mode works in certain very restricted cases to ensure backward compatibility with PUGH. I believe it works if each process holds exactly 1 component.</div><div><br></div><div>-erik</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Feb 20, 2018 at 5:22 PM, Vassilios Mewes <span dir="ltr"><<a href="mailto:vxmsma@rit.edu" target="_blank">vxmsma@rit.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello all,<div><br></div><div>I am getting the following warnings on BlueWaters when running the ET in a unigrid run and calling </div><div>"CCTK_SyncGroup" from within a function that is scheduled as local:</div><div><br></div><div>^[[1mWARNING[L2,P0] (Carpet):^[[0m Synchronising group "ADMBASE::METRIC" in local mode<br></div><div><br></div><div>and so on for every group that is synced in these local functions.</div><div><br></div><div>I haven't seen this warning on bluesky (local RIT cluster) or my MacBook. </div><div><br></div><div>Is it disallowed to sync in local mode? </div><div><br></div><div>Best wishes,</div><div><br></div><div>Vassili</div><div><br></div><div><br></div><div>
<br></div></div>
<br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@einsteintoolkit.org">Users@einsteintoolkit.org</a><br>
<a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.<wbr>org/mailman/listinfo/users</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br><a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a></div><div><br></div></div></div>
</div>