[Einstein Toolkit] #490: McLachlan test case failing due to ADMBase variable differences

List overview All Threads
Download

newer

older

[Einstein Toolkit] #516: Enable...

[Einstein Toolkit] #438: Allow a...

Einstein Toolkit

10 Aug 2011 10 Aug '11

4:32 p.m.

#490: McLachlan test case failing due to ADMBase variable differences -----------------------------------+---------------------------------------- Reporter: hinder | Owner: Type: defect | Status: new Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Keywords: McLachlan | -----------------------------------+---------------------------------------- The McLachlan test ML_BSSN_sgw3d has been failing since 03-Aug-2011. The only tested variable which is showing differences is kxx, but the differences appear to be significantly larger than roundoff:

kxx.x.asc: substantial differences significant differences on 16 (out of 36) lines maximum absolute difference in column 13 is 0.000822901437894541 maximum relative difference in column 13 is 0.0560528644051835 (insignificant differences on 16 lines)

This coincides with the following commit:

commit 3ba8a55ae2578cb6dc06f0ec8b81f86b3a2654ac Author: Erik Schnetter schnetter@cct.lsu.edu Date: Tue Aug 2 20:37:19 2011 -0400

Correct schedule, in particular for checkpoint/recovery

Do not mark ADMBase variables for non-checkpointing if they have multiple timelevels. (Variables with multiple timelevels must always be checkpointed, because the past timelevels cannot be regenerated after recovery.)

Finally remove all perl post-processing of the auto-generated code; instead, use proper Kranc mechanisms.

Schedule the ADM constraints and ADM quantities after MoL_PostStep, since this is where the ADMBase variables are set.

Schedule enforcing the BSSN constraints in the new schedule group MoL_PostStepModify, since they should not be enforced after recovery. (This would lead to inconsistencies at floating-point round-off level.)

Regenerate all thorns.

and the other commits made to Cactus at the same time as explained in this email:

http://cactuscode.org/pipermail/users/2011-July/002872.html

Attached is a diff which shows what changed between the test passing and failing.

Since this test does not deal with checkpointing or recovery, I don't understand why kxx should change so drastically.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Show replies by date

Einstein Toolkit

10 Aug 10 Aug

4:45 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: assigned Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+--------------------------------------- Changes (by hinder):

* owner: => eschnett * status: new => assigned

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:1 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

12 Aug 12 Aug

2:23 p.m.

Comment (by barry.wardell):

The specific change which causes this is the scheduling of ML_BSSN_enforce. This was previously scheduled "IN MoL_PostStep AFTER ML_BSSN_SelectBoundConds" whereas now it is scheduled "IN MoL_PostStepModify". When I roll back this change the testsuites pass with zero differences.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:2 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

2:47 p.m.

Comment (by eschnett):

Thanks. Yes, MoL_PostStepModify must be scheduled BEFORE MoL_Poststep. A few other routines scheduled before MoL_PostStep must then be scheduled to be before MoL_PostStepModify as well. I'm working on this...

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:3 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

13 Aug 13 Aug

5:56 p.m.

Comment (by eschnett):

The attached patch should remedy this.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:4 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

5:56 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+--------------------------------------- Changes (by eschnett):

* status: assigned => review

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:5 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

6:56 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+---------------------------------------

Comment (by rhaas):

The proposed patch (again :-) ) removes boundary and SetTmunu calls from after AtmosphereReset in GRHydro. Since AtmosphereReset depends (in part) on values in spacemask which were set only in the interior (in GRHydro_UpdateMask.F90 line 84, they depend on RHS values in GRHydroRHS), it can only reset points to atmosphere in the interior as well (though it is quite possible that it actually loops over everything).

While I do agree with everyone else that these calls are annoying, violate all kinds of conventions, abuse MoL and can possibly impact performance (since they involve communication), I believe they are still necessary (unless one determines that no "Hydro_Atmosphere/atmosphere" bits are set in any of the regions affected by SYNC and boundaries on any of the processors.

Can any of the GRHydro users/developers confirm this (or confirm that these schedule items do not need to be present after all)?

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:6 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

9:47 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+---------------------------------------

Comment (by eschnett):

Okay -- I had assumed that my current version was correct. Thanks for being so quick.

There are two issues. One is whether these calls are really necessary; I suggest to add test case which will detect this. The other is scheduling in MoL_Evolution; I am going to change this to be scheduled in evol after MoL_Evolution instead.

Next version of the patch is attached.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:7 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

14 Aug 14 Aug

7:14 a.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+---------------------------------------

Comment (by barry.wardell):

For the record, the MoL patch fixes the original reported problem with McLachlan. With it applied, the testsuites all pass with zero differences.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:8 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

17 Aug 17 Aug

9:57 a.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+---------------------------------------

Comment (by eschnett):

Has anybody tested the grhydro patch?

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:9 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

19 Aug 19 Aug

6:54 a.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: review Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+---------------------------------------

Comment (by rhaas):

I compared schedules with and without the patch and the scheduling of the GRHydro routines does not change. Most of the GRHydro patch had already been applied (in r264 by me). I have attached a reduced patch that applies cleanly. Schedule changes between -r259 (before any GRHydro schedule changes) and with grhydro[2].diff are small, only moving GRHydro_AtmosphereReset out of MoL_Evolution with only sync_GRHydro_C2P_failed slipping in between. So the patch(es) can be applied. Note however #523 on issues with MoL_PostStepModify ordering and that maybe having a dedicated MoL_PostFullStep for final cleanup before MoL_Evolution leaves would reduce the danger of unexpected routines slipping in between MoL_Evolution and AtmosphereReset (and therefore occasionally picking up wrong values for the hydro variables).

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:10 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

6:58 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: closed Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: fixed | Keywords: McLachlan ------------------------------------+--------------------------------------- Changes (by eschnett):

* status: review => closed * resolution: => fixed

Comment:

Applied.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:11 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

20 Aug 20 Aug

2:30 a.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: reopened Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: | Keywords: McLachlan ------------------------------------+--------------------------------------- Changes (by hinder):

* status: closed => reopened * resolution: fixed =>

Comment:

Almost! The McLachlan tests now pass with the stable Carpet, but ML_BSSN_sgw3d still fails for the development version (http://damiana2.aei.mpg.de/~ianhin/testsuites/einsteintoolkit/). The only difference is in kxx:

and this is significantly above roundoff. Reopening ticket.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:12 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

Einstein Toolkit

25 Aug 25 Aug

1:57 p.m.

#490: McLachlan test case failing due to ADMBase variable differences ------------------------------------+--------------------------------------- Reporter: hinder | Owner: eschnett Type: defect | Status: closed Priority: critical | Milestone: Component: EinsteinToolkit thorn | Version: Resolution: fixed | Keywords: McLachlan ------------------------------------+--------------------------------------- Changes (by hinder):

* status: reopened => closed * resolution: => fixed

Comment:

I was mistaken - the tests pass with both versions of Carpet.

-- Ticket URL: https://trac.einsteintoolkit.org/ticket/490#comment:13 Einstein Toolkit http://einsteintoolkit.org The Einstein Toolkit

5524

Age (days ago)

5539

Last active (days ago)

trac@lists.einsteintoolkit.org

13 comments

1 participants

tags (0)

participants (1)

Einstein Toolkit