On 12/05/16 21:37, Frank Loeffler wrote:

On Thu, May 12, 2016 at 08:00:40PM +0200, Eloisa Bentivegna wrote:

this is really due to the fact that this specific variable
(ct_multilevel-err) should not be tested for relative changes, as it's
difficult to define a natural tolerance, and sometimes even the smallest
differences in execution lead to very large relative changes. I have
just pushed a commit that makes sure that a failure is only triggered if
the absolute difference is above threshold.

That is great, thanks.

No problem. But technically the next test is still pending (or at least
so it says on https://build.barrywardell.net/job/EinsteinToolkit/), so I
haven't checked that the change has fixed anything.