#114: per-variable tolerances for Cactus testsuites --------------------------+------------------------------------------------- Reporter: knarf | Owner: tbode Type: enhancement | Status: review Priority: major | Milestone: ET_2011_11 Component: Cactus | Version: Resolution: | Keywords: --------------------------+-------------------------------------------------
Comment (by tbode):
This proved simpler than expected. The latest attachment now upgrades the ABSTOL and RELTOL entries to hashes. If a test's datafile matches more than one expression aside from the default at the given level (thorn-wide or test-specific), a warning is thrown and the script is verbosely aborted.
New usage requires the format {{{ ABSTOL <Tolerance> [Expression] RELTOL <Tolerance> [Expression] }}} where [Expression] defaults to .* if missing.
Random examples:
{{{ ABSTOL 1e-5 ABSTOL 1e-10 Psi[0-9] ABSTOL 1e-12 g[xyz] ABSTOL 1e-4 (.*)*.x.asc RELTOL 1e-12 .* }}}
Again, any number of expressions are allowed at any level as long as a file matches one and only one extra tolerance expression.
This passes every test I've thrown at it and it fits everything that was desired, so please review it.