#114: per-variable tolerances for Cactus testsuites --------------------------+------------------------------------------------- Reporter: knarf | Owner: tbode Type: enhancement | Status: review Priority: major | Milestone: ET_2011_11 Component: Cactus | Version: Resolution: | Keywords: --------------------------+------------------------------------------------- Changes (by tbode):
* status: accepted => review
Comment:
I've attached a patch to RunTestUtils.pl which implements this feature. Both absolute and relative tolerances can be specified with the keywords ''VarExpABSTOL'' or ''VarExpRELTOL'' followed by a regular expression to match (without the leading m/ or trailing /) and the new tolerance value. The specified tolerances override more general tolerances for data files whose name matches these regular expressions. Any set of characters can be used for matching as long as there are no whitespaces in the regular expression.
For example: {{{ #!div style="font-size: 80%" {{{#!python VarExpABSTOL ^Psi4.[xy] 1e-8 VarExpRELTOL gxx 1e-12 }}} }}}
More specific tolerances can be specified for all the tests of a thorn or just within a test's block.
The attached patch passed the tests I gave it. Please review.