#563: Do not copy .svn directories for test suite -------------------------+-------------------------------------------------- Reporter: eschnett | Owner: eschnett Type: defect | Status: review Priority: major | Milestone: Component: SimFactory | Version: Resolution: | Keywords: -------------------------+--------------------------------------------------
Comment (by eschnett):
I don't like the idea of making things too configurable. This complicates things, both development and explaining the subtle differences to users who don't want to care. Instead, Simfactory should "just work".
We are facing one particular problem here, which is that test cases are viewed as less important than source code, and hence people don't like that there are so many of them. When people run into real problems (quota, svn checkout times, rsync times), they blame the test case results.
In my opinion, as long as the test cases are not significantly larger than the source code, we are fine, and reducing the space/time taken up by test cases doesn't make a real difference. (Although it can make a real difference in corner cases.)
Anyway: Instead of devising piece-wise solution for small parts of the problem (patterns including and excluding test cases, tarring/zipping test case results on disk or for transport, etc.), we should work towards a once-and-for-all solution to this problem, and not spend much time with micro-optimisations that shift the problem 10% into the future.
I have created https://docs.einsteintoolkit.org/et- docs/Test_suite_results_are_unwieldy for discussing this.