[Users] automatic check of testsuites?

[Ian Hinder]

On 29 Mar 2011, at 10:09, Alexander Beck-Ratzka wrote:

> On Tuesday, March 29, 2011 09:57:23 Ian Hinder wrote:
>> On 29 Mar 2011, at 03:01, Luca Baiotti wrote:
>>> Hello,
>>> 
>>> by reading the minutes I started wondering whether there is again a
>>> mechanism to check the testsuites regularly and automatically on
>>> different machines, like the mechanism that Thomas Radke had created.
>>> I read briefly the Einstein Toolkit website, but did not find this
>>> mentioned.
>> 
>> I have set up something which runs nightly on my workstation and tests the
>> ET thornlist with both versions of Carpet as well as some of our private
>> thorns.  It is by no means perfect and would need quite a bit of work to
>> make it useful.  We should have something "official" which runs on each
>> machine.  I suspect one barrier to working on this is the hope that
>> simfactory will one day be able to run testsuites, and that that would be
>> the best infrastructure to use for such a project.  Unfortunately, nobody
>> has the time to put the required work in.  Are you volunteering? :)
> 
> 
> I would be interested in doing this. However, I would need some 
> instructions...

What we really need is for somebody to take charge of the project and push it forward, so if you can do that it would be great!  I'm sure there are a few people in the same situation as me who don't have time to devote to making this happen, but can give advice and help.  We could start by getting some ideas together about what such a system would entail, and whether there are existing systems which we can either build on or use as inspiration (e.g. Thomas' system from before, or something like "buildbot").

I have just made a new page on the ET Wiki for this project and written some initial notes and requirements:

	https://docs.einsteintoolkit.org/et-docs/Automated_testing

It would be good if interested people could look at this page and add/edit what is there.  We can discuss on the mailing list.

-- 
Ian Hinder
ian.hinder at aei.mpg.de