Bruno
I'm currently testing the Einstein Toolkit on Stampede. Even without the MICs, this is a very nice and fast system, almost ideal for the ET. The scripts in Simfactory should almost work; I will update them in the coming days. (The system was unavailable in the past days, so I couldn't test them recently.)
The MICs (Xeon Phis) can be used in two ways. One can view them as an accelerator (like a GPU), and then offload certain calculations there. Unfortunately neither CUDA nor OpenCL are available there, hence one has to use PGI's OpenACC and deal with PGI's compiler that has serious problems with OpenMP.
The other option is to view the Xeon Phis as regular processors. I believe that I/O will be quite slow from them, and MPI does not (yet?) fully work there, but apart from this, one can run the ET there directly. The small caches and in-order execution will make for some challenges; in particular, multi-threading e.g. via OpenMP will be a must.
In the end, I assume that one would want to use them either as accelerator (if not via OpenCL then via something equivalent, just different), or as regular compute nodes where Carpet will have to be enhanced to handle the different CPU speeds between Xeons and Xeon Phis.
-erik