<div dir="ltr">Erik,<div> thanks. Do you have any instructions (or simfactory files) to share if I wanted to try compiling and running it on GPUs?</div><div>I have access to a GPU cluster at CINECA in Italy and I may try running there (each node has 4 x NVIDIA Volta V100 GPUs). The theory group here in Bicocca is also going to buy a server with 4 x NVIDIA A100 GPUs for testing purposes.</div><div><br></div><div>I do not have experience with GPUs, but I'm happy to help if needed.</div><div><br></div><div>Cheers,</div><div>Bruno</div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Il giorno gio 3 giu 2021 alle ore 15:38 Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu">schnetter@cct.lsu.edu</a>> ha scritto:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Bruno<br>
<br>
GPUs are supported and are working fine. A WaveToy is working, but I<br>
haven't tested it in the past weeks. The Einstein equations require<br>
more work to be efficient on GPUs.<br>
<br>
-erik<br>
<br>
On Thu, Jun 3, 2021 at 9:29 AM Bruno Giacomazzo<br>
<<a href="mailto:bruno.giacomazzo@unimib.it" target="_blank">bruno.giacomazzo@unimib.it</a>> wrote:<br>
><br>
> Roland and Erik,<br>
> thanks a lot for the explanation. I saw the release notes with CUDA listed in the larger changes and this is why I asked.<br>
><br>
> Erik, does CarpetX already support GPU via AMReX or is more work needed?<br>
><br>
> Thanks,<br>
> Bruno<br>
><br>
><br>
> Il giorno gio 3 giu 2021 alle ore 14:35 Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>> ha scritto:<br>
>><br>
>> To my knowledge, the improved support means that it is now possible to<br>
>> mix CUDA and C++ code in the same source files. That is, you can<br>
>> compile C++ code with a CUDA compiler, which will pass on the C++ bits<br>
>> to the regular C++ compiler while extracting the CUDA code. This is<br>
>> merely a technical improvement of the make system that makes it easier<br>
>> to write one version code that can run on both a CPU or a GPU, instead<br>
>> of having to write two separate versions of the code.<br>
>><br>
>> The real CUDA-related work happened in CarpetX<br>
>> <<a href="https://bitbucket.org/eschnett/cactusamrex/" rel="noreferrer" target="_blank">https://bitbucket.org/eschnett/cactusamrex/</a>>, which is not part of<br>
>> the Einstein Toolkit yet. But we're getting there!<br>
>><br>
>> -erik<br>
>><br>
>> On Thu, Jun 3, 2021 at 3:40 AM Bruno Giacomazzo<br>
>> <<a href="mailto:bruno.giacomazzo@unimib.it" target="_blank">bruno.giacomazzo@unimib.it</a>> wrote:<br>
>> ><br>
>> > would it be possible to have a (short) summary of the CUDA support introduced in the latest release?<br>
>> ><br>
>> > Thanks,<br>
>> > Bruno<br>
>> ><br>
>> > Il giorno gio 3 giu 2021 alle ore 00:15 <<a href="mailto:users@einsteintoolkit.org" target="_blank">users@einsteintoolkit.org</a>> ha scritto:<br>
>> >><br>
>> >> Hello,<br>
>> >><br>
>> >> Please consider joining the weekly Einstein Toolkit phone call at<br>
>> >> 9:00 am US central time on Thursdays. For details on how to connect<br>
>> >> and what agenda items are to be discussed, use the link below.<br>
>> >><br>
>> >> <a href="https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call" rel="noreferrer" target="_blank">https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call</a><br>
>> >><br>
>> >> --The Maintainers<br>
>> >> _______________________________________________<br>
>> >> Users mailing list<br>
>> >> <a href="mailto:Users@einsteintoolkit.org" target="_blank">Users@einsteintoolkit.org</a><br>
>> >> <a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
>> ><br>
>> ><br>
>> ><br>
>> > --<br>
>> ><br>
>> > Prof. Bruno Giacomazzo<br>
>> > Department of Physics<br>
>> > University of Milano-Bicocca<br>
>> > Piazza della Scienza 3<br>
>> > 20126 Milano<br>
>> > Italy<br>
>> ><br>
>> > email: <a href="mailto:bruno.giacomazzo@unimib.it" target="_blank">bruno.giacomazzo@unimib.it</a><br>
>> > phone: (+39) 02 6448 2321<br>
>> > web: <a href="http://www.brunogiacomazzo.org" rel="noreferrer" target="_blank">http://www.brunogiacomazzo.org</a><br>
>> ><br>
>> > ----------------------------------------------------------------------<br>
>> > There are only 10 types of people in the world:<br>
>> > Those who understand binary, and those who don't<br>
>> > ----------------------------------------------------------------------<br>
>> ><br>
>> > _______________________________________________<br>
>> > Users mailing list<br>
>> > <a href="mailto:Users@einsteintoolkit.org" target="_blank">Users@einsteintoolkit.org</a><br>
>> > <a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
>><br>
>><br>
>><br>
>> --<br>
>> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>> <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" rel="noreferrer" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
><br>
><br>
><br>
> --<br>
><br>
> Prof. Bruno Giacomazzo<br>
> Department of Physics<br>
> University of Milano-Bicocca<br>
> Piazza della Scienza 3<br>
> 20126 Milano<br>
> Italy<br>
><br>
> email: <a href="mailto:bruno.giacomazzo@unimib.it" target="_blank">bruno.giacomazzo@unimib.it</a><br>
> phone: (+39) 02 6448 2321<br>
> web: <a href="http://www.brunogiacomazzo.org" rel="noreferrer" target="_blank">http://www.brunogiacomazzo.org</a><br>
><br>
> ----------------------------------------------------------------------<br>
> There are only 10 types of people in the world:<br>
> Those who understand binary, and those who don't<br>
> ----------------------------------------------------------------------<br>
><br>
> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@einsteintoolkit.org" target="_blank">Users@einsteintoolkit.org</a><br>
> <a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
<br>
<br>
<br>
-- <br>
Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
<a href="http://www.perimeterinstitute.ca/personal/eschnetter/" rel="noreferrer" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><p><font color="#000000">Pr<font face="arial, sans-serif">of. Bruno Giacomazzo<br>Department of Physics<br>University of Milano-Bicocca<br></font></font><span style="color:rgb(0,0,0)"><font face="arial, sans-serif">Piazza della Scienza 3<br></font></span><span style="color:rgb(0,0,0)"><font face="arial, sans-serif">20126 Milano<br></font></span><span style="font-size:12.8px;color:rgb(0,0,0)">Italy</span></p><p><font color="#000000"><span style="font-size:12.8px">email: </span><span style="font-size:12.8px"><a href="mailto:bruno.giacomazzo@unimib.it" target="_blank">bruno.giacomazzo@unimib.it</a><br></span><span style="font-size:12.8px">phone: (+39) 02 6448 2321</span></font><br><font color="#000000"><span style="font-size:12.8px">web: </span></font><span style="color:rgb(0,0,0);font-size:12.8px"><a href="http://www.brunogiacomazzo.org/" style="font-size:12.8px" target="_blank">http://www.brunogiacomazzo.org</a></span></p><p><font color="#000000">----------------------------------------------------------------------<br><span style="font-size:12.8px">There are only 10 types of people in the world:<br></span><span style="font-size:12.8px">Those who understand binary, and those who don't<br></span><span style="font-size:12.8px">----------------------------------------------------------------------<br></span></font></p></div></div></div></div></div></div></div>