From rhaas at illinois.edu Sun Jan 5 18:11:10 2025 From: rhaas at illinois.edu (Haas, Roland) Date: Mon, 6 Jan 2025 00:11:10 +0000 Subject: [Carpetx-developers] CarpetX call Message-ID: Join Zoom Meeting pitp.zoom.us/j/93861697232 ID: 93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com Joining instructions -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2801 bytes Desc: not available URL: From rhaas at illinois.edu Sun Jan 5 18:11:36 2025 From: rhaas at illinois.edu (Haas, Roland) Date: Mon, 6 Jan 2025 00:11:36 +0000 Subject: [Carpetx-developers] CarpetX call Message-ID: Join Zoom Meeting pitp.zoom.us/j/93861697232 ID: 93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com Joining instructions -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2797 bytes Desc: not available URL: From rhaas at illinois.edu Wed Jan 8 16:08:01 2025 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 08 Jan 2025 16:08:01 -0600 Subject: [Carpetx-developers] Weekly call at 4pm Thursday Eastern time Message-ID: Title: CarpetX developer call When: 4pm Thursday Eastern time Join Zoom Meeting https://pitp.zoom.us/j/93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com From acw6923 at rit.edu Thu Jan 9 16:10:17 2025 From: acw6923 at rit.edu (Allen Wen (RIT Student)) Date: Thu, 9 Jan 2025 17:10:17 -0500 Subject: [Carpetx-developers] Carpetx-developers Digest, Vol 37, Issue 2 In-Reply-To: References: Message-ID: Present: Roland, Swapnil, Allen, Lucas, Liwei, Jay, Steve Performance Issues: - Liwei + Jay observed CarpetX being slower than Carpet in certain simulations when using CPUs (hydro + spacetime + 14 AMR levels). - Swapnil observed similar speeds between Carpet(X) with CarpetX using much fewer nodes. - For GPUs, Swapnil recommends: less boxes (equal to # of GPUs, perhaps less) controlled via max_grid_size for each level, set AMReX ?refine_grid_layout? to ?no?. - For CPUs, Roland recommends: port CarpetX Z4c to Carpet, or run without spacetime, or run wavetoy to isolate effects of science code vs infrastructure; try changing tiling parameters. - Compare w/ AthenaK: they advertise 98% efficient weak scaling. Due to infrastructure, # ghost zones, etc.? Potential apples to apples GPU code comparison in the future. Updates: - Steve - Wrote introduction to subcycling paper. - Lucas - Multipatch tests working, looking towards evolving black holes. - Allen - MeudonBNSX working without OMP, check if array index is accurate, or put problematic code inside omp critical. On Thu, Jan 9, 2025 at 1:00?PM < carpetx-developers-request at einsteintoolkit.org> wrote: > Send Carpetx-developers mailing list submissions to > carpetx-developers at einsteintoolkit.org > > To subscribe or unsubscribe via the World Wide Web, visit > > http://lists.einsteintoolkit.org/mailman/listinfo/carpetx-developers > or, via email, send a message with subject or body 'help' to > carpetx-developers-request at einsteintoolkit.org > > You can reach the person managing the list at > carpetx-developers-owner at einsteintoolkit.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Carpetx-developers digest..." > > > Today's Topics: > > 1. Weekly call at 4pm Thursday Eastern time (rhaas at illinois.edu) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 08 Jan 2025 16:08:01 -0600 > From: rhaas at illinois.edu > To: carpetx-developers at lists.einsteintoolkit.org, rhaas80 at gmail.com > Subject: [Carpetx-developers] Weekly call at 4pm Thursday Eastern time > Message-ID: > Content-Type: text/plain; charset="ANSI_X3.4-1968" > > Title: CarpetX developer call > When: 4pm Thursday Eastern time > > Join Zoom Meeting > https://pitp.zoom.us/j/93861697232 > > Join by phone > (CA) +1 647-558-0588 > > Join using SIP > 93861697232 at zoomcrc.com > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Carpetx-developers mailing list > Carpetx-developers at einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/carpetx-developers > > > ------------------------------ > > End of Carpetx-developers Digest, Vol 37, Issue 2 > ************************************************* > -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Fri Jan 10 16:08:01 2025 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Fri, 10 Jan 2025 16:08:01 -0600 Subject: [Carpetx-developers] Weekly call at 11am Monday Eastern time Message-ID: Title: CarpetX developer call When: 11am Monday Eastern time Join Zoom Meeting https://pitp.zoom.us/j/93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com From rhaas at illinois.edu Tue Jan 14 12:50:52 2025 From: rhaas at illinois.edu (Roland Haas) Date: Tue, 14 Jan 2025 13:50:52 -0500 Subject: [Carpetx-developers] CarpetX developer's call re-scheduling Message-ID: <20250114135052.2256a904@illinois.edu> Hello all, With the new semester the previous meeting times no longer work for all. At this point *two* slots are needed: * Thu 11am US Eastern time (week 1, this week [except we already had a meeting]) * Thu 12pm (noon) US Eastern time (week 2, next week [our next meeting]) This would seem to ensure that everybody can make it to either the week 1 or week 2 slot (with weeks 1 and 2 alternating). I will (tentatively) move the calendar invites and email reminders to account for the new slots. Since we already had a meeting this week, our next meeting is *next week* Thu Jan 23rd 12pm (noon) US Eastern time using the usual Zoom call link: https://illinois.zoom.us/j/81532767368?pwd=bGJOL2xFdHJwRUFWTE55Vy9LczZmUT09 If you have non-movable conflicts, please raise any objections before Sunday Jan 19th, 2025. Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From rhaas at illinois.edu Tue Jan 14 13:02:41 2025 From: rhaas at illinois.edu (Haas, Roland) Date: Tue, 14 Jan 2025 19:02:41 +0000 Subject: [Carpetx-developers] CarpetX call Message-ID: Join Zoom Meeting pitp.zoom.us/j/93861697232 ID: 93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com Joining instructions -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2457 bytes Desc: not available URL: From rhaas at illinois.edu Tue Jan 14 13:04:18 2025 From: rhaas at illinois.edu (Haas, Roland) Date: Tue, 14 Jan 2025 19:04:18 +0000 Subject: [Carpetx-developers] CarpetX call Message-ID: Join Zoom Meeting pitp.zoom.us/j/93861697232 ID: 93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com Joining instructions -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2567 bytes Desc: not available URL: From rhaas at illinois.edu Tue Jan 14 13:05:29 2025 From: rhaas at illinois.edu (Haas, Roland) Date: Tue, 14 Jan 2025 19:05:29 +0000 Subject: [Carpetx-developers] CarpetX call Message-ID: Join Zoom Meeting pitp.zoom.us/j/93861697232 ID: 93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com Joining instructions -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2461 bytes Desc: not available URL: From rhaas at illinois.edu Wed Jan 22 16:08:01 2025 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 22 Jan 2025 16:08:01 -0600 Subject: [Carpetx-developers] Weekly call at 12pm Thursday Eastern time Message-ID: Title: CarpetX developer call When: 12pm Thursday Eastern time Join Zoom Meeting https://pitp.zoom.us/j/93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com From rhaas at illinois.edu Fri Jan 24 16:08:01 2025 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Fri, 24 Jan 2025 16:08:01 -0600 Subject: [Carpetx-developers] Weekly call at 12pm Thursday Eastern time Message-ID: Title: CarpetX developer call When: 12pm Thursday Eastern time Join Zoom Meeting https://pitp.zoom.us/j/93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com From rhaas at illinois.edu Fri Jan 24 16:55:47 2025 From: rhaas at illinois.edu (Roland Haas) Date: Fri, 24 Jan 2025 17:55:47 -0500 Subject: [Carpetx-developers] Weekly call at 12pm Thursday Eastern time In-Reply-To: References: Message-ID: <20250124175547.2d26e926@illinois.edu> Hello all, This is the wrong reminder, sorry. The meeting next week (for which there will be a proper reminder *next* week) will be at 11am US Eastern time (just after the Einstein Toolkit call). Yours, Roland > Title: CarpetX developer call > When: 12pm Thursday Eastern time > > Join Zoom Meeting > https://pitp.zoom.us/j/93861697232 > > Join by phone > (CA) +1 647-558-0588 > > Join using SIP > 93861697232 at zoomcrc.com > _______________________________________________ > Carpetx-developers mailing list > Carpetx-developers at einsteintoolkit.org > https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinfo/carpetx-developers__;!!DZ3fjg!-Ms1Pj3ZPo71T5ecJLtvEfh9Z57QPxuvztFtDNBKACrUiv2zmeP_BaSy9WiHBCcfEXwgRtkhSY9E20nLAw$ -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From rhaas at illinois.edu Wed Jan 29 16:08:06 2025 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 29 Jan 2025 16:08:06 -0600 Subject: [Carpetx-developers] Weekly call at 11am Thursday Eastern time Message-ID: Title: CarpetX developer call When: 11am Thursday Eastern time Join Zoom Meeting https://pitp.zoom.us/j/93861697232 Join by phone (CA) +1 647-558-0588 Join using SIP 93861697232 at zoomcrc.com From chcheng3 at illinois.edu Thu Jan 30 15:44:50 2025 From: chcheng3 at illinois.edu (Cheng, Cheng-Hsin) Date: Thu, 30 Jan 2025 21:44:50 +0000 Subject: [Carpetx-developers] Meeting minutes for 2025-01-30 Message-ID: Present: Erik, Roland, Yosef, Helvi, Swapnil, Liwei, Lucas, Cheng-Hsin Performance of Z4cow using Carpet vs CarpetX ======= Liwei compared the performance of Z4cow between Carpet and CarpetX versions, and found that the CarpetX version is slower than Carpet by 30% to 50%. - Setup: 1 AMR level, with subcycling, 128^3 grid on 1 MPI process, 32 time steps. - Erik suggested that timing information is needed to see which part is the most expensive. - Liwei is thinking about profiling using HPCToolkit, but will try using the Carpet timing information first. - Roland asked if Z4cow has been compared with LazEv in terms of performance, but this hasn't been done yet. - Liwei was able to re-run the tests and show the timing information at the end of the meeting - Erik pointed out that CarpetX does domain decomposition by default into 64 boxes whereas Carpet does not, so the CarpetX test will need to use a grid size of 128 for an even comparison with Carpet. - Erik suggested that the number of RHS calls could be different and that Liwei should check it with a counter. - Erik mentioned that the AMReX tile sizes affect the performance a lot, so Liwei should also experiment with using different tile sizes to get the best performance from CarpetX. Fix for NewRadX when symmetries are applied ====== - Roland asked about the status of the pull requests for the NewRadX fix. - Cheng-Hsin reported that the pull request under CarpetX has been reviewed but still awaits formal approval from Erik before it can be merged. - The pull request under SpacetimeX needs a reviewer, and Lucas volunteered. Subcycling paper ====== - Awaiting reviewing by co-authors, and there is still some text in the discussion that needs to be written up. Will ask people if they would like to be listed as co-authors or left out. Updates from Lucas ====== - Lucas is looking into dereferencing issues when using function pointers, and is also looking into calling functions directly instead. - Lucas, Steve, and Max (PhD student) have been testing hybrid Runge-Kutta integrators on BBH simulations, where some of the intermediate RK steps are replaced with the RHS evaluated at previous timesteps, making it a multi-step method. - The hybid method maintains the accuracy and maintains the RHS evaluated in previous steps, but the downside is that more memory may be required. - Comparing the BBH waveform using standard RK4, 2-step hybrid, 3-step hybrid methods, the error is small (maximum 1e-9), and the hybrid method runs much faster than standard RK4. - The code is in the branch feature/RKAB in the CarpetX repo, and Lucas showed how to add the hybrid RK method to an evolution thorn by adding tags to the state variables. -------------- next part -------------- An HTML attachment was scrubbed... URL: