From rhaas at illinois.edu Mon Mar 4 15:18:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Mon, 04 Mar 2024 15:18:01 -0600 Subject: [Users] Agenda for Thursday's Meeting Message-ID: Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From rhaas at illinois.edu Wed Mar 6 17:15:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 06 Mar 2024 17:15:01 -0600 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From rhaas at illinois.edu Thu Mar 7 09:35:14 2024 From: rhaas at illinois.edu (Roland Haas) Date: Thu, 7 Mar 2024 09:35:14 -0600 Subject: [Users] meeting minutes for 2024-03-07 Message-ID: <20240307093514.792d2664@ekohaes8> Present: Roland, Steve, Leo, Muhammad Rizwan, Samuel, Vaishak Prasad, Zach ET release: * Steve has started reviewing Z4c, will contact Erik with questions * Roland has not yet started reviewing Multipole, will contact Lucas, changes a re fairly small, Roland not sure if this is worthwhile a full review and all * NewRadX review under way, Alex in contact with Liwei about review * No updates on Baikal rewrite * Samuel has gallery example for FUKA ready, Will create a ticket. ET US summer school and workshop: * Steve has room reserved, has coffee organized * Steve is working on organisatorial details for LIGO trip * Steve will arrange for meeting with the org committee for program * would add ET US and ET EU times to front page of ET website, would want meeting website for this SPECv8: * now at stage 4 of 6 ET testing system: * needs some bugfixing, Roland is out of time * current larger issues are: running out of quota on github, tests do not detect build failures * suggestion to have this as a Google summer of code project ** do add this to ET CSSI call agenda ** do contact HPX group who usually proposes these ** will need multiple project for students to choose from Unanswered questions: * http://lists.einsteintoolkit.org/pipermail/users/2024-February/009239.html about presync and CCTK_DEBUG. This should be fixed in https://bitbucket.org/einsteintoolkit/tickets/issues/2781 Tickets: * https://bitbucket.org/einsteintoolkit/tickets/issues/2772 Samuel is doing final testing, after which proposed change can be merged and ticket closed * https://bitbucket.org/einsteintoolkit/tickets/issues/2647 Steve and Roland will continue on working on incorporating this * https://bitbucket.org/einsteintoolkit/tickets/issues/2774 no progress yet Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From shamims at iiserb.ac.in Fri Mar 8 02:55:53 2024 From: shamims at iiserb.ac.in (Shamim Haque 1910511) Date: Fri, 8 Mar 2024 14:25:53 +0530 Subject: [Users] Definitions of different reductions in CarpetIOScalar Message-ID: Hi everyone, CarpetIOScalar thorn has the following options from outscalar_reductions: count minimum maximum sum average norm1 norm2 norm_inf icount iaverage inorm1 inorm2 What are the expressions/definitions for each? I could not find them in the ETK documentation. Please help. Regards Shamim Haque Senior Research Fellow (SRF) Department of Physics IISER Bhopal ? -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Fri Mar 8 09:44:16 2024 From: rhaas at illinois.edu (Roland Haas) Date: Fri, 8 Mar 2024 09:44:16 -0600 Subject: [Users] Definitions of different reductions in CarpetIOScalar In-Reply-To: References: Message-ID: <20240308094416.4355ed9d@ekohaes8> Hello Shamin, > CarpetIOScalar thorn has the following options from outscalar_reductions: > > count minimum maximum sum average norm1 norm2 norm_inf icount iaverage > inorm1 inorm2 > > What are the expressions/definitions for each? I could not find them in the > ETK documentation. Please help. They are defined by CarpetReduce (https://bitbucket.org/eschnett/carpet/src/master/CarpetReduce/) and mostly match the corresponding ones in LocalReduce (which has docs): http://einsteintoolkit.org/thornguide/CactusNumerical/LocalReduce/documentation.html The difference between the "i" and non "i" flavors is that the regular ones weigh the influence of a grid point by the volume of its cell so that eg the "sum" reduction becomes (up to a constant factor of the cell volume on the coarsest grid) the Riemann sum (integral) of the data. The "i" ones leave out that factor so just sum up the values. For reductions that do not perform sums (min/max) I don't think there is is a difference between the two. Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From shamims at iiserb.ac.in Sun Mar 10 03:38:42 2024 From: shamims at iiserb.ac.in (Shamim Haque 1910511) Date: Sun, 10 Mar 2024 14:08:42 +0530 Subject: [Users] Definitions of different reductions in CarpetIOScalar In-Reply-To: <20240308094416.4355ed9d@ekohaes8> References: <20240308094416.4355ed9d@ekohaes8> Message-ID: Hello Roland, This helps. Thanks a lot. Regards Shamim Haque Senior Research Fellow (SRF) Department of Physics IISER Bhopal ? On Fri, Mar 8, 2024 at 9:14?PM Roland Haas wrote: > Hello Shamin, > > > CarpetIOScalar thorn has the following options from outscalar_reductions: > > > > count minimum maximum sum average norm1 norm2 norm_inf icount iaverage > > inorm1 inorm2 > > > > What are the expressions/definitions for each? I could not find them in > the > > ETK documentation. Please help. > > They are defined by CarpetReduce > (https://bitbucket.org/eschnett/carpet/src/master/CarpetReduce/) and > mostly match the corresponding ones in LocalReduce (which has docs): > > > http://einsteintoolkit.org/thornguide/CactusNumerical/LocalReduce/documentation.html > > The difference between the "i" and non "i" flavors is that the regular > ones weigh the influence of a grid point by the volume of its cell so > that eg the "sum" reduction becomes (up to a constant factor of the > cell volume on the coarsest grid) the Riemann sum (integral) of the > data. > > The "i" ones leave out that factor so just sum up the values. > > For reductions that do not perform sums (min/max) I don't think there > is is a difference between the two. > > Yours, > Roland > > -- > My email is as private as my paper mail. I therefore support encrypting > and signing email messages. Get my PGP key from http://pgp.mit.edu . > -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Mon Mar 11 08:52:18 2024 From: rhaas at illinois.edu (Roland Haas) Date: Mon, 11 Mar 2024 08:52:18 -0500 Subject: [Users] Definitions of different reductions in CarpetIOScalar In-Reply-To: References: <20240308094416.4355ed9d@ekohaes8> Message-ID: <20240311085218.3e683d2c@ekohaes8> Hello Shamim Haque, Gald to have been able to help. Yours, Roland > Hello Roland, > > This helps. Thanks a lot. > > Regards > Shamim Haque > Senior Research Fellow (SRF) > Department of Physics > IISER Bhopal > > ? > > On Fri, Mar 8, 2024 at 9:14?PM Roland Haas wrote: > > > Hello Shamin, > > > > > CarpetIOScalar thorn has the following options from outscalar_reductions: > > > > > > count minimum maximum sum average norm1 norm2 norm_inf icount iaverage > > > inorm1 inorm2 > > > > > > What are the expressions/definitions for each? I could not find them in > > the > > > ETK documentation. Please help. > > > > They are defined by CarpetReduce > > (https://urldefense.com/v3/__https://bitbucket.org/eschnett/carpet/src/master/CarpetReduce/__;!!DZ3fjg!95Yy0JllwSa-J8mctaaso3iAcNHMeKjuSqSbCXMcaJzSr__dMzz4tMv2Yb93afgIZAm_Q9w2wySfEofrMDEx$ ) and > > mostly match the corresponding ones in LocalReduce (which has docs): > > > > > > https://urldefense.com/v3/__http://einsteintoolkit.org/thornguide/CactusNumerical/LocalReduce/documentation.html__;!!DZ3fjg!95Yy0JllwSa-J8mctaaso3iAcNHMeKjuSqSbCXMcaJzSr__dMzz4tMv2Yb93afgIZAm_Q9w2wySfEkzMOFTP$ > > > > The difference between the "i" and non "i" flavors is that the regular > > ones weigh the influence of a grid point by the volume of its cell so > > that eg the "sum" reduction becomes (up to a constant factor of the > > cell volume on the coarsest grid) the Riemann sum (integral) of the > > data. > > > > The "i" ones leave out that factor so just sum up the values. > > > > For reductions that do not perform sums (min/max) I don't think there > > is is a difference between the two. > > > > Yours, > > Roland > > > > -- > > My email is as private as my paper mail. I therefore support encrypting > > and signing email messages. Get my PGP key from https://urldefense.com/v3/__http://pgp.mit.edu__;!!DZ3fjg!95Yy0JllwSa-J8mctaaso3iAcNHMeKjuSqSbCXMcaJzSr__dMzz4tMv2Yb93afgIZAm_Q9w2wySfEuaMct0z$ . > > -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From rhaas at illinois.edu Mon Mar 11 15:18:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Mon, 11 Mar 2024 15:18:01 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From rhaas at illinois.edu Wed Mar 13 14:54:15 2024 From: rhaas at illinois.edu (Roland Haas) Date: Wed, 13 Mar 2024 14:54:15 -0500 Subject: [Users] Fwd: [nr-community-call] Applications due Mar 20 for SpECTRE community workshop Message-ID: <20240313145416.2241d852@ekohaes8> (originally sent by Nils Vu to nr-community-call at black-holes.org) Dear Numerical Relativists, This is a quick reminder that applications for our SpECTRE community workshop, Aug 5?9, 2024, at ICERM, Brown University, US, are due on Mar 20 (next Wednesday). You can find the full announcement of the workshop below. Please consider joining us for the workshop, and feel free to reach out if you have any questions. Best, Nils ? Applications are now open for an upcoming workshop "Simulating Extreme Spacetimes with SpEC and SpECTRE", Aug 5-9, 2024, at ICERM, Brown University, US. The Simulating eXtreme Spacetimes (SXS) collaboration has managed the development of two distinct numerical relativity codes to enable high-fidelity simulations of compact object mergers: (i) the Spectral Einstein Code (SpEC) based on pseudospectral methods, and (ii) the open-source code SpECTRE, an hp-adaptive discontinuous Galerkin scheme for relativistic astrophysics. Our weeklong program includes two related activities: (i) a SpEC and SpECTRE developers meeting and (ii) a SpECTRE community workshop. The code developers' meeting will bring together researchers who are actively developing SpEC, SpECTRE, and accompanying software for interacting with publicly available simulation datasets such as gravitational waveforms. The SpECTRE workshop aims to provide graduate students, postdocs, and faculty with the tools to install, run, and contribute to the open-source code SpECTRE. Our SpECTRE workshop will include both lectures and hands-on sessions. Lecture topics will include the generalized harmonic formulation of the Einstein field equation, general relativistic hydrodynamics, the discontinuous Galerkin method with finite volume sub-cells, and the Cauchy characteristic extraction method. Hands-on sessions will cover installing, running, and visualizing numerical simulations, and how to get involved with code development. There will also be ample opportunity for students and postdocs to interact with senior participants and lecturers of the ICERM workshop program. Both events will be in-person, with streaming options available for lectures. ICERM will be able to offer limited funding for some participants. The application deadline is March 20, 2024. Please apply here: https://icerm.brown.edu/topical_workshops/tw-24-ses/ Best, Katerina Chatziioannou Nils Deppe Scott Field Lawrence Kidder Geoffrey Lovelace Harald Pfeiffer Mark Scheel Leo Stein Saul Teukolsky Vijay Varma Nils Vu -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From rhaas at illinois.edu Wed Mar 13 17:15:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 13 Mar 2024 17:15:01 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. ** DAYLIGHT SAVING TIME WARNING ** Please note that the US / EU has already / not yet transitioned to / from daylight saving time. The phone call will be at 15:00 Central EU time. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From scupp1 at my.apsu.edu Thu Mar 14 09:35:48 2024 From: scupp1 at my.apsu.edu (Cupp, Samuel D.) Date: Thu, 14 Mar 2024 14:35:48 +0000 Subject: [Users] Meeting minutes for 2024-03-14 Message-ID: Present: Roland, Samuel, Peter, Zach, Harsh Parashar, Leo ET US summer school and workshop: * ?draft of website now available: https://www.cct.lsu.edu/Einsteintoolkitworkshop2024 ET release: * GRHayLHD update has a reviewer (Terrence) ET testing system: * Roland still seeking help resolving issues with this system: https://github.com/EinsteinToolkit/tests/issues Tickets: Ticket 2785 * Zenodo uses old website url * probably requires manual changes while making the next zenodo entry Ticket 2784 * CarpetX revealed new threading issues in Cactus * also revealed an error with the read/write parsing for vector array variables * both have PRs under review Ticket 2781 * issue with PreSync when CCTK_DEBUG is on and presync_only is the default "off" * PR under review to fix this -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Mon Mar 18 15:18:02 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Mon, 18 Mar 2024 15:18:02 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From hensh at astro-osaka.jp Tue Mar 19 08:34:51 2024 From: hensh at astro-osaka.jp (Sudipta Hensh) Date: Tue, 19 Mar 2024 13:34:51 +0000 Subject: [Users] Oscillations in total angular momentum from QuasiLocalMeasures Message-ID: Dear all, I hope this email finds you well. I am performing simulations of BNS mergers and utilizing the QuasiLocalMeasures thorn to plot the total angular momentum of the spacetime. However, I have noticed high-frequency oscillations in the plotted data, as shown in the attached plot. I was wondering if we should expect such oscillations. I would also like to know the reason behind such oscillations. I would appreciate if you kindly help me to understand this issue. I am looking forward to hearing from you. Many thanks in advance! Regards, Sudipta Hensh JSPS Postdoctoral Researcher Pronouns: He/Him Graduate School of Science Osaka University 1-1 Machikaneyama-cho, Toyonaka Osaka 560-0043, Japan -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: test-ang-momen.pdf Type: application/pdf Size: 22653 bytes Desc: not available URL: From schnetter at gmail.com Tue Mar 19 08:45:51 2024 From: schnetter at gmail.com (Erik Schnetter) Date: Tue, 19 Mar 2024 09:45:51 -0400 Subject: [Users] Oscillations in total angular momentum from QuasiLocalMeasures In-Reply-To: References: Message-ID: Sudipta What is the size of the simulation domain? At which radius do you evaluate the angular momentum? What is the spatial resolution there? What is the time resolution there? Is there any matter nearby? What happens if you change the evaluation radius? What if you make it smaller or larger? How close is this to the outer boundary? Do you have a visualisation of the geometry (e.g. the imaginary part of the Weyl scalar Psi_2)? In which direction does the angular momentum point? Does this change over time? What is the magnitude of the angular momentum? How does this compare to the mass? -erik On Tue, Mar 19, 2024 at 9:35?AM Sudipta Hensh wrote: > > Dear all, > > I hope this email finds you well. > > I am performing simulations of BNS mergers and utilizing the QuasiLocalMeasures thorn to plot the total angular momentum of the spacetime. However, I have noticed high-frequency oscillations in the plotted data, as shown in the attached plot. I was wondering if we should expect such oscillations. I would also like to know the reason behind such oscillations. I would appreciate if you kindly help me to understand this issue. > > I am looking forward to hearing from you. Many thanks in advance! > > Regards, > Sudipta Hensh > JSPS Postdoctoral Researcher > Pronouns: He/Him > Graduate School of Science > Osaka University > 1-1 Machikaneyama-cho, Toyonaka > Osaka 560-0043, Japan > _______________________________________________ > Users mailing list > Users at einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/users -- Erik Schnetter http://www.perimeterinstitute.ca/personal/eschnetter/ From rhaas at illinois.edu Wed Mar 20 17:15:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 20 Mar 2024 17:15:01 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. ** DAYLIGHT SAVING TIME WARNING ** Please note that the US / EU has already / not yet transitioned to / from daylight saving time. The phone call will be at 15:00 Central EU time. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From hensh at astro-osaka.jp Thu Mar 21 07:27:54 2024 From: hensh at astro-osaka.jp (Sudipta Hensh) Date: Thu, 21 Mar 2024 12:27:54 +0000 Subject: [Users] Oscillations in total angular momentum from QuasiLocalMeasures References: Message-ID: <82857b1931c3.b8bebb2b5aa92@astro-osaka.jp> Hi Erik, Sorry for the delay, I have written below the answers. 1. What is the size of the simulation domain? Simulation domain along x and y direction is [-1000,1000] and along z direction is [0,1000]. 2. At which radius do you evaluate the angular momentum? There are two extraction radii, 200 and 300. The plot that I sent was for 300. 3. What is the spatial resolution there? Spatial resolution is 5. 4. What is the time resolution there? The time resolution is 0.75. 5. Is there any matter nearby? There is no matter during the inspiral. 6. What happens if you change the evaluation radius? What if you make it smaller or larger? For smaller radius the amplitude of oscillations is comparatively smaller. 7. How close is this to the outer boundary? The extraction radius is far from the outer boundary. 8. Do you have a visualisation of the geometry (e.g. the imaginary part of the Weyl scalar Psi_2)? I am afraid that I do not have Psi_2 in the output. If necessary then I can output it. 9. In which direction does the angular momentum point? Does this change over time? The plot I sent was for the angular momentum along z direction. 10. What is the magnitude of the angular momentum? How does this compare to the mass? The initial magnitude of the angular momentum is 7.3 and total gravitational mass of the system is 2.75 M_Sun. I am leaving below some information from the parameter file that maybe relevant. CoordBase::xmin = -1000 CoordBase::xmax = 1000 CoordBase::ymin = -1000 CoordBase::ymax = 1000 CoordBase::zmin = 0 CoordBase::zmax = 1000 CoordBase::spacing = "numcells" CoordBase::ncells_x = 200 CoordBase::ncells_y = 200 CoordBase::ncells_z = 100 Carpet::max_refinement_levels = 8 Carpet::time_refinement_factors = "[1,1,2,4,8,16,32,64,128,256,512]" CarpetRegrid2::num_centres = 3 CarpetRegrid2::regrid_every = 128 CarpetRegrid2::snap_to_coarse = "yes" CarpetRegrid2::freeze_unaligned_levels = "yes" CarpetRegrid2::freeze_unaligned_parent_levels = "yes" # ----------- Region 1 -------------------- CarpetRegrid2::active_1 = "yes" CarpetRegrid2::num_levels_1 = 7 CarpetRegrid2::position_x_1 = 15.2365094091 CarpetRegrid2::position_y_1 = 0.0 CarpetRegrid2::radius_1[1] = 300.0 CarpetRegrid2::radius_1[2] = 160.0 CarpetRegrid2::radius_1[3] = 80.0 CarpetRegrid2::radius_1[4] = 40.0 CarpetRegrid2::radius_1[5] = 20.0 CarpetRegrid2::radius_1[6] = 10.0 # ----------- Region 2 -------------------- CarpetRegrid2::active_2 = "yes" CarpetRegrid2::num_levels_2 = 7 CarpetRegrid2::position_x_2 = -15.2365094091 CarpetRegrid2::position_y_2 = -0.0 CarpetRegrid2::radius_2[1] = 300.0 CarpetRegrid2::radius_2[2] = 160.0 CarpetRegrid2::radius_2[3] = 80.0 CarpetRegrid2::radius_2[4] = 40.0 CarpetRegrid2::radius_2[5] = 20.0 CarpetRegrid2::radius_2[6] = 10.0 # ----------- Region 3 -------------------- CarpetRegrid2::active_3 = "yes" CarpetRegrid2::num_levels_3 = 3 CarpetRegrid2::position_x_3 = 0 CarpetRegrid2::radius_3[1] = 320.0 CarpetRegrid2::radius_3[2] = 160.0 CarpetRegrid2::radius_3[3] = 80.0 CarpetRegrid2::radius_3[4] = 40.0 CarpetRegrid2::radius_x_3[5] = 30.0 CarpetRegrid2::radius_y_3[5] = 30.0 CarpetRegrid2::radius_z_3[5] = 25.0 CarpetRegrid2::radius_3[6] = 20.0 CarpetRegrid2::radius_3[7] = 5.0 # ----------------------------------------- Thanks for your time. I would look forward to hearing from you. Thanks, Sudipta Sudipta Hensh JSPS Postdoctoral Researcher Pronouns: He/Him Graduate School of Science Osaka University 1-1 Machikaneyama-cho, Toyonaka Osaka 560-0043, Japan Erik Schnetter wrote: Sudipta What is the size of the simulation domain? At which radius do you evaluate the angular momentum? What is the spatial resolution there? What is the time resolution there? Is there any matter nearby? What happens if you change the evaluation radius? What if you make it smaller or larger? How close is this to the outer boundary? Do you have a visualisation of the geometry (e.g. the imaginary part of the Weyl scalar Psi_2)? In which direction does the angular momentum point? Does this change over time? What is the magnitude of the angular momentum? How does this compare to the mass? -erik On Tue, Mar 19, 2024 at 9:35?AM Sudipta Hensh wrote: Dear all, I hope this email finds you well. I am performing simulations of BNS mergers and utilizing the QuasiLocalMeasures thorn to plot the total angular momentum of the spacetime. However, I have noticed high-frequency oscillations in the plotted data, as shown in the attached plot. I was wondering if we should expect such oscillations. I would also like to know the reason behind such oscillations. I would appreciate if you kindly help me to understand this issue. I am looking forward to hearing from you. Many thanks in advance! Regards, Sudipta Hensh JSPS Postdoctoral Researcher Pronouns: He/Him Graduate School of Science Osaka University 1-1 Machikaneyama-cho, Toyonaka Osaka 560-0043, Japan _______________________________________________ Users mailing list Users at einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users -- Erik Schnetter http://www.perimeterinstitute.ca/personal/eschnetter/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From wernecklr at gmail.com Thu Mar 21 09:57:21 2024 From: wernecklr at gmail.com (Leo Rosa Werneck) Date: Thu, 21 Mar 2024 07:57:21 -0700 Subject: [Users] Meeting minutes for 2024-03-21 Message-ID: <99E2B1C4-013D-446E-BD4E-5116E2732BBD@gmail.com> Hi all, Here are the minutes for today?s ET call. Chair: Roland Haas Minutes: Leo Werneck Present: Roland Haas, Leo Werneck, Peter Diener, Sam Cupp, Zach Etienne Steve Brandt * No meeting two weeks from now (April 4) due to APS April Meeting * NA ET School/Workshop @ LSU - June 3-7 (https://www.cct.lsu.edu/Einsteintoolkitworkshop2024). - Steve is deciding on length of the talks. - Everyone in the call should be thinking about talk topics to email Steve. - There will be a field trip to LIGO. - Workshop is on track to happen. - Working workshop hackathon for CarpetX may or may not happen afterwards. * ET Release - Moving as expected. - About to hit the 10 week mark ("all codes proposed for inclusion in master branch"). - Roland will try to create CarpetX versions of Grid and CartGrid3D. - Discuss these ideas in the regular CarpetX meeting. - Helvi suggested having a new repository for NewRadX so it doesn't have to live in a private repo. Will have to be discussed later with her group and the RIT group, which were not present in today's call. - Roland will start the process by creating a CarpetX repository. - MultipoleX: issue with grid, but very minor changes compared to Multipole. - NewRadX: documentation and no-harm review are in progress. Might need to poke people to figure out required citations. - Z4c: Steve will poke Erik, but already at "no-harm" stage. - GRHayL-based IllinoisGRMHD: in main now, tests updated, waiting to complete. - GRHayLHDX: Terrence is reviewing. Steve suggested having a TOV test. - Baikal with NRPy+2.0: Might need to merge PR, review underway. - BaikalX: Might not be included in this release, as more testing is needed. - The review deadlines are being extended by a week to help reviewers who are attending the 2024 APS April Meeting. * Mailing List - Someone had a problem when debug mode is enabled and PreSync is set to ?off?. A pointer isn't set, causing an assert can fail. Roland says this as a feature, not a bug, so it shouldn't be fixed with the proposed way. - One more email Erik is already involved with, so nothing to discuss. * Open Tickets - #2619: Alireza still interested in contributing Elliptica. - #2777: GRHayL-based IllinoisGRMHD --- Sam is working on fixing issues with backwards compatibility, as some of the tests are failing. - #2784: Cactus start up problems, Steve says he's working on it. - #2785: A friendly reminder that Zenodo is currently using the wrong URL. * Tickets ready for review N/A Next Chair: Sam Next Minutes: Roland Best, Leo ------ Leonardo R. Werneck, Ph.D. Postdoctoral researcher Office EP 314 | Department of Physics | University of Idaho 875 Perimeter Dr. MS 0903 Moscow, ID 83844-0903, USA leonardo at uidaho.edu https://leowerneck.github.io -------------- next part -------------- An HTML attachment was scrubbed... URL: From schnetter at gmail.com Sat Mar 23 09:33:47 2024 From: schnetter at gmail.com (Erik Schnetter) Date: Sat, 23 Mar 2024 10:33:47 -0400 Subject: [Users] Oscillations in total angular momentum from QuasiLocalMeasures In-Reply-To: <82857b1931c3.b8bebb2b5aa92@astro-osaka.jp> References: <82857b1931c3.b8bebb2b5aa92@astro-osaka.jp> Message-ID: Sudipta Does the oscillation frequency coincide with anything in your discretization? Is it related to your time step size or to the size of a grid cell? What happens if you change the spatial resolution? -erik On Thu, Mar 21, 2024 at 8:28?AM Sudipta Hensh wrote: > > Hi Erik, > > Sorry for the delay, I have written below the answers. > > 1. What is the size of the simulation domain? > > Simulation domain along x and y direction is [-1000,1000] and along z direction is [0,1000]. > > 2. At which radius do you evaluate the angular momentum? > > There are two extraction radii, 200 and 300. The plot that I sent was for 300. > > 3. What is the spatial resolution there? > > Spatial resolution is 5. > > 4. What is the time resolution there? > > The time resolution is 0.75. > > 5. Is there any matter nearby? > > There is no matter during the inspiral. > > 6. What happens if you change the evaluation radius? What if you make it > smaller or larger? > > For smaller radius the amplitude of oscillations is comparatively smaller. > > 7. How close is this to the outer boundary? > > The extraction radius is far from the outer boundary. > > 8. Do you have a visualisation of the geometry (e.g. the imaginary part > of the Weyl scalar Psi_2)? > > I am afraid that I do not have Psi_2 in the output. If necessary then I can output it. > > 9. In which direction does the angular momentum point? > Does this change over time? > > The plot I sent was for the angular momentum along z direction. > > 10. What is the magnitude of the angular momentum? How does this compare > to the mass? > > The initial magnitude of the angular momentum is 7.3 and total gravitational mass of the system is 2.75 M_Sun. > > I am leaving below some information from the parameter file that maybe relevant. > > CoordBase::xmin = -1000 > CoordBase::xmax = 1000 > CoordBase::ymin = -1000 > CoordBase::ymax = 1000 > CoordBase::zmin = 0 > CoordBase::zmax = 1000 > CoordBase::spacing = "numcells" > CoordBase::ncells_x = 200 > CoordBase::ncells_y = 200 > CoordBase::ncells_z = 100 > > Carpet::max_refinement_levels = 8 > Carpet::time_refinement_factors = "[1,1,2,4,8,16,32,64,128,256,512]" > > > CarpetRegrid2::num_centres = 3 > CarpetRegrid2::regrid_every = 128 > CarpetRegrid2::snap_to_coarse = "yes" > CarpetRegrid2::freeze_unaligned_levels = "yes" > CarpetRegrid2::freeze_unaligned_parent_levels = "yes" > > # ----------- Region 1 -------------------- > CarpetRegrid2::active_1 = "yes" > CarpetRegrid2::num_levels_1 = 7 > CarpetRegrid2::position_x_1 = 15.2365094091 > CarpetRegrid2::position_y_1 = 0.0 > CarpetRegrid2::radius_1[1] = 300.0 > CarpetRegrid2::radius_1[2] = 160.0 > CarpetRegrid2::radius_1[3] = 80.0 > CarpetRegrid2::radius_1[4] = 40.0 > CarpetRegrid2::radius_1[5] = 20.0 > CarpetRegrid2::radius_1[6] = 10.0 > > # ----------- Region 2 -------------------- > CarpetRegrid2::active_2 = "yes" > CarpetRegrid2::num_levels_2 = 7 > CarpetRegrid2::position_x_2 = -15.2365094091 > CarpetRegrid2::position_y_2 = -0.0 > CarpetRegrid2::radius_2[1] = 300.0 > CarpetRegrid2::radius_2[2] = 160.0 > CarpetRegrid2::radius_2[3] = 80.0 > CarpetRegrid2::radius_2[4] = 40.0 > CarpetRegrid2::radius_2[5] = 20.0 > CarpetRegrid2::radius_2[6] = 10.0 > > # ----------- Region 3 -------------------- > CarpetRegrid2::active_3 = "yes" > CarpetRegrid2::num_levels_3 = 3 > CarpetRegrid2::position_x_3 = 0 > CarpetRegrid2::radius_3[1] = 320.0 > CarpetRegrid2::radius_3[2] = 160.0 > CarpetRegrid2::radius_3[3] = 80.0 > CarpetRegrid2::radius_3[4] = 40.0 > CarpetRegrid2::radius_x_3[5] = 30.0 > CarpetRegrid2::radius_y_3[5] = 30.0 > CarpetRegrid2::radius_z_3[5] = 25.0 > CarpetRegrid2::radius_3[6] = 20.0 > CarpetRegrid2::radius_3[7] = 5.0 > # ----------------------------------------- > > Thanks for your time. I would look forward to hearing from you. > > Thanks, > Sudipta > > Sudipta Hensh > JSPS Postdoctoral Researcher > Pronouns: He/Him > Graduate School of Science > Osaka University > 1-1 Machikaneyama-cho, Toyonaka > Osaka 560-0043, Japan > > Erik Schnetter wrote: > > > Sudipta > > What is the size of the simulation domain? > At which radius do you evaluate the angular momentum? > What is the spatial resolution there? > What is the time resolution there? > Is there any matter nearby? > What happens if you change the evaluation radius? What if you make it > smaller or larger? > How close is this to the outer boundary? > Do you have a visualisation of the geometry (e.g. the imaginary part > of the Weyl scalar Psi_2)? > In which direction does the angular momentum point? > Does this change over time? > What is the magnitude of the angular momentum? How does this compare > to the mass? > > -erik > > > On Tue, Mar 19, 2024 at 9:35?AM Sudipta Hensh wrote: > >> >> Dear all, >> >> I hope this email finds you well. >> >> I am performing simulations of BNS mergers and utilizing the QuasiLocalMeasures thorn to plot the total angular momentum of the spacetime. However, I have noticed high-frequency oscillations in the plotted data, as shown in the attached plot. I was wondering if we should expect such oscillations. I would also like to know the reason behind such oscillations. I would appreciate if you kindly help me to understand this issue. >> >> I am looking forward to hearing from you. Many thanks in advance! >> >> Regards, >> Sudipta Hensh >> JSPS Postdoctoral Researcher >> Pronouns: He/Him >> Graduate School of Science >> Osaka University >> 1-1 Machikaneyama-cho, Toyonaka >> Osaka 560-0043, Japan >> _______________________________________________ >> Users mailing list >> Users at einsteintoolkit.org >> > http://lists.einsteintoolkit.org/mailman/listinfo/users > > > > -- > Erik Schnetter > http://www.perimeterinstitute.ca/personal/eschnetter/ > > -- Erik Schnetter http://www.perimeterinstitute.ca/personal/eschnetter/ From rhaas at illinois.edu Mon Mar 25 15:18:02 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Mon, 25 Mar 2024 15:18:02 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From sbrandt at cct.lsu.edu Wed Mar 27 13:47:25 2024 From: sbrandt at cct.lsu.edu (Steven Brandt) Date: Wed, 27 Mar 2024 13:47:25 -0500 Subject: [Users] US ET Workshop and Meeting 2024 Message-ID: North American Einstein Toolkit Workshop and Meeting 2024 TheNorth American Einstein Toolkit Meeting will take place from 3 - 7 June 2024 atThe Center for Computation and Technology , atLouisiana State univerisity in Baton Rouge, Louisiana. (https://www.cct.lsu.edu/Einsteintoolkitworkshop2024) This was a hybrid conference with talks and participants both in-person and over zoom. Please register through the site and indicate whether you would like to give a talk. The Einstein Toolkit is a community-driven software platform of core computational tools to advance and support research in relativistic astrophysics and gravitational physics. The conference consist of a mixture of tutorials for new users and talks about the latest developments both in the toolkit and the larger scientific community. Looking forward to seeing you there! --Steve -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Wed Mar 27 17:15:01 2024 From: rhaas at illinois.edu (rhaas at illinois.edu) Date: Wed, 27 Mar 2024 17:15:01 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. ** DAYLIGHT SAVING TIME WARNING ** Please note that the US / EU has already / not yet transitioned to / from daylight saving time. The phone call will be at 15:00 Central EU time. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From rhaas at illinois.edu Thu Mar 28 09:33:15 2024 From: rhaas at illinois.edu (Roland Haas) Date: Thu, 28 Mar 2024 09:33:15 -0500 Subject: [Users] meeting minutes for 2024-03-28 Message-ID: <20240328093315.064d4ba3@ekohaes8.ncsa.illinois.edu> Present: Roland, Peter, Sam, Steve, Zach ET US workshop ============== * date set to June 3 - 7 ET release timeline =================== * April 5th deadlines moved to April 19th * code is expected to be in master ** need to add Z4c ** need to add MultipoleX ** need to add NewRadX * create tickets for each contribution SpaceTimeX ========== * all in favor of trying to move SpaceTimeX to ET repos CarpetX ======= * all in favor of trying to move CarpetX to ET repos unanswered questions ==================== * https://lists.einsteintoolkit.org/pipermail/users/2024-March/009256.html related to https://bitbucket.org/einsteintoolkit/tickets/issues/2781 now merged to master tickets ======= * https://bitbucket.org/einsteintoolkit/tickets/issues/2748/inclusion-of-spacetimex-in-einstein should be made more specific for release to be used to add spacetimex to ET repos * https://bitbucket.org/einsteintoolkit/tickets/issues/2696/update-kuibit-to-140 Max ran into issues with kuibit on db1 following the tutorial * https://bitbucket.org/einsteintoolkit/tickets/issues/2786/support-carpetx-in-multipole this touches on the larger issue on CarpetX / Carpet non-compatibility tickets ready for review ======================== * no new tickets * https://bitbucket.org/einsteintoolkit/tickets/issues/963/improve-mclachlan-accuracy Peter and Zach still working on this No ET call April 4th due to APS meeting. Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From sbrandt at cct.lsu.edu Thu Mar 28 09:57:59 2024 From: sbrandt at cct.lsu.edu (Steven Brandt) Date: Thu, 28 Mar 2024 09:57:59 -0500 Subject: [Users] US ET Workshop and Meeting 2024 Message-ID: North American Einstein Toolkit Workshop and Meeting 2024 TheNorth American Einstein Toolkit Meeting will take place from 3 - 7 June 2024 atThe Center for Computation and Technology , atLouisiana State univerisity in Baton Rouge, Louisiana. (https://www.cct.lsu.edu/Einsteintoolkitworkshop2024) This was a hybrid conference with talks and participants both in-person and over zoom. Please register through the site and indicate whether you would like to give a talk. The Einstein Toolkit is a community-driven software platform of core computational tools to advance and support research in relativistic astrophysics and gravitational physics. The conference consist of a mixture of tutorials for new users and talks about the latest developments both in the toolkit and the larger scientific community. Looking forward to seeing you there! --Steve -------------- next part -------------- An HTML attachment was scrubbed... URL: From rhaas at illinois.edu Fri Mar 29 12:59:00 2024 From: rhaas at illinois.edu (Roland Haas) Date: Fri, 29 Mar 2024 12:59:00 -0500 Subject: [Users] WeylScal4 failing testsuites with ET_2023_11 In-Reply-To: References: Message-ID: <20240329125900.66cb731a@ekohaes8.ncsa.illinois.edu> Hello Bernard, (closing the email thread by making sure it is marked as "responded") This should be fixed as of commit e185dc0c https://bitbucket.org/cactuscode/cactus/commits/e185dc0c014d148908054ff34e6a051988a87e59 of Cactus (see ticket https://bitbucket.org/einsteintoolkit/tickets/issues/2781) Thanks to Sam for following up on this and testing the fixes. Yours, Roland > Hi Samuel. > > Your code fix did indeed fix the problem (without having to compile from > scratch with DEBUG=no) -- thanks! (I also compiled on a different machine > with DEBUG=no from scratch, and that ran OK too) > > I don't really understand what's going on here, though. I assume/hope that > WeylScal4 will be updated to avoid the need for this patch ... > > Thanks again, Bernard > > On Thu, Feb 29, 2024 at 3:45?PM Cupp, Samuel D. wrote: > > > This should be a bug that only affects debug mode. Looking through the > > code, I think I've tracked back the issue. The RDWR attribute for functions (set > > in CCTKi_CreateRDWRData) is only defined if presync_mode is set to > > something other than "off" (the default). As such, this section of code > > should be bypassed for that parameter setting. As a quick fix, you could > > change line 324 of repos/flesh/src/main/RDWR.cc > > > > from > > > > if(cctkGH == nullptr)) > > > > to > > > > if(cctkGH == nullptr || CCTK_Equals(presync_mode, "off")) > > > > Let me know if that fixes the issue. > > > > Samuel Cupp > > Postdoctoral Researcher > > Department of Physics > > University of Idaho > > ------------------------------ > > *From:* Bernard Kelly > > *Sent:* Thursday, February 29, 2024 12:29 PM > > *To:* Cupp, Samuel D. > > *Cc:* Einstein Toolkit Users > > *Subject:* Re: [Users] WeylScal4 failing testsuites with ET_2023_11 > > > > Hi Samuel. Thanks for the quick response. > > > > For both code releases (ET_2023_05 and ET_2023_11), I have DEBUG=yes in my > > config. > > > > Now that you've pointed it out, I *could* recompile from scratch with > > DEBUG=no ... but should I have to? And is this just covering up an actual > > bug (as the name implies)? > > > > Bernard > > > > On Thu, Feb 29, 2024 at 3:23?PM Cupp, Samuel D. > > wrote: > > > > Hi Bernard, > > Is your parfile setting the parameter presync_mode? Alternatively, did > > you compile in debug mode? I ask this because that function has the > > following code > > > > static bool presync_only = CCTK_Equals(presync_mode, "presync-only"); > > #ifndef CCTK_DEBUG > > if(!presync_only) > > return true; > > #endif > > > > Unless I'm reading this section incorrectly, the code shouldn't reach that > > assertion unless its in debug mode or the mode is "presync-only". > > > > Samuel Cupp > > Postdoctoral Researcher > > Department of Physics > > University of Idaho > > ------------------------------ > > *From:* Users on behalf of Bernard > > Kelly > > *Sent:* Thursday, February 29, 2024 11:58 AM > > *To:* Einstein Toolkit Users > > *Subject:* [Users] WeylScal4 failing testsuites with ET_2023_11 > > > > Hi. I just tried running a parameter file with WeylScal4 using the > > ET_2023_11 release, and it fails during the pre-initial stage, with screen > > output like the following: > > > > ------------- > > NFO (CarpetIOHDF5): I/O Method 'IOHDF5_1D' registered: 1D AMR output of > > grid variables to HDF5 files > > INFO (CarpetIOHDF5): I/O Method 'IOHDF5_2D' registered: 2D AMR output of > > grid variables to HDF5 files > > INFO (CarpetIOHDF5): Periodic 2D AMR output requested for: > > ML_ADMCONSTRAINTS::H > > INFO (CarpetIOHDF5): I/O Method 'IOHDF5_3D' registered: 3D AMR output of > > grid variables to HDF5 files > > INFO (CarpetIOScalar): Periodic scalar output requested for: > > ML_BSSN::H > > ML_BSSN::M1 > > ML_BSSN::M2 > > ML_BSSN::M3 > > cactus_sim_ET_2023_11_WS4_ORIG: > > /nobackupp19/bjkelly1/codes/Cactus_ET_2023_11/configs/sim/build/Cactus/main/RDWR.cc:336: > > int cctki_RDWR::CCTK_HasAccess(const _cGH *, int): Assertion > > `current_function->RDWR' failed. > > Rank 3 with PID 73750 received signal 6 > > Writing backtrace to > > Kerr_LES_StandardSpin_VACUUM_dx032_WS4_ORIG/backtrace.3.txt > > ------------- > > > > I tried to run the WeylScal4 testsuites too (Teukolsky etc), with the same > > "Assertion `current_function->RDWR' failed" message. > > > > Just to check, I went back an ET release (ET_2023_05), and did the same > > test, and the tests ran & passed. > > > > So did something happen between releases to change the behavior of > > WeylScal4? And would it affect other Kranc-generated thorns too? > > > > Thanks, Bernard > > > > -- > > ------------------------------------------------------------------ > > Bernard Kelly -- CRESST Assistant Research Scientist, NASA/GSFC > > Gravitational Astrophysics Laboratory --- Code 663 > > > > Phone: +1 (301) 286-7243 *** Fax: +1 (301) 286-2226 > > Web: https://urldefense.com/v3/__http://science.gsfc.nasa.gov/sed/bio/bernard.j.kelly__;!!DZ3fjg!_7Ft2l2JqhrYGy11coIILkYNi7AYTZN6xnZ9cs3FweqCVlJskmz_IvivhLfdBofzsBal4aBH7wsRQWIuklnyJw$ > > ORCID: orcid.org/0000-0002-3326-4454 > > ------------------------------------------------------------------ > > > > > > > > -- > > ------------------------------------------------------------------ > > Bernard Kelly -- CRESST Assistant Research Scientist, NASA/GSFC > > Gravitational Astrophysics Laboratory --- Code 663 > > > > Phone: +1 (301) 286-7243 *** Fax: +1 (301) 286-2226 > > Web: https://urldefense.com/v3/__http://science.gsfc.nasa.gov/sed/bio/bernard.j.kelly__;!!DZ3fjg!_7Ft2l2JqhrYGy11coIILkYNi7AYTZN6xnZ9cs3FweqCVlJskmz_IvivhLfdBofzsBal4aBH7wsRQWIuklnyJw$ > > ORCID: orcid.org/0000-0002-3326-4454 > > ------------------------------------------------------------------ > > > > -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From jiliwei.phys at gmail.com Fri Mar 29 15:06:05 2024 From: jiliwei.phys at gmail.com (Liwei Ji) Date: Fri, 29 Mar 2024 16:06:05 -0400 Subject: [Users] Compiling ET_2023_11 on Frontera In-Reply-To: References: Message-ID: <580D737B-E93F-40A5-BA20-1BAEB1B9C8CD@gmail.com> Hi Chloe, Maybe you can try the short way in this link https://github.com/lwJi/SpacetimeX/tree/main/Docs/compile-notes/frontera? SpacetimeX/Docs/compile-notes/frontera at main ? lwJi/SpacetimeX github.com Regards, Liwei > On Jan 29, 2024, at 17:53, Richards, Chloe Beth wrote: > > Hi everyone, > > I tried to compile the most recent release of the toolkit, ET_2023_11, on Frontera using simfactory and had some issues compiling certain thorns. > > In case there are others that are having similar issues, I was able to successfully compile once I commented out the following lines/thorns: > ExternalLibraries/Silo > GRHayL Library and GRHayL-dependent thorns > CarpetX thorns > > If users have successfully compiled with the thorns I commented out, please let me know. Thanks! > > Best, > > Chloe Richards > _______________________________________________ > Users mailing list > Users at einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/users -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: SpacetimeX.png Type: image/png Size: 91806 bytes Desc: not available URL: From lcombi at perimeterinstitute.ca Sun Mar 31 12:41:34 2024 From: lcombi at perimeterinstitute.ca (Luciano Combi) Date: Sun, 31 Mar 2024 13:41:34 -0400 Subject: [Users] About SYNCs with staggered variables Message-ID: Hi, community, I was doing some benchmark tests for my version of GRHydro with TimerReport and I found that a lot of time in the code is spent in SYNCs for the staggered variables. Analogous to IllinoisGRMHD I have the following lines in the schedule.ccl { > SYNC: > GRHydro::em_Ax,GRHydro::em_Ay,GRHydro::em_Az,GRHydro::em_psi6phi > LANG: C > } "Schedule symmetries -- Actually just a placeholder function to > ensure prolongations / processor syncs are done BEFORE outer boundaries are > updated." According to the timer, this takes 3 times more than other SYNCs. Is there a reason for this? Is it related to the prolongation operators for staggered variables? Thanks for your help! *Dr. Luciano Combi* Postdoctoral Researcher Perimeter Institute for Theoretical Physics CITA National Fellow (U. of Guelph) --- -------------- next part -------------- An HTML attachment was scrubbed... URL: