From hensh at astro-osaka.jp  Mon Apr  1 07:25:18 2024
From: hensh at astro-osaka.jp (Sudipta Hensh)
Date: Mon, 01 Apr 2024 12:25:18 +0000
Subject: [Users] Oscillations in total angular momentum from
 QuasiLocalMeasures
References: <a8695c3985eea.1f7e1325b5d4@astro-osaka.jp>
 <CADKQjjebmiND1uJZ7u8HN4a=9qyw3xV++CJGfwUkMEhLZuzrYQ@mail.gmail.com>
 <82857b1931c3.b8bebb2b5aa92@astro-osaka.jp>
 <CADKQjje1Fhgbjp4YUynYGpsdcBjkEz=qxOxrw7MnP6R5k5H9Kg@mail.gmail.com>
Message-ID: <76658eba93818.cf45b7d35cf07@astro-osaka.jp>

Hi Erik,
Sorry for the delayed reply, I was checking possible correlations with the oscillation frequency and other parameters. However, I have not found anything like that. If we increase the spatial resolution then the oscillation amplitude changes slightly while the frequency seems to be almost unchanged, so this information may not be useful.
I am looking forward to hearing from you,
Sudipta
Erik Schnetter wrote:
Sudipta
Does the oscillation frequency coincide with anything in your
discretization? Is it related to your time step size or to the size of
a grid cell?
What happens if you change the spatial resolution?
-erik
On Thu, Mar 21, 2024 at 8:28?AM Sudipta Hensh <hensh at astro-osaka.jp> wrote:
Hi Erik,
Sorry for the delay, I have written below the answers.
1. What is the size of the simulation domain?
Simulation domain along x and y direction is [-1000,1000] and along z direction is [0,1000].
2. At which radius do you evaluate the angular momentum?
There are two extraction radii, 200 and 300. The plot that I sent was for 300.
3. What is the spatial resolution there?
Spatial resolution is 5.
4. What is the time resolution there?
The time resolution is 0.75.
5. Is there any matter nearby?
There is no matter during the inspiral.
6. What happens if you change the evaluation radius? What if you make it
smaller or larger?
For smaller radius the amplitude of oscillations is comparatively smaller.
7. How close is this to the outer boundary?
The extraction radius is far from the outer boundary.
8. Do you have a visualisation of the geometry (e.g. the imaginary part
of the Weyl scalar Psi_2)?
I am afraid that I do not have Psi_2 in the output. If necessary then I can output it.
9. In which direction does the angular momentum point?
Does this change over time?
The plot I sent was for the angular momentum along z direction.
10. What is the magnitude of the angular momentum? How does this compare
to the mass?
The initial magnitude of the angular momentum is 7.3 and total gravitational mass of the system is 2.75 M_Sun.
I am leaving below some information from the parameter file that maybe relevant.
CoordBase::xmin = -1000
CoordBase::xmax = 1000
CoordBase::ymin = -1000
CoordBase::ymax = 1000
CoordBase::zmin = 0
CoordBase::zmax = 1000
CoordBase::spacing = "numcells"
CoordBase::ncells_x = 200
CoordBase::ncells_y = 200
CoordBase::ncells_z = 100
Carpet::max_refinement_levels = 8
Carpet::time_refinement_factors = "[1,1,2,4,8,16,32,64,128,256,512]"
CarpetRegrid2::num_centres = 3
CarpetRegrid2::regrid_every = 128
CarpetRegrid2::snap_to_coarse = "yes"
CarpetRegrid2::freeze_unaligned_levels = "yes"
CarpetRegrid2::freeze_unaligned_parent_levels = "yes"
# ----------- Region 1 --------------------
CarpetRegrid2::active_1 = "yes"
CarpetRegrid2::num_levels_1 = 7
CarpetRegrid2::position_x_1 = 15.2365094091
CarpetRegrid2::position_y_1 = 0.0
CarpetRegrid2::radius_1[1] = 300.0
CarpetRegrid2::radius_1[2] = 160.0
CarpetRegrid2::radius_1[3] = 80.0
CarpetRegrid2::radius_1[4] = 40.0
CarpetRegrid2::radius_1[5] = 20.0
CarpetRegrid2::radius_1[6] = 10.0
# ----------- Region 2 --------------------
CarpetRegrid2::active_2 = "yes"
CarpetRegrid2::num_levels_2 = 7
CarpetRegrid2::position_x_2 = -15.2365094091
CarpetRegrid2::position_y_2 = -0.0
CarpetRegrid2::radius_2[1] = 300.0
CarpetRegrid2::radius_2[2] = 160.0
CarpetRegrid2::radius_2[3] = 80.0
CarpetRegrid2::radius_2[4] = 40.0
CarpetRegrid2::radius_2[5] = 20.0
CarpetRegrid2::radius_2[6] = 10.0
# ----------- Region 3 --------------------
CarpetRegrid2::active_3 = "yes"
CarpetRegrid2::num_levels_3 = 3
CarpetRegrid2::position_x_3 = 0
CarpetRegrid2::radius_3[1] = 320.0
CarpetRegrid2::radius_3[2] = 160.0
CarpetRegrid2::radius_3[3] = 80.0
CarpetRegrid2::radius_3[4] = 40.0
CarpetRegrid2::radius_x_3[5] = 30.0
CarpetRegrid2::radius_y_3[5] = 30.0
CarpetRegrid2::radius_z_3[5] = 25.0
CarpetRegrid2::radius_3[6] = 20.0
CarpetRegrid2::radius_3[7] = 5.0
# -----------------------------------------
Thanks for your time. I would look forward to hearing from you.
Thanks,
Sudipta
Sudipta Hensh
JSPS Postdoctoral Researcher
Pronouns: He/Him
Graduate School of Science
Osaka University
1-1 Machikaneyama-cho, Toyonaka
Osaka 560-0043, Japan
Erik Schnetter wrote:
Sudipta
What is the size of the simulation domain?
At which radius do you evaluate the angular momentum?
What is the spatial resolution there?
What is the time resolution there?
Is there any matter nearby?
What happens if you change the evaluation radius? What if you make it
smaller or larger?
How close is this to the outer boundary?
Do you have a visualisation of the geometry (e.g. the imaginary part
of the Weyl scalar Psi_2)?
In which direction does the angular momentum point?
Does this change over time?
What is the magnitude of the angular momentum? How does this compare
to the mass?
-erik
On Tue, Mar 19, 2024 at 9:35?AM Sudipta Hensh <hensh at astro-osaka.jp> wrote:
Dear all,
I hope this email finds you well.
I am performing simulations of BNS mergers and utilizing the QuasiLocalMeasures thorn to plot the total angular momentum of the spacetime. However, I have noticed high-frequency oscillations in the plotted data, as shown in the attached plot. I was wondering if we should expect such oscillations. I would also like to know the reason behind such oscillations. I would appreciate if you kindly help me to understand this issue.
I am looking forward to hearing from you. Many thanks in advance!
Regards,
Sudipta Hensh
JSPS Postdoctoral Researcher
Pronouns: He/Him
Graduate School of Science
Osaka University
1-1 Machikaneyama-cho, Toyonaka
Osaka 560-0043, Japan
_______________________________________________
Users mailing list
Users at einsteintoolkit.org
http://lists.einsteintoolkit.org/mailman/listinfo/users
--
Erik Schnetter <schnetter at gmail.com>
http://www.perimeterinstitute.ca/personal/eschnetter/
-- 
Erik Schnetter <schnetter at gmail.com>
http://www.perimeterinstitute.ca/personal/eschnetter/
<
<
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240401/387ae865/attachment.htm>

From mzilhao at ua.pt  Mon Apr  1 09:33:12 2024
From: mzilhao at ua.pt (=?UTF-8?Q?Miguel_Zilh=C3=A3o?=)
Date: Mon, 1 Apr 2024 15:33:12 +0100
Subject: [Users] Oscillations in total angular momentum from
 QuasiLocalMeasures
In-Reply-To: <76658eba93818.cf45b7d35cf07@astro-osaka.jp>
References: <a8695c3985eea.1f7e1325b5d4@astro-osaka.jp>
 <CADKQjjebmiND1uJZ7u8HN4a=9qyw3xV++CJGfwUkMEhLZuzrYQ@mail.gmail.com>
 <82857b1931c3.b8bebb2b5aa92@astro-osaka.jp>
 <CADKQjje1Fhgbjp4YUynYGpsdcBjkEz=qxOxrw7MnP6R5k5H9Kg@mail.gmail.com>
 <76658eba93818.cf45b7d35cf07@astro-osaka.jp>
Message-ID: <a109570a-1ca7-4a5a-aa67-0e3041008834@ua.pt>

hi Sudipta and Erik,

just to mention that i've also seen similar behaviour in the ADM angular 
momentum reported by QuasiLocalMeasures in simulations with boson stars.

i don't have more detailed information at hand to provide (though i 
could find it if necessary), but i do recall that for simulation that 
i've done in the past with rotating boson stars, the ADM angular 
momentum reported oscillated widely. in same cases of the order of 100% 
of the expected value.

since this output was not crucial for my purposes at the time, and since 
all other diagnostic quantities that i looked at (including the ADM 
mass) looked totally fine, i never investigated this further.

but given what Sudipta reports, it could be worth to open an issue, and 
(once i have time to collect my data) i'd be happy to add any 
information i may have there.

cheers,
Miguel


On 01/04/2024 13:25, Sudipta Hensh wrote:
> Hi Erik,
> 
> Sorry for the delayed reply, I was checking possible correlations with 
> the oscillation frequency and other parameters. However, I have not 
> found anything like that. If we increase the spatial resolution then the 
> oscillation amplitude changes slightly while the frequency seems to be 
> almost unchanged, so this information may not be useful.
> 
> I am looking forward to hearing from you,
> Sudipta
> 
> Erik Schnetter wrote:
> 
> 
>> Sudipta
>>
>> Does the oscillation frequency coincide with anything in your
>> discretization? Is it related to your time step size or to the size of
>> a grid cell?
>>
>> What happens if you change the spatial resolution?
>>
>> -erik
>>
>>
>> On Thu, Mar 21, 2024 at 8:28?AM Sudipta Hensh <hensh at astro-osaka.jp> 
>> wrote:
>>
>>>
>>> Hi Erik,
>>>
>>> Sorry for the delay, I have written below the answers.
>>>
>>> 1. What is the size of the simulation domain?
>>>
>>> Simulation domain along x and y direction is [-1000,1000] and along z 
>>> direction is [0,1000].
>>>
>>> 2. At which radius do you evaluate the angular momentum?
>>>
>>> There are two extraction radii, 200 and 300. The plot that I sent was 
>>> for 300.
>>>
>>> 3. What is the spatial resolution there?
>>>
>>> Spatial resolution is 5.
>>>
>>> 4. What is the time resolution there?
>>>
>>> The time resolution is 0.75.
>>>
>>> 5. Is there any matter nearby?
>>>
>>> There is no matter during the inspiral.
>>>
>>> 6. What happens if you change the evaluation radius? What if you make it
>>> smaller or larger?
>>>
>>> For smaller radius the amplitude of oscillations is comparatively 
>>> smaller.
>>>
>>> 7. How close is this to the outer boundary?
>>>
>>> The extraction radius is far from the outer boundary.
>>>
>>> 8. Do you have a visualisation of the geometry (e.g. the imaginary part
>>> of the Weyl scalar Psi_2)?
>>>
>>> I am afraid that I do not have Psi_2 in the output. If necessary then 
>>> I can output it.
>>>
>>> 9. In which direction does the angular momentum point?
>>> Does this change over time?
>>>
>>> The plot I sent was for the angular momentum along z direction.
>>>
>>> 10. What is the magnitude of the angular momentum? How does this compare
>>> to the mass?
>>>
>>> The initial magnitude of the angular momentum is 7.3 and total 
>>> gravitational mass of the system is 2.75 M_Sun.
>>>
>>> I am leaving below some information from the parameter file that 
>>> maybe relevant.
>>>
>>> CoordBase::xmin? ? ? ? ? ? ? ? = -1000
>>> CoordBase::xmax? ? ? ? ? ? ? ? =? 1000
>>> CoordBase::ymin? ? ? ? ? ? ? ? = -1000
>>> CoordBase::ymax? ? ? ? ? ? ? ? =? 1000
>>> CoordBase::zmin? ? ? ? ? ? ? ? =? 0
>>> CoordBase::zmax? ? ? ? ? ? ? ? =? 1000
>>> CoordBase::spacing? ? ? ? ? ? ? ? ? ? ? = "numcells"
>>> CoordBase::ncells_x? ? ? ? ? ? ? ? ? ? = 200
>>> CoordBase::ncells_y? ? ? ? ? ? ? ? ? ? = 200
>>> CoordBase::ncells_z? ? ? ? ? ? ? ? ? ? = 100
>>>
>>> Carpet::max_refinement_levels? ? ? ? ? = 8
>>> Carpet::time_refinement_factors? ? ? ? = 
>>> "[1,1,2,4,8,16,32,64,128,256,512]"
>>>
>>>
>>> CarpetRegrid2::num_centres? ? ? ? ? ? ? = 3
>>> CarpetRegrid2::regrid_every? ? ? ? ? ? = 128
>>> CarpetRegrid2::snap_to_coarse? ? ? ? ? = "yes"
>>> CarpetRegrid2::freeze_unaligned_levels? ? ? ? ? = "yes"
>>> CarpetRegrid2::freeze_unaligned_parent_levels? = "yes"
>>>
>>> # ----------- Region 1 --------------------
>>> CarpetRegrid2::active_1? ? ? ? ? ? ? ? = "yes"
>>> CarpetRegrid2::num_levels_1? ? ? ? ? ? = 7
>>> CarpetRegrid2::position_x_1? ? ? ? ? ? = 15.2365094091
>>> CarpetRegrid2::position_y_1? ? ? ? ? ? = 0.0
>>> CarpetRegrid2::radius_1[1]? ? ? ? ? ? ? = 300.0
>>> CarpetRegrid2::radius_1[2]? ? ? ? ? ? ? = 160.0
>>> CarpetRegrid2::radius_1[3]? ? ? ? ? ? ? = 80.0
>>> CarpetRegrid2::radius_1[4]? ? ? ? ? ? ? = 40.0
>>> CarpetRegrid2::radius_1[5]? ? ? ? ? ? ? = 20.0
>>> CarpetRegrid2::radius_1[6]? ? ? ? ? ? ? = 10.0
>>>
>>> # ----------- Region 2 --------------------
>>> CarpetRegrid2::active_2? ? ? ? ? ? ? ? = "yes"
>>> CarpetRegrid2::num_levels_2? ? ? ? ? ? = 7
>>> CarpetRegrid2::position_x_2? ? ? ? ? ? = -15.2365094091
>>> CarpetRegrid2::position_y_2? ? ? ? ? ? = -0.0
>>> CarpetRegrid2::radius_2[1]? ? ? ? ? ? ? = 300.0
>>> CarpetRegrid2::radius_2[2]? ? ? ? ? ? ? = 160.0
>>> CarpetRegrid2::radius_2[3]? ? ? ? ? ? ? = 80.0
>>> CarpetRegrid2::radius_2[4]? ? ? ? ? ? ? = 40.0
>>> CarpetRegrid2::radius_2[5]? ? ? ? ? ? ? = 20.0
>>> CarpetRegrid2::radius_2[6]? ? ? ? ? ? ? = 10.0
>>>
>>> # ----------- Region 3 --------------------
>>> CarpetRegrid2::active_3? ? ? ? = "yes"
>>> CarpetRegrid2::num_levels_3? ? ? ? ? ? = 3
>>> CarpetRegrid2::position_x_3? ? ? ? ? ? = 0
>>> CarpetRegrid2::radius_3[1]? ? ? ? ? ? ? = 320.0
>>> CarpetRegrid2::radius_3[2]? ? ? ? ? ? ? = 160.0
>>> CarpetRegrid2::radius_3[3]? ? ? ? ? ? ? = 80.0
>>> CarpetRegrid2::radius_3[4]? ? ? ? ? ? ? = 40.0
>>> CarpetRegrid2::radius_x_3[5]? ? ? ? ? ? = 30.0
>>> CarpetRegrid2::radius_y_3[5]? ? ? ? ? ? = 30.0
>>> CarpetRegrid2::radius_z_3[5]? ? ? ? ? ? = 25.0
>>> CarpetRegrid2::radius_3[6]? ? ? ? ? ? ? = 20.0
>>> CarpetRegrid2::radius_3[7]? ? ? ? ? ? ? = 5.0
>>> # -----------------------------------------
>>>
>>> Thanks for your time. I would look forward to hearing from you.
>>>
>>> Thanks,
>>> Sudipta
>>>
>>> Sudipta Hensh
>>> JSPS Postdoctoral Researcher
>>> Pronouns: He/Him
>>> Graduate School of Science
>>> Osaka University
>>> 1-1 Machikaneyama-cho, Toyonaka
>>> Osaka 560-0043, Japan
>>>
>>> Erik Schnetter wrote:
>>>
>>>
>>> Sudipta
>>>
>>> What is the size of the simulation domain?
>>> At which radius do you evaluate the angular momentum?
>>> What is the spatial resolution there?
>>> What is the time resolution there?
>>> Is there any matter nearby?
>>> What happens if you change the evaluation radius? What if you make it
>>> smaller or larger?
>>> How close is this to the outer boundary?
>>> Do you have a visualisation of the geometry (e.g. the imaginary part
>>> of the Weyl scalar Psi_2)?
>>> In which direction does the angular momentum point?
>>> Does this change over time?
>>> What is the magnitude of the angular momentum? How does this compare
>>> to the mass?
>>>
>>> -erik
>>>
>>>
>>> On Tue, Mar 19, 2024 at 9:35?AM Sudipta Hensh <hensh at astro-osaka.jp> 
>>> wrote:
>>>
>>>
>>>>
>>>> Dear all,
>>>>
>>>> I hope this email finds you well.
>>>>
>>>> I am performing simulations of BNS mergers and utilizing the 
>>>> QuasiLocalMeasures thorn to plot the total angular momentum of the 
>>>> spacetime. However, I have noticed high-frequency oscillations in 
>>>> the plotted data, as shown in the attached plot. I was wondering if 
>>>> we should expect such oscillations. I would also like to know the 
>>>> reason behind such oscillations. I would appreciate if you kindly 
>>>> help me to understand this issue.
>>>>
>>>> I am looking forward to hearing from you. Many thanks in advance!
>>>>
>>>> Regards,
>>>> Sudipta Hensh
>>>> JSPS Postdoctoral Researcher
>>>> Pronouns: He/Him
>>>> Graduate School of Science
>>>> Osaka University
>>>> 1-1 Machikaneyama-cho, Toyonaka
>>>> Osaka 560-0043, Japan
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at einsteintoolkit.org
>>>>
>>>
>>> http://lists.einsteintoolkit.org/mailman/listinfo/users
>>>
>>>
>>>
>>> --
>>> Erik Schnetter <schnetter at gmail.com>
>>> http://www.perimeterinstitute.ca/personal/eschnetter/
>>>
>>>
>>
>>
>>
>> -- 
>> Erik Schnetter <schnetter at gmail.com>
>> http://www.perimeterinstitute.ca/personal/eschnetter/
>>
>>
>> <
>>
>> <
>>
> 
> _______________________________________________
> Users mailing list
> Users at einsteintoolkit.org
> http://lists.einsteintoolkit.org/mailman/listinfo/users

From rhaas at illinois.edu  Mon Apr  1 10:28:56 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Mon, 1 Apr 2024 10:28:56 -0500
Subject: [Users] About SYNCs with staggered variables
In-Reply-To: <CAN6=WiUbsiHEg_3N15ujx7HewxyR5MNVy9m9qteiBvY56HrscA@mail.gmail.com>
References: <CAN6=WiUbsiHEg_3N15ujx7HewxyR5MNVy9m9qteiBvY56HrscA@mail.gmail.com>
Message-ID: <20240401102856.433db30f@ekohaes8.ncsa.illinois.edu>

Hello Luciano,

Given that factor of 3 that you notice, it could be that this is mostly
some latency when doing network communication.

If your memory usage allows it you can experiment with the option

CarpetLib::combine_sends = "yes"

see

https://bitbucket.org/eschnett/carpet/src/master/CarpetLib/param.ccl#lines-223

and see if that makes things go faster.

This will send all data to all ranks at once instead of going a bit
slower so may help.

Yours,
Roland

> Hi, community,
> 
> I was doing some benchmark tests for my version of GRHydro with TimerReport
> and I found that a lot of time in the code is spent in SYNCs for the
> staggered variables. Analogous to IllinoisGRMHD I have the following  lines
> in the schedule.ccl
> 
>  {
> >       SYNC:
> > GRHydro::em_Ax,GRHydro::em_Ay,GRHydro::em_Az,GRHydro::em_psi6phi
> >       LANG: C
> >     } "Schedule symmetries -- Actually just a placeholder function to
> > ensure prolongations / processor syncs are done BEFORE outer boundaries are
> > updated."  
> 
> 
> 
> According to the timer, this takes 3 times more than other SYNCs. Is there
> a reason for this? Is it related to the prolongation operators for
> staggered variables?
> 
> Thanks for your help!
> 
> 
> 
> *Dr. Luciano Combi*
> Postdoctoral Researcher
> Perimeter Institute for Theoretical Physics
> CITA National Fellow (U. of Guelph)
> ---


-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240401/1a55ba1d/attachment.sig>

From rhaas at illinois.edu  Mon Apr  1 10:38:07 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Mon, 1 Apr 2024 10:38:07 -0500
Subject: [Users] number of thesis using the Einstein Toolkit codes
Message-ID: <20240401103807.60bbdc85@ekohaes8.ncsa.illinois.edu>

Hello all,

For a report to the NSF I am trying to obtain an idea of who many
student thesis were using (were enabled by) the Einstein Toolkit.

So if you are a student or are working with a student and have used the
Einstein Toolkit as part of your thesis work in between 2023-07-01 and
2024-06-30 it would be great if you could let me know.

You do not have to have defended in this period, just having used the
toolkit.

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240401/45268653/attachment.sig>

From rhaas at illinois.edu  Mon Apr  8 15:18:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Mon, 08 Apr 2024 15:18:01 -0500
Subject: [Users] Agenda for Thursday's Meeting
Message-ID: <E1rtvRJ-0000000E8Ec-473e@ekohaes8.ncsa.illinois.edu>

Please update the Wiki with agenda items for Thursday's meeting. Thanks!

https://docs.einsteintoolkit.org/et-docs/meeting_agenda

--The Maintainers

From sinan.long.23 at ucl.ac.uk  Tue Apr  9 11:28:30 2024
From: sinan.long.23 at ucl.ac.uk (Long, Sinan)
Date: Tue, 9 Apr 2024 16:28:30 +0000
Subject: [Users] Unable to access public data in LORENE
Message-ID: <DB8PR01MB6138FBA593E432C522127C35EC072@DB8PR01MB6138.eurprd01.prod.exchangelabs.com>

Dear Einstein Toolkit Consortium,

As I am trying to cross-verify the reference results and my results, I have a problem accessing public data in LORENE on this website (https://lorene.obspm.fr/data/binNS.html). It shows the error "FTP URLs are disabled". Could you help me with this, please? Thank you!

Best,
Sinan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240409/3bc7c56e/attachment.htm>

From rhaas at illinois.edu  Wed Apr 10 09:01:11 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Wed, 10 Apr 2024 09:01:11 -0500
Subject: [Users] Unable to access public data in LORENE
In-Reply-To: <DB8PR01MB6138FBA593E432C522127C35EC072@DB8PR01MB6138.eurprd01.prod.exchangelabs.com>
References: <DB8PR01MB6138FBA593E432C522127C35EC072@DB8PR01MB6138.eurprd01.prod.exchangelabs.com>
Message-ID: <20240410090111.2e81406c@ekohaes8.ncsa.illinois.edu>

Hello Sinan,

> As I am trying to cross-verify the reference results and my results,
> I have a problem accessing public data in LORENE on this website
> (https://urldefense.com/v3/__https://lorene.obspm.fr/data/binNS.html__;!!DZ3fjg!9jEPsXYtESmXIH5cgd7S9qJ18nLzn360bBMjfbSyXmob6ovcujmRuBwhQyERMlr6C_clps-SG3l-Pst6JUxvW-hGAw$
> ). It shows the error "FTP URLs are disabled". Could you help me with
> this, please? Thank you!

You will need to install a ftp client to access LORENE's initial data
files (support for the ftp (file transfer protocol) protocol has been
removed from modern browsers).

Wikipedia contains a list of ftp clients:

https://en.wikipedia.org/wiki/Comparison_of_FTP_client_software

for different operating systems. An easy to use (since it has a GUI)
one may be FileZilla

https://filezilla-project.org/download.php?type=client

For Windows you can also try WinSCP 

https://winscp.net/eng/index.php

which I have used myself for SCP based access but which also supports
FTP.

For Linux your distributions package manager will have a number of ftp
clients available eg. for Ubuntu (where I myself use lftp but it is
command line only)

https://packages.ubuntu.com/search?suite=noble&section=all&arch=any&keywords=ftp&searchon=all

For the gallery example

http://einsteintoolkit.org/gallery/bns/index.html

the Einstein Toolkit website provides a direct download for the file

G2_I12vs12_D4R33T21_45km.resu.xz 	

at

http://einsteintoolkit.org/gallery/bns/G2_I12vs12_D4R33T21_45km.resu.xz

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240410/beb43c43/attachment.sig>

From rhaas at illinois.edu  Wed Apr 10 09:01:18 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Wed, 10 Apr 2024 09:01:18 -0500
Subject: [Users] Unable to access public data in LORENE
In-Reply-To: <DB8PR01MB6138FBA593E432C522127C35EC072@DB8PR01MB6138.eurprd01.prod.exchangelabs.com>
References: <DB8PR01MB6138FBA593E432C522127C35EC072@DB8PR01MB6138.eurprd01.prod.exchangelabs.com>
Message-ID: <20240410090111.2e81406c@ekohaes8.ncsa.illinois.edu>

Hello Sinan,

> As I am trying to cross-verify the reference results and my results,
> I have a problem accessing public data in LORENE on this website
> (https://urldefense.com/v3/__https://lorene.obspm.fr/data/binNS.html__;!!DZ3fjg!9jEPsXYtESmXIH5cgd7S9qJ18nLzn360bBMjfbSyXmob6ovcujmRuBwhQyERMlr6C_clps-SG3l-Pst6JUxvW-hGAw$
> ). It shows the error "FTP URLs are disabled". Could you help me with
> this, please? Thank you!

You will need to install a ftp client to access LORENE's initial data
files (support for the ftp (file transfer protocol) protocol has been
removed from modern browsers).

Wikipedia contains a list of ftp clients:

https://en.wikipedia.org/wiki/Comparison_of_FTP_client_software

for different operating systems. An easy to use (since it has a GUI)
one may be FileZilla

https://filezilla-project.org/download.php?type=client

For Windows you can also try WinSCP 

https://winscp.net/eng/index.php

which I have used myself for SCP based access but which also supports
FTP.

For Linux your distributions package manager will have a number of ftp
clients available eg. for Ubuntu (where I myself use lftp but it is
command line only)

https://packages.ubuntu.com/search?suite=noble&section=all&arch=any&keywords=ftp&searchon=all

For the gallery example

http://einsteintoolkit.org/gallery/bns/index.html

the Einstein Toolkit website provides a direct download for the file

G2_I12vs12_D4R33T21_45km.resu.xz 	

at

http://einsteintoolkit.org/gallery/bns/G2_I12vs12_D4R33T21_45km.resu.xz

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240410/beb43c43/attachment-0003.sig>

From rhaas at illinois.edu  Wed Apr 10 17:15:02 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Wed, 10 Apr 2024 17:15:02 -0500
Subject: [Users] Einstein Toolkit Meeting Reminder
Message-ID: <E1rugDe-00000000OXj-08xB@ekohaes8.ncsa.illinois.edu>

Hello,

Please consider joining the weekly Einstein Toolkit phone call at
9:00 am US central time on Thursdays. For details on how to connect
and what agenda items are to be discussed, use the link below.

https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call

--The Maintainers

From scupp1 at my.apsu.edu  Thu Apr 11 09:49:17 2024
From: scupp1 at my.apsu.edu (Cupp, Samuel D.)
Date: Thu, 11 Apr 2024 14:49:17 +0000
Subject: [Users] meeting minutes for 2024-04-11
Message-ID: <CH0PR01MB68581656D0A68D44E1A9D861D9052@CH0PR01MB6858.prod.exchangelabs.com>

Present: Roland, Peter, Sam, Steve, Zach, Leo, Lucas, Yosef

NSF reporting time!
Those with ongoing or recently completed theses that use the Einstein Toolkit please reply to Roland's email so this information can be included in the report.

ET US workshop
==============
LIGO tour is arranged

ET release timeline
===================
Next deadline: reviews due April 19th

tickets
=======
#2790
Minor changes to fix outdated documentation in MoL

#2696
Kuibit now has new version 1.4.1 (minimum python version 3.7)

tickets ready for review
========================
#2786
Suggested changes so that Multipole will work for both Carpet and CarpetX led to conversation regarding grid implementation. Following this was a complicated discussion regarding inheritance, whether backward compatibility extends to old thornlists in general.

#963
Improvements to Baikal(Vacuum) planned for November release
Peter also plans to add these improvements to McLachlan

Other topics
==========
<https://bitbucket.org/einsteintoolkit/tickets/issues?status=new>
Sam brought up CarpetX issue requesting the addition of a feature to control the rhs tag at runtime.

Steve suggested adding general build instructions to the website that recommends using the utils/Scripts/makethornlist to generate a smaller specialized thornlist based on a parfile.

Next week:
Chair - Zach
Minute taker - Leo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240411/97fc88c1/attachment.htm>

From lcombi at perimeterinstitute.ca  Fri Apr 12 13:52:28 2024
From: lcombi at perimeterinstitute.ca (Luciano Combi)
Date: Fri, 12 Apr 2024 15:52:28 -0300
Subject: [Users] About SYNCs with staggered variables
In-Reply-To: <20240401102856.433db30f@ekohaes8.ncsa.illinois.edu>
References: <CAN6=WiUbsiHEg_3N15ujx7HewxyR5MNVy9m9qteiBvY56HrscA@mail.gmail.com>
 <20240401102856.433db30f@ekohaes8.ncsa.illinois.edu>
Message-ID: <CAN6=WiXQmsKwx28TtdGr53b6d7CO+qg_JUyiLm9dAaJmXOArxw@mail.gmail.com>

Thanks for the tip Roland.

I have tried it and it seems I'm getting the same efficiency nevertheless.

I was wondering whether, perhaps, the prolongations of the staggered
variables are somehow more expensive/inefficient?

Thanks a lot.


Luciano


On Mon, Apr 1, 2024 at 12:29?PM Roland Haas <rhaas at illinois.edu> wrote:

> Hello Luciano,
>
> Given that factor of 3 that you notice, it could be that this is mostly
> some latency when doing network communication.
>
> If your memory usage allows it you can experiment with the option
>
> CarpetLib::combine_sends = "yes"
>
> see
>
>
> https://bitbucket.org/eschnett/carpet/src/master/CarpetLib/param.ccl#lines-223
>
> and see if that makes things go faster.
>
> This will send all data to all ranks at once instead of going a bit
> slower so may help.
>
> Yours,
> Roland
>
> > Hi, community,
> >
> > I was doing some benchmark tests for my version of GRHydro with
> TimerReport
> > and I found that a lot of time in the code is spent in SYNCs for the
> > staggered variables. Analogous to IllinoisGRMHD I have the following
> lines
> > in the schedule.ccl
> >
> >  {
> > >       SYNC:
> > > GRHydro::em_Ax,GRHydro::em_Ay,GRHydro::em_Az,GRHydro::em_psi6phi
> > >       LANG: C
> > >     } "Schedule symmetries -- Actually just a placeholder function to
> > > ensure prolongations / processor syncs are done BEFORE outer
> boundaries are
> > > updated."
> >
> >
> >
> > According to the timer, this takes 3 times more than other SYNCs. Is
> there
> > a reason for this? Is it related to the prolongation operators for
> > staggered variables?
> >
> > Thanks for your help!
> >
> >
> >
> > *Dr. Luciano Combi*
> > Postdoctoral Researcher
> > Perimeter Institute for Theoretical Physics
> > CITA National Fellow (U. of Guelph)
> > ---
>
>
> --
> My email is as private as my paper mail. I therefore support encrypting
> and signing email messages. Get my PGP key from http://pgp.mit.edu .
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240412/b8996280/attachment.htm>

From rhaas at illinois.edu  Fri Apr 12 14:15:40 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Fri, 12 Apr 2024 14:15:40 -0500
Subject: [Users] About SYNCs with staggered variables
In-Reply-To: <CAN6=WiXQmsKwx28TtdGr53b6d7CO+qg_JUyiLm9dAaJmXOArxw@mail.gmail.com>
References: <CAN6=WiUbsiHEg_3N15ujx7HewxyR5MNVy9m9qteiBvY56HrscA@mail.gmail.com>
 <20240401102856.433db30f@ekohaes8.ncsa.illinois.edu>
 <CAN6=WiXQmsKwx28TtdGr53b6d7CO+qg_JUyiLm9dAaJmXOArxw@mail.gmail.com>
Message-ID: <20240412141540.3a76154e@ekohaes8.ncsa.illinois.edu>

Hello Luciano,

> Thanks for the tip Roland.
> 
> I have tried it and it seems I'm getting the same efficiency nevertheless.

Yeah, it was a bit of a long shot.

> I was wondering whether, perhaps, the prolongations of the staggered
> variables are somehow more expensive/inefficient?

I could not think of anything that would make it more expensive. It is
just a slightly different interpolation stencil, but has the same size
overall.

Could in principle be less efficient if the functions are less well
optimized.

My guess would normally be that its related to the communication time
and not so much to the actual computation time of the interpolation.

Maybe Zach Etienne, whose IllinoisGRMHD code initially required this
sort of interpolation, recalls any issues?

If not you could try and run with all verbose options on 

Carpet::verbose = yes
Carpet::veryverbose = yes

CarpetLib::verbose = yes
CarpetLib::commstate_verbose = yes

and possibly

Carpet::sync_barriers = yes

to get more consistent (but possibly slower than normal) timing results.

Note that these will produce a lot of log output so you only want to
run a very few timesteps.

@Erik: just to confirm, if one has a:

SYNC: Ax, Ay

then those two synchronizations happen in parallel and not first Ax then
a MPI_WaitAll then Ay then a MPI_WaitAll (I had thought they'd be one
after the other, but looking at CarpetLib's code in commstate and
gdata it seems they all happen at once)?

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240412/d1f6adbb/attachment.sig>

From lcombi at perimeterinstitute.ca  Sat Apr 13 10:02:39 2024
From: lcombi at perimeterinstitute.ca (Luciano Combi)
Date: Sat, 13 Apr 2024 12:02:39 -0300
Subject: [Users] question about checkpoints and number of procs
Message-ID: <CAN6=WiU06cPpgZAVbUZ7-8FooCzVmGRd9Xp+gPQh9y8EpBFndQ@mail.gmail.com>

Hi all,

Another question:

I'm trying to restart a simulation with a different number of processors
than the original run. Is there something in particular I need to do to
make it work? When I do, it gets stuck for hours reading the checkpoints.
The checkpoint is distributed in a number of files corresponding to the
original number of procs I used, should I recombine them in a particular
way?

Thanks again!


---
*Dr. Luciano Combi*
Postdoctoral Researcher
Perimeter Institute for Theoretical Physics
CITA National Fellow (U. of Guelph)
---
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240413/f2296e2d/attachment.htm>

From shenfei2002 at foxmail.com  Sat Apr 13 02:21:36 2024
From: shenfei2002 at foxmail.com (=?gb18030?B?ve23x7eyzsQ=?=)
Date: Sat, 13 Apr 2024 15:21:36 +0800
Subject: [Users] some questions regarding the use of LORENE to generate
 initial data for the merger of binary neutron stars.
Message-ID: <tencent_120663414B9C878F1092A470AB567C576309@qq.com>

Professor, hello. I am an undergraduate student from Nanjing Normal University. My research topic is related to the merger of binary neutron stars. However, I have encountered some difficulties in generating initial data with LORENE, and I hope to receive your assistance. Thank you very much.
 
I have downloaded the LORENE library in the Fedora virtual machine environment and selected some test examples from the website at&nbsp;https://ccrgpages.rit.edu/~jfaber/BNSID/. Here are my specific operations: First, I replaced the file "binaire_orbite.C" in the Codes folder with the one I downloaded in the LORENE folder, and replaced the file "coal_seq_massscan.C" with the "coal.c" file in the "/Lorene/Codes/Bin_star" directory of the LORENE folder. Next, I selected the example in the "Data/AP4/AP4_1.8_1.4" folder on the website for simulation calculations. Among them, I copied the six files, "par_eos1.d", "par_eos2.d", "par_grid1.d", "par_grid2.d", "par_init.d", and "parcoal_seq.d.40km", to the "/Lorene/Codes/Bin_star" directory of the LORENE folder. Subsequently, I ran the command in the terminal of that directory. The specific command I executed is as follows:

make init_bin

make coal

make lit_bin

./init_bin

 

./coal

However, during the execution process, I encountered the following assertion error:

coal: /home/lhc/Lorene/C++/Include/tbl.h:282: double&amp; Lorene::Tbl::set(int): Assertion `etat == ETATQCQ' failed.

Aborted (core dumped)

Next, I modified the line 282 in the file "/home/lhc/Lorene/C++/Include/tbl.h" from etat == ETATQCQ to true and attempted to run it again. This time, there was no assertion error reported.

&nbsp;

 

After running for about an hour, I obtained the following files:

However, the initial data file I obtained is different from the initial data files in the "Data/AP4/AP4_1.8_1.4" folder on the website https://ccrgpages.rit.edu/~jfaber/BNSID/. Specifically, the file I got is named "resu_4.000000e+01_2.080000e+00_1.550000e+00.d".

&nbsp;

 

Do you know why this is the case? Is it due to my incorrect operation steps that led to this issue?





????
shenfei2002 at foxmail.com



&nbsp;
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240413/30c13088/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 2A08FBFE at 4BD3F234.80321A66.jpg
Type: image/jpeg
Size: 47217 bytes
Desc: not available
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240413/30c13088/attachment-0001.jpg>

From rhaas at illinois.edu  Mon Apr 15 08:19:13 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Mon, 15 Apr 2024 08:19:13 -0500
Subject: [Users] question about checkpoints and number of procs
In-Reply-To: <CAN6=WiU06cPpgZAVbUZ7-8FooCzVmGRd9Xp+gPQh9y8EpBFndQ@mail.gmail.com>
References: <CAN6=WiU06cPpgZAVbUZ7-8FooCzVmGRd9Xp+gPQh9y8EpBFndQ@mail.gmail.com>
Message-ID: <20240415081913.1475d57f@ekohaes8.ncsa.illinois.edu>

Hello Luciano ,

> I'm trying to restart a simulation with a different number of processors
> than the original run. Is there something in particular I need to do to
> make it work? When I do, it gets stuck for hours reading the checkpoints.
> The checkpoint is distributed in a number of files corresponding to the
> original number of procs I used, should I recombine them in a particular
> way?

The issue is that when changing the number of MPI ranks the data needs
to be reorganized and right now this means that each MPI rank will open
every single file to look for data, which can overwhelm the file system.

A quick workaround is often to set:

CarpetIOHDF5::open_one_input_file_at_a_time = "yes"

which reduces IO contention.

If that is still too slow (this has happened only with many hundreds of
MPI ranks though), then you can try the hacked version of CarpetIOHDF5
in the branch rhaas/map which contains an helper script that you can
run offline to parse all information in the checkpoint files into a
"map" file. At checkpoint recovery time the MPI ranks then read in the
map file which tells them exactly where they need to look for their
data, this significantly reduces IO issues. It is is not user friendly
though and was an emergency hack and will most likely require some
trial and error to get it right, so setting the parameter above would
be my first attempt.

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240415/c368f367/attachment.sig>

From lcombi at perimeterinstitute.ca  Mon Apr 15 12:04:11 2024
From: lcombi at perimeterinstitute.ca (Luciano Combi)
Date: Mon, 15 Apr 2024 14:04:11 -0300
Subject: [Users] question about checkpoints and number of procs
In-Reply-To: <20240415081913.1475d57f@ekohaes8.ncsa.illinois.edu>
References: <CAN6=WiU06cPpgZAVbUZ7-8FooCzVmGRd9Xp+gPQh9y8EpBFndQ@mail.gmail.com>
 <20240415081913.1475d57f@ekohaes8.ncsa.illinois.edu>
Message-ID: <CAN6=WiUFyC4M8Em2iZsrKq+5LdRwkCx50tF-7BvrpKzMBHMGRQ@mail.gmail.com>

I see, thanks, Roland!

As a matter of fact, I had that option already activated, otherwise it
would just give me a memory error.

I'm thinking of maybe restarting the simulation with openMP activated to
speed up the process, do you think it will help? Otherwise, I will try your
hack.

Cheers.
Luciano


On Mon, Apr 15, 2024 at 10:19?AM Roland Haas <rhaas at illinois.edu> wrote:

> Hello Luciano ,
>
> > I'm trying to restart a simulation with a different number of processors
> > than the original run. Is there something in particular I need to do to
> > make it work? When I do, it gets stuck for hours reading the checkpoints.
> > The checkpoint is distributed in a number of files corresponding to the
> > original number of procs I used, should I recombine them in a particular
> > way?
>
> The issue is that when changing the number of MPI ranks the data needs
> to be reorganized and right now this means that each MPI rank will open
> every single file to look for data, which can overwhelm the file system.
>
> A quick workaround is often to set:
>
> CarpetIOHDF5::open_one_input_file_at_a_time = "yes"
>
> which reduces IO contention.
>
> If that is still too slow (this has happened only with many hundreds of
> MPI ranks though), then you can try the hacked version of CarpetIOHDF5
> in the branch rhaas/map which contains an helper script that you can
> run offline to parse all information in the checkpoint files into a
> "map" file. At checkpoint recovery time the MPI ranks then read in the
> map file which tells them exactly where they need to look for their
> data, this significantly reduces IO issues. It is is not user friendly
> though and was an emergency hack and will most likely require some
> trial and error to get it right, so setting the parameter above would
> be my first attempt.
>
> Yours,
> Roland
>
> --
> My email is as private as my paper mail. I therefore support encrypting
> and signing email messages. Get my PGP key from http://pgp.mit.edu .
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240415/d9f0aed4/attachment.htm>

From rhaas at illinois.edu  Mon Apr 15 12:16:54 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Mon, 15 Apr 2024 12:16:54 -0500
Subject: [Users] question about checkpoints and number of procs
In-Reply-To: <CAN6=WiUFyC4M8Em2iZsrKq+5LdRwkCx50tF-7BvrpKzMBHMGRQ@mail.gmail.com>
References: <CAN6=WiU06cPpgZAVbUZ7-8FooCzVmGRd9Xp+gPQh9y8EpBFndQ@mail.gmail.com>
 <20240415081913.1475d57f@ekohaes8.ncsa.illinois.edu>
 <CAN6=WiUFyC4M8Em2iZsrKq+5LdRwkCx50tF-7BvrpKzMBHMGRQ@mail.gmail.com>
Message-ID: <20240415121654.6fded47a@ekohaes8.ncsa.illinois.edu>

Hello Luciano,

> As a matter of fact, I had that option already activated, otherwise it
> would just give me a memory error.
Hmm, ok.

> I'm thinking of maybe restarting the simulation with openMP activated to
> speed up the process, do you think it will help? Otherwise, I will try your
> hack.
I would be surprised if OpenMP helped since this is all IO bound and
there is no computation. Note that you must ensure that even if you do
not use OpenMP the number of MPI ranks is the same as your final
simulation, otherwise you will end up having to wait for the checkpoint
recovery again.

Using my hack you will need to switch to branch rhaas/map:

git checkout rhaas/map

then recompile and make sure you also compile all the utilities
(simfactory does that automatically, in Cactus itself this is make
foo-utils).

This will give you a new utility called 

hdf5_create_binary_map

and there is also a helper script hdf5_create_binary_map.sh (both
should end up in exe/sim/*).

Run hdf5_create_binary_map.sh in each checkpoint file, it will produce
one "map" file per checkpoint file. This can be done in parallel (one
invocation per file, all invocations in parallel) if the cluster admins
let you (might need a short term interactive job maybe).

Concatenate all map files to a new map file using the same basename:

cat foo.file_*.map >foo.map

and make sure the concatenated map is in the same location as the
checkpoint files.

The logic for this is mostly in the ReadMap function of
CarpetIOHDF5/src/Input.cc

You may want to add a 

CCTK_VINFO("Reading map files %s", fn);

just before the fopen call in there if you are not sure you have
everything set up correctly. Otherwise there is no (obvious)
indication that the map file is used (it silently falls back to the old
/ slow method if the map file is missing).

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240415/8560371d/attachment.sig>

From rhaas at illinois.edu  Mon Apr 15 15:18:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Mon, 15 Apr 2024 15:18:01 -0500
Subject: [Users] Agenda for Thursday's Meeting
Message-ID: <E1rwSm9-00000009D7I-11br@ekohaes8.ncsa.illinois.edu>

Please update the Wiki with agenda items for Thursday's meeting. Thanks!

https://docs.einsteintoolkit.org/et-docs/meeting_agenda

--The Maintainers

From hamzaw.w06 at gmail.com  Mon Apr 15 15:44:50 2024
From: hamzaw.w06 at gmail.com (Hamza Wadiwala)
Date: Mon, 15 Apr 2024 15:44:50 -0500
Subject: [Users] Support Ticket - Hamza
Message-ID: <CAAOA2DgLr8ESME12ekO=bYkAb6KmYO4zCayyCX8++yr=B+jDiQ@mail.gmail.com>

Hello,

I am currently attempting to work my way through this website, for setting
up the Einstein toolkit on windows.  Setup Tutorial - Einstein Toolkit
Documentation <https://docs.einsteintoolkit.org/et-docs/Setup_Tutorial>. I
am using Ubuntu in windows powershell for my installation, but when it
comes to the part about option lists for different linux versions on the
webpage, I am unable to find the option list they are referencing and can't
seem to find any replacement for it. I'm using simfactory2 instead of the
original simfactory they reference in the 2017 web page, and the most
recent versions of all the files and cactus that are posted on the website.

Best,
Hamza
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240415/8f24578b/attachment.htm>

From rhaas at illinois.edu  Tue Apr 16 08:50:00 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Tue, 16 Apr 2024 08:50:00 -0500
Subject: [Users] Support Ticket - Hamza
In-Reply-To: <CAAOA2DgLr8ESME12ekO=bYkAb6KmYO4zCayyCX8++yr=B+jDiQ@mail.gmail.com>
References: <CAAOA2DgLr8ESME12ekO=bYkAb6KmYO4zCayyCX8++yr=B+jDiQ@mail.gmail.com>
Message-ID: <20240416085000.49ee220f@ekohaes8.ncsa.illinois.edu>

Hello Hamza,

> I am currently attempting to work my way through this website, for setting
> up the Einstein toolkit on windows.  Setup Tutorial - Einstein Toolkit
> Documentation <https://urldefense.com/v3/__https://docs.einsteintoolkit.org/et-docs/Setup_Tutorial__;!!DZ3fjg!96rlBO3tVRIBAVENHsewo8f4IdbyMNBwMsb93N6ohsMWXnzK-S8YPG-4aIFQ0dLoKjRkULo6zlT9xtSnFqs$ >. I

Uff, that is one very old tutorial. It is unfortunately quite likely
out of date (I will add a warning on top to that effect).

Instead I would suggest following the instructions in the juyter
notebook (by copying and pasting the commands from the cells to your
terminal):

https://github.com/einsteintoolkit/jupyter-et/blob/master/tutorial-server/notebooks/CactusTutorial.ipynb

It lists both the Ubuntu packages to install and the commands used to
download and compile. No custom option list is required anymore and the
"generic.cfg" one used by default will work.

> am using Ubuntu in windows powershell for my installation, but when it
> comes to the part about option lists for different linux versions on the
> webpage, I am unable to find the option list they are referencing and can't
> seem to find any replacement for it. I'm using simfactory2 instead of the
> original simfactory they reference in the 2017 web page, and the most
> recent versions of all the files and cactus that are posted on the website.

With the prerequisite packages installed you will not require any
special option list since Cactus's build system will detect all
required packages.

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240416/832fbe9d/attachment-0001.sig>

From max.misyura94 at gmail.com  Wed Apr 17 06:57:53 2024
From: max.misyura94 at gmail.com (=?UTF-8?B?0JzQsNC60YHQuNC8INCc0LjRgdGO0YDQsA==?=)
Date: Wed, 17 Apr 2024 14:57:53 +0300
Subject: [Users] Data from the simulation GW150914
Message-ID: <CAHAo3hwnBvSwNvy4Cz77vUQ_RT4CSTcHVVdSAv3Md_pBsRNC0w@mail.gmail.com>

I am Misyura Maxim and I am conducting research into how strong
gravitational waves interact with matter.
Am I correct to assume that I can obtain the full data from the simulation
GW150914. In particular, I am interested in the values provided by ADMBASE,
otherwise, it would be necessary for me to download all the available data.

Sincerely yours,
Misyura Maxim, PhD student of Saint-Petersburg State University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240417/bb93d5bb/attachment.htm>

From rhaas at illinois.edu  Wed Apr 17 17:15:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Wed, 17 Apr 2024 17:15:01 -0500
Subject: [Users] Einstein Toolkit Meeting Reminder
Message-ID: <E1rxDYT-0000000D5kf-1fXE@ekohaes8.ncsa.illinois.edu>

Hello,

Please consider joining the weekly Einstein Toolkit phone call at
9:00 am US central time on Thursdays. For details on how to connect
and what agenda items are to be discussed, use the link below.

https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call

--The Maintainers

From zachetie at gmail.com  Thu Apr 18 09:57:14 2024
From: zachetie at gmail.com (Zach Etienne)
Date: Thu, 18 Apr 2024 07:57:14 -0700
Subject: [Users] some questions regarding the use of LORENE to generate
 initial data for the merger of binary neutron stars.
In-Reply-To: <tencent_120663414B9C878F1092A470AB567C576309@qq.com>
References: <tencent_120663414B9C878F1092A470AB567C576309@qq.com>
Message-ID: <CAP6hNvyGC-HGF6zEaJXFRB9Czo-EFdPYenMsTUsqCTF_4cLo6Q@mail.gmail.com>

Greetings! I am CCing Prof Josh Faber on this message in the hope that
perhaps he has some time to share his insights on the question you ask.

-Zach

*     *     *
Zachariah Etienne
Assoc. Prof. of Physics, U. of Idaho
Adjunct Assoc. Prof. of Physics & Astronomy, West Virginia U.
https://etienneresearch.com
https://blackholesathome.net


On Mon, Apr 15, 2024 at 6:19?AM ???? <shenfei2002 at foxmail.com> wrote:

> Professor, hello. I am an undergraduate student from Nanjing Normal
> University. My research topic is related to the merger of binary neutron
> stars. However, I have encountered some difficulties in generating initial
> data with LORENE, and I hope to receive your assistance. Thank you very
> much.
>
> I have downloaded the LORENE library in the Fedora virtual machine
> environment and selected some test examples from the website at
> https://ccrgpages.rit.edu/~jfaber/BNSID/. Here are my specific
> operations: First, I replaced the file "binaire_orbite.C" in the Codes
> folder with the one I downloaded in the LORENE folder, and replaced the
> file "coal_seq_massscan.C" with the "coal.c" file in the
> "/Lorene/Codes/Bin_star" directory of the LORENE folder. Next, I selected
> the example in the "Data/AP4/AP4_1.8_1.4" folder on the website for
> simulation calculations. Among them, I copied the six files, "par_eos1.d",
> "par_eos2.d", "par_grid1.d", "par_grid2.d", "par_init.d", and
> "parcoal_seq.d.40km", to the "/Lorene/Codes/Bin_star" directory of the
> LORENE folder. Subsequently, I ran the command in the terminal of that
> directory. The specific command I executed is as follows:
>
> make init_bin
>
> make coal
>
> make lit_bin
>
> ./init_bin
>
> ./coal
>
> However, during the execution process, I encountered the following
> assertion error:
>
> coal: /home/lhc/Lorene/C++/Include/tbl.h:282: double&
> Lorene::Tbl::set(int): Assertion `etat == ETATQCQ' failed.
>
> Aborted (core dumped)
>
> Next, I modified the line 282 in the file
> "/home/lhc/Lorene/C++/Include/tbl.h" from etat == ETATQCQ to true and
> attempted to run it again. This time, there was no assertion error reported.
>
>
>
> After running for about an hour, I obtained the following files:
>
> However, the initial data file I obtained is different from the initial
> data files in the "Data/AP4/AP4_1.8_1.4" folder on the website
> https://ccrgpages.rit.edu/~jfaber/BNSID/. Specifically, the file I got is
> named "resu_4.000000e+01_2.080000e+00_1.550000e+00.d".
>
>
>
> Do you know why this is the case? Is it due to my incorrect operation
> steps that led to this issue?
>
> ????
> shenfei2002 at foxmail.com
>
> _______________________________________________
> Users mailing list
> Users at einsteintoolkit.org
> http://lists.einsteintoolkit.org/mailman/listinfo/users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240418/56511ade/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 2A08FBFE at 4BD3F234.80321A66.jpg
Type: image/jpeg
Size: 47217 bytes
Desc: not available
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240418/56511ade/attachment-0001.jpg>

From wernecklr at gmail.com  Thu Apr 18 10:11:15 2024
From: wernecklr at gmail.com (Leo Rosa Werneck)
Date: Thu, 18 Apr 2024 08:11:15 -0700
Subject: [Users] Meeting minutes for 2024-04-18
Message-ID: <9F8F976E-27B8-410D-930F-429E41CD4656@gmail.com>

Hi all,

Here are the minutes for today?s ET call.

Chair: Zach Etienne
Minutes: Leo Werneck

Present: Roland Haas, Leo Werneck, Peter Diener, Sam Cupp, Zach Etienne
         Johnny Tsao, Lucas Sanches, Steve Brandt

* NA ET School/Workshop @ LSU
  - June 3-7 (https://www.cct.lsu.edu/Einsteintoolkitworkshop2024).
  - Checking participant support cost availability for both domestic and
    international participants.
  - Preliminary schedule in progress, but still missing speakers.
  - There will be an excursion to LIGO, scheduled for the afternoon of June 5.
  - Leo requested a hands-on tutorial on how to set up and run containers in
    HPC systems, for reproducibility and portability.

* ET Release
  - Review deadline: tomorrow!
  - Baikal/GRHayLHD: Terrence is actively reviewing.
  - IllinoisGRMHD: haven't heard from Lorenzo yet.

* Online ET Tutorial
  - Requested by a research group from Denmark who contributed to the toolkit.
  - The Amsterdam workshop can be useful, if it happens.
  - Roland looking for lecturers/tutorial givers.
  - Roland will know more details by next week.
  - For those in the West coast: keep in mind the time zone difference.

* Mailing List
  - Misyura Maxim is interested in obtaining the data for GW150914. Message
    will be forward to authors, as Zenodo doesn't contain all the data.
  - A student from Nanjing Normal University inquired about LORENE. Zach will
    forward the message to Josh.

* Open Tickets
  - #2760: simfactory had warnings with Python 3.12. Steve and Roland worked on
    it, and asked Zach to review. Most of the fixes involved strings used for
    regex into raw strings.
  - #2791: use apptainer rather than Docker for documentation.
  - #963: improve McLachlan accuracy; Zach and Peter will meet about it.

* Tickets ready for review
  - #2760: see above.
  - #963: see above.
  - #2786: Multipole support in CarpetX, stalled after discussion.

Next Chair: Lucas
Next Minutes: Roland

Best,
Leo


------
Leonardo R. Werneck, Ph.D.
Postdoctoral researcher
Office EP 314 | Department of Physics | University of Idaho
875 Perimeter Dr. MS 0903
Moscow, ID 83844-0903, USA
leonardo at uidaho.edu <mailto:leonardo at uidaho.edu>
https://leowerneck.github.io <https://leowerneck.github.io/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240418/85ebfaa2/attachment.htm>

From rhaas at illinois.edu  Thu Apr 18 10:16:44 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Thu, 18 Apr 2024 10:16:44 -0500
Subject: [Users] Data from the simulation GW150914
In-Reply-To: <CAHAo3hwnBvSwNvy4Cz77vUQ_RT4CSTcHVVdSAv3Md_pBsRNC0w@mail.gmail.com>
References: <CAHAo3hwnBvSwNvy4Cz77vUQ_RT4CSTcHVVdSAv3Md_pBsRNC0w@mail.gmail.com>
Message-ID: <20240418101644.6755a34e@ekohaes8.ncsa.illinois.edu>

Hello Misyura Maxim,

The full data may be available for the original authors of the Zenodo
publication (in cc).

Failing that there may be copies of similar data available from the
last time the gallery example was run as a test case, eg by Debroah
Ferguson, also in cc (though not all 3D data is stored by default).

> I am Misyura Maxim and I am conducting research into how strong
> gravitational waves interact with matter.
> Am I correct to assume that I can obtain the full data from the simulation
> GW150914. In particular, I am interested in the values provided by ADMBASE,
> otherwise, it would be necessary for me to download all the available data.
> 
> Sincerely yours,
> Misyura Maxim, PhD student of Saint-Petersburg State University

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240418/a8e876fb/attachment.sig>

From Garrison at uhcl.edu  Thu Apr 18 20:57:00 2024
From: Garrison at uhcl.edu (Garrison, David)
Date: Fri, 19 Apr 2024 01:57:00 +0000
Subject: [Users] Cactus Code 4.15.0
Message-ID: <D64424AB-6B82-48B9-B103-0563803F277D@uhcl.edu>

Hello,

I am having problems getting Cactus 4.15.0 to work.  I am built WaveToyC with Pugh as a test and get the error below:


INFO (PUGH): Not setting up a topology for 1 dimensions

INFO (PUGH): Not setting up a topology for 2 dimensions

INFO (PUGH): Setting up a topology for 3 dimensions

INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 1D output every 1 iterations

INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'

INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 2D output turned off

INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 3D output turned off

Assertion failed: (current_function->RDWR), function CCTK_HasAccess, file RDWR.cc, line 336.

zsh: abort      ./cactus_wave ./wavetoy.par

When I comment out the assertion on line 336 of RDWR.cc<http://RDWR.cc>, I get the statement below:


INFO (PUGH): Not setting up a topology for 1 dimensions

INFO (PUGH): Not setting up a topology for 2 dimensions

INFO (PUGH): Setting up a topology for 3 dimensions

INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 1D output every 1 iterations

INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'

INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 2D output turned off

INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 3D output turned off

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dx' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dy' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dz' where 'CCTK_BASEGRID'.

INFO (CartGrid3D): Grid Spacings:

INFO (CartGrid3D): dx=>1.1111111e-01  dy=>1.1111111e-01  dz=>1.1111111e-01

INFO (CartGrid3D): Computational Coordinates:

INFO (CartGrid3D): x=>[-0.500, 0.500]  y=>[-0.500, 0.500]  z=>[-0.500, 0.500]

INFO (CartGrid3D): Indices of Physical Coordinates:

INFO (CartGrid3D): x=>[0,9]  y=>[0,9]  z=>[0,9]

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::r' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::x' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::y' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::z' where 'CCTK_BASEGRID'.

INFO (PUGH): Single processor evolution

INFO (PUGH): 3-dimensional grid functions

INFO (PUGH):   Size: 10 10 10

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_dt' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_min_time' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_wave_speed' where 'CCTK_BASEGRID'.

INFO (Time): Timestep set to 0.0555556 (courant_static)

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::x' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::y' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::z' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

????????????????????????????????????????

Done.


Previously I was using Cactus 4.11.0 with no such issues.  It looks like RDWR.cc<http://RDWR.cc> was changed in the flesh sometime between 4.11.0 and 4.15.0.  Has anyone else has this issue?  Is there a patch?  If WaveToy doesn?t work, how can anything else work?


-DG


--
David Garrison, Ph.D.
Associate Dean for the College of Science and Engineering,
Professor and Founding Chair of Physics
University of Houston-Clear Lake
Bayou 3611
Houston, TX 77058

Phone: 281-283-3796
https://www.uhcl.edu/science-engineering/faculty/garrison-david
http://www.uhcl.edu/physics

"If we knew what it was we were doing, it would not be called research, would it?" ? Albert Einstein.




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240419/0e3dd71a/attachment-0001.htm>

From Garrison at uhcl.edu  Thu Apr 18 20:57:00 2024
From: Garrison at uhcl.edu (Garrison, David)
Date: Fri, 19 Apr 2024 01:57:00 +0000
Subject: [Users] Cactus Code 4.15.0
Message-ID: <D64424AB-6B82-48B9-B103-0563803F277D@uhcl.edu>

Hello,

I am having problems getting Cactus 4.15.0 to work.  I am built WaveToyC with Pugh as a test and get the error below:


INFO (PUGH): Not setting up a topology for 1 dimensions

INFO (PUGH): Not setting up a topology for 2 dimensions

INFO (PUGH): Setting up a topology for 3 dimensions

INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 1D output every 1 iterations

INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'

INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 2D output turned off

INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 3D output turned off

Assertion failed: (current_function->RDWR), function CCTK_HasAccess, file RDWR.cc, line 336.

zsh: abort      ./cactus_wave ./wavetoy.par

When I comment out the assertion on line 336 of RDWR.cc<http://RDWR.cc>, I get the statement below:


INFO (PUGH): Not setting up a topology for 1 dimensions

INFO (PUGH): Not setting up a topology for 2 dimensions

INFO (PUGH): Setting up a topology for 3 dimensions

INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 1D output every 1 iterations

INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'

INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 2D output turned off

INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files

INFO (IOASCII): Periodic 3D output turned off

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dx' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dy' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dz' where 'CCTK_BASEGRID'.

INFO (CartGrid3D): Grid Spacings:

INFO (CartGrid3D): dx=>1.1111111e-01  dy=>1.1111111e-01  dz=>1.1111111e-01

INFO (CartGrid3D): Computational Coordinates:

INFO (CartGrid3D): x=>[-0.500, 0.500]  y=>[-0.500, 0.500]  z=>[-0.500, 0.500]

INFO (CartGrid3D): Indices of Physical Coordinates:

INFO (CartGrid3D): x=>[0,9]  y=>[0,9]  z=>[0,9]

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::r' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::x' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::y' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::z' where 'CCTK_BASEGRID'.

INFO (PUGH): Single processor evolution

INFO (PUGH): 3-dimensional grid functions

INFO (PUGH):   Size: 10 10 10

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_dt' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_min_time' where 'CCTK_BASEGRID'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_wave_speed' where 'CCTK_BASEGRID'.

INFO (Time): Timestep set to 0.0555556 (courant_static)

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::x' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::y' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::z' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.

????????????????????????????????????????

Done.


Previously I was using Cactus 4.11.0 with no such issues.  It looks like RDWR.cc<http://RDWR.cc> was changed in the flesh sometime between 4.11.0 and 4.15.0.  Has anyone else has this issue?  Is there a patch?  If WaveToy doesn?t work, how can anything else work?


-DG


--
David Garrison, Ph.D.
Associate Dean for the College of Science and Engineering,
Professor and Founding Chair of Physics
University of Houston-Clear Lake
Bayou 3611
Houston, TX 77058

Phone: 281-283-3796
https://www.uhcl.edu/science-engineering/faculty/garrison-david
http://www.uhcl.edu/physics

"If we knew what it was we were doing, it would not be called research, would it?" ? Albert Einstein.




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240419/0e3dd71a/attachment-0003.htm>

From Garrison at uhcl.edu  Thu Apr 18 21:12:49 2024
From: Garrison at uhcl.edu (Garrison, David)
Date: Fri, 19 Apr 2024 02:12:49 +0000
Subject: [Users] Cactus Code 4.15.0
In-Reply-To: <D64424AB-6B82-48B9-B103-0563803F277D@uhcl.edu>
References: <D64424AB-6B82-48B9-B103-0563803F277D@uhcl.edu>
Message-ID: <75035C54-7B8D-4C0C-8A17-784D62CA3D20@uhcl.edu>

BTW,

I just noticed that this error only shows up when 'DEBUG = yes' is set in the configuration file.  Everything works when debugging is turned off but I think this could be an issue for anyone trying to run a debugger on the code.

-DG

On Apr 18, 2024, at 8:57?PM, Garrison, David <Garrison at uhcl.edu> wrote:

Hello,

I am having problems getting Cactus 4.15.0 to work.  I am built WaveToyC with Pugh as a test and get the error below:

INFO (PUGH): Not setting up a topology for 1 dimensions
INFO (PUGH): Not setting up a topology for 2 dimensions
INFO (PUGH): Setting up a topology for 3 dimensions
INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 1D output every 1 iterations
INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'
INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 2D output turned off
INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 3D output turned off
Assertion failed: (current_function->RDWR), function CCTK_HasAccess, file RDWR.cc, line 336.
zsh: abort      ./cactus_wave ./wavetoy.par

When I comment out the assertion on line 336 of RDWR.cc<https://urldefense.com/v3/__http://RDWR.cc__;!!BCR0FSePrR4x!GitSODhu9UAPHVGqjrNogiYzOPBu3fCynePdXA296rd9hNQhalNz9_Fq0RcgP31W9IvdbFRb_MFsjbQAHk4$>, I get the statement below:

INFO (PUGH): Not setting up a topology for 1 dimensions
INFO (PUGH): Not setting up a topology for 2 dimensions
INFO (PUGH): Setting up a topology for 3 dimensions
INFO (IOASCII): I/O Method 'IOASCII_1D' registered: output of 1D lines of grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 1D output every 1 iterations
INFO (IOASCII): Periodic 1D output requested for 'WAVETOY::phi'
INFO (IOASCII): I/O Method 'IOASCII_2D' registered: output of 2D planes of grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 2D output turned off
INFO (IOASCII): I/O Method 'IOASCII_3D' registered: output of 3D grid functions/arrays to ASCII files
INFO (IOASCII): Periodic 3D output turned off
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dx' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dy' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialSpacings' for grid function 'GRID::coarse_dz' where 'CCTK_BASEGRID'.
INFO (CartGrid3D): Grid Spacings:
INFO (CartGrid3D): dx=>1.1111111e-01  dy=>1.1111111e-01  dz=>1.1111111e-01
INFO (CartGrid3D): Computational Coordinates:
INFO (CartGrid3D): x=>[-0.500, 0.500]  y=>[-0.500, 0.500]  z=>[-0.500, 0.500]
INFO (CartGrid3D): Indices of Physical Coordinates:
INFO (CartGrid3D): x=>[0,9]  y=>[0,9]  z=>[0,9]
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::r' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::x' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::y' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'CartGrid3D::SpatialCoordinates' for grid function 'GRID::z' where 'CCTK_BASEGRID'.
INFO (PUGH): Single processor evolution
INFO (PUGH): 3-dimensional grid functions
INFO (PUGH):   Size: 10 10 10
WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_dt' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_min_time' where 'CCTK_BASEGRID'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'Time::Time_Initialise' for grid function 'TIME::courant_wave_speed' where 'CCTK_BASEGRID'.
INFO (Time): Timestep set to 0.0555556 (courant_static)
WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::x' where 'CCTK_INITIAL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::y' where 'CCTK_INITIAL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'GRID::z' where 'CCTK_INITIAL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'IDScalarWaveC::WaveToy_InitialData' for grid function 'WAVETOY::phi' where 'CCTK_INITIAL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
WARNING[L1,P0] (Cactus): Possibly illegal access by 'WaveToyC::WaveToy_Evolution' for grid function 'WAVETOY::phi' where 'CCTK_EVOL'.
????????????????????????????????????????
Done.

Previously I was using Cactus 4.11.0 with no such issues.  It looks like RDWR.cc<https://urldefense.com/v3/__http://RDWR.cc__;!!BCR0FSePrR4x!GitSODhu9UAPHVGqjrNogiYzOPBu3fCynePdXA296rd9hNQhalNz9_Fq0RcgP31W9IvdbFRb_MFsjbQAHk4$> was changed in the flesh sometime between 4.11.0 and 4.15.0.  Has anyone else has this issue?  Is there a patch?  If WaveToy doesn?t work, how can anything else work?

-DG

--
David Garrison, Ph.D.
Associate Dean for the College of Science and Engineering,
Professor and Founding Chair of Physics
University of Houston-Clear Lake
Bayou 3611
Houston, TX 77058

Phone: 281-283-3796
https://www.uhcl.edu/science-engineering/faculty/garrison-david
http://www.uhcl.edu/physics

"If we knew what it was we were doing, it would not be called research, would it?" ? Albert Einstein.




_______________________________________________
Users mailing list
Users at einsteintoolkit.org
https://urldefense.com/v3/__http://lists.einsteintoolkit.org/mailman/listinfo/users__;!!BCR0FSePrR4x!GitSODhu9UAPHVGqjrNogiYzOPBu3fCynePdXA296rd9hNQhalNz9_Fq0RcgP31W9IvdbFRb_MFsULyoAtg$

--
David Garrison, Ph.D.
Associate Dean for the College of Science and Engineering,
Professor and Founding Chair of Physics
University of Houston-Clear Lake
Bayou 3611
Houston, TX 77058

Phone: 281-283-3796
https://www.uhcl.edu/science-engineering/faculty/garrison-david
http://www.uhcl.edu/physics

"If we knew what it was we were doing, it would not be called research, would it?" ? Albert Einstein.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240419/a0c70f55/attachment-0001.htm>

From rhaas at illinois.edu  Thu Apr 18 21:34:51 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Thu, 18 Apr 2024 21:34:51 -0500
Subject: [Users] Cactus Code 4.15.0
In-Reply-To: <75035C54-7B8D-4C0C-8A17-784D62CA3D20@uhcl.edu>
References: <D64424AB-6B82-48B9-B103-0563803F277D@uhcl.edu>
 <75035C54-7B8D-4C0C-8A17-784D62CA3D20@uhcl.edu>
Message-ID: <20240418213451.1a88866d@fdea4908>

Hello David,

> I just noticed that this error only shows up when 'DEBUG = yes' is
> set in the configuration file.  Everything works when debugging is
> turned off but I think this could be an issue for anyone trying to
> run a debugger on the code.

I am guessing you are seeing an instance of this issue:

https://bitbucket.org/einsteintoolkit/tickets/issues/2781/fix-bug-in-debug-mode-with-presync_mode

A patch has been applied to the development version already:

https://bitbucket.org/cactuscode/cactus/commits/e185dc0c014d148908054ff34e6a051988a87e59

Or alternatively, in the same function, change (back) 

#ifndef CCTK_DEBUG
  if(!presync_only)
    return true;
#endif

to

  if(!presync_only)
    return true;

which is what it was in the previous version (and which is save).

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240418/a114a9dc/attachment.sig>

From rhaas at illinois.edu  Mon Apr 22 15:18:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Mon, 22 Apr 2024 15:18:01 -0500
Subject: [Users] Agenda for Thursday's Meeting
Message-ID: <E1rz06z-00000004G41-3Wfj@ekohaes8.ncsa.illinois.edu>

Please update the Wiki with agenda items for Thursday's meeting. Thanks!

https://docs.einsteintoolkit.org/et-docs/meeting_agenda

--The Maintainers

From sbrandt at cct.lsu.edu  Wed Apr 24 14:14:45 2024
From: sbrandt at cct.lsu.edu (Steven Brandt)
Date: Wed, 24 Apr 2024 14:14:45 -0500
Subject: [Users] US ET Workshop 2024
Message-ID: <8738772a-516b-4941-b32f-3d40bb198b76@cct.lsu.edu>

Dear Einstein Toolkit Users,

Please consider participating in this year's US meeting.

https://www.cct.lsu.edu/Einsteintoolkitworkshop2024

**** DEADLINE FOR HOTEL SPECIAL RATE: 5/5/2024 ****

*Lodging:*

A block of rooms has been reserved at the Cook Hotel on LSU's campus.
Cook Hotel @ LSU
3848 W. Lakeshore Drive, Baton Rouge, LA? 70808
225-383-2665 (ask for CCT/Einstein Toolkit Workshop block)
Special rate:? $119.00 (deluxe double rooms) expires 5/5/24
A complimentary breakfast is served each morning in the Shaquille R. 
O'Neal Lodge from 6:00 AM until 9:30 AM for all
registered hotel guests.

*Einstein Toolkit Workshop Booking Link for the Cook Hotel*
https://reservations.travelclick.com/110626?groupID=4282636

--Steve
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240424/dd58751e/attachment.htm>

From rhaas at illinois.edu  Wed Apr 24 17:15:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Wed, 24 Apr 2024 17:15:01 -0500
Subject: [Users] Einstein Toolkit Meeting Reminder
Message-ID: <E1rzktJ-000000084xX-1srf@ekohaes8.ncsa.illinois.edu>

Hello,

Please consider joining the weekly Einstein Toolkit phone call at
9:00 am US central time on Thursdays. For details on how to connect
and what agenda items are to be discussed, use the link below.

https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call

--The Maintainers

From rhaas at illinois.edu  Thu Apr 25 11:58:56 2024
From: rhaas at illinois.edu (Roland Haas)
Date: Thu, 25 Apr 2024 11:58:56 -0500
Subject: [Users] meeting minutes for 2024-04-25
Message-ID: <20240425115856.6f20a108@ekohaes8.ncsa.illinois.edu>

Present: Steve, Roland, Lucas, Sam, Zach, Peter (others I forgot to
write down right away)

ET release
==========

* all thorns need to be added to thorn list: Multipole updates, Z4c,
  NewRadX
* the upcoming 2024-05 will be "Landau",
  https://en.wikipedia.org/wiki/Lev_Landau
* release managers to contact champions about author lists, requested
  and suggested citations, check on formal inclusion criteria
* review criteria:
  https://docs.einsteintoolkit.org/et-docs/How_to_Review_a_new_component
* email templates:
  https://docs.einsteintoolkit.org/et-docs/Release_Process#Emails_to_send_to_contributors_and_gallery_runners
* add this to release process wiki page

Unanswered questions
====================

* no questions
* reminder for LSU summer school and workshop attendees to register to
  get reduced hotel rate and be provided lunch

Tickets
=======

* https://bitbucket.org/einsteintoolkit/tickets/issues/2778
  grhaylhd-x-update-for-tabulated-eos will be closed
* https://bitbucket.org/einsteintoolkit/tickets/issues/2760
  syntaxwarnings-raised-during-build-process will be merged and closed
* https://bitbucket.org/einsteintoolkit/tickets/issues/963
  improve-mclachlan-accuracy Peter is still testing slow start lapse
* https://bitbucket.org/einsteintoolkit/tickets/issues/2789
  citation-suggestion-for-kranc will have to contact authors once more
  for decision on what to cite
* https://bitbucket.org/einsteintoolkit/tickets/issues/2790
  mol-documentation-out-of-sync no update, is documentation only
  change, nothing bad happns if one follows the current docs
* https://bitbucket.org/einsteintoolkit/tickets/issues/2788
  et-building-error not enough information, reporter has gone radio
  silent, will close.
* https://bitbucket.org/einsteintoolkit/tickets/issues/2787
  einsteintoolkitth-no-longer-sorted to be fixed, Steve suggests a
  script, Roland points out that there are comments that one needs to
  keep with their GetComponent stanza
* https://bitbucket.org/einsteintoolkit/tickets/issues/2772
  issues-link-against-kadath-thorns-and Waiting for input by Samuel
  Tootle
* https://bitbucket.org/einsteintoolkit/tickets/issues/2765
  nsimd-is-not-actually-build-with-simd-code Worked for Steve
  apparently, may be "invalid", will put "on hold"

Chapter for Springer book
=========================

* still in bad shape
* promised some text on GRHydro
* Steve urges Roland to add some more text to get this done soon

Yours,
Roland

-- 
My email is as private as my paper mail. I therefore support encrypting
and signing email messages. Get my PGP key from http://pgp.mit.edu .
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240425/709c84d0/attachment.sig>

From sbrandt at cct.lsu.edu  Fri Apr 26 15:05:27 2024
From: sbrandt at cct.lsu.edu (Steven Brandt)
Date: Fri, 26 Apr 2024 15:05:27 -0500
Subject: [Users] US Einstein Toolkit Workshop and School
Message-ID: <3b06facf-6bb0-4b90-8e23-4c29616d5506@cct.lsu.edu>

Dear Einstein Toolkit User Community,

We still have room for more participants in this year's US Einstein 
Toolkit and School. Don't miss this chance to learn, interact with 
toolkit users and maintainers, and to advance your open source research.

* Registration is free (but required, group hotel rates available 
through 5/5/2024)
* Financial support is available.
* A trip to LIGO is planned.
* Opportunities to give talks are available

/Laissons la bonne recherche rouler/

We look forward to seeing you.

https://www.cct.lsu.edu/Einsteintoolkitworkshop2024

--Steve
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.einsteintoolkit.org/pipermail/users/attachments/20240426/9769d586/attachment.htm>

From rhaas at illinois.edu  Mon Apr 29 15:18:01 2024
From: rhaas at illinois.edu (rhaas at illinois.edu)
Date: Mon, 29 Apr 2024 15:18:01 -0500
Subject: [Users] Agenda for Thursday's Meeting
Message-ID: <E1s1XRp-0000000GEdL-2xDA@ekohaes8.ncsa.illinois.edu>

Please update the Wiki with agenda items for Thursday's meeting. Thanks!

https://docs.einsteintoolkit.org/et-docs/meeting_agenda

--The Maintainers