From PANAGIOTIS.IOSIF at units.it Sat Aug 2 15:55:04 2025 From: PANAGIOTIS.IOSIF at units.it (IOSIF PANAGIOTIS) Date: Sat, 2 Aug 2025 20:55:04 +0000 Subject: [Users] Users Digest, Vol 184, Issue 14 In-Reply-To: References:

Message-ID: Dear Leo, Thank you for your answer and for sharing your experience. No, I hadn't received a reply to my question yet. So it seems that macros such as @ALLOCATION@ (or any other SimFactory placeholder) can be changed via : * either editing the .ini file * or specifying the relevant command line option (i.e., among the ones that come up when doing "./simfactory/bin/sim --help"). And if I understand correctly, it seems that whatever is specified as a command-line option for sim takes priority over what is specified in the configuration files. Is this correct? If yes, then these placeholders could be simply left alone when editing the submitscript and runscript, and set via the respective sim command-line option when submitting a simulation. Right? And to reiterate part of my initial question: * If these @FOO@ macros for SimFactory are documented somewhere, I would be grateful if you could point me to the relevant page. * If such documentation does not exist, then it is also ok, and this empirical understanding will have to suffice for now. I was just asking to make sure I was not missing some obvious documentation source. Best, Panayotis ________________________________ From: Users on behalf of Leonardo Werneck Sent: Thursday, July 31, 2025 7:26 PM To: users at einsteintoolkit.org Subject: Re: [Users] Users Digest, Vol 184, Issue 14 Dear Iosif, I hope this message finds you well. I'm not sure you already got a reply, but in case you haven't, my understanding is that placeholders like @FOO@ are there to indicate things you need to change yourself, manually. So when you see something like: #SBATCH -A @ALLOCATION@ then it means you should replace @ALLOCATION@ with the name of your allocation in the specific cluster. Someone else can correct me if this is not correct, but that's how I usually handle these. Cheers, Leo On Fri, Jul 25, 2025 at 8:06?AM > wrote: Send Users mailing list submissions to users at einsteintoolkit.org To subscribe or unsubscribe via the World Wide Web, visit http://lists.einsteintoolkit.org/mailman/listinfo/users or, via email, send a message with subject or body 'help' to users-request at einsteintoolkit.org You can reach the person managing the list at users-owner at einsteintoolkit.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Users digest..." Today's Topics: 1. SimFactory placeholder macros (IOSIF PANAGIOTIS) 2. Issue with ReadInterpolate (Luciano Combi) ---------------------------------------------------------------------- Message: 1 Date: Fri, 25 Jul 2025 10:43:36 +0000 From: IOSIF PANAGIOTIS > To: Einstein Toolkit Users > Subject: [Users] SimFactory placeholder macros Message-ID: > Content-Type: text/plain; charset="iso-8859-1" Hi, I have been following this document, https://einsteintoolkit.org/seminars/2022_02_24/index.html , to set up ET on my cluster, working also on some example configuration files. While preparing the submit and run scripts, I wanted to check the description of the @FOO@ macros that SimFactory uses. I checked these places but found no information. * https://simfactory.bitbucket.io/simfactory2/userguide/ (no mention of macros) * https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutorial (1 mention of the @USER@ macro and a pointer to a section #Macros that seems missing) * https://docs.einsteintoolkit.org/et-docs/Configuring_a_new_machine (there is no information on the submitscript and runscript) So I would like to ask: If e.g. I have this line in my submitscript: #SBATCH -A @ALLOCATION@ Where is @ALLOCATION@ "read" from? My guess is that this is specified in the .ini file in this line: allocation = Could you confirm if this is the case? Is there another source of documentation (that I might have missed) describing what these @FOO@ placeholders do? Best regards, Panagiotis ------------------- Panagiotis Iosif postdoctoral researcher Department of Physics, University of Trieste Via Alfonso Valerio 2, Trieste 34127 Italy ------------------- -------------- next part -------------- An HTML attachment was scrubbed... URL: ------------------------------ Message: 2 Date: Fri, 25 Jul 2025 15:05:48 +0000 From: Luciano Combi > To: "users at einsteintoolkit.org" > Subject: [Users] Issue with ReadInterpolate Message-ID: > Content-Type: text/plain; charset="iso-8859-1" Hi people, I have used ReadInterpolate successfully for different applications in the past. I'm now trying to use it to interpolate onto a new grid that has 5 ghost zones i.e.: CoordBase::boundary_size_x_lower = 5 CoordBase::boundary_size_y_lower = 5 CoordBase::boundary_size_z_lower = 5 CoordBase::boundary_size_x_upper = 5 CoordBase::boundary_size_y_upper = 5 CoordBase::boundary_size_z_upper = 5 Driver::ghost_size = 5 GRHydro::GRHydro_stencil = 5 But I'm getting this error: CCTK_Proc569.err <== while executing schedule bin ReadInterpolate_ReadData, routine ReadInterpolate::ReadInterpolate_Read in thorn ReadInterpolate, file /home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInterpolate/src/read.c:559: -> Skipping integer variable 'SPACEMASK::space_mask it=335925 tl=0 rl=0 c=569'. Do not know how to interpolate integers. ERROR from host bcn1814.usr.hlrn.de process 569 while executing schedule bin ReadInterpolate_ReadData, routine ReadInterpolate::ReadInterpolate_Read in thorn ReadInterpolate, file /home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInterpolate/src/interpolate.cc:130: -> There were 70227 points in 27 variables that could not be set. cactus_etk_devel: /home/mvxcombi/ET_Zelmani/Cactus/arrangements/Carpet/Carpet/src/helpers.cc:275: int Carpet::Abort(const cGH*, int): Assertion `0' failed. Rank 569 with PID 1675935 received signal 6 Writing backtrace to AIC_interp/backtrace.569.txt The original grid has 3 ghost zones. I'm using the following parfile: # What to interpolate # ------------------- ReadInterpolate::files = "checkpoint.chkpt.it_335925" ReadInterpolate::max_number_of_read_variables = 30 ReadInterpolate::only_these_datasets = ":Y_e, :rho, :temperature, :vel, :Ax, :Ay, :Az, :psi6phi, :kxx, :kxy, :kxz, :kyy, :kyz, :kzz, :gxx, :gxy, :gxz, :gyy, :gyz, :gzz, :betax, :betay, :betaz, :alp" ReadInterpolate::minimum_reflevel = 0 # Default ReadInterpolate::maximum_reflevel = 1000 # Default # Interpolator settings # --------------------- ReadInterpolate::epsilon = 1.e-12 #2 # Default ReadInterpolate::interpolator_half_width = -1 # Default, use cctk_nghostzones ReadInterpolate::interpolator_name = "Lagrange polynomial interpolation" ReadInterpolate::interpolator_pars = " order = 3 boundary_off_centering_tolerance = {1. 1. 1. 1. 1. 1.} boundary_extrapolation_tolerance = {1.e-12 1.e-12 1.e-12 1.e-12 1.e-12 1.e-12} " # Fixing the read-in data # ----------------------- ReadInterpolate::shift_read_datasets_by[0] = 0. ReadInterpolate::shift_read_datasets_by[1] = 0. ReadInterpolate::shift_read_datasets_by[2] = 0. ReadInterpolate::enforce_symmetries_after_reading = no # Default ReadInterpolate::fix_cell_centered_origins = no # Default Any suggestions on how to solve this issue? Thanks a lot!! -------------- next part -------------- An HTML attachment was scrubbed... URL: ------------------------------ Subject: Digest Footer _______________________________________________ Users mailing list Users at einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users ------------------------------ End of Users Digest, Vol 184, Issue 14 ************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From users at einsteintoolkit.org Mon Aug 4 15:18:02 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Mon, 04 Aug 2025 15:18:02 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: <6891157a.Z7afyN97eZfy58gk%users@einsteintoolkit.org> Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From users at einsteintoolkit.org Wed Aug 6 17:15:02 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Wed, 06 Aug 2025 17:15:02 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: <6893d3e6.GJzN6bm1U/WFbFkw%users@einsteintoolkit.org> Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From diener at cct.lsu.edu Thu Aug 7 09:26:12 2025 From: diener at cct.lsu.edu (Peter Diener) Date: Thu, 7 Aug 2025 09:26:12 -0500 (CDT) Subject: [Users] Users Digest, Vol 184, Issue 14 In-Reply-To: References:

Message-ID: Dear Iosif, Yes, @ALLOCATION@ will be read from the corresponding * .ini file if not specified with the --allocation=YOUR_ALLOCATION command line option. And yes the command line will override the information in the .ini file. However, I would rather place the allocation information in simfactory/etc/defs.local.ini than in the .ini file. Multiple users with different allocations can use the same machine, so that information belongs in the user specific .ini file. There is no list of macros documented anywhere, unfortunately. Cheers, Peter Assistant Professor Research Center for Computation & Technology and Department of Physics & Astronomy Louisiana State University On Sat, 2 Aug 2025, IOSIF PANAGIOTIS wrote: > Dear Leo, > > Thank you for your answer and for sharing your experience. > No, I hadn't received a reply to my question yet. > > So it seems that macros such as @ALLOCATION@ (or any other SimFactory > placeholder) can be changed via : > * either editing the .ini file > * or specifying the relevant command line option (i.e., among the ones > that come up when doing "./simfactory/bin/sim --help"). > > And if I understand correctly, it seems that whatever is specified as a > command-line option?for sim?takes priority?over what is specified in the > configuration files. > Is this correct? > > If yes, then these placeholders could be simply left alone when editing the > submitscript and runscript, and set via the respective sim?command-line > option when submitting a simulation. Right? > > And to reiterate part of my initial question: > * If these @FOO@ macros for SimFactory are documented somewhere, I would > be grateful if you could point me to the relevant page.? > * If such documentation does not exist, then it is also ok, and this > empirical understanding will have to suffice for now. I was just asking > to make sure I was not missing some obvious documentation source. > > Best, > Panayotis > > ____________________________________________________________________________ > From: Users on behalf of Leonardo > Werneck > Sent: Thursday, July 31, 2025 7:26 PM > To: users at einsteintoolkit.org > Subject: Re: [Users] Users Digest, Vol 184, Issue 14 ? > Dear Iosif, > > I hope this message finds you well. > > I'm not sure you already got a reply, but in case you haven't, my > understanding is that placeholders like?@FOO@ are there to indicate things > you need to change yourself, manually. > > So when you see something like: > > #SBATCH -A?@ALLOCATION@ > > then it means you should replace?@ALLOCATION@ with the?name of your > allocation in the specific cluster. > > Someone else can correct me if this is not?correct, but that's how I usually > handle these. > > Cheers, > Leo > > > On Fri, Jul 25, 2025 at 8:06?AM wrote: > Send Users mailing list submissions to > ? ? ? ? users at einsteintoolkit.org > > To subscribe or unsubscribe via the World Wide Web, visit > ? ? ? ? http://lists.einsteintoolkit.org/mailman/listinfo/users > or, via email, send a message with subject or body 'help' to > ? ? ? ? users-request at einsteintoolkit.org > > You can reach the person managing the list at > ? ? ? ? users-owner at einsteintoolkit.org > > When replying, please edit your Subject line so it is more > specific > than "Re: Contents of Users digest..." > > > Today's Topics: > > ? ?1. SimFactory placeholder macros (IOSIF PANAGIOTIS) > ? ?2. Issue with ReadInterpolate (Luciano Combi) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 25 Jul 2025 10:43:36 +0000 > From: IOSIF PANAGIOTIS > To: Einstein Toolkit Users > Subject: [Users] SimFactory placeholder macros > Message-ID: > ? ? ? ? COM> > > Content-Type: text/plain; charset="iso-8859-1" > > Hi, > > I have been following this document, > https://einsteintoolkit.org/seminars/2022_02_24/index.html , to > set up ET on my cluster, working also on some example > configuration files. > > While preparing the submit and run scripts, I wanted to check > the description of the @FOO@ macros that SimFactory uses. > > I checked these places but found no information. > > ? * > https://simfactory.bitbucket.io/simfactory2/userguide/ (no > mention of macros) > ? * > https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutori > al (1 mention of the @USER@ macro and a pointer to a section#Macros d_Tutorial#Macros> that seems missing) > ? * > https://docs.einsteintoolkit.org/et-docs/Configuring_a_new_machine > (there is no information on the submitscript and runscript) > > So I would like to ask: > > If e.g. I have this line in my submitscript: > #SBATCH -A @ALLOCATION@ > > Where is @ALLOCATION@ "read" from? > > My guess is that this is specified in the .ini file in this > line: > allocation = > > Could you confirm if this is the case? > > Is there another source of documentation (that I might have > missed) describing what these @FOO@ placeholders do? > > Best regards, > Panagiotis > > > ------------------- > Panagiotis Iosif > postdoctoral researcher > Department of Physics, University of Trieste > Via Alfonso Valerio 2, Trieste 34127 > Italy > ------------------- > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: 8ab5/attachment-0001.htm> > > ------------------------------ > > Message: 2 > Date: Fri, 25 Jul 2025 15:05:48 +0000 > From: Luciano Combi > To: "users at einsteintoolkit.org" > Subject: [Users] Issue with ReadInterpolate > Message-ID: > ? ? ? ? LOOK.COM> > > Content-Type: text/plain; charset="iso-8859-1" > > Hi people, > > I have used ReadInterpolate successfully for different > applications in the past. I'm now trying to use it to > interpolate onto a new grid that has 5 ghost zones i.e.: > > CoordBase::boundary_size_x_lower? ? ?= 5 > CoordBase::boundary_size_y_lower? ? ?= 5 > CoordBase::boundary_size_z_lower? ? ?= 5 > CoordBase::boundary_size_x_upper? ? ?= 5 > CoordBase::boundary_size_y_upper? ? ?= 5 > CoordBase::boundary_size_z_upper? ? ?= 5 > Driver::ghost_size? ? ? ? ? ? ? ? ? ?= 5 > GRHydro::GRHydro_stencil? ? ? ? ? ? ?= 5 > But I'm getting this error: > > CCTK_Proc569.err <== > ? while executing schedule bin ReadInterpolate_ReadData, routine > ReadInterpolate::ReadInterpolate_Read > ? in thorn ReadInterpolate, file/home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInter > polate/src/read.c:559: > ? -> Skipping integer variable 'SPACEMASK::space_mask it=335925 > tl=0 rl=0 c=569'. Do not know how to interpolate integers. > ERROR from host bcn1814.usr.hlrn.de process 569 > ? while executing schedule bin ReadInterpolate_ReadData, routine > ReadInterpolate::ReadInterpolate_Read > ? in thorn ReadInterpolate, file/home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInter > polate/src/interpolate.cc:130: > ? -> There were 70227 points in 27 variables that could not be > set. > cactus_etk_devel:/home/mvxcombi/ET_Zelmani/Cactus/arrangements/Carpet/Carpet/src/helpers.cc: > 275: int Carpet::Abort(const cGH*, int): Assertion `0' failed. > Rank 569 with PID 1675935 received signal 6 > Writing backtrace to AIC_interp/backtrace.569.txt > The original grid has 3 ghost zones. I'm using the following > parfile: > # What to interpolate > # ------------------- > ReadInterpolate::files? ? ? ? ? ? ? ? ? ? ? ? = > "checkpoint.chkpt.it_335925" > ReadInterpolate::max_number_of_read_variables = 30 > ReadInterpolate::only_these_datasets? ? ? ? ? = ":Y_e, :rho, > :temperature, :vel, :Ax, :Ay, :Az, :psi6phi, :kxx, :kxy, :kxz, > :kyy, :kyz, :kzz, :gxx, :gxy, :gxz, :gyy, :gyz, :gzz, :betax, > :betay, :betaz, :alp" > ReadInterpolate::minimum_reflevel? ? ? ? ? ? ?= 0? ? ?# Default > ReadInterpolate::maximum_reflevel? ? ? ? ? ? ?= 1000? # Default > > # Interpolator settings > # --------------------- > ReadInterpolate::epsilon? ? ? ? ? ? ? ? ?= 1.e-12 #2? # Default > ReadInterpolate::interpolator_half_width = -1? ? ? # Default, > use cctk_nghostzones > ReadInterpolate::interpolator_name? ? ? ?= "Lagrange polynomial > interpolation" > ReadInterpolate::interpolator_pars? ? ? ?= " > ? ? order = 3 > ? ? boundary_off_centering_tolerance = {1. 1. 1. 1. 1. 1.} > ? ? boundary_extrapolation_tolerance = {1.e-12 1.e-12 1.e-12 > 1.e-12 1.e-12 1.e-12} > " > > # Fixing the read-in data > # ----------------------- > ReadInterpolate::shift_read_datasets_by[0] = 0. > ReadInterpolate::shift_read_datasets_by[1] = 0. > ReadInterpolate::shift_read_datasets_by[2] = 0. > > ReadInterpolate::enforce_symmetries_after_reading = no? # > Default > ReadInterpolate::fix_cell_centered_origins? ? ? ? = no? # > Default > > Any suggestions on how to solve this issue? > > Thanks a lot!! > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: 4213/attachment.htm> > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Users mailing list > Users at einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/users > > > ------------------------------ > > End of Users Digest, Vol 184, Issue 14 > ************************************** > > > From PANAGIOTIS.IOSIF at units.it Mon Aug 11 07:55:41 2025 From: PANAGIOTIS.IOSIF at units.it (IOSIF PANAGIOTIS) Date: Mon, 11 Aug 2025 12:55:41 +0000 Subject: [Users] Users Digest, Vol 184, Issue 14 In-Reply-To: References:

Message-ID: Dear Peter, Thank you for the clarifications regarding the Simfactory macros and the best practice advice. best, Panayotis ________________________________ From: Peter Diener Sent: Thursday, August 7, 2025 4:26 PM To: IOSIF PANAGIOTIS Cc: Leonardo Werneck ; users at einsteintoolkit.org Subject: Re: [Users] Users Digest, Vol 184, Issue 14 Dear Iosif, Yes, @ALLOCATION@ will be read from the corresponding * .ini file if not specified with the --allocation=YOUR_ALLOCATION command line option. And yes the command line will override the information in the .ini file. However, I would rather place the allocation information in simfactory/etc/defs.local.ini than in the .ini file. Multiple users with different allocations can use the same machine, so that information belongs in the user specific .ini file. There is no list of macros documented anywhere, unfortunately. Cheers, Peter Assistant Professor Research Center for Computation & Technology and Department of Physics & Astronomy Louisiana State University On Sat, 2 Aug 2025, IOSIF PANAGIOTIS wrote: > Dear Leo, > > Thank you for your answer and for sharing your experience. > No, I hadn't received a reply to my question yet. > > So it seems that macros such as @ALLOCATION@ (or any other SimFactory > placeholder) can be changed via : > * either editing the .ini file > * or specifying the relevant command line option (i.e., among the ones > that come up when doing "./simfactory/bin/sim --help"). > > And if I understand correctly, it seems that whatever is specified as a > command-line option for sim takes priority over what is specified in the > configuration files. > Is this correct? > > If yes, then these placeholders could be simply left alone when editing the > submitscript and runscript, and set via the respective sim command-line > option when submitting a simulation. Right? > > And to reiterate part of my initial question: > * If these @FOO@ macros for SimFactory are documented somewhere, I would > be grateful if you could point me to the relevant page. > * If such documentation does not exist, then it is also ok, and this > empirical understanding will have to suffice for now. I was just asking > to make sure I was not missing some obvious documentation source. > > Best, > Panayotis > > ____________________________________________________________________________ > From: Users on behalf of Leonardo > Werneck > Sent: Thursday, July 31, 2025 7:26 PM > To: users at einsteintoolkit.org > Subject: Re: [Users] Users Digest, Vol 184, Issue 14 > Dear Iosif, > > I hope this message finds you well. > > I'm not sure you already got a reply, but in case you haven't, my > understanding is that placeholders like @FOO@ are there to indicate things > you need to change yourself, manually. > > So when you see something like: > > #SBATCH -A @ALLOCATION@ > > then it means you should replace @ALLOCATION@ with the name of your > allocation in the specific cluster. > > Someone else can correct me if this is not correct, but that's how I usually > handle these. > > Cheers, > Leo > > > On Fri, Jul 25, 2025 at 8:06?AM wrote: > Send Users mailing list submissions to > users at einsteintoolkit.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://lists.einsteintoolkit.org/mailman/listinfo/users > or, via email, send a message with subject or body 'help' to > users-request at einsteintoolkit.org > > You can reach the person managing the list at > users-owner at einsteintoolkit.org > > When replying, please edit your Subject line so it is more > specific > than "Re: Contents of Users digest..." > > > Today's Topics: > > 1. SimFactory placeholder macros (IOSIF PANAGIOTIS) > 2. Issue with ReadInterpolate (Luciano Combi) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 25 Jul 2025 10:43:36 +0000 > From: IOSIF PANAGIOTIS > To: Einstein Toolkit Users > Subject: [Users] SimFactory placeholder macros > Message-ID: > COM> > > Content-Type: text/plain; charset="iso-8859-1" > > Hi, > > I have been following this document, > https://einsteintoolkit.org/seminars/2022_02_24/index.html , to > set up ET on my cluster, working also on some example > configuration files. > > While preparing the submit and run scripts, I wanted to check > the description of the @FOO@ macros that SimFactory uses. > > I checked these places but found no information. > > * > https://simfactory.bitbucket.io/simfactory2/userguide/ (no > mention of macros) > * > https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutori > al (1 mention of the @USER@ macro and a pointer to a section#Macros d_Tutorial#Macros> that seems missing) > * > https://docs.einsteintoolkit.org/et-docs/Configuring_a_new_machine > (there is no information on the submitscript and runscript) > > So I would like to ask: > > If e.g. I have this line in my submitscript: > #SBATCH -A @ALLOCATION@ > > Where is @ALLOCATION@ "read" from? > > My guess is that this is specified in the .ini file in this > line: > allocation = > > Could you confirm if this is the case? > > Is there another source of documentation (that I might have > missed) describing what these @FOO@ placeholders do? > > Best regards, > Panagiotis > > > ------------------- > Panagiotis Iosif > postdoctoral researcher > Department of Physics, University of Trieste > Via Alfonso Valerio 2, Trieste 34127 > Italy > ------------------- > > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: 8ab5/attachment-0001.htm> > > ------------------------------ > > Message: 2 > Date: Fri, 25 Jul 2025 15:05:48 +0000 > From: Luciano Combi > To: "users at einsteintoolkit.org" > Subject: [Users] Issue with ReadInterpolate > Message-ID: > LOOK.COM> > > Content-Type: text/plain; charset="iso-8859-1" > > Hi people, > > I have used ReadInterpolate successfully for different > applications in the past. I'm now trying to use it to > interpolate onto a new grid that has 5 ghost zones i.e.: > > CoordBase::boundary_size_x_lower = 5 > CoordBase::boundary_size_y_lower = 5 > CoordBase::boundary_size_z_lower = 5 > CoordBase::boundary_size_x_upper = 5 > CoordBase::boundary_size_y_upper = 5 > CoordBase::boundary_size_z_upper = 5 > Driver::ghost_size = 5 > GRHydro::GRHydro_stencil = 5 > But I'm getting this error: > > CCTK_Proc569.err <== > while executing schedule bin ReadInterpolate_ReadData, routine > ReadInterpolate::ReadInterpolate_Read > in thorn ReadInterpolate, file/home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInter > polate/src/read.c:559: > -> Skipping integer variable 'SPACEMASK::space_mask it=335925 > tl=0 rl=0 c=569'. Do not know how to interpolate integers. > ERROR from host bcn1814.usr.hlrn.de process 569 > while executing schedule bin ReadInterpolate_ReadData, routine > ReadInterpolate::ReadInterpolate_Read > in thorn ReadInterpolate, file/home/mvxcombi/ET_Zelmani/Cactus/arrangements/EinsteinInitialData/ReadInter > polate/src/interpolate.cc:130: > -> There were 70227 points in 27 variables that could not be > set. > cactus_etk_devel:/home/mvxcombi/ET_Zelmani/Cactus/arrangements/Carpet/Carpet/src/helpers.cc: > 275: int Carpet::Abort(const cGH*, int): Assertion `0' failed. > Rank 569 with PID 1675935 received signal 6 > Writing backtrace to AIC_interp/backtrace.569.txt > The original grid has 3 ghost zones. I'm using the following > parfile: > # What to interpolate > # ------------------- > ReadInterpolate::files = > "checkpoint.chkpt.it_335925" > ReadInterpolate::max_number_of_read_variables = 30 > ReadInterpolate::only_these_datasets = ":Y_e, :rho, > :temperature, :vel, :Ax, :Ay, :Az, :psi6phi, :kxx, :kxy, :kxz, > :kyy, :kyz, :kzz, :gxx, :gxy, :gxz, :gyy, :gyz, :gzz, :betax, > :betay, :betaz, :alp" > ReadInterpolate::minimum_reflevel = 0 # Default > ReadInterpolate::maximum_reflevel = 1000 # Default > > # Interpolator settings > # --------------------- > ReadInterpolate::epsilon = 1.e-12 #2 # Default > ReadInterpolate::interpolator_half_width = -1 # Default, > use cctk_nghostzones > ReadInterpolate::interpolator_name = "Lagrange polynomial > interpolation" > ReadInterpolate::interpolator_pars = " > order = 3 > boundary_off_centering_tolerance = {1. 1. 1. 1. 1. 1.} > boundary_extrapolation_tolerance = {1.e-12 1.e-12 1.e-12 > 1.e-12 1.e-12 1.e-12} > " > > # Fixing the read-in data > # ----------------------- > ReadInterpolate::shift_read_datasets_by[0] = 0. > ReadInterpolate::shift_read_datasets_by[1] = 0. > ReadInterpolate::shift_read_datasets_by[2] = 0. > > ReadInterpolate::enforce_symmetries_after_reading = no # > Default > ReadInterpolate::fix_cell_centered_origins = no # > Default > > Any suggestions on how to solve this issue? > > Thanks a lot!! > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: 4213/attachment.htm> > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Users mailing list > Users at einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/users > > > ------------------------------ > > End of Users Digest, Vol 184, Issue 14 > ************************************** > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From users at einsteintoolkit.org Mon Aug 11 15:18:01 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Mon, 11 Aug 2025 15:18:01 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: <689a4ff9.L7ZYKaB7EU7yJur4%users@einsteintoolkit.org> Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From users at einsteintoolkit.org Wed Aug 13 17:15:01 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Wed, 13 Aug 2025 17:15:01 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: <689d0e65.Ypk+fsihgO3Sj63e%users@einsteintoolkit.org> Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From lucas.t.s.carneiro at gmail.com Thu Aug 14 09:52:33 2025 From: lucas.t.s.carneiro at gmail.com (Lucas Timotheo Sanches) Date: Thu, 14 Aug 2025 09:52:33 -0500 Subject: [Users] Meeting Minutes for 2025-08-14 Message-ID: Present: Lucas (minutes), Steven R Brandt (chair), Peter Diener, Beyhan, Helvi Witek, Jamie Bamber, Maxwell Rizzo, Roland Hass, Yosef Zlochower # Hackathon post mortem - Steve suggests that high level "how does the infrastructure works" talks may be useful for participants. Helvi added it as feedback for next talk. - Steve says he is open to having the next one at LSU. Steve suggests also that Canada is now a possibility. # Agenda items - BBH gallery example. Peter has not been able to get around to it yet. - Backports to Kruskal: Roland and Steve worked on various changes to make libs compile in various Linux distros. Roland reports to be testing it now on ACCESS clusters, and will merge it into master as soon as he is done testing. - Helvi asked Jay, Lucas and Cheng-Hsin to give updates on the projects of the Hackathon: 1. Jay: Ported Radicces M1, into a new code, called NUX. Removed GLS dependencies, close to having a GPU ready. Team effort, Allen, Jamie and Maxwell were the working forces. 2. Cheng-Hsin: Work on adding subcycling support to CanudaX. Got it into the evolution thorn, but Multipole output is not being output correctly. NewRadX performance and profiling the codes (Liwei, Lucas and Erik). 3. Lucas: Worked on getting higher order interpolation working on CapyrX. Initial tests indicate that evolution is working. He mentions wanting to run more tests using Multipole to see if the extracted wave forms are correct. He also worked on adding advective derivatives (working) and matter coupling (still needs work) to CottonmouthBSSN. 4. Steve: Created a JSON-like tags system for interface files. This feature can improve the way information is passed to the driver and aid in Cactus reflection mechanisms. He also created a reflection struct, that coalesces all useful information that Cactus has about a grid hierarchy. # Unanswered questions on the mailing list. - No questions # Tickets - 2858: Lucas says he can try the machine files for Marenostrum. If they work we will add them to simfactory. - 2867: Apparently, this happens when one does not use the SILO library that is distributed with the ETK. We discussed possibilities for making it work with spack. Roland has shared the options he uses while compiling. That may help. - 2872: Yosef points out that the problem went away with a new version but that does not mean it is solved. Steve says that there is not much we can do unless it shows up in the current or newer versions. From rhaas at mail.ubc.ca Thu Aug 14 10:54:13 2025 From: rhaas at mail.ubc.ca (Roland Haas) Date: Thu, 14 Aug 2025 08:54:13 -0700 Subject: [Users] meeting minutes for 2025-08-07 Message-ID: <20250814085413.13072b58@haengie2.phas.ubc.ca> Present: Deborah, Roland, Steve, Peter, Beyhan, Jhon, Johnny, Keith, Maxwell, Liwei, Yosef Chair: Deborah Minutes: Roland BBH gallery example =================== * no updates Questions on mailing list ========================= * simfactory macros, https://lists.einsteintoolkit.org/pipermail/users/2025-July/009692.html, responded in digest by Leo https://lists.einsteintoolkit.org/pipermail/users/2025-July/009701.html Open tickets ============ * https://bitbucket.org/einsteintoolkit/tickets/issues/2882 running-bbh-with-carpetx-with-cpus-high Liwei will respond * https://bitbucket.org/einsteintoolkit/tickets/issues/2881 running-bbh-with-carpetx-assertion-all-i-0 Liwei will respond * https://bitbucket.org/einsteintoolkit/tickets/issues/2773 make-carpetx-thorndoc-is-confused-in Steve will take a look, Roland poked an older ticket * https://bitbucket.org/einsteintoolkit/tickets/issues/2171 papi-compile-issues-with-intel-19-beta-on Roland will close as wontfix since too old OS * https://bitbucket.org/einsteintoolkit/tickets/issues/2867 wavetoyx-examples-hdf5-output-error-in-all is an older ticket, now made visible. In 2025-08-14 call Lucas confirms that Silo is producing this warning. * https://bitbucket.org/einsteintoolkit/tickets/issues/2866 problem-while-building-the-et-on-mn5 Steve will try and respond * https://bitbucket.org/einsteintoolkit/tickets/issues/2880 backport-externallibraries-changes-for-gcc Roland is testing fixes on different OS distros * https://bitbucket.org/einsteintoolkit/tickets/issues/2848 updates-to-flrwsolver No updates, still not sure how to provide fully reproducible pseudorandom number generator * https://bitbucket.org/einsteintoolkit/tickets/issues/2764 pugh-tries-to-free-memory-not-allocated-by Beyhan reports no updates * https://bitbucket.org/einsteintoolkit/tickets/issues/2282 gallery-examples-use-low-order-integration had a short discussion about integrations, Yosef reported that he has used Driscol-Healy in different code successfully for spherical harmonic decomposition. Issues are assigned to Zach. * https://bitbucket.org/einsteintoolkit/tickets/issues/963 improve-mclachlan-accuracy Peter is still working on this Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . From users at einsteintoolkit.org Mon Aug 18 15:18:01 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Mon, 18 Aug 2025 15:18:01 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: <68a38a79.mnNP6xjxMBaFEgAp%users@einsteintoolkit.org> Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From users at einsteintoolkit.org Wed Aug 20 17:15:01 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Wed, 20 Aug 2025 17:15:01 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: <68a648e5.vSpEdlWutYGznr5G%users@einsteintoolkit.org> Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From rhaas at illinois.edu Thu Aug 21 09:30:01 2025 From: rhaas at illinois.edu (Roland Haas) Date: Thu, 21 Aug 2025 07:30:01 -0700 Subject: [Users] meeting minutes for 2025-08-21 Message-ID: <20250821073001.60875626@fdea4908> Present: Peter, Roland, Steve, Beyhan, Johnny, Keith, Lucas, Maxwell, Yosef BBH gallery example =================== * no updates on BBH gallery examples, Roland to send reminders Backports to Kruskal ==================== * Roland provided updates, is mostly done with testing * extra changes for CMake 4.0 will also be included Simfactory files ================= * Lucas is in the process of testing the provided MN5 files on MN5 * Roland reported that Bruno Giacomazzo and Fatemeh Hossein Nouri provided files for the Leonardo system at Cineca which will be included as well Open tickets ============ * https://bitbucket.org/einsteintoolkit/tickets/issues/2859 iohdf5-passes-cflags-to-linker Beyhan will review * https://bitbucket.org/einsteintoolkit/tickets/issues/963 improve-mclachlan-accuracy no updates, timing is difficult with Zach travelling * https://bitbucket.org/einsteintoolkit/tickets/issues/2764 pugh-tries-to-free-memory-not-allocated-by no updates by Beyhan * https://bitbucket.org/einsteintoolkit/tickets/issues/2882 running-bbh-with-carpetx-with-cpus-high no updates, Roland to ping * https://bitbucket.org/einsteintoolkit/tickets/issues/2867 wavetoyx-examples-hdf5-output-error-in-all Keith says low priority * https://bitbucket.org/einsteintoolkit/tickets/issues/2858 compiling-carpetx-issues-with-pdesolvers Lucas is in the process of testing the provided MN5 files on MN5 Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu . -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From users at einsteintoolkit.org Mon Aug 25 15:18:01 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Mon, 25 Aug 2025 15:18:01 -0500 Subject: [Users] Agenda for Thursday's Meeting Message-ID: <68acc4f9.4LiQylonLWgUzfl6%users@einsteintoolkit.org> Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers From users at einsteintoolkit.org Wed Aug 27 17:15:02 2025 From: users at einsteintoolkit.org (users at einsteintoolkit.org) Date: Wed, 27 Aug 2025 17:15:02 -0500 Subject: [Users] Einstein Toolkit Meeting Reminder Message-ID: <68af8366.7ILkWiYc2Bu+xbnC%users@einsteintoolkit.org> Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers From sbrandt at cct.lsu.edu Thu Aug 28 09:52:20 2025 From: sbrandt at cct.lsu.edu (Steven Brandt) Date: Thu, 28 Aug 2025 09:52:20 -0500 Subject: [Users] Meeting minutes for 2025-08-26 Message-ID: <1ec4956e-ba3b-424c-a3c9-2937303d10ea@cct.lsu.edu> Aug 28, 2025 Present: Roland, Steve, Keith, Deborah, Leo, Nikolai, Zach, Lucas, Jay, Helvi, Johnny * BBH Gallery Example * Nikolai is a new student from BYU working for Zach * Open Tickets 2882 - Running BBH high mem/cpu low performance 2884 - Remove static variables used in fortran wrappers 1847 - FFTW ticket 2858 - Mare Nostrum files - Trying to use Singularity, some success ? ? ? ?Does not have access to the internet, so rely on rsync 2866 - Building ET on MN5: OpenCL, probably should just disable 2867 - WaveyToX examples, HDF5 output error message in all three examples ? ? ? ?Seems to be harmless? 2880 - Backport External Libraries for gcc-15 ? ? ? ?Roland is working on this 2883 - External libraries failing with CMake 4.0 2733 - make CarpetX-Thorndoc is confused in perl ? ? ? ?Steve will work on this 2878 - CarpetX: Add multipatch output support * Tickets ready for review 2764 - PUGH tries to free memory not allocated by malloc 963? - Improve McLachlin Accuracy ? ? ? ?Zach will talk to Peter. Should link to BBH gallery example ticket: 2706 2855 - NoiseX 2860 - Don't call opt 4th order 2851 - Cray Pointer issue with Canuda - Merged PR, can close ticket. Zach suggests we sort tickets by reverse sort