Users

users@lists.einsteintoolkit.org

3 participants
3984 discussions

Agenda for Thursday's Meeting
by rhaas＠illinois.edu 16 Dec '24

16 Dec '24

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Meeting minutes for 2024-12-12
by Lucas Timotheo Sanches 12 Dec '24

12 Dec '24

Attendees: Lucas (Minutes), Zachariah Etienne, Peter Diener, Roland Hass (chair), Steven R. Brandt, Leo Rosa Werneck, Maxwell Rizzo # Pre-agenda topics * Zach asked for updated citations for the new release on Zenodo. Roland did so right away. * SPEC v8: Steve reports that Cactus is still proceeding at being a SPEC benchmark. The SPEC team reports successfully compiling a severely reduced version of Cactus on Windows with MSVC. # "Canon" Release post-mortem * Roland's thoughts on this release were the following: He believes it was an "Okish release". In his opinion, we were delayed for too long (even though there are always delays). He stresses the importance of getting service accounts in repos so that people can create branches with these accounts. This should make it easier for contributors and release managers to make edits. He wants to clean it up, too many manual steps should be more automated. Judgment calls should also be reduced. * More updates for the gallery examples are still needed. # Upcoming release * Roland asked if any of the present would volunteer to be release manager assistant for the upcoming release. So far, there were none. * Codes for possible inclusion in the next release were discussed: 1. Z4c: Champions: Erik, Roland. Reviewers: Steve and Peter. 2. BHaHAHA: Champion: Zach, Review: Steve. 3. CCE data writer: Champion: Deborah Ferguson, Review: Peter Diener 4. New modules for cosmology: Hayley Macpherson needs to be contacted and asked if she has any code she would like to include. 5. More gallery examples: Roland suggested that we create more gallery examples for alternative codes that already exist in the toolkit, such as Fishbone-Moncrief, Canuda, Baikal and others. # Mailing list No emails. # Open tickets * 2836: Roland and Erik are reviewing it. * 2835: Roland suggests that anyone that wants backtrace in Carpet should review this ticket. * 2633: Peter apologizes for not having time to look at this last week and says he will take a look. * 963: Peter wanted to contact Zach to discuss the improvements, but got delayed. Zach reports he still needs to move some of the improvements to Baikal. # Tickets ready for review * No new updates on any specific ticket. * Maxwell Rizzo has reported an issue with the Anvil cluster. He reports that simfactory is producing invalid job ids when recovering jobs that are old but whose data still exists. Roland says there is a bug in simfactory when getting job IDs which may be related to this. He suggests artificially setting the job id in the properties.ini simfactory file to anything other. than -1, which signifies an invalid job. # Other topics * Zach initiated a discussion on the inconvenience of getting proper citations for individual thorns used during Cactus execution. This, he adds, may lead to codes being used without proper citation in application papers. He proposes that whenever Cactus runs, a bibtex file is emitted for the active thorns in the parameter file being run. This would help users note and remember to properly cite the papers of the codes being used. Roland pointed out that similar functionality was proposed (and never reviewed or accepted) in ticket 2254, which uses extra bibtex tags in formaline Zach argued that a solution using formaline may be easily disabled, as for instance, he dislikes using formaline for production builds as it takes a long time for it to run. Lucas suggested for Cactus to officially add .bib files (along with .ccl files) as an optional file in the definition of a Thorn. Users could then optionally include a .bib file in their thorn directories containing citation information. After that, either the flesh or an offline tool would read a parameter files' ActiveThorn list and concatenate the citations for each of the thorns used. The suggestion was liked, however Zach pointed out that simple concate- nation may not be enough, as some thorns may have overlapping citations. Steve pointed out that Piraha has a grammar for .bib files and can parse them. This should come in handy if parsing these files is necessary. To end the meeting on time, Roland suggested that we continue this discussion next week.

1 0

Einstein Toolkit Meeting Reminder
by rhaas＠illinois.edu 11 Dec '24

11 Dec '24

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

The Twenty-Ninth Release of the Einstein Toolkit
by Roland Haas 10 Dec '24

10 Dec '24

Release Announcement Click here to read the announcement in HTML (with hyperlinks): https://einsteintoolkit.org/about/releases/ET_2024_11_announcement.html We are pleased to announce the twenty-ninth release (code name "Annie Jump Cannon") of the Einstein Toolkit, an open-source, community-developed software infrastructure for relativistic astrophysics. The major changes in this release include: One new thorn has been added: * TOVola -- solves the Tolman-Oppenheimer-Volkov equations for simple polytropes, piecewise polytropes, and tabulated equations of state. Updated thorns: * CarpetX -- many updates and new functionality * GRHayL -- support WENO5 reconstruction In addition, bug fixes accumulated since the previous release have been included. The Einstein Toolkit is a collection of software components and tools for simulating and analyzing general relativistic astrophysical systems. It builds on numerous software efforts in the numerical relativity community, including codes to compute initial data parameters, the spacetime evolution codes Baikal, lean_public, and McLachlan, analysis codes to compute horizon characteristics and gravitational waves, the Carpet AMR infrastructure, and the relativistic (magneto)hydrodynamics codes GRHayLHD, GRHayLHDX, GRHydro, and IllinoisGRMHD. Data analysis and post-processing are handled by the kuibit library. The Einstein Toolkit also contains a 1D self-force code. For parts of the toolkit, the Cactus Framework is used as the underlying computational infrastructure, providing large-scale parallelization, general computational components, and a model for collaborative, portable code development. The Einstein Toolkit uses a distributed software model. Its different modules are developed, distributed, and supported either by the core team of Einstein Toolkit Maintainers or by individual groups. Where modules are provided by external groups, the Einstein Toolkit Maintainers ensure quality control for modules included in the toolkit and help coordinate support. The Einstein Toolkit Maintainers currently involve staff and faculty from five different institutions and host weekly meetings that are open to anyone. Guiding principles for the design and implementation of the toolkit include: open, community-driven software development; well thought-out and stable interfaces; separation of physics software from computational science infrastructure; provision of complete working production code; training and education for a new generation of researchers. For more information about using or contributing to the Einstein Toolkit, or to join the Einstein Toolkit Consortium, please visit our web pages at http://einsteintoolkit.org, or contact the users mailing list users(a)einsteintoolkit.org. The Einstein Toolkit is primarily supported by NSF 2004157/2004044/2004311/2004879/2003893/2114582/2227105 (Enabling fundamental research in the era of multi-messenger astrophysics). The Einstein Toolkit contains about 400 regression test cases. On a large portion of the tested machines, almost all of these tests pass, using both MPI and OpenMP parallelization. Contributors Among the many contributors to the Einstein Toolkit and to this release in particular, important contributions to new and existing components were made by the following authors: * David Boyer * Erik Schnetter * Leonardo Werneck * Liwei Ji * Samuel Cupp * Steven R. Brandt * Terrence Pierre Jacques * Zachariah Etienne How to upgrade from Launda Release (ET_2024_05) To upgrade from the previous release, use GetComponents with the new thornlist to check out the new version. See the Download page (http://einsteintoolkit.org/download.html) on the Einstein Toolkit website for download instructions. The SelfForce-1D code uses a single git repository; thus, using git pull; git checkout ET_2024_11 will update the code. To install Kuibit, do the following: pip install --user -U kuibit==1.5.0 Machine notes Supported (tested) machines include: * Debian, Ubuntu, Fedora, Mint, OpenSUSE, and macOS installations with dependencies installed as prescribed in the official installation instructions * Anvil * Deep Bayou * Delta * Expanse * Frontera * Queen Bee 3 and 4 * Stampede 3 * Sunrise * Supermike Note for individual machines: * TACC machines: defs.local.ini needs to have `sourcebasedir = $WORK` and `basedir = $SCRATCH/simulations` configured for this machine. You need to determine $WORK and $SCRATCH by logging in to the machine. All repositories participating in this release carry a branch ET_2024_11 marking this release. These release branches will be updated if severe errors are found. The "Annie Jump Cannon" Release Team on behalf of the Einstein Toolkit Consortium (2024-11-29) * Roland Haas * Maxwell Rizzo * David Boyer * Domenica Garzon * Bing-Jyun Tsao * Lucas Timotheo Sanches * Peter Diener * Steven R. Brandt November 29, 2024

1 0

Agenda for Thursday's Meeting
by rhaas＠illinois.edu 09 Dec '24

09 Dec '24

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Expression of interest for postdoc positions in gravity theory and GW phenomenology at Sapienza University of Rome
by paolo.pani＠uniroma1.it 05 Dec '24

05 Dec '24

From: Paolo Pani <paolo.pani(a)uniroma1.it> To: undisclosed-recipients:; Subject: Expression of interest for postdoc positions in gravity theory and GW phenomenology at Sapienza University of Rome Date: Thu, 5 Dec 2024 17:36:03 +0100 Please share the following announcement with potentially interested candidates. %%%%%%%%% We expect to open several postdoctoral positions to work in the gravity theory and gravitational-wave phenomenology group at Sapienza University of Rome https://web.uniroma1.it/gmunu . Successful candidates will join the *FIS project 'ET-NOW: Fundamental Physics, Nuclear Physics, and Cosmology with the Einstein Telescope' *(PI: Paolo Pani) recently funded by the Italian Ministry for Research. Candidates with expertise in gravitational-wave modeling, numerical relativity, science interpretation and data analysis, and with interests in cosmology, nuclear, high-energy physics & gravity are particularly encouraged to apply. The appointment is for 2+1 years (extension subject to funding renewal and satisfactory performance), with a net salary competitive with international standards. All candidates must hold (or soon be completing) a Ph.D. in Physics. Although flexible, the positions are expected to start typically in Sep 2025; but earlier start dates (as early as March 2025) can also be considered. Screening of the applications will begin in late December 2024 and will continue until the positions are filled. *Expressions of interest can be submitted here:* https://forms.gle/mGWkr3Cm6KDzktPn8 The research activities of the gmunu group include gravitational-wave modeling and phenomenology, black-hole and neutron-star physics, tests of gravity and of the nature of compact objects, and strong-gravity searches for dark matter. Group members are also expected to get involved in other activities such as training of students, networking, workshop & meeting organization, etc. The gmunu group currently includes the PI, Prof. Paolo Pani, 6 postdocs and 5 PhD students. Successful candidates will directly collaborate also with Prof. Francesco Pannarale (GW modelling and data analysis), Prof. Alfredo Urbano (Beyond the standard model theory and phenomenology; cosmology and physics of the primordial universe), and their students. Project members are also expected to interact with the ET experimental and GW data-analysis group [https://web.infn.it/VirgoRoma/index.php/en/] and with the INFN Rome Theory group [https://theory.roma1.infn.it/ ] at Sapienza, and to actively take part of the activities of the ET Observational Science Board. The Department of Physics at Sapienza is a vibrant work environment which hosts renowned research groups in several areas of physics, including gravitational-wave science, cosmology, and high-energy physics. In 2024 it ranked 12th among all Physics Departments worldwide and first in Italy, according to the Shanghai Global Ranking. -- Paolo Pani Professor of Theoretical Physics Junior Fellow, Scuola Superiore di Studi Avanzati Sapienza Physics Department (Marconi Building), 3rd floor, room 334 Sapienza University of Rome Piazzale Aldo Moro 5 - 00185 Rome (Italy) +39 06 4991 4472 (int 24472) https://web.uniroma1.it/gmunu/

1 0

meeting minutes for 2024-12-05
by Roland Haas 05 Dec '24

05 Dec '24

Present: Roland, Bill, Peter, Zach, Johnny, Leo, Maxwell, Lucas, Steve ET Cannon release ================= * waiting for TOVola commit rights, Zach will try and follow up * some failing tests, likely due to tight tolerances * Peter finished BBH gallery example, everything looks fine, will skip VisIt visualization unless QB cooporates, Bill mentions a singularity image for VisIt that he has used successfully in the past. Lucas reports having successfully used sshfs to access the files on the cluster from one's workstation. * Running VisiIt via singularity, singularity run docker://symerio/visit and see halfway down the ticket for Multipatch https://bitbucket.org/einsteintoolkit/tickets/issues/2174/test-multi-patch-… Next ET release =============== * possibly inclusions for next release, Maxwell Rizzo is chair ** Z4c ** BHaHAHA horizon finder ** CCE code to hook up to Spectre ** possibly more modules for cosmology Updated tickets =============== * 2520 update gauge settings in TOV example to be more typical, will postpone until 2025 * will close 2171 since issue can no longer be reproduced * 2773 "make CarpetX-ThornDoc is confused in InterLatex.pl", Steve will take a look * 2282 "gallery examples use low-order integration n Multipole", Peter tested some of this but has not quite gotten all results. Will continue and report next week. * 2606 "Inconsistent LAPACK versions in ExternalLibraries/BLAS & LAPACK", Zach will look into it again * 2576 "`after` statements in scheduler in `IllinoisGRMHD`", Zach&Leo&Sam will check and close ticket if posible * 1566 "Update Cactus autoconf", Roland has change ready, will apply shortly after release to have lots of time for testing * 2831 "ExternalLibraries/MPI creates MPI_INC_DIRS that have double quotes in their value", Steve has a fix in mind * 2761 "some ExternalLibraries require cmake to build", to be included in master now, since it limits things on expanse * 2719 "GetCompnents does not handle symbolic links correctly when checking repository inter-dependencies", still persists, mostly affects FUKA * 2820 "NewRadX boundary condition conflicts with symmetry condition", just did not make for this release, should make it for the next Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

1 0

Einstein Toolkit Meeting Reminder
by rhaas＠illinois.edu 04 Dec '24

04 Dec '24

1 0

Re: [Users] need help running simulation on slurm
by Roland Haas 04 Dec '24

04 Dec '24

Hello Maya, Sorry for the long delay in responding. > My name is Maya Baireddy. I am working on my school research project trying > to run the simulation of BNS merger on amarel supercomputer from my local > university. Thanks for contacting me. I will try and see if I can provide some help. > Could you please help me to start my simulation on SLURM. I have followed > the ETK gallery example for BNS simulation steps 1-5. But I am not able to > proceed to successfully create a machine to run the simulation. > > I run the following steps > /home/sb1554/BNS/simfactory/bin/sim create bns --parfile > /home/sb1554/BNS/bns.par --machine slurmbns > > srun bns.sh -o slurm.bns.%N.%j.out Looks ok to me. > and got the error: > > **** An error occurred in MPI_Init_thread*** on a NULL communicator*** > MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,*** > and potentially your MPI job)* With errors like this my first guess is usually that he MPI stack used to compile and the one used at runtime is not the same. SLURM in particular can be dicey in that respect since it can try and directly interface with MPI. > I am attaching my machine, submit script, run script, log files. Thank you. > I would appreciate any pointers from you. Or if you could point me to the > right person. > > I was trying to post this on EKT forum, but need one credit to post. To the gitter chat? I though that was open to all with no requirements? This one: https://gitter.im/EinsteinToolkit/EinsteinToolkit The mailing list users(a)einsteintoolkit.org was unavailable for a while due to required maintenance. You would have to sign up to post, otherwise the post will be held for "moderator approval" (which it will receive, just may take a little bit of time). Now for the actual question. The machine.ini file (slurmbns.ini-machine.txt) looks strange (eg it contains two [slurmbns] sections). The line submit = sbatch /home/sb1554/BNS/simfactory/mdb/runscripts/slurmbns.run will always make is use the file "/home/sb1554/BNS/simfactory/mdb/runscripts/slurmbns.run" as the file passed to SLURM as the job script. The "submit" entry should be just "sbatch" without the extra file name. There is no "envsetup" section so you will have to yourself make sure that he same modules (in particular mpi modules) are loaded when you compile and when you submit the job, otherwise SLURM (and srun) may use the wrong MPI stack. The run script "slurmbns.ini-runscript.txt" is also strange since it contains a "/home/sb1554/BNS/simfactory/bin/sim run" which would again call the runscript. Instead it should contain the "srun" call. The submitscript is also strange since it should end with a line calling "sim run". It may be best to first directly add the srun command to the SLURM batch file (the "submitscript" mostly since it has the SBATCH headers) and set the headers by hand, load the modules, and call srun from there. This should make it look very similar to a MPI+OpenMP "Hybrid" parallelization example submit script that your cluster admins may provide. For SLURM based machines, the machine ini files usually look very similar. In your case I would suggest taking a look at say the ones for the Delta cluster at NCSA: https://bitbucket.org/simfactory/simfactory2/src/master/mdb/machines/delta.… https://bitbucket.org/simfactory/simfactory2/src/master/mdb/optionlists/del… https://bitbucket.org/simfactory/simfactory2/src/master/mdb/runscripts/delt… https://bitbucket.org/simfactory/simfactory2/src/master/mdb/submitscripts/d… You may also want to call in to the Einstein Toolkit weekly call on Thursday (the Gitter chat may also work for real time communication). Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

1 0

Agenda for Thursday's Meeting
by rhaas＠illinois.edu 02 Dec '24

02 Dec '24

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users