Users

users@lists.einsteintoolkit.org

3 participants
3984 discussions

ET_2023_05 Release: Call For New Contributions
by Leonardo Werneck 13 Jan '23

13 Jan '23

Dear all, If you are interested in contributing a new functionality to the Einstein Toolkit in the upcoming release, please contact Leo Werneck (wernecklr(a)gmail.com) or Sam Cupp (scupp1(a)my.apsu.edu) by Jan 18, 2023 (next Wednesday) so that we can announce them in the next weekly telecon. Currently, the following new functionalities have been proposed: - FLRW solver - FUKA v2 - CarpetX prerelease - Major feature update to IllinoisGRMHD (includes thorns NRPyEOSET and NRPyLeakageET) We will vote on whether or not to include new features on a weekly telecon in the near future. Sincerely, The Release Team

1 0

Trouble with account creation for online usage of tutorial
by Panagiotis Iosif 13 Jan '23

13 Jan '23

Dear ET users, I am a new user trying to familiarize myself with the ET. I tried following the instructions in the "Tutorial for new users" but I encountered a problem with account creation (in order to use the CactusTutorial.ipynb notebook online to get a feel for the basics). I went to the web server, https://etk.cct.lsu.edu/, clicked on the "Sign in with CILogon" button and then I entered my ORCID credentials. Afterwards I got (as expected) the "403: Forbidden" page, then clicked on "Request account" and answered the two questions. However when I clicked submit, I got a page saying "Please provide a valid email address." and there is no way I can proceed further. I noticed that in the "email" field, instead of an email address, my ORCID is automatically entered and I suppose that is the problem (see attached screenshots). Do you have any suggestions as to how I can proceed and create my account? Best regards, Panagiotis Iosif ------------------------------------------------------------- Dr. Panagiotis Iosif postdoctoral researcher email: piosif(a)auth.gr; paniosif(a)gmail.com Section of Astrophysics, Astronomy and Mechanics Department of Physics Aristotle University of Thessaloniki 54124, Thessaloniki, Greece -------------------------------------------------------------

1 1

Meeting Minutes: 2023-01-12
by Yosef Zlochower 12 Jan '23

12 Jan '23

Present: Zach, Roland, Leo, Samuel, Yosef. Additional New features for next release: * Feature update for IGM (neutrino physics and tabulated EOS support) * https://docs.einsteintoolkit.org/et-docs/Release_Details Announcements: * GRHayL Library version of GRMHD code under development at U Idaho (to generalize across infrastructures). To be presented at a telecon later in the year. * Pull requests for update so that ETK works on Mac M1 out of the box. * Next US ET summer school will be at RIT. Details to be released soon. Discussion: Improving build system and external library support. Building on a new cluster can be quite complicated and often requires sysadmin support. Perhaps improving the build system should be part of the next proposal. Chair for next week: Leo Minute Taker: Roland Yosef

1 0

Einstein Toolkit Meeting Reminder
by reminders＠einsteintoolkit.org 11 Jan '23

11 Jan '23

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Agenda for Thursday's Meeting
by reminders＠einsteintoolkit.org 09 Jan '23

09 Jan '23

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

meeting minutes for 2023-01-05
by Roland Haas 05 Jan '23

05 Jan '23

Present: Leo, Roland, Steve, Zach nrpytutorial development: * Sam and Steve were active over winter break modernizing code ** Steve observes breakage in Giraffe code ** Zach will chat with Ken about this ET release contribution * Leo and Sam are release chair * Fishbone-Moncrief gallery example: Roland will collect files and created website * Elliptica reader: release managers will contact * FUKA: release managers will contact Unaswered questions: * http://lists.einsteintoolkit.org/pipermail/users/2022-December/008802.html is about ET summer school. Will answer, next US meeting is RIT, next EU meeting is Miguel Zilhao (Portugal, Porto?) FB-Moncrief ID and NRPy+ modernization: * Zach's group will start on this (https://bitbucket.org/einsteintoolkit/tickets/issues/2503/various-small-pro…) * Baikal will get read / writes support (by Sam) Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

1 1

About the next Einstein Toolkit Summer School
by Mário Raia Neto 05 Jan '23

05 Jan '23

Dear Einstein Toolkit Team: First of all, I hope to find you safe, as well as all your beloved ones. I wish you a happy new year. Now, I'm a undergraduate physics student from Brazil and I work with general relativity. I wish to learn more about numerical relativity and due to that I would like to know if will occur a next edition of the "Einstein Toolkit Summer School"; it will be a next summer school for the next academic year? Best regards, Mário Raia Neto.

2 1

Einstein Toolkit Meeting Reminder
by reminders＠einsteintoolkit.org 04 Jan '23

04 Jan '23

1 0

Agenda for Thursday's Meeting
by reminders＠einsteintoolkit.org 02 Jan '23

02 Jan '23

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Re: [Users] Issue with Multiple Node Simulation on cluster
by Spandan Sarma 19306 27 Dec '22

27 Dec '22

Dear Erik and Steven, Thank you so much for the suggestions. We changed the runscript to add -x OMP_NUMTHREADS to the command line and it worked in solving the issue with the total number of threads being 144. Now it sets to 32 (equal to the number of procs). Also, the iterations have increased to 132105 for 32 procs (24 hr walltime) compared to just 240 before. Although this is a huge increase, we expected it to be a bit more. For a shorter walltime (30 mins) we received iterations - 2840, 2140, 1216 for procs - 32, 16, 8. Are there any more changes that we can do to improve on this? The new runscript and the output file (as a drive link) are attached below (no changes were made to the machine file, option list and the submit script from before). p32_omp.out <https://drive.google.com/file/d/1TpM03UQ6vfxJS2ArxzZuI3MBD6JzrTnP/view?usp=…> On Thu, Dec 15, 2022 at 2:49 PM Spandan Sarma 19306 <spandan19(a)iiserb.ac.in> wrote: > Dear Erik and Steven, > > Thank you so much for the suggestions. We changed the runscript to add -x > OMP_NUMTHREADS to the command line and it worked in solving the issue with > the total number of threads being 144. Now it sets to 32 (equal to the > number of procs). > > Also, the iterations have increased to 132105 for 32 procs (24 hr > walltime) compared to just 240 before. Although this is a huge increase, we > expected it to be a bit more. For a shorter walltime (30 mins) we received > iterations - 2840, 2140, 1216 for procs - 32, 16, 8. Are there any more > changes that we can do to improve on this? > > The new runscript and the output file for 32 procs are attached below (no > changes were made to the machine file, option list and the submit script > from before). > > On Fri, Dec 9, 2022 at 8:13 PM Steven R. Brandt <sbrandt(a)cct.lsu.edu> > wrote: > >> It's not too late to do a check, though, to see if all other nodes have >> the same OMP_NUM_THREADS value. Maybe that's the warning? It sounds like >> it should be an error. >> >> --Steve >> >> On 12/8/2022 5:23 PM, Erik Schnetter wrote: >> > Steve >> > >> > Code that runs as part of the Cactus executable is running too late >> > for this. At that time, OpenMP has already been initialized. >> > >> > There is the environment variable "CACTUS_NUM_THREADS" which is >> > checked at run time, but only if it is set (for backward >> > compatibility). Most people do not bother setting it, leaving this >> > error undetected. There is a warning output, but these are generally >> > ignored. >> > >> > -erik >> > >> > On Thu, Dec 8, 2022 at 3:48 PM Steven R. Brandt <sbrandt(a)cct.lsu.edu> >> wrote: >> >> We could probably add some startup code in which MPI broadcasts the >> >> OMP_NUM_THREADS setting to all the other processes and either checks >> the >> >> value of the environment variable or calls omp_set_num_threads() or >> some >> >> such. >> >> >> >> --Steve >> >> >> >> On 12/8/2022 9:03 AM, Erik Schnetter wrote: >> >>> Spandan >> >>> >> >>> The problem is likely that MPI does not automatically forward your >> >>> OpenMP setting to the other nodes. You are setting the environment >> >>> variable OMP_NUM_THREADS in the run script, and it is likely necessary >> >>> to forward this environment variable to the other processes as well. >> >>> Your MPI documentation will tell you how to do this. This is likely an >> >>> additional option you need to pass when calling "mpirun". >> >>> >> >>> -erik >> >>> >> >>> On Thu, Dec 8, 2022 at 2:50 AM Spandan Sarma 19306 >> >>> <spandan19(a)iiserb.ac.in> wrote: >> >>>> Hello, >> >>>> >> >>>> >> >>>> This mail is in continuation to the ticket, “Issue with compiling ET >> on cluster”, by Shamim. >> >>>> >> >>>> >> >>>> So after Roland’s suggestion, we found that using the –prefix >> <openmpi-directory> command along with hostfile worked successfully in >> simulating a multiple node simulation in our HPC. >> >>>> >> >>>> >> >>>> Now we find that the BNSM gallery simulation evolves for only 240 >> iterations on 2 nodes (16+16 procs, 24 hr walltime), which is very slow >> with respect to, simulation on 1 node (16 procs, 24 hr walltime) evolved >> for 120988 iterations. The parallelization process goes well within 1 node, >> we received iterations - 120988, 67756, 40008 for procs - 16, 8, 4 (24 hr >> walltime) respectively. We are unable to understand what is causing this >> issue when openmpi is given 2 nodes (16+16 procs). >> >>>> >> >>>> >> >>>> In the output files we found the following, which may be an >> indication towards the issue: >> >>>> >> >>>> IINFO (Carpet): MPI is enabled >> >>>> >> >>>> INFO (Carpet): Carpet is running on 32 processes >> >>>> >> >>>> INFO (Carpet): This is process 0 >> >>>> >> >>>> INFO (Carpet): OpenMP is enabled >> >>>> >> >>>> INFO (Carpet): This process contains 1 threads, this is thread 0 >> >>>> >> >>>> INFO (Carpet): There are 144 threads in total >> >>>> >> >>>> INFO (Carpet): There are 4.5 threads per process >> >>>> >> >>>> INFO (Carpet): This process runs on host n129, pid=20823 >> >>>> >> >>>> INFO (Carpet): This process runs on 1 core: 0 >> >>>> >> >>>> INFO (Carpet): Thread 0 runs on 1 core: 0 >> >>>> >> >>>> INFO (Carpet): This simulation is running in 3 dimensions >> >>>> >> >>>> INFO (Carpet): Boundary specification for map 0: >> >>>> >> >>>> nboundaryzones: [[3,3,3],[3,3,3]] >> >>>> >> >>>> is_internal : [[0,0,0],[0,0,0]] >> >>>> >> >>>> is_staggered : [[0,0,0],[0,0,0]] >> >>>> >> >>>> shiftout : [[1,0,1],[0,0,0]] >> >>>> >> >>>> WARNING level 1 from host n131 process 21 >> >>>> >> >>>> in thorn Carpet, file >> /home2/mallick/ET9/Cactus/arrangements/Carpet/Carpet/src/SetupGH.cc:426: >> >>>> >> >>>> -> The number of threads for this process is larger its number >> of cores. This may indicate a performance problem. >> >>>> >> >>>> >> >>>> This is something that we couldn’t understand as we asked for only >> 32 procs, with num-threads set to 1. The command that we used to submit our >> job was: >> >>>> >> >>>> ./simfactory/bin/sim create-submit p32_mpin_npn --procs=32 >> --ppn=16 --num-threads=1 --ppn-used=16 --num-smt=1 >> --parfile=par/nsnstohmns1.par --walltime=24:10:00 >> >>>> >> >>>> >> >>>> I have attached the out file, runscript, submitscript, optionlist, >> machine file for reference. Thanks in advance for help. >> >>>> >> >>>> >> >>>> Sincerely, >> >>>> >> >>>> -- >> >>>> Spandan Sarma >> >>>> BS-MS' 19 >> >>>> Department of Physics (4th Year), >> >>>> IISER Bhopal >> >>>> _______________________________________________ >> >>>> Users mailing list >> >>>> Users(a)einsteintoolkit.org >> >>>> http://lists.einsteintoolkit.org/mailman/listinfo/users >> >>> >> >> _______________________________________________ >> >> Users mailing list >> >> Users(a)einsteintoolkit.org >> >> http://lists.einsteintoolkit.org/mailman/listinfo/users >> > >> > >> _______________________________________________ >> Users mailing list >> Users(a)einsteintoolkit.org >> http://lists.einsteintoolkit.org/mailman/listinfo/users >> > > > -- > Spandan Sarma > BS-MS' 19 > Department of Physics (4th Year), > IISER Bhopal > -- Spandan Sarma BS-MS' 19 Department of Physics (4th Year), IISER Bhopal

2 2

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users