Users October 2021

users@lists.einsteintoolkit.org

22 participants
27 discussions

Fwd: Regarding Installation of Einstein's toolkit
by Ratan Deshpande 08 Nov '21

08 Nov '21

I have installed Ubuntu LTS on Windows Installed X11 server and Putty but I dont know how to resolve host name issue according to https://docs.einsteintoolkit.org/et-docs/Setup_Tutorial I am not getting how to proceed with installation. Please do assist in this regard. Regards, Ratan

2 1

Meeting Minutes 2021-10-28
by Miguel Gracia 28 Oct '21

28 Oct '21

Present: Roland H., Miguel G., Steven B., Leonardo W., Gabriele B., Yosef Z., William G., Zach E., Atul K., Bilal Hameed A., Peter D. Chair: Roland H. Minutes: Miguel G. SPEC benchmark contribution [SB] Took the code and ran it successfully without NaNs. Spec benchmark people have not responded. Next ET release <https://docs.einsteintoolkit.org/et-docs/Release_Process> [SB, YZ, RH] Vote on names: It was decided that the next release name is: Katherine Johnson <https://en.wikipedia.org/wiki/Katherine_Johnson> Gallery runs: BBH <https://bitbucket.org/einsteintoolkit/tickets/issues/2172/test-binary-black…> [?]. Cheng-Hsin Ch -No update BNS <https://bitbucket.org/einsteintoolkit/tickets/issues/2176/test-binary-neutr…> [?]. No update. TOV <https://bitbucket.org/einsteintoolkit/tickets/issues/2175/test-single-stabl…> [PD] No update. Poisson <https://bitbucket.org/einsteintoolkit/tickets/issues/2173/test-poisson-equa…> [MG]. No update. scalar wave <https://bitbucket.org/einsteintoolkit/tickets/issues/2174/test-multi-patch-…> [BG] No update New Functionality: Yosef started to review Kuibit , he was able to generate some images but he encountered some examples missing found in the documentation notebooks (development version) and some python dependencies failed to build in his machine. Yosef does not know what task he should be performing: [RH] 1. reviewing the code base for Kuibit but might not be necessary because it has been already reviewed by an open source reviewer. [RH] 2. Check if the installation instructions and user manual fulfill their purpose. [RH] Decide how to install, adding it to getcomponents or use the same method SefForce-1D code uses. Gabrielle Bozzola explained that he can tag the documentation for each of Kuibit versions to avoid mixtures. Gabrielle also mentioned that installing Kuibit with pip should be enough to get all the dependencies necessary to successfully install and run it. Gabrielle could fix the mixed documentation and that the missing examples was a glitch, should be fix. he will work on this. Roland suggested that having instructions to generate the BBH gallery example plots with Kuibit should be enough and users should be referred to kuibit documentation if they want to explore more Kuibit capabilities. RePriMand: Roland has started checking it, recreate the example provided by Wolfgang , he created a make file and it works. He also created a thornlist that gets it as an external library. FLRWSolver: no update. [RH] will contact the people in charge through the ticket. [RH] Ideally, the reviewed inclusions should be added before the release freeze (Nov 12). Unanswered question on mailing list: [SB]: Hee II responded, precise math did fix the issue (intel NaNs vs no NaNs gcc). Steve is going to investigate more about this. Open tickets About ticket : https://bitbucket.org/einsteintoolkit/tickets/issues/2571/runtime-failure-d… <https://bitbucket.org/einsteintoolkit/tickets/issues/2571/runtime-failure-d…> Roland suggests to include a CarpetX branch with the modified Flesh that fixes all compatibility issues with CarpetX. check the ticket for more details. Other questions: No other questions. Next call: November 4th Chair: Peter D. Minutes: Leo W. end of the call

1 0

Fwd: ET and recent Intel compilers
by Steven R. Brandt 28 Oct '21

28 Oct '21

Just trying to keep this on the users list. --Steve -------- Forwarded Message -------- Subject: Re: [Users] ET and recent Intel compilers Date: Mon, 25 Oct 2021 09:00:26 +0900 From: Hee Il Kim <heeilkim(a)gmail.com> To: Steven R. Brandt <sbrandt(a)cct.lsu.edu> Hi Steve, I'm using that 'fp-precise' option. The bns specific thorns like NSTracker and RotatingSymmetry180 didn't make the issue (and RK3 instead of RK4 is tested). I think I might be mistaken but I've thought that TOV and BNS use different initial data setup, for instance, to get the values for _p, _p_p etc. I was suspecting that BNS might be causing the trouble while making those data. But I've got messy confirming what I have thought. Do you have any feeling it's likely caused by this process? Since the TOV test didn't encounter the issue, I think there's no more bns-specific processes. Thanks in advance. Hee Il On Thu, Oct 21, 2021 at 10:45 PM Steven R. Brandt <sbrandt(a)cct.lsu.edu> wrote: Sorry I lost track of this email thread. I got caught up with other things. I'm wondering whether you have tried compiling with fp-precise? I'm just wondering whether it could be a problem with Intel's optimization. --Steve On 9/1/2021 6:21 AM, Hee Il Kim wrote: > Hi, > > As James Healy mentioned in the post "[Users] Einstein Toolkit and > modern AMD supercomputer", I found static_tov.par passed the test > for the Intel issue. So some bns-generic codes would make NaNs. > But less probable because the only bns-generic code would be > NSTracker but I've already encountered the NaN production issue > w/wo NSTracker. > > NaNChecker itself could be suspected but both bns and tove tests > are using NaNChecker. > > Rather, it could be a generic issue of Intel compiler. There are > some bugs reported and new features in handling NaNs for the case > of ifx. Those look just irrelevant yet. > > Hee Il > > > > > _______________________________________________ > Users mailing list > Users(a)einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/users _______________________________________________ Users mailing list Users(a)einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users

1 0

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 27 Oct '21

27 Oct '21

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Question about Llama's Thornburg04nc set up
by Luciano Combi 27 Oct '21

27 Oct '21

Hello everyone! I'm trying to set up an accretion disk using GRHydro and a Llama grid setup without a Cartesian patch (Thornburg04nc). I'm using a private thorn (TorusID) to set up all grid functions including a fixed Kerr-Schild metric. I'm following a simple parfile in LlamaToy that uses Thornburg04nc and one that Roland shared a few months ago but I'm having seemingly basic issues. In particular, I'm getting the following error: cactus_etk_devel_gcc_mpi: > /gpfs/fs0/home/d/dsiegel/lcombi/ET_devel/Cactus/arrangements/Llama/Coordinates/src/interpolate.cc:407: > CCTK_INT4 > Coordinates::Coordinates_SymmetryInterpolate(CCTK_POINTER_TO_CONST, > CCTK_INT4, CCTK_INT4, CCTK_INT4, CCTK_INT4, CCTK_INT4, CCTK_INT4, const > void* const*, CCTK_INT4, const CCTK_INT4*, CCTK_INT4, const CCTK_INT4*, > void* const*, CCTK_INT4): Assertion `thevars.at(num_time_derivs).at(num_derivs).at(time_level).at(basevar).at(derivvar) > == -1' failed. > In the code, it's mentioned that this could be a problem from CarpetInterp? but not sure what's going on, honestly. I attach the parfile and the full .out, .err. Thanks a lot in advance, Best. -- *Luc Combi* Instituto Argentino de Radioastronomía CONICET, Buenos Aires, Argentina web page. <http://sites.google.com/view/lucianocombi>

2 4

Configuring SimFactory issue
by Bilal Hameed 27 Oct '21

27 Oct '21

Dear Users, I am configuring ET in SimFactory, I am using Jupyter in virtual env, unfortunately, found an error %%bash ./simfactory/bin/sim setup-silent Warning: Unable to determine CACTUS_PATH, using /home/bilal/Cactus/repos/simfactory2 instead Here we will define some necessary Simulation Factory defaults. "

2 18

Postdoc Opening at the U. of Idaho
by Zach Etienne 25 Oct '21

25 Oct '21

Greetings Einstein Toolkit users! I have an opening for a new postdoctoral position, which can involve work with the Einstein Toolkit. Here's the ad: The Department of Physics at the University of Idaho (Principal Investigator: Zachariah Etienne) is seeking applications for a Postdoctoral Fellow in the field of Computational Astrophysics/Numerical Relativity. The successful candidate will: - Perform state-of-the-art simulations of important astrophysical/multi-messenger phenomena, and analyze and visualize simulation data. - Work with multi-institution networks of collaborators on next-generation numerical relativity projects such as: - NRPy+-enhanced Einstein Toolkit, which involves advancing NRPy+-based code generation within the Einstein Toolkit framework, lowering the barrier to entry for new users. - IllinoisGRMHD (https://illinoisgrmhd.net): Supercomputer simulations of magnetized binary neutron star mergers with IllinoisGRMHD ( https://illinoisgrmhd.net), coupling dynamical spacetimes, GRMHD, tabulated equations of state, and neutrino physics. - BlackHoles@Home (https://blackholesathome.net), which is a proposed, BOINC-based volunteer-computing / public-outreach project called aimed at unlocking the consumer-grade desktop computer as a core tool for numerical relativity simulations of black holes and black hole binaries. Our goal is to generate more than 10,000 NR-based waveform predictions per year, validating all existing waveform catalogs and greatly exploring the parameter space. - ChaNGa/NRPy+: Advancing the state-of-the-art in supercomputer simulations of binary neutron star mergers, through the marriage of the ChaNGa SPH code (for GRHD/GRMHD) and the NRPy+-based BlackHoles@Home infrastructure (for the spacetime). - NRPyElliptic: A fast new hyperbolic relaxation elliptic solver for generating initial data for numerical relativity. - Write scientific papers summarizing work and present work at scientific conferences. The preferred start date is August 2022, though earlier start dates are acceptable. This position may be renewed in annualized increments for a duration of at least two years, contingent upon performance, need, and funding. The screening process will begin on December 15, 2022 and will continue until the position is filled. -={ Qualifications }=- - Ph.D. in Physics, Mathematics, Astronomy, Computer Science, or a related field required. - Strong programming skills (C and Python, or closely related languages). - Experience in high-performance computing and large-scale data analysis. - Excellent ability to communicate research to both experts and non-experts. -={ Requirements }=- - Resume or CV - Statement of research - Three letters of recommendation -={ University of Idaho }=- The University of Idaho (UI) is located in the idyllic Palouse region, on the Washington state border. It experiences a Mediterranean-like climate with warm, dry summers, and mild winters. UI is situated in Moscow, the most walkable city in Idaho (walkscore.com), and is only 15km from Pullman, WA, another college town . The University of Idaho is an Equal Opportunity/Affirmative Action/Veterans/Disability Employer. -={ Apply for this Position }=- Here's the link to apply: https://uidaho.peopleadmin.com/postings/33500 -Zach * * * Zachariah Etienne Assoc. Prof. of Physics, U. of Idaho http://astro.phys.wvu.edu/zetienne/ http://blackholesathome.net

2 1

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 25 Oct '21

25 Oct '21

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

2021-10-21 meeting agenda
by Hamilton, Maria 21 Oct '21

21 Oct '21

Present: Yosef Zlochower, Maria Hamilton, Roland Haas, Atul Kedia, Leo Werneck, Steve Brandt, Peter Diener, David Bradley, Bilal Hameed Chair: Steve Brandt Minutes: Maria Hamilton Agenda: * Steve brings up Eric's suggestion to change "contribute" to "collaborate & interact" on the ETK web page * Roland agrees that it makes sense * Maria agrees as well, no one opposes * Change accepted * Next ET release: * Steve explains Yosef’s role in the release as a deputy, to “scowler the tickets for include in release notes”. He advances that it will be a good idea to make the function of r"elease deputy" official in the future releases, as a training mechanism for potential coordinators. * Steve asks why Gallery runs assigned have question marks? Roland answers that those are Helvi’s volunteers and he was not provided their names yet. * Roland does not have any update on Reprimand. It is not critical, will only be checked out but not compiled, because it requires Boost, which is not supported by the ETK Development. It is not used by CarpetX, only used by THC. * No update on FLWSolver. * No update on Kuibit, but Yosef will look over it this coming Sunday. * Steve proposes to start searching for names for the next release. https://docs.einsteintoolkit.org/et-docs/Release_Details#Tools.2FLinks * Nothing jumps out at anybody in particular * David Bradley proposes a fictional character from Avengers * Peter proposes NASA research mathematician Katherine Johnson * Unanswered tickets and mailing list: * #2571 https://bitbucket.org/einsteintoolkit/tickets/issues/2571/runtime-failure-d… * Chair Nov 4 – Peter D Remaining business * Steve: offers account on Deep Bayou, the HPC at LSU, if anybody wants to work on it to compile Carpet X. It has 14 nodes, 48 core, GPU, good for high performance codes. * Maria: gnuplot not working on Mac Big Sur, suggestion to maybe not use Mac. * Leo Werneck encountered the problem and fixed it, might have a solution. Meeting Adjourns --Maria _______________________ Maria C. Babiuc Hamilton, Ph.D. Professor, Department of Physics College of Science, Marshall University, 1 John Marshall Drive, Huntington, WV, 25755 Room S 257, Phone: (304)696-2754

1 0

ET and recent Intel compilers
by Hee Il Kim 21 Oct '21

21 Oct '21

Hi, I've encountered various issues from recent Intel compilers. Except for some versions having header file issues, I could manage to build ET executables but actual run stalled at various steps depending on the compiler versions. For example, Case 1. Before initial data generation ... INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 1 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 0 INFO (CarpetRegrid2): Enforcing grid structure properties, iteration 1 Case 2. During reading Lorene data (e.g., while reading resu.d) Case 3. Evolution started with normal IDs but NaNs produced from the next evolution step. I've encountered the issues in various combinations of OneAPI/IntelMPI and OneAPI/OpenMPI on Centos8 (gcc-8.3.1) machines. There had been no issues for OpenMPI/GCC. But I've just found Case 1 is produced on an old machine with devtoolset gcc-6.3.1/openmpi-1.8.4. You have any hints for the issue? Thanks in advance. Hee Il

2 4

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users October 2021