Users

users@lists.einsteintoolkit.org

3 participants
3984 discussions

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 30 Aug '21

30 Aug '21

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Meeting Minutes 2021-08-26
by Gabella, William E 26 Aug '21

26 Aug '21

Present: Bill G, Helvi W, Steve B, Miguel G, Yosef Z, Roland H, Leonardo RW, Atul K, Peter D, Zach E, Maria H, Gabriele B Chair: Helvi W, Minutes: Bill G * SPEC benchmark contribution [https://bitbucket.org/einsteintoolkit/tickets/issues/2470 task] [RH, SB] Roland, no real updates, do need to send an extended description and ask if they need more details. Steve would like to know why they asked for this detailed description. https://www.spec.org/cpu2017/Docs/benchmarks/507.cactuBSSN_r.html * next ET release manager [RH] Next release is in November; recall feature freeze is about two weeks before release and hard freeze a few days before. https://docs.einsteintoolkit.org/et-docs/Release_Details https://docs.einsteintoolkit.org/et-docs/Release_Process Steve agreed to be the manager with help from Yosef. Helvi, it is useful to have more than one person to do this. Steve, Roland left off the conditional that Steve will do it if Roland does this "soon," need not be the next release after. ** New inclusions for next release FLRWSolver/Cosmology by Hayley Macpherson and Helvi will review it. Ticket #2549, https://bitbucket.org/einsteintoolkit/tickets/issues/2549/inlcude-flrwsolve… . Kuibit and possibly RePriMand for inclusion. RePriMand has ticket #2551, https://bitbucket.org/einsteintoolkit/tickets/issues/2551/include-reprimand… . RePriMand does have a thorn and an external library for it. Unlikely to build out of the box...requires a couple of other packages/tools. If it requires external libraries not typically available on clusters, we cannot enable it by default. For example, Peter's 1D Force is a model of a stand-alone version that is not built by default and uses SCons for building. Atul, wanted to volunteer for Kuibit review, and he is unable to review Kuibit this semester. Can do less intensive work for the release though. Yosef intends to try to review Kuibit. Review does not check for correctness, checks for running and documentation. Ticket #2438, https://bitbucket.org/einsteintoolkit/tickets/issues/2538/inclusion-of-kuib… . Yosef, build systems question, can RePriMand run on all clusters. Wolfgang says it is mostly Python and if you have some Pip version maybe can install/build that way. Builds using Meson which uses Ninja and not Make. Gabriele, how will Kuibit is to be included in the ET? In the repo or installed by Pip? Roland, could use it in GetComponents and that gives best exposure and lets different branches be checked out. Kuibit was reviewed in the Journal of Open Science Software...there is a link in the ticket. JOSS paper at https://joss.theoj.org/papers/10.21105/joss.03099 . Roland, If the software is independently hosted, we ask for a branch label with the ET name, and then if their Master branch for that software fails, we use the ET branch of their software. Helvi, has a code in the ET and has one branch for the ET and there is another branch her group uses routinely. Roland discusses a couple of options and how to get the dependencies for Kuibit, for example. Gabriele also uses Tags on the Branches that he can make very easily. He likes distributing the repo because of all the examples. Helvi, maybe include these links in the documentation. ** Gallery Examples Helvi has two students that should do examples. * Any Other Business ** Maria, would like documentation on thorns Multipole and QuasiLocalMeasures and SphericalSurface used to extract the GWs. Why/How do they depend on each other and how to tune the parameters. Helvi, Check the Readme for the thorn, some information there. Roland, WeylScal4 everyhwere in 3D space, and Multipole calculates the projection and spin spherical harmonics. QuasiLocalMeasures is separate, concerned with calculations on horizons, like spin, etc, not concerned with waves but with horizons. There are papers cited there, in the README. An older thorn does the same thing. Some documentation was started but does not go very far. SphericalSurface does not do any analysis, it is a way to describe in the code star-shaped surface. Horizon finder will store the shape in the spherical surface to do the isolated horizon quantities. Waveform extraction does not use the SphericalSurface at all. ** Helvi, there is a new monthly call for the NumRel community started by Nils Fischer; the next call is 13th September. The idea is to have speakers from different code communities, next time SXS/Mitman and Meudon/Oertel are presenting. Structure is to describe the project, here is what we are working, and here is where we have difficulties and ask if there are any ideas in the community. https://github.com/sxs-collaboration/nr-community-call/wiki * [https://www.einsteintoolkit.org/tools/unanswered.php unanswered question on mailing list] Perl script is failing, in many ways. It does not display unanswered entries on the mailing list right now. Roland is aware. * [https://bitbucket.org/einsteintoolkit/tickets/issues?status=open&status=new… open tickets sorted by update time] Helvi goes through the tickets. #2553, CPPFLAGS and CXXFLAGS trouble when you use a non-g++ compiler, like using the cuda compiler. Roland has a work around. Only affects Cuda. If doing Cuda this might affect you. #2559, HDF5 library generates 2GB of files and we do not use them and causes trouble in some user quotas. Roland, this is cleanup. #2558, link for Power incorrect, ticket is almost closed, need to wait one more week and then will backport the fix. #2538, inclusion of Kuibit, discussed above. * [https://bitbucket.org/einsteintoolkit/tickets/issues?status=new&status=open… tickets ready for review] Nothing new or discussed. * Any Other Business Next weeks chair and minute taker: Yosef will chair. Maria will take minutes. -- ============================== William Gabella Research Assistant Professor Department of Physics and Astronomy Nashville, TN USA (o) 615-343-2713

1 0

Fwd: [nr-community-call] Next NR community call: Sep 13th
by Helvi Witek 26 Aug '21

26 Aug '21

Dear all, join us for the NR community call on Sept. 13; see below Best wishes Helvi --------------------------------------------- Dr. Helvi Witek Assistant Professor Department of Physics University of Illinois at Urbana-Champaign 247 Loomis Lab 1110 W Green St Urbana, IL 61801 --------------------------------------------- -------- Forwarded Message -------- Subject: [nr-community-call] Next NR community call: Sep 13th Date: Tue, 24 Aug 2021 11:25:42 +0200 From: Nils Fischer <nils.fischer(a)black-holes.org> To: nr-community-call(a)black-holes.org Dear Numerical Relativists, Our next NR community call will be on *September 13th*. Please note this is a week later than usual to accommodate a public holiday in the US. Our speakers will be *Keefe Mitman (Caltech / SXS)* and *Micaela Oertel (Meudon / CompOSE). *You can find the schedule in the wiki: https://github.com/sxs-collaboration/nr-community-call/wiki <https://urldefense.com/v3/__https://github.com/sxs-collaboration/nr-communi…> - Feel free to circulate this information within the NR community. - Please subscribe to our mailing list <https://urldefense.com/v3/__https://groups.google.com/u/1/a/black-holes.org…> to receive info on the community calls in the future (or send a short message to nr-community-call+subscribe(a)black-holes.org <mailto:nr-community-call+subscribe@black-holes.org> to subscribe) and join our Slack <https://urldefense.com/v3/__https://join.slack.com/t/generalrelativity/shar…> for discussions (channel: #nr-community-call <https://urldefense.com/v3/__https://generalrelativity.slack.com/archives/C0…>). - Please sign up for a slot <https://urldefense.com/v3/__https://docs.google.com/forms/d/e/1FAIpQLSfoCnn…> in the schedule to speak at one of the community calls: https://github.com/sxs-collaboration/nr-community-call/wiki <https://urldefense.com/v3/__https://github.com/sxs-collaboration/nr-communi…> Best, Nils -- You received this message because you are subscribed to the Google Groups "NR community call" group. To unsubscribe from this group and stop receiving emails from it, send an email to nr-community-call+unsubscribe(a)black-holes.org <mailto:nr-community-call+unsubscribe@black-holes.org>.

1 0

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 25 Aug '21

25 Aug '21

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 23 Aug '21

23 Aug '21

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

BHNS simulation issues - Hamiltonian constraint violations and general problems
by Konrad Topolski 23 Aug '21

23 Aug '21

Hi all I am trying to run a BH-NS simulation using at least one of some (and sometimes more) unofficial thors. That would be Kadath for the initial data and possibly THC for hydro evolution. I'm trying to run the simulation either with GRHydro or with THC. In both cases I believe that the initial data gets imported correctly - I have looked at some simple visuals which I'm attaching to this mail. However, as the simulation proceeds, huge hamiltonian constraint violations occur and e.x. the lapse gets driven to 0 globally. This can also be seen. How can I help this? Is it because the puncture is not tracked correctly? Trying to set up a PunctureTracker at the location of the black hole yields a failure very soon, as the shift at puncture is said to be (nan, nan, nan). I'm sending the .par files, outputs (.out), errors (.err) and visualization (.png). Best regards Konrad

2 5

Meeting minutes for 2021-8-19
by Miguel Gracia 19 Aug '21

19 Aug '21

Present: Peter D., Miguel G., Roland H., Steven B., Zach E., Atul K., Leonardo W., Gabriele B., Yosef Z., William G., Maria H. Hayley M., Helvi W. Chair: Steven B. Minutes: Miguel G. * SPEC benchmark contribution Roland sent email. They needed a description, Roland is working on that https://www.spec.org/cpu2017/Docs/benchmarks/507.cactuBSSN_r.html * Next ET release manager search: Roland sent email to people asking: “are you willing to be the release manager?”. Yosef suggested that there should be a release team with a coordinator more than a release manager in charge of everything. Being the release manager shouldn’t be too difficult because Zach in the last release created detailed notes about the process, also he pointed out some stuff in release list that only Steve or Roland can do like updating ZENODO site. It was decided to wait for one more week if not Steve volunteered to do it if Roland does the next one. * New components in the release: Kuibit: Yosef is going to review it, he will try to start soon by installing it, Gabriele said version 1.3 master branch should be most possible candidate for the release. Kuibit documentation should be followed in order to install it or follow the gallery example link<https://www.einsteintoolkit.org/gallery/bbh/index.html>: Atul is going to find out soon if he will be able to help with the review. RePrimAnd: Roland is going to review RePrimAnd library. The release will include only the library. FLRWSolver: Hayley Macpherson is setting everything up to meet the ET inclusion requirements. Helvi is the reviewer. She will start in the coming weeks. * CarpetX activities update: Roland. CarpetX is peaking up steam, Erick main author. Developers group has growth ( from different institutions) aiming for a Hydro code. The contributor rules/guidelines have been updated. Steven: Does CarpetX work on AMD gpu’s? Roland’s not sure but might be possible. * MWRM21<https://midwest-relativity-meeting-2021.physics.illinois.edu/> at UIUC November 11 - 13, 2021 Thursday to Saturday -Midwest relativity meeting planned to be hybrid (online/in person) , everyone is invited. * Unanswered question on mailing list: -ET and recent Intel compilers (Hee Il Kim) mixing compilers might be part of the issue. Steve is going to reply. Other questions: Maria H: is it possible to have BNS evolution where each of the stars has different EOS?. Roland: No, it is not possible in order to do it, one will need to modify the code. * Open tickets SDSC Expanse machine added to machine list. * Tickets ready to review Next call: August 26th Chair: Helvi W. Minutes: William G — end of the call

1 0

Error running single star simulation
by Alessandro Ciarfella 19 Aug '21

19 Aug '21

Hello everyone, I'm Alessandro Ciarfella, a Ph.D. student at the Rochester Institute of Technology. I was trying to run the single star simulation example on ubuntu installed on a virtual box but after I submit the simulation and run the python code to plot the output either from inside the Cactus directory or the home directory the following error message appears: /bin/sh: 1: /home/alessandro/simulations/tov_ET/output-0002: Permission denied Output is written to Traceback (most recent call last): File "tov_ET.py", line 9, in <module> lin_data = np.genfromtxt(outdir+"/tov_ET/hydrobase-rho.maximum.asc") File "/home/alessandro/.local/lib/python3.8/site-packages/numpy/lib/npyio.py", line 1793, in genfromtxt fid = np.lib._datasource.open(fname, 'rt', encoding=encoding) File "/home/alessandro/.local/lib/python3.8/site-packages/numpy/lib/_datasource.py", line 193, in open return ds.open(path, mode, encoding=encoding, newline=newline) File "/home/alessandro/.local/lib/python3.8/site-packages/numpy/lib/_datasource.py", line 533, in open raise IOError("%s not found." % path) OSError: /tov_ET/hydrobase-rho.maximum.asc not found. I would highly appreciate some help on this. Thanks in advance. Cheers, Alessandro Ciarfella

2 1

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 18 Aug '21

18 Aug '21

1 0

XSEDE's Expanse and failing tests
by Gabriele Bozzola 18 Aug '21

18 Aug '21

Hello, Two days ago, I opened a PR to the simfactory repo to add Expanse, the newest machine at the San Diego Supercomputing Center, based on AMD Epyc "Rome" CPUs and part of XSEDE. In the meantime, I realized that some tests are failing miserably, but I couldn't figure out why. Before I describe what I found, let me start with a side node on AMD compilers. <side node> There are four compilers available on Expanse: GNU, Intel, AMD, and PGI. I did not touch the PGI compilers. I briefly tried (and failed) to compile with the AMD compilers (aocc and flang). I did not try hard, and it seems that most of the libraries on Expanse are compiled with gcc anyways. A first step to support these compilers is adding the lines: elif test "`$F90 --version 2>&1 | grep AMD`" ; then LINUX_F90_COMP=AMD else elif test "`$CC --version 2>&1 | grep AMD`" ; then LINUX_C_COMP=AMD fi elif test "`$CC --version 2>&1 | grep AMD`" ; then LINUX_CXX_COMP=AMD fi in the obvious places in flesh/lib/make/known-architecture/linux. </side node> I successfully compiled the Einstein Toolkit with - gcc 10.2.0 and OpenMPI 4.0.4 - gcc 9.2.0 and OpenMPI 4.0.4 - intel 2019 and Intel MPI 2019 I noticed that some tests, like ADMMass/tov_carpet.par, gave completely incorrect results. For example, the expected value is 1.3, but I would find 1.6. I disabled all the optimizations, but the test would keep failing. At the end, I noticed that if I ran with 8/16/32 MPI processes per node, and the corresponding number of OpenMP threads (128/N_MPI), the test would fail, but if I ran with 4/2/1 MPI processes, the test would pass. Most of my experiments were with gcc 10, but the test fails also with the Intel suite. I tried increasing the OMP_STACK_SIZE to a very large value, but it didn't help. Any idea of what the problem might be? Gabriele

2 6

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users