Users September 2021

users@lists.einsteintoolkit.org

14 participants
24 discussions

Meeting Minutes 2021-09-16
by Gabella, William E 16 Sep '21

16 Sep '21

Present: Roland H, Helvi W, Peter D, Steve B, David B, Niklas M, Leonardo R, Bruno G, Gabriele B, Bill G, Atul K, Miguel G Chair: Helvi, Minutes: Bill * next ET release [SB, YZ, RH] https://docs.einsteintoolkit.org/et-docs/Release_Details Steve, has created a timeline in Release Details, and it seems nothing requires urgent attention right now. If you have a new feature you want in the ET, you should make that known. And we need to check on reviewing new features. Kuibit, reviewer Yosef not present. RePriMand thorn, Roland has compiled it and you do need Meson installed and then the external libraries thorn that is included does build. So at this point need to look through the code. It is a stand-alone code, so considering how/what the tests should be. Steve, added a list of new items proposed for the next release above the Release Details timeline under New Functionality (after some discussion). Roland, in the past created a Milestone on the release that includes these items. Helvi, FRWSolver from Hayley McPherson needs external Python compilation and try to see how to make it robust. Fuka, is anyone reviewing it and the Kadath elliptic solver? Roland, it uses C++ features we do not support in the ET, needs C++14 vs C++11 (now). Not going in. Some links: Fuka, https://kadath.obspm.fr/fuka/ Kuitbit, https://sbozzolo.github.io/kuibit/ RePriMand, https://github.com/wokast/RePrimAnd FLRWSolver_public, https://github.com/hayleyjm/FLRWSolver_public * Seminar and tutorial series [RH] Roland, in the ET meeting there was discussion to revive the seminar series and to have it more open...and to offer tutorials, and would like those using the tutorials to share how it worked for them. One presenter Wolfgang Kastaun, but that is it. Frequency, Steve suggests once a month is good. General agreement. Helvi, Num Rel community call is first Monday of the month---Nils getting speakers from different code infrastructure. So maybe go with the second or third week of the month. Collect suggestions at the link https://docs.einsteintoolkit.org/et-docs/Einstein_Toolkit_Seminar_Proposals Suggestions: ** Gabriele B volunteered for Kuibit tutorials. ** Roland, suggests CarpetX and GRHydroX talks. ** Bruno, Jay Vijay Kalinani and Lorenzo Ennoggi for Spritz, similar. ** Helvi, Giuseppe Ficarra. ** Roland, Sam Cupp maybe...he is currently working with Roland and Steve benchmarking the low-level infrastructure for CarpetX. ** Roland on how to setup Simfactory on a cluster, probably in one or two months from now. ** Helvi, Hayley McPherson give apresentation on the FRLW solver. Hands-on about generating initial data maybe. ** Helvi for xTensor tutorial part 2, BSSN or Initial Data. She is giving it next week Monday, 20 Sept, UCLA tutorial week Math Comput challenges. Tutorial / School week this week and next week. Helvi, Start on October 21st, the third week...and November 18th following...and December 16th after that. * SPEC status[RH, SB] Roland, have not done anything since last week. Trying to satisfy the short and long runs parameter file. Timeline? SPEC is valuable for being benchmarked and spreading around the community, as well as reporting to NSF. * Atul, asks about the Midwest Relatvitiy Meeting and Helvi responds that it will be hybrid, i.e. in-person and online. https://midwest-relativity-meeting-2021.physics.illinois.edu/ [https://www.einsteintoolkit.org/tools/unanswered.php unanswered question on mailing list] Topolski on THC Thorn, Kadath elliptic solver in Fuka branch. Seems mostly a THC question. David Radice seems to be responding. Hee Il Kim on Intel compilers. Helvi, can anyone follow-up with him? Yosef said something about difficulties with newer compilers. Helvi, could compile on Mac with M1 chip which is great, with Roland's help. Will send the Pull Request and it can be included in the release. [https://bitbucket.org/einsteintoolkit/tickets/issues?status=open&status=new… open tickets sorted by update time] #2551, ReprMand #2549, FLRW solver #2538, Inlude Kuibit, waiting for review. #2487, *_evolution_method = "LeanBSSNMoL", Helvi can look at it, but is busy right now. #2565, compiling PETSc, Roland hopes the new verison of PETsc fixes this, currently defaults to Python 2. #2564, Catctus' configure test, Roland, a bit technical. We test C++ by creating a file with extension *.C but this fails for CUDA which wants .cxx (or .cpp). A fix might be our own test for C++ compiles and if you can parse the Autoconf there, it should work. If that works, will make it into a Pull Request. #2254, Cactus thorns register citation request at runtime, this would be nice. Adds two function calls to Formaline that adds string to use this citation if you use the thorn. Right now hard to read, because in Formaline text format. Bibtex file and format is best. Seems straightforward but takes some time. [https://bitbucket.org/einsteintoolkit/tickets/issues?status=new&status=open… tickets ready for review] * Any other business ** Compiler Warnings David, how many people compiling the ET watch the compile, esp the compiler warnings? Roland, compiles from scratch and does not look for the whole ET, but for a thorn being developed he pays them a lot of attention. And many warnings come from F77, ancient code that we mostly do not use. Roland, if you do have fixes for the warnings then put in the pull request for it. Some of the warnings should be easy to fix. * Next week Chair: Peter D, Minutes: Miguel G -- ============================== William Gabella Research Assistant Professor Department of Physics and Astronomy Nashville, TN USA (o) 615-343-2713

1 0

Compilation error using Simfactory
by Jay Vijay Kalinani 16 Sep '21

16 Sep '21

Hi all, I have been trying to set up the Einstein Toolkit along with the GRMHD code Spritz on a recently upgraded machine 'Galileo100 <https://wiki.u-gov.it/confluence/display/SCAIUS/GALILEO100+short+guide>' at CINECA, Bologna, Italy. When I try to compile with simfactory, I get the following error message: [jkalinan@login02 Cactus]$ ./simfactory/bin/sim build Spritz --machine=g100 --thornlist=./thornlists/einsteintoolkit_newSpritzBNS.th Using configuration: Spritz Reconfiguring Spritz Writing configuration to: /g100/home/userexternal/jkalinan/ET/Lorentz/Cactus/configs/Spritz/OptionList /bin/bash: -c: line 0: syntax error near unexpected token `;' /bin/bash: -c: line 0: `{ ; } && { cd /g100/home/userexternal/jkalinan/ET/Lorentz/Cactus && echo yes | { make -j4 Spritz-config options=/g100/home/userexternal/jkalinan/ET/Lorentz/Cactus/configs/Spritz/OptionList; } 2>&1; }' Unfortunately, I am not familiar with this type of error, and any insights on how to understand and/or fix this error and compile correctly with simfactory would be much appreciated. Kindly let me know. The python version loaded on the machine is 3.8.6. However, I am able to compile without any problems using make via the following commands: make Spritz-config options=/g100/home/userexternal/jkalinan/ET/Lorentz/Cactus/simfactory/mdb/optionlists/g100.cfg thornlist=./thornlists/einsteintoolkit_newSpritzBNS.th make Spritz Thank you very much. Cheers, Jay Kalinani

3 3

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 15 Sep '21

15 Sep '21

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 13 Sep '21

13 Sep '21

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Code failure apparently due to changes in Reduction.c
by Yosef Zlochower 13 Sep '21

13 Sep '21

Hi, A code that we are using seems to no longer work with Cactus. The issue seems to be that the code called CCTK_LocalArrayReductionHandle. The code, as checked out, produces errors because the appropriate handle isn't found. If I modify the function as below, I no longer get the error message int CCTK_LocalArrayReductionHandle(const char *reduction) { int handle; handle = Util_GetHandle(LocalArrayReductionOperators, reduction, NULL); if (handle < 0) { CCTK_VWarn(1,__LINE__,__FILE__,"Cactus", "CCTK_LocalArrayReductionHandle: No handle: '%d' found for reduction operator " "'%s'", handle, reduction); } handle += ARRAY_OPERATOR_HANDLE_OFFSET; //// MY changes return handle; } Should we no longer use CCTK_LocalArrayReductionHandle? -- Dr. Yosef Zlochower Center for Computational Relativity and Gravitation Associate Professor School of Mathematical Sciences Rochester Institute of Technology 85 Lomb Memorial Drive Rochester, NY 14623 Office:74-2067 Phone: +1 585-475-6103 yosef(a)astro.rit.edu CONFIDENTIALITY NOTE: The information transmitted, including attachments, is intended only for the person(s) or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and destroy any copies of this information.

3 7

Patch for 3D hdf5 output files
by Francesco Zappa 13 Sep '21

13 Sep '21

Hallo everybody, I am Francesco Zappa, a PhD student at the Jena university. I am using a Cactus-based code and I am running simulations on Hawk cluster. Unfortunately, recent policy of Hawk have severe restrictions in terms of number of files that can be produced at the same time. The problem is that running several mpi processes generate many hdf5 output files and I would like to have them packed somehow. I have tried to use the option CarpetIOHDF5::one_file_per_proc = "yes" which works fine for 2D data files but it does not seem to work on 3D data files (which have the form <variable>.file_<process>.h5). I have been aware of the fact that it exists a patch for the Carpet Thorn to have these files packed together somehow. Could you please help me with this issue? Best regards, Francesco Zappa ------------------------------------- Friedrich-Schiller-Universität Jena Theoretisch-Physikalisches Institut Fröbelstieg 1, Office 219, Phone Number 0049-3641-9-47133 D-07743 Jena

3 2

meeting minutes for 2021-09-09
by Roland Haas 09 Sep '21

09 Sep '21

Present: Peter D., Yosef, Roland, Steve, Atul, Miguel, Helvi, Leo, Zach, Gabriele SPEC benchmark: * need to provide parameters for 1 min short and full node long run Next ET release: * Steve updated timeline, template: https://docs.einsteintoolkit.org/et-docs/Release_Process instance: https://docs.einsteintoolkit.org/et-docs/Release_Details * past date of adding new thorns * current time intersects with SC2021, which Steve is attending, but is a quiet week with just gallery examples being due * Students in Helvi's group are testing galleries Jenkins updates: * Roland will migrate away from dedicated Jenkins VM to GitHub actions based setup developed by UIUC REU students * reported on at 2021-04-29 and demo on https://mojamil.github.io/einsteintoolkit Emails: * Intel compiler question: Gabriele responded to the email and could run with modern intel compilers but just BBH, in Hee Il's email it is a BNS, Yosef had used Intel 19 but could not get it simulate BNS, Intel 18 worked (but this was a while ago) * THC thorn issues: conversation is between Konrad and David * PITTNull compilation failures: Intel compiler issue when it tries to optimize large Maple generated code chunks. Yosef suggests adding options (pragma), is working with a student on a leaner version of the code Tickets: * init_3_timelevels: https://bitbucket.org/einsteintoolkit/tickets/issues/2554/init_3_timelevels… some nans on past timelevels but not everywhere. Steve suggests trying to run with presync tests enabled to see if it reports sometthing useful. Chair next week (Sept 16): Helvi Minute taker next week (Sept 16): Bill Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

1 0

Multiple postdoc openings at Penn State
by Radice, David 09 Sep '21

09 Sep '21

Dear all: The Department of Physics at The Pennsylvania State University is seeking to fill two postdoctoral scholar positions in numerical relativity and high-energy astrophysics. The first position will be funded by NASA and is dedicated to the study of binary black holes for LISA in collaboration with David Radice: https://tinyurl.com/eucfauc4 The second position will be funded by NSF and is dedicated to the modeling of high-energy emission from merging neutron stars in collaboration with David Radice and Kohta Murase: https://tinyurl.com/4uncwsxk Additionally, there will be ample opportunity to collaborate with other members of the Institute for Gravitation and the Cosmos, which includes, among others, Abhay Ashtekar, Eugenio Bianchi, Martin Bojowald, Chad Hanna, Sarah Shandera, and B.S. Sathyaprakash. These position requires a Ph.D. in mathematics, physics, astronomy, or a closely related field. Please, refer to the URL above for the application details. Questions can be directed to David Radice (dur566(a)psu.edu). We specifically seek applications from women and from members of groups traditionally underrepresented among scholars in higher education. Penn State is an equal opportunity, affirmative action employer, and is committed to providing employment opportunities to all qualified applications without regards to race, color, religion, age, sex, sexual orientation, gender identify, national origin, disability or protected veteran status. With best wishes, David Radice (he/him) Assistant Professor Department of Physics The Pennsylvania State University 104 Davey Lab, Box 113 University Park, PA 16802-6300

1 0

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 08 Sep '21

08 Sep '21

1 0

Compilation error with ifort
by Lorenzo Ennoggi 08 Sep '21

08 Sep '21

Hi, I am trying to compile the Einstein Toolkit on MarconiA3 and I am getting the following error: ifort: error #10106: Fatal error in /marconi/prod/opt/compilers/intel/pe-xe-2018/binary/compilers_and_libraries_2018.5.274/linux/bin/intel64/fortcom, terminated by kill signal compilation aborted for /marconi/home/userexternal/lennoggi/ET_2020_11/Cactus/configs/Spritz_UpwindCT/build/NullConstr/NullConstr_R00.f90 (code 1) I have tried to compile both at O3 and O2, but that makes no difference. I am attaching the optionlist I am using. Do you have any clue about what may be causing the error? Thank you, Lorenzo

3 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users September 2021