Users July 2021

users@lists.einsteintoolkit.org

20 participants
38 discussions

recon_method dependency (weno)
by Hee Il Kim 07 Jul '21

07 Jul '21

Hi I'm reporting on recon_method dependency issue at least found in Turing and Lorentz. I've been studying BNS evolution by taking some of the Parma group models as references (DOI: 10.1103/PhysRevD.93.064047). But there were significant differences in merger time, t_merger. At the moment, I will put aside direct comparison between the GRHydro of Parma and recents ones. What I've found is that WENO of Turing/Lorentz produces much shorter inspiraling time (See the attached figure). But WENO-Z/PPM/MP5, they all produce similar inspiraling time. Of course, depending on resolutions, they produce different merging behaviour but as shown in the figure, higher-res PPM matches with lower-res WENO-Z nicely, which is consistent with our expectations. I've got the identical results for both Turing and Lorentz versions. I've missed recent GRHydro developments for a long time and I have no guesses for the discrepancy. I hope GRHydro developers examine this issue for the consistency of the recon_method. Thanks for your help in advance. Hee Il

3 4

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 07 Jul '21

07 Jul '21

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 05 Jul '21

05 Jul '21

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Submitting a simulation via simfactory on a cluster
by Konrad Topolski 05 Jul '21

05 Jul '21

Thanks, that seems to have done the trick. I set ppn to 48 and managed to properly set up all .run, .ini, .sub and .cfg according to my clusters' configuration. Now all starts up the way I want it, the MPI processes are reporting for duty and there is output from Cactus. When trying to run the gallery example GW150914.rpar, I am getting an error though: WARNING level 0 from host nid00268 process 0 while executing schedule bin BoundaryConditions, routine CoordinatesSymmetry::CoordinatesSymmetry_Apply_FirstPass in thorn CoordinatesSymmetry, file /lustre/tetyda/home/topolski/Cactus/arrangements/Llama/CoordinatesSymmetry/src/apply.c:665: -> Cannot apply symmetry boundary zones in the lower x direction, since there seem to be more symmetry zones than interior zones cactus_okeanos: /lustre/tetyda/home/topolski/Cactus/arrangements/Carpet/Carpet/src/helpers.cc:275: int Carpet::Abort(const _cGH *, int): Assertion `0' failed. Rank 0 with PID 272 This example is said to have been tested on 19-Nov-2020 - have there been any changes since which made the parameter file obsolete, or should I start troubleshooting my configuration? Best regards Konrad Topolski

2 3

Fwd: [nr-community-call] Today: NR community call at 9am Pacific time
by Helvi Witek 05 Jul '21

05 Jul '21

Dear all, there is a new, monthly NR community call for numerical relativists across the different infrastructures and codes. Today is our second call. In Nils Fischer's email below you can find information about today's meeting, and how to sign up to the mailing list and slack channel. Best wishes Helvi --------------------------------------------- Dr. Helvi Witek Assistant Professor Department of Physics University of Illinois at Urbana-Champaign 247 Loomis Lab 1110 W Green St Urbana, IL 61801 --------------------------------------------- -------- Forwarded Message -------- Subject: [nr-community-call] Today: NR community call at 9am Pacific time Date: Mon, 5 Jul 2021 11:03:43 +0200 From: Nils Fischer <nils.fischer(a)black-holes.org> To: nr-community-call(a)black-holes.org Dear Numerical Relativists, We’ll have our NR community call *today, July 5th at 9am LA / noon NYC / 5pm London / 6pm Berlin *in this Zoom room: https://mpi-aei.zoom.us/j/98949704345 <https://mpi-aei.zoom.us/j/98949704345> Our speakers today are *Thomas Helfer (JHU / GRChombo)* and *Miguel Gracia (UT Austin / Maya)*. - Feel free to circulate this information within the NR community. - Please subscribe to our mailing list <https://urldefense.com/v3/__https://groups.google.com/u/1/a/black-holes.org…> to receive info on the community calls in the future (or send a short message to nr-community-call+subscribe(a)black-holes.org <mailto:nr-community-call+subscribe@black-holes.org> to subscribe) and join our Slack <https://urldefense.com/v3/__https://join.slack.com/t/generalrelativity/shar…> for discussions (channel: #nr-community-call <https://urldefense.com/v3/__https://generalrelativity.slack.com/archives/C0…>). - Please sign up for a slot <https://urldefense.com/v3/__https://docs.google.com/forms/d/e/1FAIpQLSfoCnn…> in the schedule to speak at one of the community calls: https://github.com/sxs-collaboration/nr-community-call/wiki <https://urldefense.com/v3/__https://github.com/sxs-collaboration/nr-communi…> Looking forward to seeing you all later, Nils -- You received this message because you are subscribed to the Google Groups "NR community call" group. To unsubscribe from this group and stop receiving emails from it, send an email to nr-community-call+unsubscribe(a)black-holes.org <mailto:nr-community-call+unsubscribe@black-holes.org>.

1 0

Re: [Users] Users Digest, Vol 136, Issue 2
by Federico Cipolletta 03 Jul '21

03 Jul '21

Hello Konrad, To my understanding, it seems like the .cfg file has something wrong ( http://lists.einsteintoolkit.org/pipermail/users/2018-February/006103.html - i.e. the num-smt of your cluster should be 2, that should mean hyper threading - NOTE: I could be wrong with that). Moreover, you should use --procs=24 when submitting (from my experience this flag should be interpreted as the number of mpi task, that should correspond to the physical cores). I am only providing my experience, but for sure, some more experienced users/developers could drive you to the most correct answer. Regards, Federico Cipolletta. Il sab 3 lug 2021, 19:00 <users-request(a)einsteintoolkit.org> ha scritto: > Send Users mailing list submissions to > users(a)einsteintoolkit.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://lists.einsteintoolkit.org/mailman/listinfo/users > or, via email, send a message with subject or body 'help' to > users-request(a)einsteintoolkit.org > > You can reach the person managing the list at > users-owner(a)einsteintoolkit.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Users digest..." > > > Today's Topics: > > 1. Submitting a simulation via simfactory on a cluster > (Konrad Topolski) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sat, 3 Jul 2021 17:59:24 +0200 > From: Konrad Topolski <k.topolski2(a)student.uw.edu.pl> > Subject: [Users] Submitting a simulation via simfactory on a cluster > To: users(a)einsteintoolkit.org > Message-ID: > < > CAEx5SMHM6GszcaqE3_L0Rvx5+U29D6STMYH2d0PW777acyqrRA(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hi > > I am trying to get things right setting up simfactory on my cluster. > I have created the okeanos.ini and okeanos.cfg files, as well as built the > Cactus executable that's called cactus_okeanos. First I want to debug the > machine setup, then I hope to take care of the submission script. > > To submit a job, I use: > simfactory/bin/sim create-submit GW150914_4 --parfile > par/GW150914/GW150914.rpar --walltime 24:00:00 --configuration=okeanos > --machine=okeanos > > The error I am getting is the following: > > Warning: Too many threads per process specified: specified num-threads=48 > (ppn-used is 24) > Warning: Number of used cores per node, number of SMT threads, and number > of threads per process are inconsistent: ppn-used=24, num-smt=1, > num-threads=48_threads (ppn-used*num-smt must be an integer multiple of > num-threads) > Warning: Total number of threads and number of threads per process are > inconsistent: procs=1, num-threads=48 (procs*num-smt must be an integer > multiple of num-threads) > Warning: Total number of threads and number of cores per node are > inconsistent: procs=1, ppn-used=24 (procs must be an integer multiple of > ppn-used) > > The relevant part of my machine .ini file looks like this: > cpu = Intel Xeon E5-2690 v3 > cpufreq = 2.6 > ppn = 24 # or more > max-num-threads = 48 # or more > num-threads = 48 # or more > nodes = 1084 > memory = 131072 #any node has 128GB ram > min-ppn = 24 > maxwalltime = 48:00:00 > > I know that each node in my cluster consists of 12 sockets for cpus, each > cpu has two cores and each core supports multithreading (=2), so it's > 12x2x2 = 48. > What am I getting wrong? > > > Best regards > Konrad Topolski >

2 1

Submitting a simulation via simfactory on a cluster
by Konrad Topolski 03 Jul '21

03 Jul '21

Hi I am trying to get things right setting up simfactory on my cluster. I have created the okeanos.ini and okeanos.cfg files, as well as built the Cactus executable that's called cactus_okeanos. First I want to debug the machine setup, then I hope to take care of the submission script. To submit a job, I use: simfactory/bin/sim create-submit GW150914_4 --parfile par/GW150914/GW150914.rpar --walltime 24:00:00 --configuration=okeanos --machine=okeanos The error I am getting is the following: Warning: Too many threads per process specified: specified num-threads=48 (ppn-used is 24) Warning: Number of used cores per node, number of SMT threads, and number of threads per process are inconsistent: ppn-used=24, num-smt=1, num-threads=48_threads (ppn-used*num-smt must be an integer multiple of num-threads) Warning: Total number of threads and number of threads per process are inconsistent: procs=1, num-threads=48 (procs*num-smt must be an integer multiple of num-threads) Warning: Total number of threads and number of cores per node are inconsistent: procs=1, ppn-used=24 (procs must be an integer multiple of ppn-used) The relevant part of my machine .ini file looks like this: cpu = Intel Xeon E5-2690 v3 cpufreq = 2.6 ppn = 24 # or more max-num-threads = 48 # or more num-threads = 48 # or more nodes = 1084 memory = 131072 #any node has 128GB ram min-ppn = 24 maxwalltime = 48:00:00 I know that each node in my cluster consists of 12 sockets for cpus, each cpu has two cores and each core supports multithreading (=2), so it's 12x2x2 = 48. What am I getting wrong? Best regards Konrad Topolski

2 1

meeting minutes for 2021-07-01
by Roland Haas 01 Jul '21

01 Jul '21

Present: Peter, David B,. Bill G., Roland, Leo, Yosef, SPEC: * no update Kuibit: * general agreement to include it, 2 explicit in favor, no objections, go ahead with inclusion at this point, bring up again next week * Roland mentioned that the paper may be in JOSS and thus reviewed Other codes to include: * RWZM self-force code could be ready for inclusion next release, by Sam Cupp * code is currently working for a circular effective source, currently testing fluxes and comparing to existing codes * Idaho (nee WVU) group may have an ID solver code that might be up for inclusion * LORENE2 update LORENE update: * no update yet, Roland to ping Josh New ET release manager: * postpone for a week ET school: * have heard back from most speakers confirming their slots * will most likely start 30min earlier than initially advertised * students can still register (to the last day), but no longer submit (new) talks * will finalize program and contributed talks today chair next weeks: Peter, Roland minutes next week: Leo, Bill Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users July 2021