Users

users@lists.einsteintoolkit.org

3 participants
3984 discussions

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 08 Apr '20

08 Apr '20

Hello, Please consider joining the weekly Einstein Toolkit phone call at 9:00 am US central time on Thursdays. For details on how to connect and what agenda items are to be discussed, use the link below. https://docs.einsteintoolkit.org/et-docs/Main_Page#Weekly_Users_Call --The Maintainers

1 0

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 06 Apr '20

06 Apr '20

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

optimal nodes, mpi tasks, and cpus per mpi task?
by Bill Gabella 03 Apr '20

03 Apr '20

Okay just a little advice from the community, running a qc0 BBH merger example on our HPC at Vanderbilt and trying to tune my parameters. WE use Slurm / SBATCH and the ones I am working with are: o amount of memory per node o number of nodes o numpy of MPI tasks o if more than one cpu per task helps One example was 4 GB per node, 4 nodes, 4 MPI tasks, and 2 CPUs per task. Was a little slower than 1 CPU per task---perhaps memory. I have learned from you all that ETK is a memory hog more than a CPU hog, ur, to say lots of memory helps vs lots of cores. Any examples you have of simple, vanilla BBH would be good. My SBATCH script includes #SBATCH --mem 4000 # amount of memory per node #SBATCH --nodes=4 # Like -24, number of nodes on which to run #SBATCH -n 4 # Total number of mpi tasks requested, def 1 task/1 cpu #SBATCH -c 2 # Number of cpus per mpi task #SBATCH -t 1:00:00 # Run time (d-hh:mm:ss) and was told to use srun and not mpirun -np XXXX, myparFile="qc0-mclachlan.par" myCactusExe="/labs/einstein/20191028/Cactus/exe/cactus_sim" ##echo "mpirun -np 4 $myCactusExe $myparFile" ##mpirun -np 4 $myCactusExe $myparFile echo "srun $myCactusExe $myparFile" srun $myCactusExe $myparFile Eventually I want to get Simfactory running and see several HPC's that use Slurm in the machine database directory. Still I think I need to understand these parameters to tune the scripts Simfactory uses. thanks, bill e.g. -- ===================================== William Gabella Research Assistant Professor Department of Physics and Astronomy Vanderbilt University Nashville, TN USA b.gabella(a)vanderbilt.edu (o) 615-343-2713

2 1

Fwd: error message on the static jupyter notebook
by Bill Gabella 02 Apr '20

02 Apr '20

Maybe this should go to the users list? I am spam'ing it to Users and Maintainers, sorry:) bill e.g. -------- Forwarded Message -------- Subject: error message on the static jupyter notebook Date: Thu, 2 Apr 2020 15:23:50 -0500 From: Bill Gabella <b.gabella(a)vanderbilt.edu> Organization: Vanderbilt University To: maintainers(a)einsteintoolkit.org When I go to the static Jupyter notebook under Downloads: Tutorial New users I see an error message. The link is https://nbviewer.jupyter.org/github/nds-org/jupyter-et/blob/master/CactusTu… and the error is a "Host Error" via Cloudflare...sometimes that is for illegal downloads:) See attached graphic. bill e.g. -- ===================================== William Gabella Research Assistant Professor Department of Physics and Astronomy Vanderbilt University Nashville, TN USA b.gabella(a)vanderbilt.edu (o) 615-343-2713

2 2

Meeting Minutes for 2020-04-02
by Bill Gabella 02 Apr '20

02 Apr '20

Present: Steve B, Roland H, Yosef Z, Zhichao Z, Maria H, Liu H, Christopher E, Alois Peter S, Beyhan, Zach E, Helvi, Kadri Y Chair: Steve Minutes: Bill (Helvi next week, April 9th) SB-Ian Hinder is working on replacement for cactuscode.org, test.cactuscode.org. Please take a look, make comments. SB-What do we use SVN for? External libs, but they are on github / bitcode. RH-High GW Analysis is on those SVN servers. We could make a Git copy of it. SB nice to get rid of another server. * update on potential codes to be included in next release, from minutes [RH] ** BaikalETK (Zach, Helvi) ZE-Intel17 performance regression, Zach looking into it and could not fix, but no problem with Intel19. Baikal on Intel19 is faster than McLachlan with GCC. Slowest of the four is McLachlan with GCC which is 20% slower running on one high HPC node and 4 MPI processes. Did not test Intel18, no access. For performance, have to disable dependency checking with vectorization...in Intel17 causes the compiler to segfault---does give warning message. For Intel19 these problems are resolved. Zach did put in a #ifdef and it will compile with Intel17 but performance is half what it should be. Baikal is in a much better state than a week ago. NRPy can now reliably generate C code kernels in parallel in ~6 minutes on an older i7 machine. Zach fixed a problem whereby sometimes the parallel codegen didn't work, resulting in a fallback serial codegen mode being called and serial codegen could take ~ an hour. It would be good to know which clusters are using the older Intel compiler. Helvi is official reviewer. Zach says ready for Helvi's review. SB-ETK proposal was awarded for another 4 years! **PreSync (Steve, Roland) SB-Not a lot to say about PreSync. Adding the missing deps from Giraffe. RH-I am reviewing it and finding where things break, a lot of places to fix things. * timeline of upcoming release[RH] https://docs.einsteintoolkit.org/et-docs/Release_Details#Schedule_for_ET_20… Release data listed as May 31st, a Monday. Previous dates have shuffled around. Do not put off work for the release, we are all busy with many things. * Release of testsuite results http://einsteintoolkit.org/testsuite_results/index.php SB has not moved Docker images around yet. RH-Found likelihood to get code to hang on Comet, not always the same. LLama patch 7 test, infinite loop by malloc, provided by the MPI lib. Not always error at the same code place. Using OpenMPI on Comet, and seems to work. Typical mpi is Intel, OpenMPI or MPIch, not typical is MVAPICH2 which is on Comet. **bugs of severity major or worse https://bitbucket.org/einsteintoolkit/tickets/issues?kind=bug&priority=majo… **trivial or minor bugs tagged for the next release https://bitbucket.org/einsteintoolkit/tickets/issues?kind=bug&priority=mino… **other open tickets flagged for next release https://bitbucket.org/einsteintoolkit/tickets/issues?kind=proposal&kind=enh… RH-New tickets are mostly related to PreSync. *gallery testing: tasks https://bitbucket.org/einsteintoolkit/tickets/issues?kind=task&milestone=ET… ** volunteers needed, please volunteer (someone)[RH] **TOV: Brock Brendal (UIUC) **BNS: Shawn Rosofsky (UIUC) **BBH: A. Peter S., Runs fine on one system, but some units problem. **Poisson: Gabella (Vanderbilt) **Multipatch scalar wave: TBD Let us find someone!! SB-Has a Python script RunOne that will run one of the tests at a time. It is useful. Shows the MPI command and you can re-run just it. He can make it available. SB-Replacement machine for the tutorial server. Quote from Dell on a little workstation, maybe 16 cores and 32 GB Ram and Jupyter hub could be on that. Wants it to be its own machine because of the security risk, and wants it walled off in its own box. We have some overhead funds at LSU that we might be able to use. The current server is still running, but not ideal. * Unanswered question on mailing list Scalar fields email, Zach had a Skype with him. Helvi might show her code that couples scalar field to other. * Open Tickets *Tickets ready for review SB ETK workshop, 3-7 August 2020 at LSU, kept the announcement, and unsure if it will happen or not. Looking for lecturers and tutors. -- ===================================== William Gabella Research Assistant Professor Department of Physics and Astronomy Vanderbilt University Nashville, TN USA b.gabella(a)vanderbilt.edu (o) 615-343-2713

1 0

Minutes
by Bill Gabella 02 Apr '20

02 Apr '20

1 0

MPI error in tutorial for new users
by Praveer Krishna 02 Apr '20

02 Apr '20

Dear ET Users, I'm a beginner attempting to follow the Jupyter tutorial for new users. I have been able to successfully run the helloworld.par and tov_ET.par files with procs set to 1 but I'm having issues when I try to use multiple processors on my laptop. I initially got this error <https://imgur.com/a/cuLLp79> saying "mpirun: not found", following which I installed Open MPI on my system. The error persisted, so I removed Open MPI and installed mpich instead. This seemingly fixed the issue, but I received another error <https://imgur.com/gdXSqCj> saying "CACTUS_NUM_PROCS is set to 4 but there are 1 MPI processes" I found one <https://www.mail-archive.com/search?l=users@einsteintoolkit.org&q=subject:%…> or two <https://www.mail-archive.com/users@einsteintoolkit.org/msg01591.html> previous queries regarding this exact error, but the suggestions have not worked for me so far. Having never worked with MPI before, I am not sure what else I should try. I'd be grateful for a few words of advice on this issue from anyone in the community. Thank you in advance for your time. Regards, Praveer Krishna

2 3

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 01 Apr '20

01 Apr '20

1 0

Agenda for Thursday's Meeting
by users＠einsteintoolkit.org 30 Mar '20

30 Mar '20

Please update the Wiki with agenda items for Thursday's meeting. Thanks! https://docs.einsteintoolkit.org/et-docs/meeting_agenda --The Maintainers

1 0

Einstein Toolkit Meeting Reminder
by users＠einsteintoolkit.org 26 Mar '20

26 Mar '20

4 3

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users