Users October 2018

users@lists.einsteintoolkit.org

18 participants
31 discussions

Postdoctoral Fellowships Available in Multi-messenger Astrophysics at RIT
by Manuela Campanelli 09 Oct '18

09 Oct '18

Dear All, Please find below about the "Frontiers in Gravitational Wave Astrophysics" postdoctoral fellowships job advertisement at RIT. Best regards, Manuela %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% Postdoctoral Fellowships Available in Multi-messenger Astrophysics at RIT https://ccrg.rit.edu/content/news/2018-07-26/postdoctoral-fellowships-avail… <https://ccrg.rit.edu/content/news/2018-07-26/postdoctoral-fellowships-avail…> The recent observations of a binary neutron star merger using both gravitational wave interferometers as well as electromagnetic telescopes across the full spectrum have initiated the age of multi-messenger astronomy and astrophysics. As part of several NASA and NSF collaborative projects, the RIT’s Center for Computational Relativity and Gravitation (CCRG) is currently seeking to fill one or two postdoctoral research positions with highly qualified individuals interested in pursuing research in the fields of numerical relativity, theoretical and computational astrophysics, with an emphasis on general relativistic magneto-hydrodynamics simulations. We are particularly interested in relativistic magneto-hydrodynamics simulations of accretion disks around supermassive black hole mergers, and binary neutron star coalescences from prior to merger through to the formation of disks and/or collapse of the merged remnant, the production of jets, and launching of outflows. We are also interested perform “event-based” simulations, using parameters informed by specific LIGO/Virgo detections, and thereby permitting much closer comparison with observables, in order to interpret current and future multi-messenger observations by a wide array of current and future detectors. The successful postdoctoral candidates will be Fellows of a new prestigious “Frontier in Gravitational-Wave Astrophysics” (FGWA) Program. Initially appointed for two or three years, the Fellows are renewable up to five years depending on satisfactory performance and the availability of funds. Senior scientists in the group includes Manuela Campanelli (Director), Joshua Faber, Carlos Lousto, Richard O’Shaughnessy, Jason Nordhaus, Yosef Zlochower, Sukanya Chakrabarti, John Whelan, and Hans-Peter Bischof, several postdoctoral fellows and Ph.D. students (see http://ccrg.rit.edu/people <http://ccrg.rit.edu/people> for an overview on who is or has been at CCRG). The group is involved in several large collaborations, including the LIGO Scientific Collaboration (LSC), The Einstein Toolkit Consortium (http://einsteintoolkit.org <http://einsteintoolkit.org/>) and a NASA Theoretical and Computational Astrophysics Network (TCAN). CCRG researchers have access to several computing cluster facilities at national computing centers such as XSEDE and the NCSA’s Blue Waters Supercomputer (with an allocation of over 160 million core hours), as well as a dedicated over 3000-core cluster hosted at the Center. More information about the CCRG is available at http://ccrg.rit.edu/ <http://ccrg.rit.edu/>. And about Rochester at http://en.wikipedia.org/wiki/Rochester,_New_York <http://en.wikipedia.org/wiki/Rochester,_New_York> Applications should consist of a cover letter, a brief statement of research interests, a curriculum vitae including publication list, and at least three letters of recommendation. All materials should be sent electronically as soon as possible to: manuela[AT]astro[dot]rit[dot]edu with a copy to ccrg-postdoc[AT]ccrgweb.rit.edu <http://ccrgweb.rit.edu/>. Application material should also be posted at: https://sjobs.brassring.com/TGnewUI/Search/Home/Home?partnerid=25483&siteid… <https://sjobs.brassring.com/TGnewUI/Search/Home/Home?partnerid=25483&siteid…> Enquiries can be addressed to the center’s Director: Manuela Campanelli, manuela[AT]astro[dot]rit[dot]edu Center for Computational Relativity and Gravitation, School of Mathematical Sciences, and School of Physics and Astronomy, Rochester Institute of Technology (RIT) 85 Lomb Memorial Drive Rochester, New York 14623 USA <https://maps.google.com/?q=85+Lomb+Memorial+Drive+Rochester,+New+York+14623…> Review of completed applications will begin as soon as available and will continue until a suitable candidate is found. Starting date can be as early as January and no later than September, 2019. RIT is committed to equal employment opportunity and affirmative action.

1 0

Postdoctoral Positions at WVU
by Zach Etienne 08 Oct '18

08 Oct '18

Hello everyone, I have a couple of openings for postdocs. They will work in part with IllinoisGRMHD (a thorn in the Toolkit) to advance binary neutron star science: *Postdoctoral Research Associate – Computational Relativistic Astrophysics / Numerical RelativityJob Number: 10075* The Department of Mathematics at West Virginia University is seeking two postdoctoral researchers in the field of Computational Relativistic Astrophysics/Numerical Relativity. The positions require a Ph.D. in Physics or a related field; strong programming skills (C and Python, or closely related languages); experience in high-performance computing and large-scale data analysis; and an excellent ability to communicate research to both experts and non-experts. Successful candidates will work with a multi-institution network of collaborators on a variety of numerical relativity projects, including for example (1) supercomputer simulations of magnetized binary neutron star mergers with IllinoisGRMHD ( https://illinoisgrmhd.net); and (2) a volunteer-computing / public-outreach project called BlackHoles@Home (https://blackholesathome.net), which is aimed at unlocking the consumer-grade desktop computer as a core tool for numerical relativity simulations of black holes and black hole binaries. Applications Preferred start date is September 2019, though earlier start dates are acceptable. These positions may be renewed in annualized increments for up to three years, contingent upon performance, need, and funding. The screening process will begin on November 15, 2018 and will continue until the positions are filled. To apply, please visit https://careers.wvu.edu and navigate to the position title listed above. Upload a letter of application, a CV, and the names and contact information of three referees. For additional information, contact Professor Zachariah B. Etienne at zbetienne *at* mail.wvu.edu. Fostering diversity and inclusivity is part of WVU’s mission, and we welcome applications from minorities, females, individuals with disabilities, and veterans. WVU is an EEO/Affirmative Action Employer. -Zach * * * Zachariah Etienne Assistant Professor of Mathematics West Virginia University https://math.wvu.edu/~zetienne/ https://blackholesathome.net

1 0

meeting minutes for 2018-10-08
by Roland Haas 08 Oct '18

08 Oct '18

Present: Roland, Zach, Bill, Chris, Peter, Steve, Yosef non-deterministic tests: https://trac.einsteintoolkit.org/ticket/2200 * no progress yet, will have to investigate. Roland to attach log files of failed and succeeded runs to ticket Carpet updates https://trac.einsteintoolkit.org/ticket/2203 * Steve will review it WVU_Diagnosis: * Zach is rewrote one of the thorns (poynting flux computation) using NRPy+ * helper thorns in GiRaFFE and IllinoisGRMHD are causing a bit scheduling nightmare since the interaction between the two codes and the helper is complex. * Zach pointed out that HydroBase doc may not make definiton of Bvec clear enough in particular wrt. sqrt(gamma), 4-velocity to use, sqrt(4pi) * IllinoisGRMHD may use more of HydroBase and ADMBase variable directly in the future * no tests yet because of this * suggestion to adjust VolumeIntegral thorn to work on HydroBase variables directly since there were questions on the mailing list about tracking multiple NS Lean, Proca: * none are in yet, have reviews * add to master thornlist for now so that they are being compiled Discontinous Galerkin in Cactus: * Jonah's DG framework is almost ready to included * Steve is interacting with Jonah for this BNS gallery example: * https://trac.einsteintoolkit.org/ticket/2119 * not working yet Memory usage during regrid: * https://trac.einsteintoolkit.org/ticket/2194 * still waiting for example parfile Next ET release: * feature freeze likely in January 2019 * Zach will propose some of the NRPy+ codes * Peter's self-force code may be interesting to include the next release after Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://pgp.mit.edu .

2 2

mass estimation of neutron star
by 林家暉 07 Oct '18

07 Oct '18

Dear whom it may concern, I simulated the binary neutron star merger as in gallery code(https://einsteintoolkit.org/gallery/bns/index.html). I tried to find out the mass of the merged neutron star. For test, I calculated the initial mass of each neutron star from the file rho.xy.h5 which is the rest mass density. What I computed is about 0.9 solar mass , however it supposed to be much larger because the baryonic mass of the initial data of each neutron star is about 1.45 solar mass. I also calculated magnetic energy which corresponds to about 1e-6 solar mass which is not a possible reason of the discrepancy. I also considered velocity which may increase mass due to the relativity but the maximum of the initial velocity is only about 0.1c which also does not raise the mass too much. What is the possible reason that the total rest mass is so much smaller than the baryonic mass ? Thank you. Best regards, Chia-Hui

2 12

hdf5 output generation for Mathematica and VisIt
by Jens Mahlmann 07 Oct '18

07 Oct '18

Dear all, I hope I may approach you with a rather general question on output generation. For visualization, I find it convenient to use both SimulationTools for Mathematica as well as VisIt. Both are fine with reading hdf5 files and the interface to Carpet data is in general very nice. However, I find that depending on if I activate CarpetIOHDF5::one_file_per_group or not, I have difficulties of opening the files in one or the other (with yes I am great for visit but not for SimulationTools and vice versa). Especially, I would like to have the 3D output in one file per group, and the 2D output not. Is there an option to do so? Or does anybody have a best practice for a student of how to overcome this in post process? I want to avoid running all simulations twice... Thank you and my best! Jens

2 1

Issue running the default qc0-mclachlan.par
by Gomard-Henshaw, Chad 06 Oct '18

06 Oct '18

Hello, When running the default qc0 simulation, I get an error (see attached). This was run using the following command in the windows linux subshell: ./simfactory/bin/sim create-run qc05 \ --parfile=par/qc0-mclachlan.par The simulation runs for about an hour before aborting; I get partial output files but only with two data points. Can you please advise on how to address this issue? Thanks! -- Chad Henshaw Georgia Institute of Technology - Physics

3 8

`tl >= 0 and tl < timelevels' failure in recovering with ML_BSSN
by Jens Mahlmann 03 Oct '18

03 Oct '18

Dear all, I have encountered an `tl >= 0 and tl < timelevels' error when recovering checkpoints while using ML_BSSN and helpers. I am currently running a minimal example in which I merely activate ML_BSSN ML_BSSN_Helper ML_ADMConstraints without giving any further options (nor using them for spacetime evolution). The errors occur after I want to to the recovering. I am sure there is something very basic I am missing in my parameter file. I have included the example in the following. Thank you for your help and input! My best from Tel Aviv Jens

2 1

Re: [Users] [ET Trac] [Einstein Toolkit] #2203: accumulated Carpet updates
by Zach Etienne 03 Oct '18

03 Oct '18

Hi Roland, I'm always nervous when a big Carpet update comes down the pipeline. Could you please confirm the full ETK testsuite passes with the new version of Carpet before pushing to master? There are a lot of Carpet features that aren't tested by qc0-mclachlan.par, but are tested by the testsuite. -Zach * * * Zachariah Etienne Assistant Professor of Mathematics West Virginia University *https://math.wvu.edu/~zetienne/ <https://math.wvu.edu/~zetienne/>* https://blackholesathome.net On Wed, Oct 3, 2018 at 10:07 AM Einstein Toolkit < trac-noreply(a)einsteintoolkit.org> wrote: > #2203: accumulated Carpet updates > --------------------------+--------------------------------- > Reporter: Roland Haas | Owner: Roland Haas > Type: defect | Status: assigned > Priority: minor | Milestone: > Component: Carpet | Version: development version > Resolution: | Keywords: > --------------------------+--------------------------------- > > Comment (by Roland Haas): > > These are (almost there is a single commit of mine in the Cactus pull > request) Erik's changes, and I have already reviewed them and tested them > on my workstation. > > I will leave this ticket open until Tuesday Oct 9 2018 and then apply all > changes in the pull request unless there are objections. > > -- > Ticket URL: <https://trac.einsteintoolkit.org/ticket/2203#comment:1> > Einstein Toolkit <http://einsteintoolkit.org> > The Einstein Toolkit > _______________________________________________ > Trac mailing list > Trac(a)einsteintoolkit.org > http://lists.einsteintoolkit.org/mailman/listinfo/trac >

2 3

Compile Errors
by Christopher Ramirez 02 Oct '18

02 Oct '18

Hello, Using PGI 18.4 and intel mpi provided by PSXE 2018. I'm using the newest version of ET at the moment, and when compiling I'm reaching the current errors. I'm not too familiar with the errors I'm getting for piranha, nor am I understanding whats calling the intlc library. I've linked directly to the containing folder inside of my config file and am thinking it's not the library I assumed it was (provided by intel). Could someone please review and let me know if you're familiar with any of these? Thank you. pa: file ReParse.cc.o, line 1311: unknown variable reference: &2&542 ipa: file ReParse.cc.o, line 1312: unknown variable reference: &2&543 ipa: file ReParse.cc.o, line 2850: unknown variable reference: &2&660 ipa: file ReParse.cc.o, line 2853: unknown variable reference: &2&661 ipa: file ReParse.cc.o, line 3187: unknown variable reference: &2&683 ipa: file ReParse.cc.o, line 3188: unknown variable reference: &2&684 ipa: file ReParse.cc.o, line 3218: unknown variable reference: &2&688 ipa: file ReParse.cc.o, line 3219: unknown variable reference: &2&689 ipa: file ReParse.cc.o, line 3613: unknown variable reference: &2&729 ipa: file ReParse.cc.o, line 3614: unknown variable reference: &2&730 ipa: file AutoGrammar.cc.o, line 1093: unknown variable reference: &2&293 ipa: file AutoGrammar.cc.o, line 1094: unknown variable reference: &2&294 ipa: file AutoGrammar.cc.o, line 1155: unknown variable reference: &2&300 ipa: file AutoGrammar.cc.o, line 1156: unknown variable reference: &2&301 ipa: file AutoGrammar.cc.o, line 1602: unknown variable reference: &2&334 ipa: file AutoGrammar.cc.o, line 1605: unknown variable reference: &2&335 ipa: file AutoGrammar.cc.o, line 1939: unknown variable reference: &2&357 ipa: file AutoGrammar.cc.o, line 1940: unknown variable reference: &2&358 ipa: file AutoGrammar.cc.o, line 1970: unknown variable reference: &2&362 ipa: file AutoGrammar.cc.o, line 1971: unknown variable reference: &2&363 ipa: file AutoGrammar.cc.o, line 2216: unknown variable reference: &2&388 ipa: file AutoGrammar.cc.o, line 2217: unknown variable reference: &2&389 ipa: file Lookup.cc.o, line 1810: unknown variable reference: &2&448 ipa: file Lookup.cc.o, line 1811: unknown variable reference: &2&449 ipa: file Lookup.cc.o, line 1872: unknown variable reference: &2&454 ipa: file Lookup.cc.o, line 1873: unknown variable reference: &2&455 ipa: file Lookup.cc.o, line 2371: unknown variable reference: &2&497 ipa: file Lookup.cc.o, line 2374: unknown variable reference: &2&498 ipa: file Lookup.cc.o, line 2708: unknown variable reference: &2&520 ipa: file Lookup.cc.o, line 2709: unknown variable reference: &2&521 ipa: file Lookup.cc.o, line 2739: unknown variable reference: &2&525 ipa: file Lookup.cc.o, line 2740: unknown variable reference: &2&526 ipa: file Lookup.cc.o, line 3081: unknown variable reference: &2&563 ipa: file Lookup.cc.o, line 3082: unknown variable reference: &2&564 The following function(s) are called, but no IPA information is available: assert, get_mpi_comm Linking without IPA /usr/bin/ld: cannot find -lintlc child process exit status 1: /usr/bin/ld make[1]: *** [/home/ramirez/Cactus/exe/cactus_drewz] Error 2

3 4

Error: job id is negative
by Ferguson, Deborah L 01 Oct '18

01 Oct '18

Periodically when continuing a run, I get the error Error: job id is negative Aborting Simfactory It is fixed by deleting the symlink to the previous active directory and then resubmitting. Although that fix works, when I want to submit a job multiple times at once (so that when one output is finished running, the next one starts automatically), this error prevents me from doing that. Anyone have any ideas on what might be the underlying cause of this issue and how to actually fix it? Thanks! Deborah ----------------------------------------- Deborah Ferguson Graduate Student Georgia Institute of Technology Center for Relativistic Astrophysics Boggs 1-66

3 3

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users October 2018