Users November 2013

users@lists.einsteintoolkit.org

12 participants
26 discussions

RotatingDBHIVP/E2xeon_test_rdbh on stampede
by Ian Hinder 22 Nov '13

22 Nov '13

Hi Erik, For me, the test RotatingDBHIVP/E2xeon_test_rdbh fails on stampede, but for you it passes on stampede. The optionlists seem to be the same. Can you think of a possible explanation? The results should be the same. Your results: http://git.barrywardell.net/?p=EinsteinToolkitTestResults-sandbox.git;a=blo… My results: http://git.barrywardell.net/?p=EinsteinToolkitDaturaTestResults.git;a=blob;… (the second repo is badly-named; the result is from stampede not datura) I have diffed the output log files, and there is nothing suspicious. Same number of OpenMP threads, at least for the 2 proc version. I'm wondering if the differences could come down to memory alignment differences between your executable and mine, due to different strings (dates, home directories etc) being present in the executable. See http://software.intel.com/en-us/articles/run-to-run-reproducibility-of-floa…. The largest absolute difference measured is 2.92969914994501e-09. -- Ian Hinder http://numrel.aei.mpg.de/people/hinder

2 1

Test results
by Ian Hinder 22 Nov '13

22 Nov '13

Hi, Erik and I have been working on automating the tests of the ET for the upcoming release. The current status can be viewed (work in progress) here: https://build.barrywardell.net/view/EinsteinToolkitMulti/job/EinsteinToolki… This shows any failing tests as "x". You can click on the "x" to see the reason for the failure. These results are up-to-date as of now. Shall I commit them to the release-info repository (and continue to do so periodically)? -- Ian Hinder http://numrel.aei.mpg.de/people/hinder

3 3

global reductions in specified domains
by Vassilios Mewes 21 Nov '13

21 Nov '13

Hello all! Is there a way to use the global Cactus reduction functions on fractions of the entire grid? I am interested in summing grid scalars (say rho) in spherical shells in the grid. Is there a way to perform the "sum" reduction on those shells specified by a global radius variable? Or do I need to write my own MPI function that sums the contributions from all processors that have grid point that fall within the shell I am interested in? best wishes, Vassili

3 8

*no* Einstein Toolkit Meeting Reminder
by Frank Loeffler 15 Nov '13

15 Nov '13

Hi There will be *no* usual Einstein Toolkit Meeting next Monday. (Frank is at an all-day workshop at SC, Erik is at SC as well). The main topic right now is the release, and we are using either the email list and/or the IRC channel to coordinate that. The next usual Einstein Toolkit meeting will be held on Monday, November 25th. Please send emails/requests/comments to the email list until then. Frank

1 0

warning
by Steven R. Brandt 14 Nov '13

14 Nov '13

My application issues the following warning when I attempt to run with FMR. WARNING[L1,P0] (Carpet): There are not enough time levels for the desired temporal prolongation order in the grid function group "FUNWAVE::MIXING_GROUP". With Carpet::prolongation_order_time=1, you need at least 2 time levels. I don't sync this group anywhere. Does anyone know why I need two time levels? Cheers, Steve

2 2

testsuite status
by Frank Loeffler 14 Nov '13

14 Nov '13

Hi, Here a quick update over the current testsuite status: Builds using gcc succeed in all tests - maybe in part because test data might actually have been produced using this. The problems we see usually come from the Intel compiler, but for different reasons. Using default (simfactory) options, we have a couple of failures on most machines using the Intel compiler. First, assuming an Intel compiler version > 11, all tests pass with fp-model set to precise. This is encouraging, as it means that the remaining failures there are caused by inaccuracies introduced by the compiler, which indicates one or multiple of three things (or both). Either the error-tolerance is set too low on the tests, the tests themselves have conceptional accuracy problems (e.g. the ones using Exact), or the simfactory compiler options are simply too inaccurate. We have adapted some of the tests falling into the first category already. We have replacements for most tests using Exact already (which pass) and might therefore drop the old and known-to-be-problematic Exact testsuites before the release (we know that the problem is in Exact itself, which isn't as exact as the name implies). We are unlikely at this point to suggest to change compiler options. Most people wouldn't be using the precise options for the Intel compiler in their productions runs, and this environment is the one we have to test. Another issue is the Intel compiler version 11. This seems to cause segfaults in some suites, especially hydro suites, and at the moment we suspect the usage of cray pointers to be the culprit. Higher compiler versions seems to be fine, but some machines don't have that option. This includes queenbee - the machine used for the Einstein Toolkit test accounts and the new users tutorial. We need to find a fix for this. IDAxiOffBrillBH and RotatingDBHIVP suites seem to have problems on Loewe (and one of them on stampede). Only someone with access to Loewe could have a look at what happens there. The only remaining problem I can see besides all these is the balsara4_1d test, and Roland is going to look into that. Given this, I suggest to properly fix the tests, one way or another, and postpone the release at least to next week - and depending on availability of the people involved (SC13 next week) maybe the week after that (but don't count on it). Frank

1 0

Machine tests
by Frank Loeffler 14 Nov '13

14 Nov '13

Hi We need people running tests on various machines. See below for a (probably not complete) list of machines that we don't have even halfway recent results online, but should. Pick and choose some by replying to this email. This includes not only actually running the tests, but potentially trying to fix problems if any arise - so simply running 'distribute' might not be all that is needed, and not everyone has a login everywhere. bluewaters hopper kraken stampede supermuc titan zwicky I do/did queenbee supermike tezpur spine Frank

4 8

Test failures
by Frank Löffler 14 Nov '13

14 Nov '13

Hi So far, Ian ran tests on datura and I ran the testsuites, on my workstation. The gcc build shows no failures at all, but the intel suite shows 9, but in part different than the one on datura. http://einsteintoolkit.org/release-info/parse_testsuite_results.php In the following I try to give a short summary of some of the failures: Exact/KS-tilted fails on my workstation. This has always been a fragile test. GRHydro_test_shock_* fail on datura. I don't have the raw files, but it seems from the overview page that all files show problems. This has to be looked into. It would be interesting to see if this is a datura-only problem of whether we see this elsewhere too. balsara4_1d fails on my workstation - likely a tolerance issue. Anyone? A lot of the other hydro tests fail on datura, suggesting that there is a real problem with hydro there. Some of the Multipole tests fail due to tolerance in the convergence order output. I would like to see someone who is expert in that thorn/testsuite to take a look. Some of the RotatingSymmetry180/90 testsuites fail on my workstation, due to tolerance, as suggested by the results. These are the Kerr testsuites, and at the same time the corresponding Kerr-EE suites succeed, suggesting a similar issue as with other Exact testsuites: insufficient accuracy of the initial data itself - or in other words a tolerance problem. So, in short: apart from a hydro problem on datura we see the 'usual' Exact-related problems, a failure in balsara4_1d and in the testsuites of Multipole. However, we need more results. Please test other machines as well! Frank

2 6

Meeting Minutes
by Roland Haas 12 Nov '13

12 Nov '13

Present: Erik, Frank, Roland, Philipp, Steve Release: * want to release this week * Name: Noether (http://en.wikipedia.org/wiki/Emmy_Noether) * fix outstanding tickets by Tuesday ** GRHydro failures: Roland ** Regenerate Kranc thorns: Roland ** failure of Dissipation on bethe: Roland simfactory: * simfactory's distribute script now runs short benchmarks, the benchmarks last about 2min Yours, Roland

1 1

Release Notes
by Frank Loeffler 12 Nov '13

12 Nov '13

Hi, I started to write up release notes. The current state can be found here: https://svn.einsteintoolkit.org/www/about/releases/ET_2013_11_announcement.… Please add/change/comment. All developers should have write permissions (this is a subversion repository, so you can just check things out and commit changes - no need to send me patches). Frank

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users November 2013