#1725: Disable Fortran 77 support in Cactus
-------------------------+--------------------------------------------------
Reporter: eschnett | Owner:
Type: enhancement | Status: new
Priority: unset | Milestone:
Component: Other | Version: development version
Keywords: |
-------------------------+--------------------------------------------------
There are no "Fortran 77" compilers any more. Cactus currently
distinguishes between FCODE and F90CODE (pure Fortran 77, and Fortran 90).
The pure Fortran 77 code has less argument checking etc. and is less safe,
and is not needed any more. It should be removed, both from the makefile
system as well as from the CST that auto-generates code.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1725>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1757: Stampede needs to be updated
----------------------+-----------------------------------------------------
Reporter: hinder | Owner:
Type: task | Status: new
Priority: critical | Milestone:
Component: Other | Version: development version
Keywords: backport |
----------------------+-----------------------------------------------------
The SimFactory definition for Stampede currently uses the intel/13.1.1.163
compiler. This compiler will be removed next Tuesday (see
https://portal.tacc.utexas.edu/user-guides/stampede/intel15). According
to TACC, the current default is the older intel/13.0.2.146, and this is
the recommended and default compiler, and will remain so. Both compilers
have the "restrict" keyword blacklisted in Cactus (#1276). They will
install intel/15.0.1 at the end of April. There is also intel/14.0.1.106
available, but it is labeled as "limited software stack". It is not clear
why they are removing a newer compiler, or why they chose to do this a
month before installing an even newer one.
Our options are:
1. Upgrade to intel/14.0.1.106, which is labeled as "limited software
stack"
2. Downgrade to intel/13.0.2.146, which is the default and will remain so
for a while
This should be done both for the trunk and the release branch. I suggest
that option 2 is the most conservative, and probably the easiest, as there
might be libraries which are not compiled for intel/14.0.1.106.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1757>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1458: intel 13 2013.1.117 miss-compiles asserts in TwoPunctures tp_utils.c
-----------------------------------+----------------------------------------
Reporter: rhaas | Owner:
Type: defect | Status: new
Priority: major | Milestone:
Component: EinsteinToolkit thorn | Version: development version
Keywords: TwoPunctures |
-----------------------------------+----------------------------------------
this continues the thread in #1429 in particular
https://trac.einsteintoolkit.org/ticket/1429#comment:14.
Currently we need to determine which versions are affected.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1458>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1599: CarpetInterp/waveinterp_2p tests constant in time initial data
--------------------------+-------------------------------------------------
Reporter: rhaas | Owner: eschnett
Type: defect | Status: new
Priority: minor | Milestone:
Component: Carpet | Version: development version
Keywords: CarpetInterp |
--------------------------+-------------------------------------------------
the test waveinterp_2p sets up initial data using IDWaveMoL (fom
CactusExamples) using kx=ky=kz = 0. and slopet = 0.1. Ie the initial data
is constant in space and has frequency 0.1. It then evolves this using
WaveMoL and interpolates in space and time with CarpetInterp.
Since the function is constant in space (exactly so, see eg the output in
InterpToArray::array1d_vars[0]) the interpolation in space just tests
roundoff errors. The second time derivative (array1d_vars[2]) should be
zero and all we measure in the test is truncation errors on the level of
1e-9. This makes the test very sensitive to -Ofast, -O0, gcc vs. intel
etc. and not a very good test.
I would rather either use a Gausian wave for initial data so that there is
some actual data in the result and not just numerical noise, or leave out
the 2nd time derivative from the test data.
The test fails due to significant errors in a virtual machine using
ubuntu.cfg (which usies -ffast-math and -O2).
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1599>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1753: hwloc: move pkg-config based detection into Search phase
-----------------------------------+----------------------------------------
Reporter: rhaas | Owner:
Type: enhancement | Status: new
Priority: minor | Milestone:
Component: EinsteinToolkit thorn | Version: development version
Keywords: hwloc |
-----------------------------------+----------------------------------------
the attacheched patch changes detect.sh such that pkg-config is treated on
the same footing as the search at commonly known places. It also adds the
option for the user to specify HWLOC_LIBS rather than hard-coding it to
hwloc.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1753>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1396: Display prompts of executed commands
---------------------------+------------------------------------------------
Reporter: rhaas | Owner: eric9
Type: enhancement | Status: new
Priority: optional | Milestone:
Component: GetComponents | Version: development version
Keywords: |
---------------------------+------------------------------------------------
the attached patch goes to some lengths to capture both stdout and stderr
when executing commands and displays each line of output as it is
generated by the command. This is useful for programs that output prompts
to stdout and wait for user input afterwards.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1396>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#68: GetComponents hang due to certificate issues.
--------------------------------+-------------------------------------------
Reporter: diener@… | Owner: eric9
Type: defect | Status: new
Priority: major | Milestone:
Component: GetComponents | Version: ET_2010_06
Keywords: |
--------------------------------+-------------------------------------------
I did a complete new checkout of the EinsteinToolkit on numrel06 using the
version of GetComponents available on the EinsteinToolkit web pages and
had GetComponents
hang with no errors or warnings when checking out
AEIThorns/AEILocalInterp.
Trying the checkout manually I got:
Error validating server certificate for 'https://svn.aei.mpg.de:443':
- The certificate is not issued by a trusted authority. Use the
fingerprint to validate the certificate manually!
Certificate information:
- Hostname: svn.aei.mpg.de
- Valid: from Tue, 23 Feb 2010 16:02:12 GMT until Sun, 22 Feb 2015
16:02:12 GMT
- Issuer: Max-Planck-Gesellschaft, DE
- Fingerprint:
03:b4:e8:6e:d9:09:e9:93:72:e9:ff:fa:df:e4:2c:6d:1d:2a:e4:66
(R)eject, accept (t)emporarily or accept (p)ermanently? p
After accepting the certificate and restarting the checkout proceeded
without problems.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/68>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#181: AEILocalInterp should not off-centre the interpolation stencil by default
----------------------------+-----------------------------------------------
Reporter: hinder | Owner:
Type: defect | Status: new
Priority: minor | Milestone:
Component: Cactus | Version:
Keywords: AEILocalInterp |
----------------------------+-----------------------------------------------
AEILocalInterp by default will off-centre the interpolation stencil if
there are insufficient points to perform the interpolation. In a parallel
setting, this could happen due to there being insufficient ghost points
for the interpolator chosen. The off-centering leads to an interpolation
error which is of the correct order but larger than for a centered
stencil. More importantly, it leads to different results on different
numbers of processes. This violates a basic design principle of Cactus,
and the expectation of users, that changing the number of processors
should not change the results of a simulation.
I propose that instead of silently off-centering the stencil,
AEILocalInterp should abort with an error indicating that there are
insufficient ghost-zones. The interpolator options corresponding to this
are:
boundary_off_centering_tolerance={0.0 0.0 0.0 0.0 0.0 0.0}
boundary_extrapolation_tolerance={0.0 0.0 0.0 0.0 0.0 0.0}
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/181>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#778: Compiling PittNullCode is slow
-----------------------------------+----------------------------------------
Reporter: eschnett | Owner:
Type: defect | Status: new
Priority: major | Milestone:
Component: EinsteinToolkit thorn | Version:
Keywords: |
-----------------------------------+----------------------------------------
Compiling PittNullCode is very slow on some systems (e.g. with gcc). I
believe this is because files such as NullConstr_R00.F90 contain many
whole-array operations that the compiler has to analyse.
I suggest to rewrite these routines, using e.g. forall or do loops. If we
want to keep the elegant, index-free notation, then I suggest to add an
elemental subroutine for the actual calculations and calling it with whole
arrays.
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/778>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit
#1283: Missing data in HDF5 files
--------------------+-------------------------------------------------------
Reporter: hinder | Owner:
Type: defect | Status: new
Priority: major | Milestone:
Component: Cactus | Version:
Keywords: |
--------------------+-------------------------------------------------------
If a simulation runs out of disk space while writing an HDF5 file, the
simulation will terminate. The hdf5 file being written might then be
corrupt, and all data from it may be irretrievable. In that case,
restarting from the last-written checkpoint file may leave a "gap" in the
data corresponding to the period between the start of the failed restart
and the last checkpoint file written.
Steps to reproduce:
• Start a simulation which checkpoints periodically and consists
of several restarts
• Keep all checkpoint files
• Restart 0000 completes successfully and checkpoints at iteration
i1
• Restart 0001 checkpoints once after some evolution at iteration
i2
• Restart 0001 terminates abnormally while writing an HDF5 output
file at iteration i3
• The output file is corrupted and nonrecoverable, so there is no
data from iteration i1 to iteration i3
• Restart 0002 starts at iteration i2 as this is the last
checkpoint available
• The simulation continues until the end, but the data from the
corrupted HDF5 file between iteration i1 and i2 is lost
Possible solutions:
1. Write HDF5 files safely, e.g. by first copying the file to a
new temporary file, performing the write, then atomically moving the
temporary file over the original file. The original file would then
remain in the event of a crash while writing the new file. This could be
very expensive for 3D output files.
2. Start a new set of HDF5 files after each checkpoint. This
seems to be the most efficient and simplest solution, but requires readers
of HDF5 files to be modified to take it into account.
3. Check the consistency of all HDF5 files in the previous
restart(s) on recovery, and recover from the latest checkpoint file for
which all previous HDF5 files are valid. We could use code to check the
HDF5 file, or some other flagging mechanism to indicate that HDF5 writes
were completed successfully; e.g. we could rename the HDF5 file to .tmp
during writes, and rename it back after a successful write. This is
complex and requires Cactus or simfactory to look into previous restarts.
It also only applies to HDF5 files, and requires breaking several
abstraction barriers.
4. Wait for HDF5 journalling support. As far as I know only
metadata journalling is planned, which is probably not enough, and in any
case, they are not actively working on the next version of HDF5 at the
moment due to lack of funding.
5. Checkpoint only on termination of the simulation
In reality, we do not keep all checkpoint files. I usually keep just the
last checkpoint file. I believe that a Cactus simulation will only delete
checkpoint files which it has itself written, which means that there will
generally be one checkpoint file kept per restart; the last one written.
This means that you can always recover from the above situation by
rerunning the restart during which the problem occurred. However, keeping
one checkpoint file per restart is a problem in itself, and we should fix
this as well, which would then mean the potential for losing data in the
case of an interrupted write operation.
Thoughts?
--
Ticket URL: <https://trac.einsteintoolkit.org/ticket/1283>
Einstein Toolkit <http://einsteintoolkit.org>
The Einstein Toolkit