Ian

We've been running on 64-bit systems since Cactus was designed... I doubt that a 64-bit issue is the problem here.

(Historical factoid: This was one of the motivations for introducing CCTK_REAL. The early Cray 64-bit systems defined the "integer" to be 64 bit, as one would naively expect. The Fortran standard the requires "single precision" floating point numbers to be 64-bit as well, so that one would want to use "single precision" on such a system, not "double precision" that would have 128 bits and be very slow. So -- CCTK_REAL, which has the same number of bits on all systems.)

Yes, we've encountered and dealt segfaults before. Can you give us more information? I recommend you open a bug report on trac.einsteintoolkit.org where you can easily attach information, and then attach your option list, parameter file, machine configuration, as well as the exact commands you used to build your executable and run your job.

-erik

On Wed, Aug 20, 2014 at 12:17 PM, Ian Smith <the.pond@dsl.pipex.com> wrote:

Hi again list,

I've just done another install onto my 64-bit Ubuntu 14.04 machine (the
32-bit Debian one is running now), and when I submit a job I get this
output:

$ ./simfactory/bin/sim show-output --follow static_tov
Simulation name: static_tov
================================================================================
The job's Formaline output is:
================================================================================
(file does not exist)
================================================================================
The job's stdout is:
================================================================================
Simulation name: static_tov
Running simulation static_tov
Preparing:
Checking:
/home/ian/simulations/static_tov/output-0001-active
bonsai
Wed Aug 20 17:10:06 BST 2014
Environment:
Starting:
INFO (Cactus): Increasing logging level from 0 to 3
Wed Aug 20 17:10:07 BST 2014
Simfactory Done at date: 0

================================================================================
The job's stderr is:
================================================================================
+ set -e
+ cd /home/ian/simulations/static_tov/output-0001-active
+ echo Checking:
+ pwd
+ hostname
+ date
+ echo Environment:
+ export GMON_OUT_PREFIX=gmon.out
+ GMON_OUT_PREFIX=gmon.out
+ export OMP_NUM_THREADS=4
+ OMP_NUM_THREADS=4
+ env
+ echo Starting:
++ date +%s
+ export CACTUS_STARTTIME=1408551006
+ CACTUS_STARTTIME=1408551006
+ mpirun -np 1
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim -L 3
/home/ian/simulations/static_tov/output-0001/static_tov_small.par
[bonsai:02183] *** Process received signal ***
[bonsai:02183] Signal: Segmentation fault (11)
[bonsai:02183] Signal code: Address not mapped (1)
[bonsai:02183] Failing at address: 0x44000098
[bonsai:02183] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)
[0x7fefca300340]
[bonsai:02183] [ 1] /usr/lib/libmpich.so.10(PMPI_Comm_rank+0x4b)
[0x7fefc800d63b]
[bonsai:02183] [ 2]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CactusDefaultMyProc+0x6f)
[0xc2951f]
[bonsai:02183] [ 3]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_CommandLineFinished+0x40)
[0xc16380]
[bonsai:02183] [ 4]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_ProcessCommandLine+0x204)
[0xc00744]
[bonsai:02183] [ 5]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_InitialiseCactus+0x3c)
[0xbfd8ec]
[bonsai:02183] [ 6]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(main+0x1e)
[0xbf542e]
[bonsai:02183] [ 7]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fefc6f83ec5]
[bonsai:02183] [ 8]
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim() [0xbfd62c]
[bonsai:02183] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 2183 on node bonsai exited
on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

================================================================================

anyone else encountered or dealt with this?

Cheers,

Ian.
_______________________________________________
Users mailing list
Users@einsteintoolkit.org
http://lists.einsteintoolkit.org/mailman/listinfo/users

--
Erik Schnetter <schnetter@cct.lsu.edu>
http://www.perimeterinstitute.ca/personal/eschnetter/