<div dir="ltr">Ian<div><br></div><div>We've been running on 64-bit systems since Cactus was designed... I doubt that a 64-bit issue is the problem here.</div><div><br></div><div>(Historical factoid: This was one of the motivations for introducing CCTK_REAL. The early Cray 64-bit systems defined the "integer" to be 64 bit, as one would naively expect. The Fortran standard the requires "single precision" floating point numbers to be 64-bit as well, so that one would want to use "single precision" on such a system, not "double precision" that would have 128 bits and be very slow. So -- CCTK_REAL, which has the same number of bits on all systems.)</div>
<div><br></div><div>Yes, we've encountered and dealt segfaults before. Can you give us more information? I recommend you open a bug report on <a href="http://trac.einsteintoolkit.org">trac.einsteintoolkit.org</a> where you can easily attach information, and then attach your option list, parameter file, machine configuration, as well as the exact commands you used to build your executable and run your job.</div>
<div><br></div><div>-erik</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Aug 20, 2014 at 12:17 PM, Ian Smith <span dir="ltr"><<a href="mailto:the.pond@dsl.pipex.com" target="_blank">the.pond@dsl.pipex.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi again list,<br>
<br>
I've just done another install onto my 64-bit Ubuntu 14.04 machine (the<br>
32-bit Debian one is running now), and when I submit a job I get this<br>
output:<br>
<br>
$ ./simfactory/bin/sim show-output --follow static_tov<br>
Simulation name: static_tov<br>
================================================================================<br>
The job's Formaline output is:<br>
================================================================================<br>
(file does not exist)<br>
================================================================================<br>
The job's stdout is:<br>
================================================================================<br>
Simulation name: static_tov<br>
Running simulation static_tov<br>
Preparing:<br>
Checking:<br>
/home/ian/simulations/static_tov/output-0001-active<br>
bonsai<br>
Wed Aug 20 17:10:06 BST 2014<br>
Environment:<br>
Starting:<br>
INFO (Cactus): Increasing logging level from 0 to 3<br>
Wed Aug 20 17:10:07 BST 2014<br>
Simfactory Done at date: 0<br>
<br>
================================================================================<br>
The job's stderr is:<br>
================================================================================<br>
+ set -e<br>
+ cd /home/ian/simulations/static_tov/output-0001-active<br>
+ echo Checking:<br>
+ pwd<br>
+ hostname<br>
+ date<br>
+ echo Environment:<br>
+ export GMON_OUT_PREFIX=gmon.out<br>
+ GMON_OUT_PREFIX=gmon.out<br>
+ export OMP_NUM_THREADS=4<br>
+ OMP_NUM_THREADS=4<br>
+ env<br>
+ echo Starting:<br>
++ date +%s<br>
+ export CACTUS_STARTTIME=1408551006<br>
+ CACTUS_STARTTIME=1408551006<br>
+ mpirun -np 1<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim -L 3<br>
/home/ian/simulations/static_tov/output-0001/static_tov_small.par<br>
[bonsai:02183] *** Process received signal ***<br>
[bonsai:02183] Signal: Segmentation fault (11)<br>
[bonsai:02183] Signal code: Address not mapped (1)<br>
[bonsai:02183] Failing at address: 0x44000098<br>
[bonsai:02183] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)<br>
[0x7fefca300340]<br>
[bonsai:02183] [ 1] /usr/lib/libmpich.so.10(PMPI_Comm_rank+0x4b)<br>
[0x7fefc800d63b]<br>
[bonsai:02183] [ 2]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CactusDefaultMyProc+0x6f)<br>
[0xc2951f]<br>
[bonsai:02183] [ 3]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_CommandLineFinished+0x40)<br>
[0xc16380]<br>
[bonsai:02183] [ 4]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_ProcessCommandLine+0x204)<br>
[0xc00744]<br>
[bonsai:02183] [ 5]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(CCTKi_InitialiseCactus+0x3c)<br>
[0xbfd8ec]<br>
[bonsai:02183] [ 6]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim(main+0x1e)<br>
[0xbf542e]<br>
[bonsai:02183] [ 7]<br>
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7fefc6f83ec5]<br>
[bonsai:02183] [ 8]<br>
/home/ian/simulations/static_tov/SIMFACTORY/exe/cactus_sim() [0xbfd62c]<br>
[bonsai:02183] *** End of error message ***<br>
--------------------------------------------------------------------------<br>
mpirun noticed that process rank 0 with PID 2183 on node bonsai exited<br>
on signal 11 (Segmentation fault).<br>
--------------------------------------------------------------------------<br>
<br>
================================================================================<br>
<br>
anyone else encountered or dealt with this?<br>
<br>
Cheers,<br>
<br>
Ian.<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@einsteintoolkit.org">Users@einsteintoolkit.org</a><br>
<a href="http://lists.einsteintoolkit.org/mailman/listinfo/users" target="_blank">http://lists.einsteintoolkit.org/mailman/listinfo/users</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br><a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a>
</div>