[Users] MPI trouble on 64-bit Mac OS X 10.6.7 (fink version)
Scott Hawley
scott.hawley at belmont.edu
Fri May 20 12:21:17 CDT 2011
Well, there does happen to be an MPI_Finalize "train wreck" at the end, but by that point I've already got my data:
[0] Now copying physical spacetime into Cactus data structure
INFO (TexMEx): Done with TexMEx
INFO (ADMMacros): Spatial finite differencing order: 4
INFO (ADMMacros): Spatial finite differencing order: 4
INFO (ADMMacros): Spatial finite differencing order: 4
INFO (ADMMacros): Spatial finite differencing order: 4
INFO (AHFinderDirect): proc 0: searching for horizon 1/2
INFO (AHFinderDirect): AH 1/2: r=1.99593 at (-4.980572,0.000204,0.000000)
INFO (AHFinderDirect): AH 1/2: area=54.13981184 m_irreducible=1.037823364
INFO (AHFinderDirect): AH 2/2: r=1.99593 at (4.980572,-0.000204,-0.000000)
INFO (AHFinderDirect): AH 2/2: area=54.13981184 m_irreducible=1.037823364
===================================================================================================
Thorn | Scheduled routine in time bin | gettimeofday [secs] | getrusage [secs]
===================================================================================================
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
Carpet | Multi-model Startup routine | 0.00026100 | 0.00015600
Carpet | Startup routine | 0.00001000 | 0.00000900
AEILocalInterp | register CCTK_InterpLocalUniform() inter| 0.00000500 | 0.00000300
CarpetInterp | Startup routine | 0.00000100 | 0.00000100
CarpetReduce | Startup routine | 0.00004000 | 0.00003000
CartGrid3D | Register GH Extension for GridSymmetry | 0.00000500 | 0.00000200
CoordBase | Register a GH extension to store the coo| 0.00000200 | 0.00000200
IOUtil | Startup routine | 0.00000500 | 0.00000200
LocalInterp | register LocalInterp's interpolation ope| 0.00000200 | 0.00000100
[provision.local:91413] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
Slab | Create MPI datatypes for complex variabl| 0.00000300 | 0.00000300
SymBase | Register GH Extension for SymBase | 0.00000200 | 0.00000100
---------------------------------------------------------------------------------------------------
| Total time for CCTK_STARTUP | 0.00033600 | 0.00021000
===================================================================================================
ADMAnalysis | Register symmetry of Ricci tensor and sc| 0.00008000 | 0.00007100
ADMBase | Set up GF symmetries | 0.00008000 | 0.00007700
ADMConstraints | Register GF symmetries for ADM Constrain| 0.00023600 | 0.00022700
Boundary | Register boundary conditions that this t| 0.00001700 | 0.00001100
CartGrid3D | Register coordinates for the Cartesian g| 0.00010700 | 0.00009800
CoordGauge | Initialize slicing, setup priorities for| 0.00001300 | 0.00000800
CoordGauge | Identify the slicing for the next iterat| 0.00000900 | 0.00000600
Slab | Initialise timers | 0.00003400 | 0.00002400
SpaceMask | Set grid symmetries for mask | 0.00001500 | 0.00001000
SpaceMask | Set grid symmetries for emask (compatibi| 0.00001100 | 0.00000800
CartGrid3D | Register symmetry boundaries | 0.00006500 | 0.00006000
SymBase | Print symmetry boundary face description| 0.00000900 | 0.00000500
---------------------------------------------------------------------------------------------------
| Total time for CCTK_WRAGH | 0.00067600 | 0.00060500
===================================================================================================
ADMAnalysis | Check that the metric_type is recognised| 0.00111600 | 0.00003700
ADMBase | Check consistency of parameters | 0.00002600 | 0.00002200
ADMConstraints | Check that we can deal with this metric_| 0.00004200 | 0.00003700
Boundary | Check dimension of grid variables | 0.00000600 | 0.00000300
CarpetRegrid | Check Parameters | 0.00001100 | 0.00000700
CartGrid3D | Check coordinates for CartGrid3D | 0.00000900 | 0.00000600
---------------------------------------------------------------------------------------------------
| Total time for CCTK_PARAMCHECK | 0.00121000 | 0.00011200
===================================================================================================
ADMBase | Set the shift_state variable to 0 | 0.00042900 | 0.00040700
ADMBase | Set the dtlapse_state variable to 0 | 0.00019400 | 0.00017600
ADMBase | Set the dtshift_state variable to 0 | 0.00019000 | 0.00017400
ADMMacros | Initialize the local_spatial_order | 0.00021500 | 0.00011600
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
CartGrid3D | Set up ranges for spatial 3D Cartesian c| 0.00033800 | 0.00018600
CarpetReduce | Initialise the weight function | 0.00680000 | 0.00395200
CarpetReduce | Set up the outer boundaries of the weigh| 0.00042400 | 0.00040600
CarpetReduce | Set up the weight function for the restr| 0.03050000 | 0.02837400
CartGrid3D | Set up spatial 3D Cartesian coordinates | 0.06041500 | 0.03934700
AHFinderDirect | setup data structures | 0.00344000 | 0.00232800
SpaceMask | Initialise mask to zero | 0.00354400 | 0.00203900
SpaceMask | Set old style mask to one | 0.01313800 | 0.00262400
SphericalSurface| Set surface resolution automatically | 0.00100600 | 0.00095500
SphericalSurface| Calculate surface coordinate descriptors| 0.00006900 | 0.00005600
SphericalSurface| Set surface radii to be used for initial| 0.00006100 | 0.00005100
SphericalSurface| Test the state of the spherical surfaces| 0.00006000 | 0.00005000
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[provision.local:91410] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
SymBase | Check whether the driver set up the grid| 0.00029900 | 0.00028200
---------------------------------------------------------------------------------------------------
| Total time for CCTK_BASEGRID | 0.12112200 | 0.08152300
===================================================================================================
StaticConformal | Set the conformal_state variable to 0 | 0.00016800 | 0.00014800
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
TexMEx | Calculate initial data with TexMEx | 110.10679400 | 106.53449800
ADMBase | Set the lapse to 1 at all points | 0.01679100 | 0.00792400
---------------------------------------------------------------------------------------------------
| Total time for CCTK_INITIAL | 110.12375300 | 106.54257000
===================================================================================================
ADMConstraints | Set conformal_state to 0 for physical, o| 0.00057300 | 0.00055000
LegoExcision | Excise a fixed lego sphere | 0.02932700 | 0.02850400
Boundary | Apply all requested local physical bound| 0.00040000 | 0.00038300
CartGrid3D | Apply symmetry boundary conditions | 0.00015300 | 0.00013100
Boundary | Unselect all grid variables for boundary| 0.00002800 | 0.00001100
---------------------------------------------------------------------------------------------------
| Total time for CCTK_POSTINITIAL | 0.03048100 | 0.02957900
===================================================================================================
AHFinderDirect | import the excision mask | 0.01030700 | 0.00921100
AHFinder[provision.local:91409] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
[provision.local:91412] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
Direct | find apparent horizon(s) after this time| 1.25908800 | 1.24079600
AHFinderDirect | store apparent horizon(s) into spherical| 0.00631300 | 0.00625600
AHFinderDirect | save apparent horizon(s) into Cactus var| 0.00028400 | 0.00025300
AHFinderDirect | set mask(s) based on apparent horizon po| 0.00053800 | 0.00051900
SpaceMask | Ensure that all mask values are legal | 0.00377300 | 0.00367000
SphericalSurface| Set surface radii | 0.00006300 | 0.00005100
SphericalSurface| Test the state of the spherical surfaces| 0.00006200 | 0.00004900
---------------------------------------------------------------------------------------------------
| Total time for CCTK_POSTSTEP | 1.28042800 | 1.26080500
===================================================================================================
CarpetLib [provision.local:91411] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[provision.local:91415] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
| Print timing statistics if desired | 0.00003200 | 0.00001700
CarpetLib | Print memory statistics if desired | 0.00002800 | 0.00001400
---------------------------------------------------------------------------------------------------
| Total time for CCTK_ANALYSIS | 0.00006000 | 0.00003100
===================================================================================================
---------------------------------------------------------------------------------------------------
| Total time for simulation | 112.41905900 | 108.55538600
===================================================================================================
--------------------------------------------------------------------------------
Done.
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[provision.local:91408] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
*** An error occurred in MPI_Finalize
*** after MPI was finalized
*** MPI_ERRORS_ARE_FATAL (your MPI job will now abort)
[provision.local:91414] Abort after MPI_FINALIZE completed successfully; not able to guarantee that all other processes were killed!
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 535 bytes
Desc: This is a digitally signed message part
Url : http://lists.einsteintoolkit.org/pipermail/users/attachments/20110520/7e826596/attachment-0001.bin
More information about the Users
mailing list