Hello Rishank Diwan,
this sounds a bit like a mismatch between the MPI library used to compile and the mpirun command used to run your code.
Can you provide file mpi.log produced by this code, please:
mpirun -n 2 exe/cactus_sim -S par/static_tov.par &>mpi.log
This can have multiple causes, one of them that there is no or multiple MPI stacks installed.
To check this, please run:
dpkg --list | grep -vi compile | grep -i mpi
and check that there is exactly one of the OpenMPI or MPICH packages installed (you can also try "update-alternatives --list mpi" but it will not catch everything if eg the MPICH development files but OpenMPI runtime files are installed update-alternatives won't notice).
If there is no MPI stack installed at all, then you should consult:
https://nbviewer.jupyter.org/github/nds-org/jupyter-et/blob/master/CactusTut...
and follow the Debian/Ubuntu/Mint instructions to install an MPI stack and the other recommended packages, then compile from scratch. After making sure that there is no other MPI stack installed.
Finally you may want to check what MPI library your executable is actually linked against by running:
dpkg -S $(readlink -f $(ldd exe/cactus_sim | gawk '/libmpi.so/{print $3}'))
then running
dpkg -S $(readlink -f $(which mpirun))
and check that the two are compatible (ie from the same MPI stack).
Yours, Roland
Dear Sir/Madam
I am trying to compile a Cactus executable on my laptop, which has an
ubuntu-based operating system(Ubuntu 18.04). I am using the latest version i.e; ET_2019_10. I am using simfactory and following the Simulation Factory Advanced Tutorial. For building, I am using generic configuration files which are also the default files.
Here are the steps I am using:
simfactory/bin/sim setup
./simfactory/bin/sim build -j2 --thornlist ../einsteintoolkit.th
Compilation produces an executable, but when I go for running the
example file using the command,
exe/cactus_sim
I get the following error.
""
Fatal error in PMPI_Comm_rank: Invalid communicator, error stack:
PMPI_Comm_rank(110): MPI_Comm_rank(comm=0x8202540, rank=0x7ffcee11d818)
failed
PMPI_Comm_rank(68).: Invalid communicator
[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=805918213
:
system msg for write_line failure : Bad file descriptor
""
I am not able to find any relevant solution on the internet. Can you
please help me find in the solution.
Yours Sincerely,
Rishank Diwan Pre-final Year Undergraduate Student Department of Physics Indian Institute of Technology, Kharagpur