<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On 20 Apr 2020, at 15:38, Rishank Diwan <<a href="mailto:rishank2610@gmail.com" class="">rishank2610@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div dir="ltr" class="">Dear Sir/Madam
<div class=""><br class="">
</div>
<div class="">
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">I am trying to compile a Cactus executable on my laptop, which has an</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">ubuntu-based operating system(Ubuntu 18.04). I am using the latest version i.e; ET_2019_10. I am using simfactory and following the Simulation Factory Advanced Tutorial.
</span></div>
</div>
</div>
</div>
</blockquote>
<div><br class="">
</div>
<div>Hi Rishank,</div>
<div><br class="">
</div>
<div>Are you referring to this?</div>
<div><br class="">
</div>
<div><a href="https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutorial" class="">https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutorial</a></div>
<div><br class="">
</div>
<div>This was last updated in 2018; it might have been superseded by the Jupyter tutorials described at <a href="https://einsteintoolkit.org/documentation/new-user-tutorial.html" class="">https://einsteintoolkit.org/documentation/new-user-tutorial.html</a>.
Roland, can you confirm?</div>
<br class="">
<blockquote type="cite" class="">
<div class="">
<div dir="ltr" class="">
<div class="">
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">For building, I am using generic configuration files which are also the default files.</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">Here are the steps I am using:</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">simfactory/bin/sim setup</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">./simfactory/bin/sim build -j2 --thornlist ../</span><a style="background:transparent;margin-top:0pt;margin-bottom:0pt;color:rgb(74,110,224)" target="_blank" href="http://einsteintoolkit.th/" class="gmail-_e75a791d-denali-editor-page-rtfLink"><span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">einsteintoolkit.th</span></a></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">Compilation produces an executable, but when I go for running the</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">example file using the command,</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">exe/cactus_sim</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">I get the following error.</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">""</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">Fatal error in PMPI_Comm_rank: Invalid communicator, error stack:</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">PMPI_Comm_rank(110): MPI_Comm_rank(comm=0x8202540, rank=0x7ffcee11d818)</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">failed</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">PMPI_Comm_rank(68).: Invalid communicator</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=805918213</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">:</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">system msg for write_line failure : Bad file descriptor</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">""</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<br class="">
</div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">I am not able to find any relevant solution on the internet. Can you</span></div>
<div style="color: rgb(14, 16, 26); background-color: transparent; margin-top: 0pt; margin-bottom: 0pt; background-position: initial initial; background-repeat: initial initial;" class="">
<span style="background:transparent;margin-top:0pt;margin-bottom:0pt" class="">please help me find in the solution.</span></div>
</div>
</div>
</div>
</blockquote>
<div><br class="">
</div>
<div>Can you try running the executable via simfactory, as per the tutorial section "Running a simulation" (<a href="https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutorial#Running_a_Simulation" class="">https://docs.einsteintoolkit.org/et-docs/Simulation_Factory_Advanced_Tutorial#Running_a_Simulation</a>)?
</div>
<div><br class="">
</div>
</div>
<blockquote style="margin: 0 0 0 40px; border: none; padding: 0px;" class="">
<div>
<div>simfactory/bin/sim run static_tov --configuration sim-debug --parfile=par/static_tov.par --procs=8</div>
</div>
</blockquote>
<div>
<div><br class="">
</div>
<div>This will hopefully make sure that the MPI used to build the code is used to run it as well (though I have my suspicions that even then it's not guaranteed). You say that you are running the executable with</div>
<div><br class="">
</div>
</div>
<blockquote style="margin: 0 0 0 40px; border: none; padding: 0px;" class="">
<div>
<div>exe/cactus_sim</div>
</div>
</blockquote>
<div>
<div><br class="">
</div>
<div>but that is not how the tutorial says to run it. In general, Cactus executables will need certain environment variables set, modules loaded, etc, and to be run with the correct mpirun command.</div>
<div><br class="">
</div>
<div>That being said, running the executable directly <i class="">should</i><span style="font-style: normal;" class=""> work on a ubuntu system like this, but it's better to use sim run.</span></div>
<div><br class="">
</div>
</div>
<div class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
-- <br class="">
Ian<b class=""><span class="Apple-converted-space"> </span></b>Hinder<br class="">
Research Software Engineer<br class="">
University of Manchester, UK</div>
</div>
</div>
<br class="">
</body>
</html>