Hi,<div><br></div><div>Today I have done a download of Cactus (Lovelace) to my account on the Ohio Supercomputer Center front end. Here is what I did:</div><div><br></div><div><div>curl -O <a href="https://raw.github.com/gridaphobe/CRL/master/GetComponents">https://raw.github.com/gridaphobe/CRL/master/GetComponents</a> </div>
<div>chmod a+x GetComponents</div><div>./GetComponents --parallel <a href="https://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th">https://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th</a></div><br>
<div class="gmail_quote">Next, I have tried building using sim with an experimental optionlist file tuned to OSC (based on one from ranger). I attach the optionlist. While in the Cactus directory I ran:</div><div class="gmail_quote">
<br></div><div class="gmail_quote">simfactory/bin/sim build --optionlist=./oscmvapich2 --thornlist=thornlists/<a href="http://einsteintoolkit.th">einsteintoolkit.th</a> >& sun.attempt2 &</div><div class="gmail_quote">
<br></div><div class="gmail_quote">With this optionlist the build got farther along. It seemed to decide to build openmpi even though the env variables in the included optionlist file oscmvapich2 is replete with mentions of MPI. It claims that it finished the openmpi build. I have verified that HDF5, LORENE, and MPI have times of build entered in /nfs/05/bgs001/Cactus/configs/sim/scratch/done. I have also more'd the mpi.h file in /nfs/05/bgs001/Cactus/configs/sim/scratch/external/MPI/include so I know it exists. However, make crashes when the build spews:</div>
<div class="gmail_quote"><div><br></div><div><div>Creating /nfs/05/bgs001/Cactus/configs/sim/lib/libthorn_Socket.a</div><div>COMPILING /nfs/05/bgs001/Cactus/configs/sim/bindings/build/Formaline/cctk_ThornBindings.c</div><div>
/nfs/05/bgs001/Cactus/arrangements/CactusUtils/Formaline/src/announce.cc(44): catastrophic error: cannot open source file "mpi.h"</div><div> # include <mpi.h></div><div> ^</div><div><br>
</div><div>COMPILING /nfs/05/bgs001/Cactus/arrangements/CactusUtils/Formaline/src/announce.cc</div><div>COMPILING /nfs/05/bgs001/Cactus/arrangements/CactusUtils/Formaline/src/file.cc</div><div>/nfs/05/bgs001/Cactus/arrangements/CactusUtils/Formaline/src/announce.cc(44): catastrophic error: cannot open source file "mpi.h"</div>
<div> # include <mpi.h></div><div> ^</div><div><br></div><div>compilation aborted for /nfs/05/bgs001/Cactus/configs/sim/build/Formaline/announce.cc (code 4)</div><div>make[3]: *** [announce.cc.o] Error 4</div>
<div>make[3]: *** Waiting for unfinished jobs....</div><div>Checking status of thorn HydroBase</div><div>make[2]: *** [make.checked] Error 2</div><div>make[1]: *** [/nfs/05/bgs001/Cactus/configs/sim/lib/libthorn_Formaline.a] Error 2</div>
<div>make[1]: *** Waiting for unfinished jobs....</div><div>COMPILING /nfs/05/bgs001/Cactus/configs/sim/bindings/build/HydroBase/cctk_ThornBindings.c</div><div>COMPILING /nfs/05/bgs001/Cactus/arrangements/EinsteinBase/HydroBase/src/StartUp.c</div>
<div>COMPILING /nfs/05/bgs001/Cactus/arrangements/EinsteinBase/HydroBase/src/Initialisation.c</div><div>Creating /nfs/05/bgs001/Cactus/configs/sim/lib/libthorn_HydroBase.a</div><div>make: *** [sim] Error 2</div></div><div>
<br></div><div>So, </div><div><br></div><div>1. why did sim decide to build openmpi when the system mpi exists and would seem to be known...</div><div><br></div><div>2. even so, if openmpi was built successfully why did make not see the mpi.h file which exists?</div>
<div><br></div><div>Does all this mean that I have not gotten very close to having the optionlist file contents close enough to the OSC system-supplied code? </div><div><br></div><div>Please help.</div><div><br></div><div>
Thanks.</div><div><br></div><div>Comer</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div class="h5"><div class="gmail_quote">On Sun, Sep 2, 2012 at 2:50 PM, Ian Hinder <span dir="ltr"><<a href="mailto:ian.hinder@aei.mpg.de" target="_blank">ian.hinder@aei.mpg.de</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><br><div><div><div>On 2 Sep 2012, at 19:42, Comer Duncan wrote:</div><br><blockquote type="cite">
Ok, I now see that NoMPI is claimed to be disabled if MPI is found. Since my experience seemed to be that no mpi was found, I would like to know what to do in order to find where mpi presence is tested for in the sim build process and what I need to do to make sure that mpi is found on the OSC system. As I mentioned earlier, MPI is clearly available (have used it in several other projects but not yet einsteintoolkit). The option list file I have used makes explicit mention of various env variables which indicate where to care and feed the system's mpi. Please help.</blockquote>
<div><br></div></div><div>Hi Comer,</div><div><br></div><div>It's best if this discussion happens on the mailing list, as others can help and it will help future readers as well. I need to know which thornlist and which branch of the ET you are trying to use, as the handling of MPI has changed between the last release and the current trunk. Where did you download the thornlist from? Are you trying to use the standard thornlist, or have you put one together yourself? Do you get any warnings during the Cactus configuration process?</div>
<div><div><br><blockquote type="cite"><div>
<br></div><div>Thanks.</div><div><br>Comer<br><br><div class="gmail_quote">On Sun, Sep 2, 2012 at 9:16 AM, Comer Duncan <span dir="ltr"><<a href="mailto:comer.duncan@gmail.com" target="_blank">comer.duncan@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Ian,<br><br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word"><div><div><div><div><br></div></div>
</div><div>That is just the version of Cactus - what about theI rest of the ET? i.e. which thornlist did you use to download everything?</div></div></div></blockquote><div><br></div><div> Yesterday after posting my question I took another look at <a href="http://einsteintoolkit.th/" target="_blank">einsteintoolkit.th</a> which was what I used when I downloaded the tool kit on May 26. Lo and behold it has the following section:</div>
<div><br></div><div>.</div><div>.</div><div>.</div><div><div>CactusTest/TestTimers</div><div>CactusTest/TestTypes</div><div><br></div><div>#CactusUtils/Accelerator</div><div>CactusUtils/Formaline</div><div>CactusUtils/NaNChecker</div>
<div>CactusUtils/Nice</div><div>CactusUtils/NoMPI <<<<<<<<<<<< !!Note?</div><div>#CactusUtils/OpenCLRunTime</div><div>CactusUtils/TerminationTrigger</div><div>CactusUtils/TimerReport</div>
<div><br></div><div>CactusWave/IDScalarWave</div><div>CactusWave/IDScalarWaveC</div></div><div>.</div><div>.</div><div>.</div><div><br></div><div>Thus, perhaps for reasons not at all clear the noted inclusion of NoMPI gets in the way of 'have MPI' evaluating to true? If this is the case, then commenting it would then implicitly let the build know that MPI _is_ wanted?? </div>
<div><br></div><div>One would think that MPI would be wanted by default on any computing environment that one would want to do real computation on, with the exception of one's laptop or desktop I guess.</div><div><br>
</div><div>Thanks.</div><span><font color="#888888"><div><br></div><div>Comer </div></font></span><div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word"><div><div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<div>-- </div><div>Ian Hinder</div><div><a href="http://numrel.aei.mpg.de/people/hinder" target="_blank">http://numrel.aei.mpg.de/people/hinder</a></div></div></span></div></span></div></span></span>
</div>
<br></div></div></blockquote></div></div><br>
</blockquote></div><br></div>
</blockquote></div></div></div><div><div><br><div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Helvetica;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:12px;white-space:normal;font-family:Helvetica;word-spacing:0px"><div style="word-wrap:break-word">
<div>-- </div><div>Ian Hinder</div><div><a href="http://numrel.aei.mpg.de/people/hinder" target="_blank">http://numrel.aei.mpg.de/people/hinder</a></div></div></span></div></span></div></span></span>
</div>
<br></div></div></div></blockquote></div><br></div></div></div>
</blockquote></div><br></div>