Dear Colleagues,<div>I am trying to install ETK in hopper, at NERSC. I started from scratch following the steps of the advanced tutorial. I am building a package, which includes an N-body code and Cactus, so I my aim is to be able to run Cactus in different machines. My last attempt showed me following issue:</div>
<div>After doing simfactory/bin/sim setup in hopper, I tried</div><div><br></div><div><div>simfactory/bin/sim build</div><div><br></div><div>with the result</div><div><br></div><div>Using configuration: sim</div><div>Reconfiguring sim</div>
<div>Writing configuration to: /global/u1/f/fiestas/CACTUS-save/Cactus/configs/sim/OptionList</div><div>/bin/bash: module: command not found</div></div><div><br></div><div>I am using the last development version here <a href="http://einsteintoolkit.org/download/">http://einsteintoolkit.org/download/</a> (also tried the last release with the same results)</div>
<div><br></div><div>I found in simfactory/mdb/machines/hopper.ini a list of module commands which apparently can not be executed. I run it in queenbee without problems. </div><div>Would appreciate any help.</div><div><br>
</div><div>Regards,</div><div>Jose</div><div><br></div><div><br></div><div><br><br><div class="gmail_quote">On Sat, Feb 25, 2012 at 11:51 AM, Jose Fiestas Iquira <span dir="ltr"><<a href="mailto:jafiestas@lbl.gov">jafiestas@lbl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Erik,<div><br><div>Yes, should be loaded automatically. Find strange they don't.</div><div>I use ./simfactory/bin/sim build from the Cactus directory (I tried adding --thornlist=manifest/<a href="http://einsteintoolkit.th" target="_blank">einsteintoolkit.th</a>) but I keep getting</div>
<div class="im">
<div><div>Using configuration: sim</div><div>Reconfiguring sim</div><div>Writing configuration to: /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/OptionList</div><div>/bin/bash: module: command not found</div></div><div>
<br>
</div></div><div>I tried deleting the module commands in simfactory/mdb/machines/hopper.ini</div><div>and doing them by hand.</div><div>I got more output (attached) but an error anyway.</div><div><br></div><div>This tries are from scratch, I loaded ETK from </div>
<div><a href="http://einsteintoolkit.org/download/" target="_blank">http://einsteintoolkit.org/download/</a></div><div>the development version, as you tried.</div><div><br></div><div>It seems to me the problem is related to the configuration of my account. But I did not change the defaults. </div>
<div><br></div><div>Best,</div><div>Jose</div><div><div class="h5"><div><br></div><div><br><div class="gmail_quote">On Sat, Feb 25, 2012 at 6:16 AM, Erik Schnetter <span dir="ltr"><<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Jose<br>
<br>
The modules that are loaded automatically should not matter;<br>
Simfactory should do the right thing anyway.<br>
<br>
What command do you use to compile? I use<br>
<br>
./bin/sim build --thornlist=manifest/<a href="http://einsteintoolkit.th" target="_blank">einsteintoolkit.th</a><br>
<span><font color="#888888"><br>
-erik<br>
</font></span><div><div><br>
On Fri, Feb 24, 2012 at 6:36 PM, Jose Fiestas Iquira <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>> wrote:<br>
> Sorri pgi compilers, not pig :)<br>
><br>
><br>
> On Fri, Feb 24, 2012 at 3:35 PM, Jose Fiestas Iquira <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
> wrote:<br>
>><br>
>> You have loaded the pig compilers. I tried both pig and intel without<br>
>> success. It is something related to the configuration. I get:<br>
>> Internal error - couldn't enter<br>
>> '/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/config-data'<br>
>><br>
>> Cheers,<br>
>> Jose<br>
>><br>
>><br>
>> On Fri, Feb 24, 2012 at 3:30 PM, Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>> wrote:<br>
>>><br>
>>> $ module list<br>
>>> Currently Loaded Modulefiles:<br>
>>> 1) modules/<a href="http://3.2.6.6" target="_blank">3.2.6.6</a><br>
>>> 2) xtpe-network-gemini<br>
>>> 3) pgi/11.9.0<br>
>>> 4) xt-libsci/11.0.03<br>
>>> 5) udreg/2.3.1-1.0400.3911.5.13.gem<br>
>>> 6) ugni/2.3-1.0400.4127.5.20.gem<br>
>>> 7) pmi/3.0.0-1.0000.8661.28.2807.gem<br>
>>> 8) dmapp/3.2.1-1.0400.3965.10.63.gem<br>
>>> 9) gni-headers/2.1-1.0400.4156.6.1.gem<br>
>>> 10) xpmem/0.1-2.0400.30792.5.6.gem<br>
>>> 11) xe-sysroot/4.0.36<br>
>>> 12) xt-asyncpe/5.04<br>
>>> 13) atp/1.3.0<br>
>>> 14) PrgEnv-pgi/4.0.36<br>
>>> 15) eswrap/1.0.10<br>
>>> 16) xtpe-mc12<br>
>>> 17) xt-shmem/5.4.0<br>
>>> 18) xt-mpich2/5.4.0<br>
>>> 19) torque/2.5.9<br>
>>> 20) moab/6.1.4<br>
>>><br>
>>> -erik<br>
>>><br>
>>> On Fri, Feb 24, 2012 at 4:31 PM, Jose Fiestas Iquira <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
>>> wrote:<br>
>>> > Erik,<br>
>>> > I suspect the default modules I loaded are not sufficient, because I am<br>
>>> > not<br>
>>> > doing more than 'simfactory/bin/sim setup' and 'simfactory/bin/sim<br>
>>> > build'.<br>
>>> > Could you please send me a 'module list' of your account to compare<br>
>>> > with<br>
>>> > mine?<br>
>>> > Best,<br>
>>> > Jose<br>
>>> ><br>
>>> ><br>
>>> > On Fri, Feb 24, 2012 at 12:26 PM, Erik Schnetter<br>
>>> > <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> > wrote:<br>
>>> >><br>
>>> >> Jose<br>
>>> >><br>
>>> >> I just built the ET from scratch and ran the test cases there. All<br>
>>> >> went fine on Hopper, no problems at all.<br>
>>> >><br>
>>> >> -erik<br>
>>> >><br>
>>> >> On Fri, Feb 24, 2012 at 2:39 PM, Erik Schnetter<br>
>>> >> <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> wrote:<br>
>>> >> > On Fri, Feb 24, 2012 at 2:11 PM, Jose Fiestas Iquira<br>
>>> >> > <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
>>> >> > wrote:<br>
>>> >> >> Hi Erik,<br>
>>> >> >><br>
>>> >> >> I am getting in Hopper the same error after simfactory/bin/sim<br>
>>> >> >> build:<br>
>>> >> >> Using configuration: sim<br>
>>> >> >> Reconfiguring sim<br>
>>> >> >> Writing configuration to:<br>
>>> >> >> /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/OptionList<br>
>>> >> >> /bin/bash: module: command not found<br>
>>> >> >> fiestas@hopper10:~/CACTUS/Cactus> exit<br>
>>> >> >> exit<br>
>>> >> >><br>
>>> >> >> Could you install it without problems?<br>
>>> >> ><br>
>>> >> > Yes. I am not seeing these problems. Maybe they are specific to your<br>
>>> >> > account settings? Could you investigate where the "module" command<br>
>>> >> > is<br>
>>> >> > used?<br>
>>> >> ><br>
>>> >> >> A question. Should I set hopper10 as:<br>
>>> >> >> key allocation []<br>
>>> >> ><br>
>>> >> > I don't know what you mean by this.<br>
>>> >> ><br>
>>> >> > The allocation on Hopper is the "repository" there; it is e.g.<br>
>>> >> > "m152"<br>
>>> >> > for me.<br>
>>> >> ><br>
>>> >> > -erik,<br>
>>> >> ><br>
>>> >> >> Thanks,<br>
>>> >> >> Jose<br>
>>> >> >><br>
>>> >> >><br>
>>> >> >> On Fri, Feb 24, 2012 at 10:45 AM, Jose Fiestas Iquira<br>
>>> >> >> <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
>>> >> >> wrote:<br>
>>> >> >>><br>
>>> >> >>> You mean this version?<br>
>>> >> >>><br>
>>> >> >>> <a href="http://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th" target="_blank">http://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th</a><br>
>>> >> >>><br>
>>> >> >>> I am trying now in a new directory. I had installed Cactus, the<br>
>>> >> >>> Wavetoy<br>
>>> >> >>> and ETk in the same place and probably there were some conflicts.<br>
>>> >> >>> That<br>
>>> >> >>> is<br>
>>> >> >>> where I got the module error. Hope doing it new works well as in<br>
>>> >> >>> your<br>
>>> >> >>> case.<br>
>>> >> >>> Did you follow the tutorial in the ETK page for new users?<br>
>>> >> >>><br>
>>> >> >>> Cheers,<br>
>>> >> >>> Jose<br>
>>> >> >>><br>
>>> >> >>><br>
>>> >> >>><br>
>>> >> >>><br>
>>> >> >>> On Fri, Feb 24, 2012 at 10:18 AM, Erik Schnetter<br>
>>> >> >>> <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> >>> wrote:<br>
>>> >> >>>><br>
>>> >> >>>> Jose<br>
>>> >> >>>><br>
>>> >> >>>> No, things didn't work on Carver. I received errors, but didn't<br>
>>> >> >>>> investigate, mostly because I dislike the PGI compiler.<br>
>>> >> >>>><br>
>>> >> >>>> I'm building on Hopper as we speak, using the Intel compiler, and<br>
>>> >> >>>> things are going fine.<br>
>>> >> >>>><br>
>>> >> >>>> I'm using the development version of the ET, not the release from<br>
>>> >> >>>> last<br>
>>> >> >>>> autumn, though.<br>
>>> >> >>>><br>
>>> >> >>>> -erik<br>
>>> >> >>>><br>
>>> >> >>>> On Fri, Feb 24, 2012 at 12:40 PM, Jose Fiestas Iquira<br>
>>> >> >>>> <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
>>> >> >>>> wrote:<br>
>>> >> >>>> > Hi Erik,<br>
>>> >> >>>> > The problem with module (?) came actually when I tried it in<br>
>>> >> >>>> > Hopper.<br>
>>> >> >>>> > There<br>
>>> >> >>>> > is no special need for Carver, Hopper would be fine. Did your<br>
>>> >> >>>> > try<br>
>>> >> >>>> > in<br>
>>> >> >>>> > Carver<br>
>>> >> >>>> > worked, anyway?<br>
>>> >> >>>> > Best,<br>
>>> >> >>>> > Jose<br>
>>> >> >>>> ><br>
>>> >> >>>> ><br>
>>> >> >>>> > On Fri, Feb 24, 2012 at 9:14 AM, Erik Schnetter<br>
>>> >> >>>> > <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> >>>> > wrote:<br>
>>> >> >>>> >><br>
>>> >> >>>> >> On Wed, Feb 22, 2012 at 8:38 PM, Jose Fiestas Iquira<br>
>>> >> >>>> >> <<a href="mailto:jafiestas@lbl.gov" target="_blank">jafiestas@lbl.gov</a>><br>
>>> >> >>>> >> wrote:<br>
>>> >> >>>> >> > It was like these:<br>
>>> >> >>>> >> > ....<br>
>>> >> >>>> >> > COMPILING<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > /global/u1/f/fiestas/CACTUS/Cactus/arrangements/Carpet/LoopControl/src/loopcontrol.c<br>
>>> >> >>>> >> > PGC-W-0155-parallel for loop variable must be local k<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c:<br>
>>> >> >>>> >> > 1080)<br>
>>> >> >>>> >> > PGC-S-0094-Illegal type conversion required<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c:<br>
>>> >> >>>> >> > 1080)<br>
>>> >> >>>> >> > PGC-S-0094-Illegal type conversion required<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c:<br>
>>> >> >>>> >> > 1080)<br>
>>> >> >>>> >> > PGC/x86-64 Linux 9.0-3: compilation completed with severe<br>
>>> >> >>>> >> > errors<br>
>>> >> >>>> >> > make[3]: *** [loopcontrol.c.o] Error 2<br>
>>> >> >>>> >> > make[2]: *** [make.checked] Error 2<br>
>>> >> >>>> >> > make[1]: ***<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > [/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_LoopControl.a]<br>
>>> >> >>>> >> > Error 2<br>
>>> >> >>>> >> > make[1]: *** Waiting for unfinished jobs....<br>
>>> >> >>>> >> > .....<br>
>>> >> >>>> >> > COMPILING<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > /global/u1/f/fiestas/CACTUS/Cactus/arrangements/EinsteinInitialData/IDAxiBrillBH/src/ParamCheck.c<br>
>>> >> >>>> >> > Creating<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAnalyticBH.a<br>
>>> >> >>>> >> > Creating<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAxiBrillBH.a<br>
>>> >> >>>> >> > Creating<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAxiOddBrillBH.a<br>
>>> >> >>>> >> > make: *** [sim] Error 2<br>
>>> >> >>>> >> ><br>
>>> >> >>>> >> > I am trying hopper now. Let see.<br>
>>> >> >>>> >><br>
>>> >> >>>> >> Is there a reason why you want to use Carver, or would another<br>
>>> >> >>>> >> machine<br>
>>> >> >>>> >> be fine as well?<br>
>>> >> >>>> >><br>
>>> >> >>>> >> The PGI compilers are often a bit peculiar; I prefer the Intel<br>
>>> >> >>>> >> compilers. Let me try to build on Hopper -- this should work<br>
>>> >> >>>> >> fine,<br>
>>> >> >>>> >> I<br>
>>> >> >>>> >> can then help you there.<br>
>>> >> >>>> >><br>
>>> >> >>>> >> -erik<br>
>>> >> >>>> >><br>
>>> >> >>>> >> --<br>
>>> >> >>>> >> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> >>>> >> <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
>>> >> >>>> ><br>
>>> >> >>>> ><br>
>>> >> >>>><br>
>>> >> >>>><br>
>>> >> >>>><br>
>>> >> >>>> --<br>
>>> >> >>>> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> >>>> <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
>>> >> >>><br>
>>> >> >>><br>
>>> >> >><br>
>>> >> ><br>
>>> >> ><br>
>>> >> ><br>
>>> >> > --<br>
>>> >> > Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> > <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
>>> >><br>
>>> >><br>
>>> >><br>
>>> >> --<br>
>>> >> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> >> <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
>>> ><br>
>>> ><br>
>>><br>
>>><br>
>>><br>
>>> --<br>
>>> Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
>>> <a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
>><br>
>><br>
><br>
<br>
<br>
<br>
--<br>
Erik Schnetter <<a href="mailto:schnetter@cct.lsu.edu" target="_blank">schnetter@cct.lsu.edu</a>><br>
<a href="http://www.perimeterinstitute.ca/personal/eschnetter/" target="_blank">http://www.perimeterinstitute.ca/personal/eschnetter/</a><br>
</div></div></blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>