I am experiencing some issues compiling the ETK on BW.

The command I use is the standard command for simfactory, where I specify the machine as follows:

./simfactory/bin/sim build ETK_standard --mdbkey make 'make -j16' --machine=bluewaters --thornlist=../einsteintoolkit.th | cat >& compilation_trial.out

The error on which I am actually stuck is the following:

COMPILING arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc:112:48: error: macro "CCTK_LOOP3STROFF_NORMAL" requires 24 arguments, but only 23 given dstipadext, dstjpadext, dstkpadext) { ^ In file included from /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_core.h:157:0, from /mnt/a/u/sciteam/cipollet/Cactus/configs/ETK_standard/bindings/include/CarpetLib/cctk.h:7, from /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc:1: /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc: In function 'void CarpetLib::interpolate_3d_2tl(const T*, CCTK_REAL8, const T*, CCTK_REAL8, const ivect3&, const ivect3&, T*, CCTK_REAL8, const ivect3&, const ivect3&, const ibbox3&, const ibbox3&, const ibbox3&, const ibbox3&, void*)': /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2460:3: error: 'CCTK_LOOP3STROFF_NORMAL' was not declared in this scope CCTK_LOOP3STROFF_NORMAL(name, \ ^ /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2444:3: note: in expansion of macro 'CCTK_LOOP3STROFF' CCTK_LOOP3STROFF(name, \ ^ /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2428:3: note: in expansion of macro 'CCTK_LOOP3STR' CCTK_LOOP3STR(name, \ ^ /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc:111:3: note: in expansion of macro 'CCTK_LOOP3' CCTK_LOOP3(interpolate_3d_2tl, i, j, k, 0, 0, 0, regiext, regjext, regkext, ^ In file included from /mnt/a/u/sciteam/cipollet/Cactus/configs/ETK_standard/bindings/include/loopcontrol.h:4:0, from /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc:4: /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc: At global scope: /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/LoopControl/src/loopcontrol.h:263:3: error: expected declaration before '}' token } \ ^ /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/LoopControl/src/loopcontrol.h:304:42: note: in expansion of macro 'LC_ENDLOOP3STROFF_NORMAL' #define CCTK_ENDLOOP3STROFF_NORMAL(name) LC_ENDLOOP3STROFF_NORMAL(name) ^ /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2470:3: note: in expansion of macro 'CCTK_ENDLOOP3STROFF_NORMAL' CCTK_ENDLOOP3STROFF_NORMAL(name) \ ^ /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2452:3: note: in expansion of macro 'CCTK_ENDLOOP3STROFF' CCTK_ENDLOOP3STROFF(name) \ ^ /mnt/a/u/sciteam/cipollet/Cactus/src/include/cctk_Loop.h:2436:3: note: in expansion of macro 'CCTK_ENDLOOP3STR' CCTK_ENDLOOP3STR(name) \ ^ /mnt/a/u/sciteam/cipollet/Cactus/arrangements/Carpet/CarpetLib/src/interpolate_3d_2tl.cc:116:3: note: in expansion of macro 'CCTK_ENDLOOP3' CCTK_ENDLOOP3(interpolate_3d_2tl); ^ make[3]: *** [interpolate_3d_2tl.cc.o] Error 1 make[2]: *** [make.checked] Error 2 make[1]: *** [/mnt/a/u/sciteam/cipollet/Cactus/configs/ETK_standard/lib/libthorn_CarpetLib.a] Error 2 make: *** [ETK_standard] Error 2

As you can see, the CarpetLib is not compiled, due to an error on a call to a macro of Cactus. As the CarpetLib is a pretty standard one, I assume that there should be some bugs in the machine configuration file in simfactory, probably when specifying the flags for the compilers. I also tried the other configuration for BW machine (i.e. the "-cray" and "-pgi" versions) when trying to compile another config of the ETK on BW, but neither those where succesful.

Can anyone give me some hint?

Thank you very much, Federico Cipolletta.