#1757: Stampede needs to be updated ----------------------+----------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: new Priority: critical | Milestone: Component: Other | Version: development version Keywords: backport | ----------------------+----------------------------------------------------- The SimFactory definition for Stampede currently uses the intel/13.1.1.163 compiler. This compiler will be removed next Tuesday (see https://portal.tacc.utexas.edu/user-guides/stampede/intel15). According to TACC, the current default is the older intel/13.0.2.146, and this is the recommended and default compiler, and will remain so. Both compilers have the "restrict" keyword blacklisted in Cactus (#1276). They will install intel/15.0.1 at the end of April. There is also intel/14.0.1.106 available, but it is labeled as "limited software stack". It is not clear why they are removing a newer compiler, or why they chose to do this a month before installing an even newer one.
Our options are:
1. Upgrade to intel/14.0.1.106, which is labeled as "limited software stack" 2. Downgrade to intel/13.0.2.146, which is the default and will remain so for a while
This should be done both for the trunk and the release branch. I suggest that option 2 is the most conservative, and probably the easiest, as there might be libraries which are not compiled for intel/14.0.1.106.
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: critical | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: backport -------------------------+-------------------------------------------------- Changes (by hinder):
* status: new => confirmed * component: Other => SimFactory
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: critical | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: backport -------------------------+--------------------------------------------------
Comment (by rhaas):
We need to carefully evaluate intel 15.0.1. SpEC knows of at least one bug in there (ticket 913 in SpEC), basically it mis-compiles (with the options used in SpEC's makefile which differ from what Cactus normally uses):
{{{ int ip,p; int eo; for (ip=0; ip<wsize;ip++) { p = indx2p(ip,wsize);
eo = abs(p % 2); if (p == -1) { w[ip] = I * M_PI/2.; } else if (p == 1) { w[ip] = - I * M_PI/2.; } else if ( eo == 0) { w[ip] = 2./(1.-p*p); } else { w[ip] = 0; } } }}}
and produces a floating point exception (either divide by zero or maybe some overflow). Adding a printf for p just before makes the exception go away.
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: critical | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: backport -------------------------+--------------------------------------------------
Comment (by diener):
I have been using stampede lately using the modules intel/14.0.1.106 and mvapich2/2.0b. I was using the Xeon Phis in offload mode for a non- einsteintoolkit code so I created a new optionlist and runscript (by modifying slightly the existing ones for the different compiler and for additional offload needs). I can commit those if there's interest. I have not checked if the full einstein toolkit can be compiled with this optionlist with the offload stuff removed.
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: critical | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: backport -------------------------+--------------------------------------------------
Comment (by rhaas):
Stampede's option list and machine.ini file were updated in aa5e116efca9b423a1f0564746a092087c3c2a9a and 936f046e1caf53c19b795c9db51c9642723c4fdb of simfactory respectively. I am keeping the ticket open since TACC will shortly install a new version of intel 15.0.1 at the end of April.
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: minor | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: backport -------------------------+-------------------------------------------------- Changes (by hinder):
* priority: critical => minor
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: minor | Milestone: Component: SimFactory | Version: development version Resolution: | Keywords: -------------------------+-------------------------------------------------- Changes (by knarf):
* keywords: backport =>
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: confirmed Priority: minor | Milestone: ET_2018_02 Component: SimFactory | Version: development version Resolution: | Keywords: -------------------------+-------------------------------------------------- Changes (by hinder):
* milestone: => ET_2018_02
#1757: Stampede needs to be updated -------------------------+-------------------------------------------------- Reporter: hinder | Owner: Type: task | Status: closed Priority: minor | Milestone: ET_2018_02 Component: SimFactory | Version: development version Resolution: wontfix | Keywords: -------------------------+-------------------------------------------------- Changes (by rhaas):
* status: confirmed => closed * resolution: => wontfix
Comment:
Stampede1 is being retired on Jan 31st.
trac@lists.einsteintoolkit.org
-
Einstein Toolkit