<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from text --><style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<meta content="text/html; charset=UTF-8">
<style type="text/css" style="">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Hi Dr Radice, Thanks for the reply. What is the general speed you get on Marconi KNL for GW150914 case (or for any other simulation)? </p>
<p><br>
</p>
<p>Regards</p>
<div id="x_Signature">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<p><span style="font-family:Calibri,Arial,Helvetica,sans-serif">.............................</span></p>
<span style="font-family:Calibri,Arial,Helvetica,sans-serif"></span>
<p><span style="font-family:Calibri,Arial,Helvetica,sans-serif">Bhavesh Khamesra</span></p>
<span style="font-family:Calibri,Arial,Helvetica,sans-serif"></span>
<p><span style="font-family:Calibri,Arial,Helvetica,sans-serif">Graduate Student</span></p>
<span style="font-family:Calibri,Arial,Helvetica,sans-serif"></span>
<p><span style="font-family:Calibri,Arial,Helvetica,sans-serif">Centre of Relativistic Astrophysics</span></p>
<span style="font-family:Calibri,Arial,Helvetica,sans-serif"></span>
<p><span style="font-family:Calibri,Arial,Helvetica,sans-serif">Georgia Institute of Technology</span></p>
</div>
</div>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> David Radice <david.e.pi.3.14@gmail.com><br>
<b>Sent:</b> Wednesday, May 3, 2017 2:54:51 PM<br>
<b>To:</b> Khamesra, Bhavesh<br>
<b>Cc:</b> users@einsteintoolkit.org<br>
<b>Subject:</b> Re: [Users] Benchmarking</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText">Bhavesh:<br>
<br>
> 2. I was able to run GW150914 on development queue (68 cores) and the speeds on Stampede were around 12.9M while that on KNL goes around 2.4M. To understand the reason for such small speeds, I tried running this on higher number of cores on Stampede (128)
and it runs at speed of around 20.9M (tested the run for 12 hours). However, on doing the same in normal queue in KNL, the simulation crashes after a couple of iterations on KNL with some segmentation fault error. Also, before crashing, the speed on KNL is
around 4.2M. I have attached the error file of the simulation.<br>
<br>
FYI, I have seen the same with my code: it runs (very slowly) on a single KNL node, but it crashes immediately when running on more than 1 node. Curiously, I do not have the same problem on Marconi KNL, an Italian cluster with the same architecture/interconnect
as Stampede KNL.<br>
<br>
Best wishes,<br>
<br>
David<br>
</div>
</span></font>
</body>
</html>