<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><br><div><div>On 20 Oct 2015, at 22:13, Geraint Pratten <<a href="mailto:g.pratten@sussex.ac.uk">g.pratten@sussex.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div dir="ltr"><div class="gmail_default" style="font-family: arial, helvetica, sans-serif;">Thanks Ian, I think that did the trick! I rebuilt Cactus with a different MPI infrastructure and made sure that the appropriate MPI environment was loaded. Seems to be working now, e.g. <br></div><div class="gmail_default" style="font-family: arial, helvetica, sans-serif;"><br></div><div class="gmail_default" style="font-family: arial, helvetica, sans-serif;"><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): MPI is enabled</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): Carpet is running on 12 processes</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): This is process 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): OpenMP is enabled</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): This process contains 1 threads, this is thread 0</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): There are 12 threads in total</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): There are 1 threads per process</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): This process runs on host node203, pid=28712</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): This process runs on 24 cores: 0-23</div><div style="margin: 0px; font-size: 11px; font-family: Menlo; color: rgb(245, 245, 245); background-color: rgb(0, 0, 0);">INFO (Carpet): Thread 0 runs on 24 cores: 0-23</div></div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_default" style="font-family: arial, helvetica, sans-serif;">Thanks!</div><div class="gmail_default" style="font-family: arial, helvetica, sans-serif;">Geraint</div></div></div></blockquote><div><br></div><div>Glad to hear it's working!</div><div><br></div><div>The last line indicates that the threads are not being pinned to specific cores. Usually, we recommend to pin them. You should be able to do this by activating thorns hwloc and SystemTopology in your parameter file.</div><div><br></div><div>Note to others: with a change in the last few months, some of the functionality of hwloc was moved into SystemTopology, which is not automatically activated. If you want to get automatic thread pinning, you now need to edit your parameter files to explicitly activate SystemTopology in addition to hwloc.</div><div><br></div><div>Erik, could SystemTopology be automatically activated somehow?</div><div><br></div></div><div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div>-- </div><div>Ian Hinder</div><div><a href="http://members.aei.mpg.de/ianhin">http://members.aei.mpg.de/ianhin</a></div></div></div></div></div>
</div>
<br></body></html>