<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<div>Hello,</div>
<div><br>
</div>
<div>I am trying to use Generic Hyperslabbing to change an initial array from the normal Cactus MPI distribution to one where all the GF points can exist in one loop on one processor. For example if phi_temp is an N^3 array and phi_in is an (N-2)^3 array,</div>
<div><br>
</div>
<div> sizex = cctk_gsh[0]; </div>
<div> sizey = cctk_gsh[1];</div>
<div> sizez = cctk_gsh[2];</div>
<div> </div>
<div> fsizex = cctk_gsh[0]-2; </div>
<div> fsizey = cctk_gsh[1]-2;</div>
<div> fsizez = cctk_gsh[2]-2;</div>
<div><br>
</div>
<div> struct xferinfo info1[3];</div>
<div> </div>
<div> for (d=0; d<3; ++d) {</div>
<div> /* Source array: Cactus layout */</div>
<div> info1[d].src.gsh = cctk_gsh[d];</div>
<div> info1[d].src.lbnd = cctk_lbnd[d];</div>
<div> info1[d].src.lsh = cctk_lsh[d];</div>
<div> info1[d].src.lbbox = cctk_bbox[2*d];</div>
<div> info1[d].src.ubbox = cctk_bbox[2*d+1];</div>
<div> info1[d].src.nghostzones = cctk_nghostzones[d];</div>
<div> </div>
<div> /* Destination array: New layout */</div>
<div> info1[d].dst.gsh = cctk_gsh[d];</div>
<div> info1[d].dst.lbnd = 0;</div>
<div> info1[d].dst.lsh = cctk_gsh[d];</div>
<div> info1[d].dst.lbbox = cctk_bbox[2*d];</div>
<div> info1[d].dst.ubbox = cctk_bbox[2*d+1];</div>
<div> info1[d].dst.nghostzones = cctk_nghostzones[d]; </div>
<div> </div>
<div> /* Source slab: whole array */</div>
<div> info1[d].src.off = 0;</div>
<div> info1[d].src.len = cctk_gsh[d];</div>
<div> info1[d].src.str = 1;</div>
<div> </div>
<div> /* Destination slab: whole array */</div>
<div> info1[d].dst.off = 0;</div>
<div> info1[d].dst.len = cctk_gsh[d];</div>
<div> info1[d].dst.str = 1;</div>
<div> </div>
<div> /* No transformation */</div>
<div> info1[d].xpose = d;</div>
<div> info1[d].flip = 0;</div>
<div> }</div>
<div> </div>
<div> ierr = Slab_Transfer</div>
<div> (cctkGH, cctk_dim, info1, -1,</div>
<div> CCTK_VARIABLE_REAL, phi_temp,</div>
<div> CCTK_VARIABLE_REAL, phi_temp);</div>
<div> assert (! ierr);</div>
<div> </div>
<div> phi_in = malloc(sizeof(CCTK_REAL)*fsizex*fsizey*fsizez);</div>
<div><br>
</div>
<div> for(k = 1; k <= fsizez; k++) </div>
<div> {</div>
<div> for(j = 1; j <= fsizey; j++) </div>
<div> {</div>
<div> for(i = 1; i <= fsizex; i++) </div>
<div> {</div>
<div> phi_in[(i-1) + (j-1)*fsizex + (k-1)*fsizex*fsizey] = phi_temp[i + j*sizex + k*sizex*sizey];</div>
<div> }</div>
<div> }</div>
<div> }</div>
<div><br>
</div>
<div>Running the code as is causes segmentation fault and some of the output GFs are distorted. If I comment out the Slab_Transfer I don't get a Segmentation fault. If I run the code with a single processor, there is no segmentation fault and no distortion
in the GFs. Can you see what I'm doing wrong with the hyperslabbing? There must be a better way to get the transfer to work while avoiding the errors.</div>
<div><br>
</div>
<div>-DG</div>
<div><br>
</div>
<div><br>
<div style="font-family:Tahoma; font-size:13px"><span class="Apple-style-span" style="font-family:'Segoe UI',Helvetica,Arial,sans-serif">-- <br>
David Garrison, Ph.D.<br>
Associate Professor and Chair of Physics<br>
University of Houston-Clear Lake<br>
Bayou 3531<br>
Houston, TX 77058 <br>
<br>
Tel: 281-283-3796 <br>
Fax: 281-283-3709 <br>
<a href="http://sce.uhcl.edu/garrison" target="_blank">http://sce.uhcl.edu/garrison</a><br>
<br>
For more information about the UHCL Physics Program go to<br>
<a href="http://www.uhcl.edu/physics" target="_blank">http://www.uhcl.edu/physics</a> or sign up for UHCL newsletters at<br>
<a href="https://ecommunications.houston.edu/uhcl/join.html" target="_blank">https://ecommunications.houston.edu/uhcl/join.html</a><br>
<br>
"If we knew what it was we were doing, it would not be called research,<br>
would it?" ‹ Albert Einstein.</span></div>
</div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<div>
<div style="direction:ltr; font-family:Tahoma; color:#000000; font-size:10pt">
<div></div>
</div>
</div>
</div>
</div>
</body>
</html>