Users March 2012

users@lists.einsteintoolkit.org

23 participants
48 discussions

Re: [Users] ETK in Carver
by Jose Fiestas Iquira 08 Mar '12

08 Mar '12

Dear Colleagues, I am trying to install ETK in hopper, at NERSC. I started from scratch following the steps of the advanced tutorial. I am building a package, which includes an N-body code and Cactus, so I my aim is to be able to run Cactus in different machines. My last attempt showed me following issue: After doing simfactory/bin/sim setup in hopper, I tried simfactory/bin/sim build with the result Using configuration: sim Reconfiguring sim Writing configuration to: /global/u1/f/fiestas/CACTUS-save/Cactus/configs/sim/OptionList /bin/bash: module: command not found I am using the last development version here http://einsteintoolkit.org/download/ (also tried the last release with the same results) I found in simfactory/mdb/machines/hopper.ini a list of module commands which apparently can not be executed. I run it in queenbee without problems. Would appreciate any help. Regards, Jose On Sat, Feb 25, 2012 at 11:51 AM, Jose Fiestas Iquira <jafiestas(a)lbl.gov>wrote: > Hi Erik, > > Yes, should be loaded automatically. Find strange they don't. > I use ./simfactory/bin/sim build from the Cactus directory (I tried > adding --thornlist=manifest/einsteintoolkit.th) but I keep getting > Using configuration: sim > Reconfiguring sim > Writing configuration to: > /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/OptionList > /bin/bash: module: command not found > > I tried deleting the module commands in simfactory/mdb/machines/hopper.ini > and doing them by hand. > I got more output (attached) but an error anyway. > > This tries are from scratch, I loaded ETK from > http://einsteintoolkit.org/download/ > the development version, as you tried. > > It seems to me the problem is related to the configuration of my account. > But I did not change the defaults. > > Best, > Jose > > > On Sat, Feb 25, 2012 at 6:16 AM, Erik Schnetter <schnetter(a)cct.lsu.edu>wrote: > >> Jose >> >> The modules that are loaded automatically should not matter; >> Simfactory should do the right thing anyway. >> >> What command do you use to compile? I use >> >> ./bin/sim build --thornlist=manifest/einsteintoolkit.th >> >> -erik >> >> On Fri, Feb 24, 2012 at 6:36 PM, Jose Fiestas Iquira <jafiestas(a)lbl.gov> >> wrote: >> > Sorri pgi compilers, not pig :) >> > >> > >> > On Fri, Feb 24, 2012 at 3:35 PM, Jose Fiestas Iquira <jafiestas(a)lbl.gov >> > >> > wrote: >> >> >> >> You have loaded the pig compilers. I tried both pig and intel without >> >> success. It is something related to the configuration. I get: >> >> Internal error - couldn't enter >> >> '/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/config-data' >> >> >> >> Cheers, >> >> Jose >> >> >> >> >> >> On Fri, Feb 24, 2012 at 3:30 PM, Erik Schnetter <schnetter(a)cct.lsu.edu >> > >> >> wrote: >> >>> >> >>> $ module list >> >>> Currently Loaded Modulefiles: >> >>> 1) modules/3.2.6.6 >> >>> 2) xtpe-network-gemini >> >>> 3) pgi/11.9.0 >> >>> 4) xt-libsci/11.0.03 >> >>> 5) udreg/2.3.1-1.0400.3911.5.13.gem >> >>> 6) ugni/2.3-1.0400.4127.5.20.gem >> >>> 7) pmi/3.0.0-1.0000.8661.28.2807.gem >> >>> 8) dmapp/3.2.1-1.0400.3965.10.63.gem >> >>> 9) gni-headers/2.1-1.0400.4156.6.1.gem >> >>> 10) xpmem/0.1-2.0400.30792.5.6.gem >> >>> 11) xe-sysroot/4.0.36 >> >>> 12) xt-asyncpe/5.04 >> >>> 13) atp/1.3.0 >> >>> 14) PrgEnv-pgi/4.0.36 >> >>> 15) eswrap/1.0.10 >> >>> 16) xtpe-mc12 >> >>> 17) xt-shmem/5.4.0 >> >>> 18) xt-mpich2/5.4.0 >> >>> 19) torque/2.5.9 >> >>> 20) moab/6.1.4 >> >>> >> >>> -erik >> >>> >> >>> On Fri, Feb 24, 2012 at 4:31 PM, Jose Fiestas Iquira < >> jafiestas(a)lbl.gov> >> >>> wrote: >> >>> > Erik, >> >>> > I suspect the default modules I loaded are not sufficient, because >> I am >> >>> > not >> >>> > doing more than 'simfactory/bin/sim setup' and 'simfactory/bin/sim >> >>> > build'. >> >>> > Could you please send me a 'module list' of your account to compare >> >>> > with >> >>> > mine? >> >>> > Best, >> >>> > Jose >> >>> > >> >>> > >> >>> > On Fri, Feb 24, 2012 at 12:26 PM, Erik Schnetter >> >>> > <schnetter(a)cct.lsu.edu> >> >>> > wrote: >> >>> >> >> >>> >> Jose >> >>> >> >> >>> >> I just built the ET from scratch and ran the test cases there. All >> >>> >> went fine on Hopper, no problems at all. >> >>> >> >> >>> >> -erik >> >>> >> >> >>> >> On Fri, Feb 24, 2012 at 2:39 PM, Erik Schnetter >> >>> >> <schnetter(a)cct.lsu.edu> >> >>> >> wrote: >> >>> >> > On Fri, Feb 24, 2012 at 2:11 PM, Jose Fiestas Iquira >> >>> >> > <jafiestas(a)lbl.gov> >> >>> >> > wrote: >> >>> >> >> Hi Erik, >> >>> >> >> >> >>> >> >> I am getting in Hopper the same error after simfactory/bin/sim >> >>> >> >> build: >> >>> >> >> Using configuration: sim >> >>> >> >> Reconfiguring sim >> >>> >> >> Writing configuration to: >> >>> >> >> /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/OptionList >> >>> >> >> /bin/bash: module: command not found >> >>> >> >> fiestas@hopper10:~/CACTUS/Cactus> exit >> >>> >> >> exit >> >>> >> >> >> >>> >> >> Could you install it without problems? >> >>> >> > >> >>> >> > Yes. I am not seeing these problems. Maybe they are specific to >> your >> >>> >> > account settings? Could you investigate where the "module" >> command >> >>> >> > is >> >>> >> > used? >> >>> >> > >> >>> >> >> A question. Should I set hopper10 as: >> >>> >> >> key allocation [] >> >>> >> > >> >>> >> > I don't know what you mean by this. >> >>> >> > >> >>> >> > The allocation on Hopper is the "repository" there; it is e.g. >> >>> >> > "m152" >> >>> >> > for me. >> >>> >> > >> >>> >> > -erik, >> >>> >> > >> >>> >> >> Thanks, >> >>> >> >> Jose >> >>> >> >> >> >>> >> >> >> >>> >> >> On Fri, Feb 24, 2012 at 10:45 AM, Jose Fiestas Iquira >> >>> >> >> <jafiestas(a)lbl.gov> >> >>> >> >> wrote: >> >>> >> >>> >> >>> >> >>> You mean this version? >> >>> >> >>> >> >>> >> >>> >> http://svn.einsteintoolkit.org/manifest/trunk/einsteintoolkit.th >> >>> >> >>> >> >>> >> >>> I am trying now in a new directory. I had installed Cactus, the >> >>> >> >>> Wavetoy >> >>> >> >>> and ETk in the same place and probably there were some >> conflicts. >> >>> >> >>> That >> >>> >> >>> is >> >>> >> >>> where I got the module error. Hope doing it new works well as >> in >> >>> >> >>> your >> >>> >> >>> case. >> >>> >> >>> Did you follow the tutorial in the ETK page for new users? >> >>> >> >>> >> >>> >> >>> Cheers, >> >>> >> >>> Jose >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> On Fri, Feb 24, 2012 at 10:18 AM, Erik Schnetter >> >>> >> >>> <schnetter(a)cct.lsu.edu> >> >>> >> >>> wrote: >> >>> >> >>>> >> >>> >> >>>> Jose >> >>> >> >>>> >> >>> >> >>>> No, things didn't work on Carver. I received errors, but >> didn't >> >>> >> >>>> investigate, mostly because I dislike the PGI compiler. >> >>> >> >>>> >> >>> >> >>>> I'm building on Hopper as we speak, using the Intel compiler, >> and >> >>> >> >>>> things are going fine. >> >>> >> >>>> >> >>> >> >>>> I'm using the development version of the ET, not the release >> from >> >>> >> >>>> last >> >>> >> >>>> autumn, though. >> >>> >> >>>> >> >>> >> >>>> -erik >> >>> >> >>>> >> >>> >> >>>> On Fri, Feb 24, 2012 at 12:40 PM, Jose Fiestas Iquira >> >>> >> >>>> <jafiestas(a)lbl.gov> >> >>> >> >>>> wrote: >> >>> >> >>>> > Hi Erik, >> >>> >> >>>> > The problem with module (?) came actually when I tried it in >> >>> >> >>>> > Hopper. >> >>> >> >>>> > There >> >>> >> >>>> > is no special need for Carver, Hopper would be fine. Did >> your >> >>> >> >>>> > try >> >>> >> >>>> > in >> >>> >> >>>> > Carver >> >>> >> >>>> > worked, anyway? >> >>> >> >>>> > Best, >> >>> >> >>>> > Jose >> >>> >> >>>> > >> >>> >> >>>> > >> >>> >> >>>> > On Fri, Feb 24, 2012 at 9:14 AM, Erik Schnetter >> >>> >> >>>> > <schnetter(a)cct.lsu.edu> >> >>> >> >>>> > wrote: >> >>> >> >>>> >> >> >>> >> >>>> >> On Wed, Feb 22, 2012 at 8:38 PM, Jose Fiestas Iquira >> >>> >> >>>> >> <jafiestas(a)lbl.gov> >> >>> >> >>>> >> wrote: >> >>> >> >>>> >> > It was like these: >> >>> >> >>>> >> > .... >> >>> >> >>>> >> > COMPILING >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> /global/u1/f/fiestas/CACTUS/Cactus/arrangements/Carpet/LoopControl/src/loopcontrol.c >> >>> >> >>>> >> > PGC-W-0155-parallel for loop variable must be local k >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c: >> >>> >> >>>> >> > 1080) >> >>> >> >>>> >> > PGC-S-0094-Illegal type conversion required >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c: >> >>> >> >>>> >> > 1080) >> >>> >> >>>> >> > PGC-S-0094-Illegal type conversion required >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> (/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/build/LoopControl/loopcontrol.c: >> >>> >> >>>> >> > 1080) >> >>> >> >>>> >> > PGC/x86-64 Linux 9.0-3: compilation completed with severe >> >>> >> >>>> >> > errors >> >>> >> >>>> >> > make[3]: *** [loopcontrol.c.o] Error 2 >> >>> >> >>>> >> > make[2]: *** [make.checked] Error 2 >> >>> >> >>>> >> > make[1]: *** >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> [/global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_LoopControl.a] >> >>> >> >>>> >> > Error 2 >> >>> >> >>>> >> > make[1]: *** Waiting for unfinished jobs.... >> >>> >> >>>> >> > ..... >> >>> >> >>>> >> > COMPILING >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> /global/u1/f/fiestas/CACTUS/Cactus/arrangements/EinsteinInitialData/IDAxiBrillBH/src/ParamCheck.c >> >>> >> >>>> >> > Creating >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAnalyticBH.a >> >>> >> >>>> >> > Creating >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAxiBrillBH.a >> >>> >> >>>> >> > Creating >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> >>> >> >>>> >> > >> /global/u1/f/fiestas/CACTUS/Cactus/configs/sim/lib/libthorn_IDAxiOddBrillBH.a >> >>> >> >>>> >> > make: *** [sim] Error 2 >> >>> >> >>>> >> > >> >>> >> >>>> >> > I am trying hopper now. Let see. >> >>> >> >>>> >> >> >>> >> >>>> >> Is there a reason why you want to use Carver, or would >> another >> >>> >> >>>> >> machine >> >>> >> >>>> >> be fine as well? >> >>> >> >>>> >> >> >>> >> >>>> >> The PGI compilers are often a bit peculiar; I prefer the >> Intel >> >>> >> >>>> >> compilers. Let me try to build on Hopper -- this should >> work >> >>> >> >>>> >> fine, >> >>> >> >>>> >> I >> >>> >> >>>> >> can then help you there. >> >>> >> >>>> >> >> >>> >> >>>> >> -erik >> >>> >> >>>> >> >> >>> >> >>>> >> -- >> >>> >> >>>> >> Erik Schnetter <schnetter(a)cct.lsu.edu> >> >>> >> >>>> >> http://www.perimeterinstitute.ca/personal/eschnetter/ >> >>> >> >>>> > >> >>> >> >>>> > >> >>> >> >>>> >> >>> >> >>>> >> >>> >> >>>> >> >>> >> >>>> -- >> >>> >> >>>> Erik Schnetter <schnetter(a)cct.lsu.edu> >> >>> >> >>>> http://www.perimeterinstitute.ca/personal/eschnetter/ >> >>> >> >>> >> >>> >> >>> >> >>> >> >> >> >>> >> > >> >>> >> > >> >>> >> > >> >>> >> > -- >> >>> >> > Erik Schnetter <schnetter(a)cct.lsu.edu> >> >>> >> > http://www.perimeterinstitute.ca/personal/eschnetter/ >> >>> >> >> >>> >> >> >>> >> >> >>> >> -- >> >>> >> Erik Schnetter <schnetter(a)cct.lsu.edu> >> >>> >> http://www.perimeterinstitute.ca/personal/eschnetter/ >> >>> > >> >>> > >> >>> >> >>> >> >>> >> >>> -- >> >>> Erik Schnetter <schnetter(a)cct.lsu.edu> >> >>> http://www.perimeterinstitute.ca/personal/eschnetter/ >> >> >> >> >> > >> >> >> >> -- >> Erik Schnetter <schnetter(a)cct.lsu.edu> >> http://www.perimeterinstitute.ca/personal/eschnetter/ >> > >

2 2

Re: [Users] [Commits] [svn:einsteintoolkit] Workshop_Spring_2012/flyer/ (Rev. 3)
by Roland Haas 08 Mar '12

08 Mar '12

Hello Frank, all, > Added: > /flyer/ > etk2.pdf, etk2.svg, etk3.png Is this the final version we can post in our institutes? Yours, Roland -- My email is as private as my paper mail. I therefore support encrypting and signing email messages. Get my PGP key from http://keys.gnupg.net.

2 1

dynamic memory
by Babiuc-Hamilton, Maria 06 Mar '12

06 Mar '12

Hello, I have a really hard time in trying to declare a temporary array in C++ using Carpet. The same code used to work just fine with Pugh. The error I am getting at run time is: malloc: *** error for object 0x102811c08: incorrect checksum for freed object - object was probably modified after being freed. This appears at the simple attempt to add #include <assert.h> or #include <new> in the header of the file. The header I am using is: #include "cctk.h" #include "cctk_Parameters.h" #include "cctk_Arguments.h" //#include <assert.h> //#include <new> #include <cmath> #include <cstdlib> #include <cstdlib> #include <cstdio> using namespace std; The way I am trying to define the array is with malloc/free double *reinarray; reinarray = (double*)malloc(n*sizeof(double)); assert(reinarray); .........some code..... free(reinarray) with new/delete: double *reinarray; reinarray = new double[n]; ......some code...... delete[] reinarray; What I am doing wrong? thanks, Maria

2 1

Einstein Toolkit Meeting
by Frank Loeffler 05 Mar '12

05 Mar '12

Hi Please consider joining the weekly Einstein Toolkit phone call at 10 am US central time on Mondays. As usual, you can find instructions how to join on the following web site: http://einsteintoolkit.org/community/support/ I short: the number is (+1) 225-578-4942 or (+1) 866-573-0359 and the conference id is 118682#. This week we will start with questions/issues/problems that might have come up recently, and will after that switch to the organization of the Einstein Toolkit workshop in Atlanta [1]; so that people not interested in the glory details can drop out at this point. Frank Loeffler [1] https://docs.einsteintoolkit.org/et-docs/ET_Workshop_Spring_2012

2 4

Meeting Minutes
by Roland Haas 05 Mar '12

05 Mar '12

Present were: Roland, Frank, Erik, Tanja, Bruno, Peter, Steve, Eloisa, Philipp Moesta ET paper: * Frank has set up a author-only repository with the referee response. Please take the time today to work on your assigned section. ET workshop: * individual persons assigned to schedule section, wiki has been updated to reflect these changes Yours, Roland

1 0

Re: [Users] [svn:cactuscode] flesh/trunk/src/main/ (Rev. 4793)
by Erik Schnetter 04 Mar '12

04 Mar '12

On Sun, Mar 4, 2012 at 9:14 AM, Roland Haas <roland.haas(a)physics.gatech.edu> wrote: > Hello Erik, > >> + /* if requested, change buffering mode of stdout */ > You most likely have to (re-)set stderr to unbuffered after a possible > freopen. freopen (at least from glibc, when I tested some time ago) sets > the buffering to "full". I didn't change the behaviour of stderr at all. Should we? -erik -- Erik Schnetter <schnetter(a)cct.lsu.edu> http://www.perimeterinstitute.ca/personal/eschnetter/

2 2

problem with GenericFD
by Bruno Giacomazzo 01 Mar '12

01 Mar '12

Hi, I'm trying to use the thorns WeylScal4 and Multipole to compute psi4, but I have the following problem. They require GenericFD and this returns the following error message soon after initial data computation: WARNING level 0 in thorn GenericFD processor 0 host i114-208.ranger.tacc.utexas.edu (line 107 of /work/01052/tg803155/EinsteinToolkit/Maxwell/Cactus/arrangements/KrancNumericalTools/GenericFD/src/GenericFD.c): -> Number of boundary points is different on different faces I'm using ReflectionSymmetry and RotatingSymmetry180. Do GenericFD, Multipole and WeylScal4 work with these symmetries? At the end of the email you can find the parameters I'm using for the grid and for these thorns. Thanks, Bruno Dr. Bruno Giacomazzo JILA - University of Colorado 440 UCB Boulder, CO 80309 USA Tel. : +1 303-492-0389 Fax : +1 303-492-5235 email : bruno.giacomazzo(a)jila.colorado.edu web: http://www.brunogiacomazzo.org ---------------------------------------------------------------------- There are only 10 types of people in the world: Those who understand binary, and those who don't ---------------------------------------------------------------------- # Parameters of thorn Carpet (implementing Driver) Carpet::convergence_level = 0 Carpet::domain_from_coordbase = "yes" Carpet::enable_all_storage = "no" Carpet::ghost_size = 3 Carpet::init_each_timelevel = "no" Carpet::init_fill_timelevels = "yes" Carpet::max_refinement_levels = 7 Carpet::num_integrator_substeps = 4 Carpet::output_timers_every = 2800 Carpet::prolongation_order_space = 5 Carpet::prolongation_order_time = 2 Carpet::regrid_during_initialisation = "no" Carpet::regrid_during_recovery = "no" Carpet::regrid_in_level_mode = "yes" Carpet::use_buffer_zones = "yes" Carpet::verbose = "no" # Parameters of thorn CarpetLib (implementing CarpetLib) CarpetLib::print_memstats_every = 2800 CarpetLib::print_timestats_every = 2800 # Parameters of thorn CarpetRegrid2 (implementing CarpetRegrid2) CarpetRegrid2::num_centres = 1 CarpetRegrid2::num_levels_1 = 7 CarpetRegrid2::position_x_1 = 0 CarpetRegrid2::radius_1[1] = 320 CarpetRegrid2::radius_1[2] = 160 CarpetRegrid2::radius_1[3] = 80 CarpetRegrid2::radius_1[4] = 40 CarpetRegrid2::radius_1[5] = 30 CarpetRegrid2::radius_1[6] = 20 CarpetRegrid2::symmetry_rotating180 = "yes" CarpetRegrid2::verbose = "no" # Parameters of thorn CartGrid3D (implementing grid) CartGrid3D::type = "coordbase" # Parameters of thorn CoordBase (implementing CoordBase) CoordBase::boundary_shiftout_x_lower = 1 CoordBase::boundary_shiftout_z_lower = 1 CoordBase::boundary_size_x_lower = 3 CoordBase::boundary_size_z_lower = 3 CoordBase::domainsize = "minmax" CoordBase::dx = 12.800000000000000711 CoordBase::dy = 12.800000000000000711 CoordBase::dz = 12.800000000000000711 CoordBase::xmax = 1024 CoordBase::xmin = 0 CoordBase::ymax = 1024 CoordBase::ymin = -1024 CoordBase::zmax = 1024 CoordBase::zmin = 0 # Parameters of thorn Multipole (implementing multipole) Multipole::l_max = 5 Multipole::nphi = 240 Multipole::nradii = 4 Multipole::ntheta = 120 Multipole::out_every = 64 Multipole::output_ascii = "no" Multipole::output_hdf5 = "yes" Multipole::radius[0] = 100 Multipole::radius[1] = 200 Multipole::radius[2] = 400 Multipole::radius[3] = 800 Multipole::variables = "WeylScal4::Psi4r{sw=-2 cmplx='WeylScal4::Psi4i' name='psi4'}" # Parameters of thorn ReflectionSymmetry (implementing ReflectionSymmetry) ReflectionSymmetry::avoid_origin_x = "no" ReflectionSymmetry::avoid_origin_y = "no" ReflectionSymmetry::avoid_origin_z = "no" ReflectionSymmetry::reflection_x = "no" ReflectionSymmetry::reflection_y = "no" ReflectionSymmetry::reflection_z = "yes" # Parameters of thorn WeylScal4 (implementing WeylScal4) WeylScal4::fd_order = "2nd"

4 5

changing CarpetRegrid2 parameters for ETK Maxwell + mercurial Carpet?
by Kelly, Bernard J. (GSFC-660.0)[UNIVERSITY OF MARYLAND BALTIMORE COUNTY] 01 Mar '12

01 Mar '12

Hi all. At Erik's suggestion (off-list), I resolved some checkpoint recovery issues by moving from "Curie" to the new ETK release. However, my old grid specifications seem no longer to work. The parameters are for a 2:1 mass-ratio BHB evolution. I've used three "centres" -- one each for the punctures, and one centred at the origin. Below is what I used to have in CarpetRegrid2, which worked with the last "Curie" release of ETK (the full grid is [-2048,2048] in size). ------------------------------------------------------------------- # Parameters of thorn CarpetRegrid2 (implementing CarpetRegrid2) CarpetRegrid2::freeze_unaligned_levels = "yes" CarpetRegrid2::num_centres = 3 CarpetRegrid2::num_levels_1 = 12 CarpetRegrid2::position_x_1 = -3.3333333333333333333 CarpetRegrid2::movement_threshold_1 = 0.10 CarpetRegrid2::radius_1[5] = 40 CarpetRegrid2::radius_1[6] = 20 CarpetRegrid2::radius_1[7] = 10 CarpetRegrid2::radius_1[8] = 5 CarpetRegrid2::radius_1[9] = 2.5 CarpetRegrid2::radius_1[10] = 1.25 CarpetRegrid2::radius_1[11] = 0.625 CarpetRegrid2::num_levels_2 = 13 CarpetRegrid2::position_x_2 = 6.6666666666666666667 CarpetRegrid2::movement_threshold_2 = 0.05 CarpetRegrid2::radius_2[5] = 40 CarpetRegrid2::radius_2[6] = 20 CarpetRegrid2::radius_2[7] = 10 CarpetRegrid2::radius_2[8] = 5 CarpetRegrid2::radius_2[9] = 2.5 CarpetRegrid2::radius_2[10] = 1.25 CarpetRegrid2::radius_2[11] = 0.625 CarpetRegrid2::radius_2[12] = 0.3125 CarpetRegrid2::num_levels_3 = 6 CarpetRegrid2::radius_3[1] = 1024 CarpetRegrid2::radius_3[2] = 512 CarpetRegrid2::radius_3[3] = 256 CarpetRegrid2::radius_3[4] = 160 CarpetRegrid2::radius_3[5] = 96 CarpetRegrid2::regrid_every = 60 CarpetRegrid2::verbose = "yes" ------------------------------------------------------------------- This doesn't work now, however. Current ETK complains that some entries in radius_1 and radius_2 are unspecified, and it sets them to zero with catastrophic results. To resolve this, I am now explicitly setting the missing levels: CarpetRegrid2::radius_1[1] = 1024 CarpetRegrid2::radius_1[2] = 512 CarpetRegrid2::radius_1[3] = 256 CarpetRegrid2::radius_1[4] = 160 CarpetRegrid2::radius_2[1] = 1024 CarpetRegrid2::radius_2[2] = 512 CarpetRegrid2::radius_2[3] = 256 CarpetRegrid2::radius_2[4] = 160 This runs, but complains every time step about mismatched "simulated domain volume" and "reduction weight sum": ---------------------------------------------------------------------------------- INFO (CarpetReduce): Simulation domain volume: 442368 INFO (CarpetReduce): Reduction weight sum: 442367.999999072 WARNING level 1 in thorn CarpetReduce processor 0 host r186i2n12.p4.nas.nasa.gov (line 120 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetReduce/mask_test.c): -> Simulation domain volume and reduction weight sum differ ---------------------------------------------------------------------------------- After a short evolution time (7.25 M, or more than 1700 time steps), the run crashes. First there are several messages of the form: ---------------------------------------------------------------------------------- INFO (CarpetReduce): Simulation domain volume: 442368 INFO (CarpetReduce): Reduction weight sum: 442367.999991311 INFO (CarpetRegrid2): Centre 1 is at position [-3.29831,-0.331478,7.81462e-15] with 12 levels INFO (CarpetRegrid2): Centre 2 is at position [6.58787,0.867484,8.98107e-15] with 13 levels INFO (CarpetRegrid2): Centre 3 is not active INFO (CarpetRegrid2): Regridding INFO (CarpetRegrid2): Regridding levels 10 and up WARNING level 1 in thorn CarpetLib processor 58 host r186i3n7.p4.nas.nasa.gov (line 182 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc): [...] -> /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc:948: [ml=0 rl=10 c=59] The following grid structure consistency check failed: Synchronisation and boundary prolongation: All points must have been received needrecv.empty() [...] WARNING level 0 in thorn CarpetLib processor 94 host r186i3n12.p4.nas.nasa.gov 12676 (line 1973 of /home1/bjkelly1/CODES/Cactus/configs/hahndol/build/CarpetLib/dh.cc): 12677 -> The grid structure is inconsistent. It is impossible to continue. -------------------------------------- I'm attaching my current parameter file in full. I'm reluctant to post the entire STDOUT/STDERR, since it's around a MB in size. Any ideas would be appreciated. I would turn to the copious documentation on CarpetRegrid2, but as noted before, there is none. Thanks, Bernard ----------------------------------------------------------------------------- Bernard Kelly -- CRESST Research Associate, NASA/GSFC Phone: +1 (301) 286-7243 E-Mail: bernard.j.kelly(a)nasa.gov<mailto:bernard.j.kelly@nasa.gov> Web: http://science.gsfc.nasa.gov/sed/index.cfm?fuseAction=people.jumpBio&iphone… -----------------------------------------------------------------------------

4 13

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

Users March 2012