Hi Barry,

I just tried it. The MPI error persists (only just without the messages about l_mode, m_mode).

I suspect it could be related to the mpi version in LONI. I am trying to use other batch scripts like in the LONI webpage https://docs.loni.org/wiki/Running_Jobs_on_Linux_x86_Clusters#tab=Mvapich2_J...

I also found instructions to use cactus in LONI here: https://docs.loni.org/wiki/Cactus_on_LONI_x86_Clusters

but I already configured cactus properly with simfactory.

Best, Jose

On Wed, Jan 25, 2012 at 2:49 AM, Barry Wardell barry.wardell@gmail.comwrote:

Hi Jose,

I'm not sure if this is the cause of your MPI errors, but the m_mode and l_mode parameters in WeylScal4 are deprecated. You should instead use the l_max parameter, e.g.

ActiveThorns = "WeylScal4 Multipole" WeylScal4::offset = 1e-8 WeylScal4::fd_order = "4th" WeylScal4::verbose = 0

Multipole::nradii = 8 Multipole::out_every = 128 Multipole::radius[0] = 15 Multipole::radius[1] = 30 Multipole::radius[2] = 40 Multipole::radius[3] = 50 Multipole::radius[4] = 60 Multipole::radius[5] = 70 Multipole::radius[6] = 80 Multipole::radius[7] = 90 Multipole::variables = "WeylScal4::Psi4r{sw=-2 cmplx='WeylScal4::Psi4i' name='psi4'}" Multipole::l_max = 4

Barry

On Wed, Jan 25, 2012 at 10:39 AM, Jose Fiestas Iquira jafiestas@lbl.govwrote:

...

Hello,

I am using WeylScal4 and Multipole thorns in McLachlan, and started a run using simfactory. It started well but stops after an MPI error. Before I get some warnings related to the parameters m_mode and l_mode. I am attaching the error file. It runs only for the initial time step zero.

Does somebody have probably a hint what is the best parameter setting? I am using following:

ActiveThorns = "WeylScal4 Multipole" WeylScal4::offset = 1e-8 WeylScal4::fd_order = "4th" WeylScal4::verbose = 0

Multipole::nradii = 8 Multipole::out_every = 128 Multipole::radius[0] = 15 Multipole::radius[1] = 30 Multipole::radius[2] = 40 Multipole::radius[3] = 50 Multipole::radius[4] = 60 Multipole::radius[5] = 70 Multipole::radius[6] = 80 Multipole::radius[7] = 90 Multipole::variables = "WeylScal4::Psi4r{sw=-2 cmplx='WeylScal4::Psi4i' name='Psi4'}" Multipole::l_mode = 4 Multipole::m_mode = 4

Thanks, Jose

---

Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users

Hello, Please correct me if the way to disable scalar output for complex grid functions is e.g. deleting the lines WEYLSCAL4::Psi4r and WEYLSCAL4::Psi4i below. They are the only I recognize as complex numbers. Which information am I loosing so?

---------------------------------------------------------- ActiveThorns = "CarpetIOScalar"

IOScalar::one_file_per_group = yes

IOScalar::outScalar_every = 128 IOScalar::outScalar_vars = " CarpetReduce::weight ADMBase::metric ADMBase::curv ADMBase::lapse ADMBase::shift ADMBase::dtlapse ADMBase::dtshift WEYLSCAL4::Psi4r WEYLSCAL4::Psi4i ML_ADMConstraints::ML_Ham ML_ADMConstraints::ML_mom SphericalSurface::sf_radius QuasiLocalMeasures::qlm_newman_penrose QuasiLocalMeasures::qlm_weyl_scalars QuasiLocalMeasures::qlm_ricci_scalars QuasiLocalMeasures::qlm_twometric QuasiLocalMeasures::qlm_killing_vector QuasiLocalMeasures::qlm_killed_twometric QuasiLocalMeasures::qlm_invariant_coordinates QuasiLocalMeasures::qlm_3determinant

Thanks, Jose

On Wed, Jan 25, 2012 at 7:09 AM, Erik Schnetter schnetter@cct.lsu.eduwrote:

Jose

Some thorn requests a reduction for a complex datatype, which does not work with this MPI version. This should be corrected in later versions of Carpet. Alternatively, you can try e.g. disabling scalar output for complex grid functions.

-erik

On Wed, Jan 25, 2012 at 5:39 AM, Jose Fiestas Iquira jafiestas@lbl.gov wrote:

...

Hello,

I am using WeylScal4 and Multipole thorns in McLachlan, and started a run using simfactory. It started well but stops after an MPI error. Before I

get

...

some warnings related to the parameters m_mode and l_mode. I am attaching the error file. It runs only for the initial time step zero.

Does somebody have probably a hint what is the best parameter setting? I

am

...

using following:

ActiveThorns = "WeylScal4 Multipole" WeylScal4::offset = 1e-8 WeylScal4::fd_order = "4th" WeylScal4::verbose = 0

Multipole::nradii = 8 Multipole::out_every = 128 Multipole::radius[0] = 15 Multipole::radius[1] = 30 Multipole::radius[2] = 40 Multipole::radius[3] = 50 Multipole::radius[4] = 60 Multipole::radius[5] = 70 Multipole::radius[6] = 80 Multipole::radius[7] = 90 Multipole::variables = "WeylScal4::Psi4r{sw=-2 cmplx='WeylScal4::Psi4i' name='Psi4'}" Multipole::l_mode = 4 Multipole::m_mode = 4

Thanks, Jose

---

Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users

-- Erik Schnetter schnetter@cct.lsu.edu http://www.cct.lsu.edu/~eschnett/

I did and it runs at least more than the initial step. I am checking the output. Thanks.

On Wed, Jan 25, 2012 at 12:57 PM, Ian Hinder ian.hinder@aei.mpg.de wrote:

On 25 Jan 2012, at 14:19, Jose Fiestas Iquira wrote:

Hello, Please correct me if the way to disable scalar output for complex grid functions is e.g. deleting the lines WEYLSCAL4::Psi4r and WEYLSCAL4::Psi4i below. They are the only I recognize as complex numbers. Which information am I loosing so?

Those are real numbers - we don't use the complex data type in WeylScal4. Maybe try disabling QuasiLocalMeasures? We have had problems with MPI with that thorn before (https://trac.einsteintoolkit.org/ticket/495).

---

ActiveThorns = "CarpetIOScalar"

IOScalar::one_file_per_group = yes

IOScalar::outScalar_every = 128 IOScalar::outScalar_vars = " CarpetReduce::weight ADMBase::metric ADMBase::curv ADMBase::lapse ADMBase::shift ADMBase::dtlapse ADMBase::dtshift WEYLSCAL4::Psi4r WEYLSCAL4::Psi4i ML_ADMConstraints::ML_Ham ML_ADMConstraints::ML_mom SphericalSurface::sf_radius QuasiLocalMeasures::qlm_newman_penrose QuasiLocalMeasures::qlm_weyl_scalars QuasiLocalMeasures::qlm_ricci_scalars QuasiLocalMeasures::qlm_twometric QuasiLocalMeasures::qlm_killing_vector QuasiLocalMeasures::qlm_killed_twometric QuasiLocalMeasures::qlm_invariant_coordinates QuasiLocalMeasures::qlm_3determinant

Thanks, Jose

On Wed, Jan 25, 2012 at 7:09 AM, Erik Schnetter schnetter@cct.lsu.eduwrote:

...

Jose

Some thorn requests a reduction for a complex datatype, which does not work with this MPI version. This should be corrected in later versions of Carpet. Alternatively, you can try e.g. disabling scalar output for complex grid functions.

-erik

On Wed, Jan 25, 2012 at 5:39 AM, Jose Fiestas Iquira jafiestas@lbl.gov wrote:

...

Hello,

I am using WeylScal4 and Multipole thorns in McLachlan, and started a

run

...

using simfactory. It started well but stops after an MPI error. Before

I get

...

some warnings related to the parameters m_mode and l_mode. I am

attaching

...

the error file. It runs only for the initial time step zero.

Does somebody have probably a hint what is the best parameter setting?

I am

...

using following:

ActiveThorns = "WeylScal4 Multipole" WeylScal4::offset = 1e-8 WeylScal4::fd_order = "4th" WeylScal4::verbose = 0

Multipole::nradii = 8 Multipole::out_every = 128 Multipole::radius[0] = 15 Multipole::radius[1] = 30 Multipole::radius[2] = 40 Multipole::radius[3] = 50 Multipole::radius[4] = 60 Multipole::radius[5] = 70 Multipole::radius[6] = 80 Multipole::radius[7] = 90 Multipole::variables = "WeylScal4::Psi4r{sw=-2 cmplx='WeylScal4::Psi4i' name='Psi4'}" Multipole::l_mode = 4 Multipole::m_mode = 4

Thanks, Jose

---

Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users

-- Erik Schnetter schnetter@cct.lsu.edu http://www.cct.lsu.edu/~eschnett/

---

Users mailing list Users@einsteintoolkit.org http://lists.einsteintoolkit.org/mailman/listinfo/users

-- Ian Hinder http://numrel.aei.mpg.de/people/hinder