Thanks for the breakdown.
With regard to condor, I know Duncan Brown at Syracuse has a working script 'condor_mpirun' that's GPL'd. I'm including a copy of a message that circulated to a LIGO software email list that describes how to run condor mpi jobs.
So you'd submit to a cluster with
condor_submit <name-of-script-text-file-included-below>
which would in turn call this script
for a description of the underlying issues. I personally haven't used condor in parallel in a few years, but it was particularly convenient when I did. And it's the submission system I'll likely be using in the future.
-Richard
Date: October 6, 2010 8:35:36 AM CDT
Subject: Re: [DASWG] MPI jobs on LDG clusters
Hi Vivien,