I found there is a directory /scratch/ettest52/simulations/static_tov. There are three directories and a file inside static_tov. They are output-0000, output-0000-active, SIMFACTORY and a file log.txt. Inside output-0000 there is a directory SIMFACTORY. There is not any log files. Inside SIMFACTORY there are three files properties.ini, simulation-1374132863.07 and SubmitScript.

The log.txt file in /scratch/ettest52/simulations/static_tov contains following details.


[LOG:2013-07-18 02:34:19] self.create(simulationName, parfile)::Creating simulation static_tov 

[LOG:2013-07-18 02:34:19] self.create(simulationName, parfile)::Simulation directory: /scratch/ettest52/simulations/static_tov 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::Simulation Properties: 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile):: 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::[properties] 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::machine         = queenbee 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::simulationid    = simulation-static_tov-queenbee-qb3.loni.org-ettest52-2013.07.18-02.34.19-19349 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::sourcedir       = /home/ettest52/Cactus 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::configuration   = sim 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::configid        = config-sim-qb4.loni.org-home-ettest52-Cactus 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::buildid         = build-sim-qb4.loni.org-ettest52-2013.07.18-07.25.24-12102 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::testsuite       = False 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::executable      = /scratch/ettest52/simulations/static_tov/SIMFACTORY/exe/cactus_sim 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::optionlist      = /scratch/ettest52/simulations/static_tov/SIMFACTORY/cfg/OptionList 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::submitscript    = /scratch/ettest52/simulations/static_tov/SIMFACTORY/run/SubmitScript 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::runscript       = /scratch/ettest52/simulations/static_tov/SIMFACTORY/run/RunScript 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::parfile         = /scratch/ettest52/simulations/static_tov/SIMFACTORY/par/static_tov.par 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile):: 

[LOG:2013-07-18 02:34:22] self.create(simulationName, parfile)::Simulation static_tov created 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::Restart for simulation static_tov created with restart id 0, long restart id 0000 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::Prepping for submission 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::No previous walltime available to be used, using walltime 8:00:00 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::Defined substituion properties for submission 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::{'SIMULATION_ID': 'simulation-static_tov-queenbee-qb3.loni.org-ettest52-2013.07.18-02.34.19-19349', 'NODE_PROCS': 1, 'PPN_USED': 8, 'PPN': 8, 'ALLOCATION': 'NO_ALLOCATION', 'WALLTIME_HH': '08', 'CPUFREQ': '2.33', 'USER': 'ettest52', 'RUNDIR': '/scratch/ettest52/simulations/static_tov/output-0000', 'NODES': 4, 'SIMULATION_NAME': 'static_tov', 'WALLTIME': '8:00:00', 'NUM_THREADS': 8, 'EXECUTABLE': '/scratch/ettest52/simulations/static_tov/SIMFACTORY/exe/cactus_sim', 'PROCS_REQUESTED': 32, 'EMAIL': 'urkhanal@tucdp.edu.np', 'RESTART_ID': 0, 'CHAINED_JOB_ID': '', 'FROM_RESTART_COMMAND': '', 'NUM_SMT': 1, 'WALLTIME_SECONDS': 28800, 'SIMFACTORY': '/home/ettest52/Cactus/simfactory/bin/sim', 'PROCS': 32, 'SUBMITSCRIPT': '/scratch/ettest52/simulations/static_tov/output-0000/SIMFACTORY/SubmitScript', 'WALLTIME_HOURS': 8.0, 'WALLTIME_MM': '00', 'PARFILE': '/scratch/ettest52/simulations/static_tov/output-0000/static_tov.par', 'WALLTIME_SS': '00', 'QUEUE': 'checkpt', 'CONFIGURATION': 'sim', 'SOURCEDIR': '/home/ettest52/Cactus', 'HOSTNAME': 'qb3.loni.org', 'NUM_PROCS': 4, 'SCRIPTFILE': '/scratch/ettest52/simulations/static_tov/output-0000/SIMFACTORY/SubmitScript', 'MEMORY': '8192', 'WALLTIME_MINUTES': 480, 'SHORT_SIMULATION_NAME': 'static_tov-0000'} 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::self.Properties: /scratch/ettest52/simulations/static_tov/output-0000/SIMFACTORY/properties.ini 

[LOG:2013-07-18 02:34:22] self.submit(submitScript):: 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::[properties] 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::machine         = queenbee 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::simulationid    = simulation-static_tov-queenbee-qb3.loni.org-ettest52-2013.07.18-02.34.19-19349 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::sourcedir       = /home/ettest52/Cactus 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::configuration   = sim 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::configid        = config-sim-qb4.loni.org-home-ettest52-Cactus 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::buildid         = build-sim-qb4.loni.org-ettest52-2013.07.18-07.25.24-12102 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::testsuite       = False 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::executable      = /scratch/ettest52/simulations/static_tov/SIMFACTORY/exe/cactus_sim 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::optionlist      = /scratch/ettest52/simulations/static_tov/SIMFACTORY/cfg/OptionList 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::submitscript    = /scratch/ettest52/simulations/static_tov/SIMFACTORY/run/SubmitScript 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::runscript       = /scratch/ettest52/simulations/static_tov/SIMFACTORY/run/RunScript 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::parfile         = /scratch/ettest52/simulations/static_tov/SIMFACTORY/par/static_tov.par 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::chainedjobid    = -1 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::ppn             = 8 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::procsrequested  = 32 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::allocation      = NO_ALLOCATION 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::user            = ettest52 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::numsmt          = 1 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::walltime        = 8:00:00 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::numprocs        = 4 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::nodeprocs       = 1 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::numthreads      = 8 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::hostname        = qb3.loni.org 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::ppnused         = 8 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::queue           = checkpt 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::cpufreq         = 2.33 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::procs           = 32 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::memory          = 8192 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::nodes           = 4 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::pbsSimulationName= static_tov-0000 

[LOG:2013-07-18 02:34:22] self.submit(submitScript):: 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::saving substituted submitscript contents to: /scratch/ettest52/simulations/static_tov/output-0000/SIMFACTORY/SubmitScript 

[LOG:2013-07-18 02:34:22] self.submit(submitScript)::Executing submission command: qsub /scratch/ettest52/simulations/static_tov/output-0000/SIMFACTORY/SubmitScript 

[LOG:2013-07-18 02:34:22] self.makeActive()::Simulation static_tov with restart-id 0 has been made active 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::received raw output: Invalid allocation "NO_ALLOCATION". 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::===================== Allocation information for ettest52 ===================== 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::   Proj. Name|        Alloc|  Balance| Deposited|    %Used| Days Left|       End 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::-------------------------------------------------------------------------------- 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::loni_cactus08|loni_cactus08 on @Dell_Cluster|106210.43| 250000.00|    57.52|       167|2014-01-01 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output):: 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::Note: Balance and Deposit are measured in CPU-hours 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::qsub: submit filter returned an error code, aborting job submission. 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output):: 

[LOG:2013-07-18 02:34:23] job_id = self.extractJobId(output)::using submitRegex: (\d+)[.]qb2 

[LOG:2013-07-18 02:34:23] self.submit(submitScript)::After searching raw output, it was determined that the job_id is: -1 

[LOG:2013-07-18 02:34:23] self.submit(submitScript)::The regex did NOT match anything. No job_id means no control. 

[LOG:2013-07-18 02:35:29] ret = restart.load(sim, activeId)::For simulation static_tov, loaded restart id 0, long restart id 0000 


I do not understand what these means. What I have to do to complete simulation?

Udayaraj Khanal
Professor
Central Department of Physics
Tribhuvan University
Kirtipur, Nepal