Subject: DD0521 repor
Ioanni.Katsavounidis@lngs.infn.it
Date: Sun Feb 20 2000 - 12:26:00 EST
*******************************************************************************
* DOWNLOAD : 3.7 hrs PROBLEM RUNS: 12397 - PHRASE error; crashed MY_MONITOR*
* ZEB2RAW : 2.0 hrs changed MY_MONITOR, run it with _PASS1,OK*
* PROCESS : 10.0 hrs RARE-DSTS : NRD008 DISK USED: DISK$SCRAUSA9 *
* TOTAL : 15.7 hrs GC-DSTS : NGC006 CPU USED : AXPGS3 *
*******************************************************************************
This is a report on the processing of DD052
From: AXPGS3::MACROUSA "LNGS US MACRO group" 19-FEB-2000 16:14:46.42
Subj: Start COPY of FIRST (#1) file of DD052 (RUN012378) Selected CPU:3/DISK:9
From: AXPGS3::MACROUSA "LNGS US MACRO group" 19-FEB-2000 19:57:35.12
Subj: Done COPY of LAST (#36) file of DD052 (RUN012412) Selected CPU:3/DISK:9
Download from tape to disk lasted ~ 3.7 hrs
From: AXPGS3::MACROUSA "LNGS US MACRO group" 19-FEB-2000 21:45:47.52
Subj: Submitted FIRST (#1) ZEB2RAW job of DD052 (RUN012378) Selected CPU:3/DISK:9
From: AXPGS3::MACROUSA "LNGS US MACRO group" 19-FEB-2000 23:48:49.76
Subj: Submitted LAST (#36) ZEB2RAW job of DD052 (RUN012412) Selected CPU:3/DISK:9
Conversion of ZEBRA to RAW lasted ~ 2.0 hrs
From: AXPGS3::MACROUSA "LNGS US MACRO group" 19-FEB-2000 23:49:01.09
Subj: Submitted FIRST (#1) MR MONITOR job of DD052 (RUN012378) Selected CPU:3/DISK:9
From: AXPGS3::MACROUSA "LNGS US MACRO group" 20-FEB-2000 09:45:50.22
Subj: Submitted LAST (#36) MR MONITOR job of DD052 (RUN012412) Selected CPU:3/DISK:9
Processing of the RAW RUN files lasted ~ 10.0 hrs
There were problems with 1 file:
RUN012397: (MY_MONITOR had an ugly crash, resulting in ZFATAL on event 1000001,
SAPHRH -> SAPHRRT -> ... zebra errors ...
that resulted in NOT launching
the "daughter" jobs and so CL_MONITOR found only 3 .DONE files.
First, fixed MY_MONITOR, by adding "ON ERROR THEN" logic that
guarantees launching of these other jobs even in case of such
a serious crash. Then, since CL_MONITOR found 1 .FAIL and 6 .DONE
files, relaunched MY_MONITOR_1RUN_PASS1 that ran fine)
Subj: CL:DD052 RUN012397 CAL0 fail:0,done:3,exp:7 PROBLEM
Subj: MYSTATS LOG ERRORS RUN12397 DD052 SIZE= 3-NO
Subj: CL:DD052 RUN012397 CAL0 fail:1,done:6,exp:7 PROBLEM
All RARE and GC dsts have been put on tape (NRD008 & NGC006 correspondingly)
and all relevant files cleaned/archived
DD052 is now completed. It took 3.7 + 2.0 + 10.0 = ~15.7 hrs
This archive was generated by hypermail 2a24 : Sun Feb 20 2000 - 12:26:03 EST