Diagnosis of DD248 reprocessing


Subject: Diagnosis of DD248 reprocessing
Ioanni.Katsavounidis@lngs.infn.it
Date: Sun Apr 30 2000 - 07:07:11 EDT


*******************************************************************************
* DOWNLOAD : 3.4 hrs PROBLEM RUNS: 17464, PHRASE event, crashed MY_MONITOR, *
* ZEB2RAW : 2.4 hrs relaunched using _PASS1 (OK) *
* PROCESS : 9.0 hrs RARE-DSTS : NRD051 DISK USED: DISK$SCRAUSA7 *
* TOTAL : 14.8 hrs GC-DSTS : NGC028 CPU USED : AXPGS5 *
*******************************************************************************

This is a report on the processing of DD248

From: AXPGS3::MACROUSA "LNGS US MACRO group" 29-APR-2000 08:01:48.89
Subj: Start COPY of FIRST (#1) file of DD248 (RUN017453) Selected CPU:5/DISK:7
From: AXPGS3::MACROUSA "LNGS US MACRO group" 29-APR-2000 13:25:16.49
Subj: Done COPY of LAST (#59) file of DD248 (RUN017499) Selected CPU:5/DISK:7

Download from tape to disk lasted ~ 5.4 hrs

There were the following runs out of order on TAPLIS.TAB - fixed now

 In DD248 file 4:RUN091359.ZEB expecting RUN91359/17466 vs RUN17456/90619
 In DD248 file 5:RUN091360.ZEB expecting RUN91360/14302 vs RUN17457/380
 In DD248 file 6:RUN091361.ZEB expecting RUN91361/32738 vs RUN17458/90113
 In DD248 file 7:RUN091362.ZEB expecting RUN91362/51174 vs RUN17459/52819
 In DD248 file 8:RUN017456.ZEB expecting RUN17456/90619 vs RUN17460/170016
 In DD248 file 9:RUN017457.ZEB expecting RUN17457/380 vs RUN17461/88299
 In DD248 file 10:RUN017458.ZEB expecting RUN17458/90113 vs RUN17462/88341
 In DD248 file 11:RUN017459.ZEB expecting RUN17459/52819 vs RUN17463/88299
 In DD248 file 12:RUN017460.ZEB expecting RUN17460/170016 vs RUN17464/88299
 In DD248 file 13:RUN017461.ZEB expecting RUN17461/88299 vs RUN17465/88341
 In DD248 file 14:RUN017462.ZEB expecting RUN17462/88341 vs RUN17466/88299
 In DD248 file 15:RUN017463.ZEB expecting RUN17463/88299 vs RUN17467/88299
 In DD248 file 16:RUN017464.ZEB expecting RUN17464/88299 vs RUN17468/88341
 In DD248 file 17:RUN017465.ZEB expecting RUN17465/88341 vs RUN17469/88299
 In DD248 file 18:RUN017466.ZEB expecting RUN17466/88299 vs RUN17470/88299
 In DD248 file 19:RUN017467.ZEB expecting RUN17467/88299 vs RUN17471/88299
 In DD248 file 20:RUN017468.ZEB expecting RUN17468/88341 vs RUN17472/88299
 In DD248 file 21:RUN017469.ZEB expecting RUN17469/88299 vs RUN17473/88341
 In DD248 file 22:RUN017470.ZEB expecting RUN17470/88299 vs RUN17474/88299
 In DD248 file 23:RUN017471.ZEB expecting RUN17471/88299 vs RUN17475/88299
 In DD248 file 24:RUN017472.ZEB expecting RUN17472/88299 vs RUN17476/88257
 In DD248 file 25:RUN017473.ZEB expecting RUN17473/88341 vs RUN17477/88299
 In DD248 file 26:RUN017474.ZEB expecting RUN17474/88299 vs RUN17478/88299
 In DD248 file 27:RUN017475.ZEB expecting RUN17475/88299 vs RUN17479/88299
 In DD248 file 28:RUN017476.ZEB expecting RUN17476/88257 vs RUN17480/44129
 In DD248 file 29:RUN017477.ZEB expecting RUN17477/88299 vs RUN17481/764818
 In DD248 file 30:RUN017478.ZEB expecting RUN17478/88299 vs RUN17482/764691
 In DD248 file 31:RUN017479.ZEB expecting RUN17479/88299 vs RUN17483/765535
 In DD248 file 32:RUN017480.ZEB expecting RUN17480/44129 vs RUN17484/239457
 In DD248 file 33:RUN017481.ZEB expecting RUN17481/764818 vs RUN17485/126015
 In DD248 file 34:RUN017482.ZEB expecting RUN17482/764691 vs RUN17486/258525
 In DD248 file 35:RUN017483.ZEB expecting RUN17483/765535 vs RUN17487/764944
 In DD248 file 36:RUN017484.ZEB expecting RUN17484/239457 vs RUN17488/764860
 In DD248 file 37:RUN017485.ZEB expecting RUN17485/126015 vs RUN17489/764818
 In DD248 file 38:RUN017486.ZEB expecting RUN17486/258525 vs RUN17490/764986
 In DD248 file 39:RUN017487.ZEB expecting RUN17487/764944 vs RUN17491/35986
 In DD248 file 40:RUN017488.ZEB expecting RUN17488/764860 vs RUN17492/33835
 In DD248 file 41:RUN017489.ZEB expecting RUN17489/764818 vs RUN17493/764944
 In DD248 file 42:RUN017490.ZEB expecting RUN17490/764986 vs RUN17494/764691
 In DD248 file 43:RUN017491.ZEB expecting RUN17491/35986 vs RUN17495/764691
 In DD248 file 44:RUN091363.ZEB expecting RUN91363/29025 vs RUN17496/764902
 In DD248 file 45:RUN091365.ZEB expecting RUN91365/25608 vs RUN17497/765029
 In DD248 file 46:RUN091366.ZEB expecting RUN91366/34468 vs RUN17498/765155
 In DD248 file 47:RUN091367.ZEB expecting RUN91367/52693 vs RUN17499/765197
 In DD248 file 48:RUN017492.ZEB expecting RUN17492/33835 vs RUN91359/17466
 In DD248 file 49:RUN091370.ZEB expecting RUN91370/32822 vs RUN91360/14302
 In DD248 file 50:RUN091371.ZEB expecting RUN91371/17677 vs RUN91361/32738
 In DD248 file 51:RUN091372.ZEB expecting RUN91372/14429 vs RUN91362/51174
 In DD248 file 52:RUN091373.ZEB expecting RUN91373/51469 vs RUN91363/29025
 In DD248 file 53:RUN017493.ZEB expecting RUN17493/764944 vs RUN91365/25608
 In DD248 file 54:RUN017494.ZEB expecting RUN17494/764691 vs RUN91366/34468
 In DD248 file 55:RUN017495.ZEB expecting RUN17495/764691 vs RUN91367/52693
 In DD248 file 56:RUN017496.ZEB expecting RUN17496/764902 vs RUN91370/32822
 In DD248 file 57:RUN017497.ZEB expecting RUN17497/765029 vs RUN91371/17677
 In DD248 file 58:RUN017498.ZEB expecting RUN17498/765155 vs RUN91372/14429
 In DD248 file 59:RUN017499.ZEB expecting RUN17499/765197 vs RUN91373/51469

From: VAXGS::MACROUSA "LNGS US MACRO group" 29-APR-2000 13:25:29.91
Subj: Submitted FIRST (#1) ZEB2RAW job of DD248 (RUN017453) Selected CPU:5/DISK:7
From: VAXGS::MACROUSA "LNGS US MACRO group" 29-APR-2000 16:01:27.62
Subj: Submitted LAST (#59) ZEB2RAW job of DD248 (RUN017499) Selected CPU:5/DISK:7

Conversion of ZEBRA to RAW lasted ~ 2.6 hrs

From: VAXGS::MACROUSA "LNGS US MACRO group" 29-APR-2000 16:04:06.76
Subj: Submitted FIRST (#1) MR MONITOR job of DD248 (RUN017453) Selected CPU:5/DISK:7
From: VAXGS::MACROUSA "LNGS US MACRO group" 30-APR-2000 00:43:12.74
Subj: Submitted LAST (#59) MR MONITOR job of DD248 (RUN017499) Selected CPU:5/DISK:7

Processing of the RAW RUN files lasted ~ 8.6 hrs

There was a problem with run 17464 (PHRASE-only) that caused MY_MONITOR
to halt. Relaunched it using _PASS1 version that ran fine.
Reason for 3rd e-mail was due to the fact the XC_MONITOR found the 1st
version of MY_MONITOR.LOG and reported the same problem it had found
before.

Subj: MYSTATS LOG ERRORS RUN17464 DD248 SIZE= 3-NO
Subj: CL:DD248 RUN017464 CAL0 fail:1,done:6,exp:7 PROBLEM
Subj: MYSTATS LOG ERRORS RUN17464 DD248 SIZE= 3-NO

All RARE and GC dsts have been put on tape (NRD051 & NGC028 correspondingly)
and all relevant files cleaned/archived

DD248 is now completed. It took 5.4 + 2.6 + 8.6 = ~16.6 hrs



This archive was generated by hypermail 2a24 : Sun Apr 30 2000 - 07:07:17 EDT