Subject: About NGC reprocessing
From: ORSINI MASSIMO (Massimo.Orsini@lngs.infn.it)
Date: Fri Jun 23 2000 - 11:15:21 EDT
Hi Erik,
we notice that the Gzip procedure is VERY slow even if you perform it
during the NGC processing.
It actually takes more than 2 minutes per file (80000 blocks) x 839 DSTs
= 1678 minutes ~28 hours to Gzip all of them.
Since yesterday we already launched both copies on the SLOW queues and for
this reason we decided to leave them still in progress because at this point
we can't delete those entries during execution, then it would be a waste
of time because we actually need more than 28 hours to Gzip all DSTs +
relaunch both copies again.....we pratically are not going to be able to
launch two new NGC reprocessing jobs by monday anyways.
However, Sandra Parlati and Nazzareno Taborgna say that could be useless
to Gzip those DSTs....probably we only need to TAR them only during the
copy.......in this case the whole NGC processing will be much faster.
Furthermore, when we UNZIP a DSTs, its block size is never equal to the
original one, something that's worrying us....do you really want them
ZIPPED ?
In this case, the next two NGC jobs will Gzip all DSTs during the reproces-
sing but the result will be always slow, very slow.
A presto,
Massimo&Nicola
This archive was generated by hypermail 2a24 : Fri Jun 23 2000 - 11:15:27 EDT