Hi Tim and Jeff,
The long run of the pipeline we started yesterday ran for about 8 hours at
both SDSC and NCSA. The dbingest service died fairly early from the
too-many-open-files bug; otherwise, the pipeline seems to have run fine.
I have not finished the timing analysis, yet. The results can be found on
the NCSA teragrid machine in
/usr/projects/LSST/stage3/Final/LsstDC1Final3.
Steve and I dived into the logger bug and were able to trace it to a bug
in the nlog module. We figured out and tested a fix, and now the dbingest
service is running to ingest the remaining files. As I mentioned
yesterday, I increased the size of the files by a factor of 100 to see if
this improves the overall B/s ingest rate.
We also did a 1 hour run today of the pipeline at NCSA with the consumer
dials turned to zero. The results can be found on the NCSA teragrid
machine in /usr/projects/LSST/stage3/Final/LsstDC1Final4.
cheers,
Ray
_______________________________________________
LSST-data mailing list
[email protected]
http://www.lsstmail.org/mailman/listinfo/lsst-data