On Fri, 26 May 2006, Russell E. Owen wrote: > The plan is for the Catalog Ingest Service (CIS) to have a higher level > component that will itself decide such things as: > - how many worker processes are best to handle the slices > - which slices are handled by which process > - perhaps is smart enough to realize that a process is stalled and > restart it on a different node (not likely for DC1)
Would it be simpler to just replicate the ingest service on different nodes, each one monitoring a different input directory? The configuration of the converter pipeline stage would just indicate which directory to write its output to. Since we only need 2 (rather than 200) ingest nodes, half of the converters would write to one directory, and the other half to the other directory. cheers, Ray _______________________________________________ LSST-data mailing list [email protected] http://www.lsstmail.org/mailman/listinfo/lsst-data
