On Wed, Mar 19, 2014 at 05:14:28PM -0400, P. Taylor Goetz wrote: > Have you considered using DRPC [1]? > > [1] http://storm.incubator.apache.org/documentation/Distributed-RPC.html
From what I've read so far - it seems to create and deploy a topology, which I could also do here (and probably much simpler, since it's a concrete case - not a generic one). So if a creation of a new topology per "task" is not considered as a "bad practice" - the only thing which I can't get is how to track that a task has actually finished and all data from the spout was received in sink. Perhaps I could add some sort of "record number" (which I may know in advance) and process the completion event if the sink has received the expected number of records. -- Eugene N Dzhurinsky
pgp0cVsLJxROe.pgp
Description: PGP signature
