I have a couple of innards questions:

1.       I'm familiar with how to write flow files, but what if I want to write 
to multiple FlowFiles in parallel, rather than serially? The use case I have in 
mind involves reading through an input stream and generating multiple 
derivative copies in different formats without ever reading the original stream 
more than once.  I tried capturing the OutputStream variable from the callback, 
but ends up getting closed sometimes before I am done writing.

flowFile = session.write(flowFile, new StreamCallback() {
                @Override
                public void process(final InputStream rawIn, final OutputStream 
rawOut) throws IOException {
}
});


2.       If I explicitly call ` session.commit();` does this cause transferred 
FlowFiles to be immediately released to their appropriate queues?  If yes, can 
I continue to work with the session object after commit and release batches to 
the queue? Think of it like a SQL dirty read, `FlowFile Dirty Read`.

Regards,
  Peter

Reply via email to