I have a couple of innards questions:
1. I'm familiar with how to write flow files, but what if I want to write
to multiple FlowFiles in parallel, rather than serially? The use case I have in
mind involves reading through an input stream and generating multiple
derivative copies in different formats without ever reading the original stream
more than once. I tried capturing the OutputStream variable from the callback,
but ends up getting closed sometimes before I am done writing.
flowFile = session.write(flowFile, new StreamCallback() {
@Override
public void process(final InputStream rawIn, final OutputStream
rawOut) throws IOException {
}
});
2. If I explicitly call ` session.commit();` does this cause transferred
FlowFiles to be immediately released to their appropriate queues? If yes, can
I continue to work with the session object after commit and release batches to
the queue? Think of it like a SQL dirty read, `FlowFile Dirty Read`.
Regards,
Peter