Neil, Do you have any other errors in your log? Specifically, if you search for "Unable to query" do you find anything? This appears to be a problem with the failure handling logic, but it would only get into this state if another failure occurred. That other failure should be logged starting with "Unable to query".
Thanks -Mark On Sep 13, 2017, at 10:01 AM, Neil Derraugh <[email protected]<mailto:[email protected]>> wrote: Seeing this warning and the subsequent error in a dataflow we recently authored. Bryan, looks like the same thing you were asking details of on Hortonworks Community Connection<https://community.hortonworks.com/questions/118295/nifi-filttering-records-from-avro-file-error.html>. This is a QueryRecord processor consuming a schema in the Schema Registry using a CSVReader and CSVRecordSetWriter. Cache Schema and Include Zero Record FlowFiles are set to false. 2017-09-13 09:54:42,628 WARN [Timer-Driven Process Thread-7] o.a.n.c.r.StandardProcessSession StandardProcessSession[id=36915342] closing ErrorHandlingInputStream[FlowFile=StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830], offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503]] for StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830], offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503] because the session was committed without the stream being closed. 2017-09-13 09:54:42,628 ERROR [Timer-Driven Process Thread-7] o.a.nifi.processors.standard.QueryRecord QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4] QueryRecord[id=57303d34-015e-1000-0000-0000032f37b4] failed to process session due to java.lang.IllegalStateException: StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830], offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503] already in use for an active callback or an InputStream created by ProcessSession.read(FlowFile) has not been closed: {} java.lang.IllegalStateException: StandardFlowFileRecord[uuid=8ad17b27-2d2d-49e7-9e79-e280deb8776a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1505264918993-2878, container=default, section=830], offset=0, length=308314548],offset=283108779,name=150526493445632157215839162_8ad17b27-2d2d-49e7-9e79-e280deb8776a,size=10485503] already in use for an active callback or an InputStream created by ProcessSession.read(FlowFile) has not been closed at org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3018) at org.apache.nifi.controller.repository.StandardProcessSession.validateRecordState(StandardProcessSession.java:3013) at org.apache.nifi.controller.repository.StandardProcessSession.transfer(StandardProcessSession.java:1815) at org.apache.nifi.processors.standard.QueryRecord.onTrigger(QueryRecord.java:355) at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147) at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748)
