Chakri I believe it would be tough to provide specific assistance without seeing the code for the custom processor. However, this exception 'ReadPendingException' implies to me there are multiple read attempts happening on the same stream [1].
[1] https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ReadPendingException.html Perhaps check if there are threading/object reuse issues. Thanks Joe On Wed, Jan 20, 2016 at 6:23 PM, Chakrader Dewaragatla <[email protected]> wrote: > > Hi – We are seeing the following exception on https listener processor. > Below stacks are from a custom processor (GetDataSet) which use httplistener > snip of code to listen. Any insight on this ? > > > Custom processor Stack : > > 2016-01-20 23:13:57,287 ERROR [Timer-Driven Process Thread-7] > c.l.d.e.nifi.processors.GetDataSet > GetDataSet[id=284813ac-9247-4442-a312-d67856a41ac3] > [com.lifelock.dataplatform.commons.datareader.HttpsListenerDataReader.getNextDataRecord(HttpsListenerDataReader.java:214), > > com.lifelock.dataacquisition.executor.nifi.processors.GetDataSet.onTriggerImpl(GetDataSet.java:163), > > com.lifelock.dataacquisition.executor.nifi.processors.LLDataPlatformAbstractProcessor.onTrigger(LLDataPlatformAbstractProcessor.java:51), > > org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27), > > org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146), > > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139), > > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49), > > org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119), > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471), > java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304), > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178), > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293), > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), > java.lang.Thread.run(Thread.java:745)] > > > > Httphandler processor stack: > > > 2016-01-15 20:18:39,257 WARN [Timer-Driven Process Thread-8] > org.eclipse.jetty.io.FillInterest Read pending for > AC.ReadCB@3dab9888{HttpConnection@3dab9888{FILLING_INTERESTED_CALLBACK(FILL_INTERESTED)}} > prevented > org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback$1@4cab2859 > > 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] > o.e.jetty.util.SharedBlockingCallback Blocker not complete > Blocker@48c0dc49{null} > > 2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] > o.a.n.p.standard.HandleHttpRequest > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process > due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to > import data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException; rolling back session: > org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import > data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException > > 2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] > o.a.n.p.standard.HandleHttpRequest > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process > session due to org.apache.nifi.processor.exception.FlowFileAccessException: > Failed to import data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException: > org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import > data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException > > 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] > o.a.n.p.standard.HandleHttpRequest > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] Processor > Administratively Yielded for 1 sec due to processing failure > > 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] > o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding > HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] due to uncaught > Exception: org.apache.nifi.processor.exception.FlowFileAccessException: > Failed to import data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException > > 2016-01-15 20:18:39,259 WARN [Timer-Driven Process Thread-8] > o.a.n.c.t.ContinuallyRunProcessorTask > > org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import > data from HttpInputOverHTTP@6dbe61ef for > StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] > due to java.nio.channels.ReadPendingException > > at > org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2280) > ~[nifi-framework-core-0.4.1.jar:0.4.1] > > at > org.apache.nifi.processors.standard.HandleHttpRequest.onTrigger(HandleHttpRequest.java:485) > ~[na:na] > > at > org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) > ~[nifi-api-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146) > ~[nifi-framework-core-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139) > [nifi-framework-core-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49) > [nifi-framework-core-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119) > [nifi-framework-core-0.4.1.jar:0.4.1] > > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > [na:1.7.0_60] > > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) > [na:1.7.0_60] > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) > [na:1.7.0_60] > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > [na:1.7.0_60] > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > [na:1.7.0_60] > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > [na:1.7.0_60] > > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60] > > Caused by: java.nio.channels.ReadPendingException: null > > at org.eclipse.jetty.io.FillInterest.register(FillInterest.java:62) > ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.io.AbstractEndPoint.fillInterested(AbstractEndPoint.java:123) > ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback.onEnter(AbstractConnection.java:529) > ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.io.AbstractConnection.next(AbstractConnection.java:273) > ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.io.AbstractConnection.fillInterested(AbstractConnection.java:150) > ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.server.HttpInputOverHTTP.blockForContent(HttpInputOverHTTP.java:63) > ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529] > > at > org.eclipse.jetty.server.HttpInput$1.waitForContent(HttpInput.java:476) > ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529] > > at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:121) > ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529] > > at java.io.InputStream.read(InputStream.java:101) ~[na:1.7.0_60] > > at org.apache.nifi.stream.io.StreamUtils.copy(StreamUtils.java:35) > ~[nifi-utils-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.repository.FileSystemRepository.importFrom(FileSystemRepository.java:698) > ~[nifi-framework-core-0.4.1.jar:0.4.1] > > at > org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2270) > ~[nifi-framework-core-0.4.1.jar:0.4.1] > > ... 13 common frames omitted > > > Thanks, > > -Chakri > > ________________________________ > The information contained in this transmission may contain privileged and > confidential information. It is intended only for the use of the person(s) > named above. If you are not the intended recipient, you are hereby notified > that any review, dissemination, distribution or duplication of this > communication is strictly prohibited. If you are not the intended recipient, > please contact the sender by reply email and destroy all copies of the > original message. > ________________________________
