[
https://issues.apache.org/jira/browse/NIFI-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15992307#comment-15992307
]
Joseph Witt commented on NIFI-3739:
-----------------------------------
seeing this
{code}
2017-05-02 00:00:36,541 ERROR [Timer-Driven Process Thread-6]
o.a.n.p.k.pubsub.ConsumeKafkaRecord_0_10
ConsumeKafkaRecord_0_10[id=c74d00d6-015b-1000-efbc-5c25bcf87d00] Exception
while processing data from kafka so will close the lease
org.apache.nifi.processors.kafka.pubsub.
ConsumerPool$SimpleConsumerLease@5f502953 due to
org.apache.nifi.processor.exception.ProcessException:
org.apache.nifi.schema.access.SchemaNotFoundException: java.io.EOFException:
org.apache.nifi.processor.exception.ProcessException:
org.apache.nifi.schema.access.SchemaNotFo
undException: java.io.EOFException
org.apache.nifi.processor.exception.ProcessException:
org.apache.nifi.schema.access.SchemaNotFoundException: java.io.EOFException
at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeRecordData(ConsumerLease.java:427)
at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$2(ConsumerLease.java:319)
at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
at
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:306)
at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:173)
at
org.apache.nifi.processors.kafka.pubsub.ConsumeKafkaRecord_0_10.onTrigger(ConsumeKafkaRecord_0_10.java:327)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1118)
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:144)
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.nifi.schema.access.SchemaNotFoundException:
java.io.EOFException
at
org.apache.nifi.schema.access.HortonworksEncodedSchemaReferenceStrategy.getSchema(HortonworksEncodedSchemaReferenceStrategy.java:53)
at
org.apache.nifi.serialization.SchemaRegistryService.getSchema(SchemaRegistryService.java:106)
at
org.apache.nifi.json.JsonRecordSetWriter.createWriter(JsonRecordSetWriter.java:68)
at sun.reflect.GeneratedMethodAccessor533.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:89)
at com.sun.proxy.$Proxy122.createWriter(Unknown Source)
at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeRecordData(ConsumerLease.java:412)
... 18 common frames omitted
Caused by: java.io.EOFException: null
at org.apache.nifi.stream.io.StreamUtils.fillBuffer(StreamUtils.java:92)
at org.apache.nifi.stream.io.StreamUtils.fillBuffer(StreamUtils.java:72)
at
org.apache.nifi.schema.access.HortonworksEncodedSchemaReferenceStrategy.getSchema(HortonworksEncodedSchemaReferenceStrategy.java:51)
... 26 common frames omitted
{code}
> Create Processors for publishing records to and consuming records from Kafka
> ----------------------------------------------------------------------------
>
> Key: NIFI-3739
> URL: https://issues.apache.org/jira/browse/NIFI-3739
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Extensions
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 1.2.0
>
>
> With the new record readers & writers that have been added in now, it would
> be good to allow records to be pushed to and pulled from kafka. Currently, we
> support demarcated data but sometimes we can't correctly demarcate data in a
> way that keeps the format valid (json is a good example). We should have
> processors that use the record readers and writers for this.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
