Pierre Villard created NIFI-4084:
------------------------------------

             Summary: MergeContent with Avro merge format - transfer 
relationship not specified
                 Key: NIFI-4084
                 URL: https://issues.apache.org/jira/browse/NIFI-4084
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 1.4.0
            Reporter: Pierre Villard


Using MergeContent processor with Bin-Packing strategy and Avro merge format. 
Sometimes I see the following error:

{noformat}
2017-06-19 09:38:24,531 WARN [Timer-Driven Process Thread-14] 
o.a.n.c.t.ContinuallyRunProcessorTask
org.apache.nifi.processor.exception.FlowFileHandlingException: 
StandardFlowFileRecord[uuid=8dae064d-c934-4292-8ecb-79d77da326d8,claim=,offset=0,name=1822112642788109,size=0]
 transfer relationship not specified
        at 
org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:248)
        at 
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:318)
        at 
org.apache.nifi.processor.util.bin.BinFiles.processBins(BinFiles.java:239)
        at 
org.apache.nifi.processor.util.bin.BinFiles.onTrigger(BinFiles.java:191)
        at 
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
        at 
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at 
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at 
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
2017-06-19 09:38:25,568 ERROR [Timer-Driven Process Thread-6] 
o.a.n.processors.standard.MergeContent 
MergeContent[id=1b013987-39bd-1587-8f89-244f075fff50] Failed to process bundle 
of 624 files due to org.apache.nifi.processor.exception.ProcessException: 
IOException thrown from MergeContent[id=1b013987-39bd-1587-8f89-244f075fff50]: 
java.io.IOException: Not a data file.: {}
org.apache.nifi.processor.exception.ProcessException: IOException thrown from 
MergeContent[id=1b013987-39bd-1587-8f89-244f075fff50]: java.io.IOException: Not 
a data file.
        at 
org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2159)
        at 
org.apache.nifi.processors.standard.MergeContent$AvroMerge$1.process(MergeContent.java:895)
        at 
org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
        at 
org.apache.nifi.processors.standard.MergeContent$AvroMerge.merge(MergeContent.java:890)
        at 
org.apache.nifi.processors.standard.MergeContent.processBin(MergeContent.java:462)
        at 
org.apache.nifi.processor.util.bin.BinFiles.processBins(BinFiles.java:231)
        at 
org.apache.nifi.processor.util.bin.BinFiles.onTrigger(BinFiles.java:191)
        at 
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
        at 
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at 
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at 
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Not a data file.
        at 
org.apache.avro.file.DataFileStream.initialize(DataFileStream.java:105)
        at org.apache.avro.file.DataFileStream.<init>(DataFileStream.java:84)
        at 
org.apache.nifi.processors.standard.MergeContent$AvroMerge$1$1.process(MergeContent.java:899)
        at 
org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2136)
        ... 17 common frames omitted
2017-06-19 09:38:25,569 ERROR [Timer-Driven Process Thread-6] 
o.a.n.processors.standard.MergeContent 
MergeContent[id=1b013987-39bd-1587-8f89-244f075fff50] 
MergeContent[id=1b013987-39bd-1587-8f89-244f075fff50] failed to process session 
due to org.apache.nifi.processor.exception.FlowFileHandlingException: 
StandardFlowFileRecord[uuid=5cac1983-db59-4acb-b6c6-7b3ac0f579ef,claim=,offset=0,name=1822113685824782,size=0]
 transfer relationship not specified: {}
{noformat}

Not sure why it happens yet (still looking into it) but could be because of 
flow files with no content?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to