[ 
https://issues.apache.org/jira/browse/NIFI-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15167187#comment-15167187
 ] 

Oleg Zhurakousky commented on NIFI-1534:
----------------------------------------

So, I've changed the title since the issue is more of an architectural within 
the core framework and not specific to PutKafka. In short any Processor that 
holds FlowFile to be dealt with in some future invocation of _onTrigger()_ with 
run-duration > 0 will fail. This is due to the fact that 
ContinuallyRunningProcessTask will issue _commit()_ as soon as _onTrigger()_ 
exits. Meanwhile the FlowFile in question have not been removed and/or 
transferred to any relationship because the Processor is waiting for 
acknowledgments from third-party system (the reason why FlowFile was held in 
the first place).
The bottom line, any such processor will not be able to operate in the 
environment with run-duration > 0.

> Processors that utilize batching with Run Duration > 0 fail
> -----------------------------------------------------------
>
>                 Key: NIFI-1534
>                 URL: https://issues.apache.org/jira/browse/NIFI-1534
>             Project: Apache NiFi
>          Issue Type: Bug
>            Reporter: Oleg Zhurakousky
>            Assignee: Oleg Zhurakousky
>            Priority: Critical
>             Fix For: 0.6.0
>
>
> The following error shows up in the bulletin
> {code}
> PutKafka[id=80e8946f-349c-4716-9da9-5e766582f788] Failed to process session 
> due to org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=27030bf8-c217-4b59-a0ba-46f1b30ff093,claim=StandardContentClaim
>  [resourceClaim=StandardResourceClaim[id=1455807429050-246, 
> container=default, section=246], offset=563929, 
> length=431],offset=0,name=hh77.33,size=431] is not known in this session
> {code}
> After some debugging I also see this
> {code}
> ERROR [Timer-Driven Process Thread-14] o.apache.nifi.processors.kafka.PutKafka
> org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=dd373d71-ebd2-432e-bcf5-9980d7df4da4,claim=StandardContentClaim
>  [resourceClaim=StandardResourceClaim[id=1454688235111-5, container=content2, 
> section=5], offset=0, length=4778852],offset=0,name=boo,size=4778852] 
> transfer relationship not specified
>         at 
> org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:210)
>  
>         at 
> org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:280)
>         at 
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:179)
> . . . .
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to