[ 
https://issues.apache.org/jira/browse/NIFI-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Joseph Witt reopened NIFI-583:
------------------------------

Found a problem.  See this output for the given configuration:

13:13:43 EDTERRORd75b0039-9cc0-41d8-b8be-a33a50e68db0
ExecuteStreamCommand[id=d75b0039-9cc0-41d8-b8be-a33a50e68db0] 
ExecuteStreamCommand[id=d75b0039-9cc0-41d8-b8be-a33a50e68db0] failed to process 
due to java.lang.IllegalStateException: 
StandardFlowFileRecord[uuid=d73ad102-7591-4513-bf5e-67c9d2103113,claim=,offset=0,name=2492655010633,size=0]
 already in use for an active callback; rolling back session: 
java.lang.IllegalStateException: 
StandardFlowFileRecord[uuid=d73ad102-7591-4513-bf5e-67c9d2103113,claim=,offset=0,name=2492655010633,size=0]
 already in use for an active callback
13:13:43 EDTERRORd75b0039-9cc0-41d8-b8be-a33a50e68db0
ExecuteStreamCommand[id=d75b0039-9cc0-41d8-b8be-a33a50e68db0] 
ExecuteStreamCommand[id=d75b0039-9cc0-41d8-b8be-a33a50e68db0] failed to process 
session due to java.lang.IllegalStateException: 
StandardFlowFileRecord[uuid=d73ad102-7591-4513-bf5e-67c9d2103113,claim=,offset=0,name=2492655010633,size=0]
 already in use for an active callback: java.lang.IllegalStateException: 
StandardFlowFileRecord[uuid=d73ad102-7591-4513-bf5e-67c9d2103113,claim=,offset=0,name=2492655010633,size=0]
 already in use for an active callback
13:13:43 EDTWARNINGd75b0039-9cc0-41d8-b8be-a33a50e68db0
ExecuteStreamCommand[id=d75b0039-9cc0-41d8-b8be-a33a50e68db0] Processor 
Administratively Yielded for 1 sec due to processing failure

config
command arguments = xmh;2;5
command path = iostat
ignore stdin = true
work directory = <not set>
i am feeding it 0 B flow files
original is being auto terminated

> Provide ExecuteStreamCommand option of streaming contents over STDIN of an 
> incoming flowfile
> --------------------------------------------------------------------------------------------
>
>                 Key: NIFI-583
>                 URL: https://issues.apache.org/jira/browse/NIFI-583
>             Project: Apache NiFi
>          Issue Type: Improvement
>    Affects Versions: 0.1.0
>            Reporter: Ricky Saltzer
>            Assignee: Ricky Saltzer
>             Fix For: 0.2.0
>
>         Attachments: NIFI-583.1.patch, NIFI-583.2.patch
>
>
> In some cases it would be really nice to allow a FlowFile to trigger an OS 
> action. For instance, after a daily dump of data is written to an Impala 
> table in HDFS, I would like to execute a refresh on the table via the shell. 
> As it stands, the ExecuteProcess processor will allow a FlowFile in a 
> connection to trigger execution, but unless your connection has an expiration 
> set, the FlowFile will stay there indefinitely. The main issue here is that 
> it will continue to re-execute your ExecuteProcess processor over and over. 
> As far as I know, there's only two clear ways around this. (1) - you can use 
> the ExecuteStreamCommand, instead, but *only* if that command can properly 
> handle STDIN. (2) - you can set your ExecuteProcess processor to execute on a 
> schedule (e.g. 1 per minute) and expire the FlowFile before it can re-execute 
> (e.g. 10 seconds). 
> It would be useful if the ExecuteProcess processor consumed the FlowFile, and 
> passed it through a "passthrough" relationship of some kind. A second option 
> would be to make it configurable (false by default) to drop the FlowFile, or 
> to pass it through a second relationship, that way it doesn't break anyone's 
> current pipelines. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to