How can I pass a flowfile attribute to a controller service?

2018-04-10 Thread Prasad, Rishab
Hi Team, Following are the combination of processors that I am using:- GetFile + SplitText + ExtractText + UpdateAttribute + ExecuteSQL + ConvertAvroToJson + PutFile Basically,I have a properties file which contains 5 comma separated values that are required by the 'DBCPConnectionPool' controlle

How can I pass a flowfile attribute to a controller service?

2018-04-10 Thread Rishab Prasad
Hi Team, Following are the combination of processors that I am using:- GetFile + SplitText + ExtractText + UpdateAttribute + ExecuteSQL + ConvertAvroToJson + PutFile Basically,I have a properties file which contains 5 comma separated values that are required by the 'DBCPConnectionPool' controlle

beginner

2018-04-10 Thread vivek
while working with the line count processer it was not performming the task it is ternsfering the file to the destination can any one help me to do this -- Sent from: http://apache-nifi-developer-list.39713.n7.nabble.com/

Re: beginner

2018-04-10 Thread Mike Thomsen
It adds an attribute to the flowfile called text.count.line for line counts. Thanks, Mike On Tue, Apr 10, 2018 at 10:01 AM, vivek wrote: > while working with the line count processer it was not performming the > task > it is ternsfering the file to the destination can any one help me to do >

Nifi Parallel Execution

2018-04-10 Thread Eric Ulicny
Hello, We have a use case where we execute processors on all nodes but would like to use the detect duplicate processor to ensure records are unique. We are observing that we must run it on one node to truly detect duplicates. Is there any way to merge flowfiles from all running executors? -Eric

Re: Nifi Parallel Execution

2018-04-10 Thread Bryan Bende
Hello, DetectDuplicate uses a DistributedMapCacheClientService which would be connecting to a DistributedMapCacheServer on one of your nodes. So all nodes should be connecting to the same cache server which is where the information about previously seen data is stored. -Bryan On Tue, Apr 10, 20

Re: How can I pass a flowfile attribute to a controller service?

2018-04-10 Thread Andy LoPresto
Hi Rishab, Someone asked a similar question and I answered it on Stack Overflow [1]. The long and short of it is while the DBCPControllerService properties support expression language, they do not have access to flowfile attributes, because the expression language is evaluated on controller ser

Re: How can I pass a flowfile attribute to a controller service?

2018-04-10 Thread Matt Burgess
+1 to Andy's answer. Note that DBCPConnectionPool isn't a connection but a connection pool, which keeps some number of connections available for use by multiple consumers (processors, e.g.). I wouldn't want to have to keep track of X number of configurations in a single controller service, which wo

Re: Signing AWS Elasticsearch Requests?

2018-04-10 Thread Mike Thomsen
The existing processors will not be refactored to use it. I'm writing new ones. On Tue, Apr 10, 2018 at 12:08 AM, Jon Logan wrote: > Thanks, a few notes -- as far as not using AWS ES, we have been having > issues with standard-ES, mainly the lack of encryption and authentication > without the X-