FetchS3Object processor

Nifi users - FetchS3Object processor do not have option to specify Object file path, how do you set that ? Eg : s3: Thanks, -Chakri The information contained in this transmission may contain privileged and confidential information. It is intended only for t

Re: Need help in nifi- flume processor

Hello Bryan, Thank you very much for your response. Is it possible to have customized flume source and sink in Nifi? I have my own customized source and sink? I followed below steps to add my own customized source but it did not work. 1) Created Maven project and added customized source. (flume.

Re: Nifi 0.3.0 on java-1.8.0 (S3 processor error)

Downgraded to java 7u80 and s3 processor works. Thanks, -Chakri From: Chakrader Dewaragatla mailto:chakrader.dewaraga...@lifelock.com>> Date: Wednesday, October 7, 2015 at 5:46 PM To: "users@nifi.apache.org" mailto:users@nifi.apache.org>> Subject: Re: Nifi 0.3.0 on

Re: Nifi 0.3.0 on java-1.8.0 (S3 processor error)

Mark – Yes, I have the right date/time with ntp client configured. Thanks, -Chakri From: Mark Payne mailto:marka...@hotmail.com>> Reply-To: "users@nifi.apache.org" mailto:users@nifi.apache.org>> Date: Wednesday, October 7, 2015 at 5:34 PM To: "users@nifi.apache.org<

Re: Nifi 0.3.0 on java-1.8.0 (S3 processor error)

Chakri, Can you check that your system's date/time is accurate? I have not tried this with S3, but I know that Twitter sends back a pretty similar response when we use GetTwitter on a node that has the wrong date/time. It has to do with the authentication protocol that is used requiring an accu

Nifi 0.3.0 on java-1.8.0 (S3 processor error)

Any one notice Nifi S3 processor broken with latest java version ? (java-1.8.0-openjdk-1.8.0.60-14.b27) S3 put error: 2015-10-08 00:28:30,745 ERROR [Timer-Driven Process Thread-6] o.a.nifi.processors.aws.s3.PutS3Object PutS3Object[id=1c0f0c5c-cbb9-4ed9-891c-0bd48ae69366] Failed to put Standa

Re: Nifi cluster features - Questions

Chakri, Correct - when NiFi instances are clustered, they do not transfer data between the nodes. This is very different than you might expect from something like Storm or Spark, as the key goals and design are quite different. We have discussed providing the ability to allow the user to indicat

Re: Nifi cluster features - Questions

Mark - Thanks for the notes. >> The other option would be to have a ListenHTTP processor run on Primary Node >> only and then use Site-to-Site to distribute the data to other nodes. Lets say I have 5 node cluster and ListenHTTP processor on Primary node, collected data on primary node is not tra

Re: Nifi cluster features - Questions

Hello Chakro, When you create a cluster of NiFi instances, each node in the cluster is acting independently and in exactly the same way. I.e., if you have 5 nodes, all 5 nodes will run exactly the same flow. However, they will be pulling in different data and therefore operating on different dat

Re: Need help in nifi- flume processor

Hello, The NiFi Flume processors are for running Flume sources and sinks with in NiFi. They don't communicate with an external Flume process. In your example you would need an ExecuteFlumeSource configured to run the netcat source, connected to a ExecuteFlumeSink configured with the logger. -Bry