Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Andre
Is anyone having issues running this build? I can build, however, when I try to run the above on commit in on my on a JamaicaVM running on ThreadX but I am getting the following error: org.junit.runners.model.TestTimedOutException: test timed out after 2 milliseconds at java.io.FileI

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Tony Kurc
I'm +1 for this as a release. On Tue, Dec 8, 2015 at 10:32 PM, Aldrin Piri wrote: > Tony, > > With regards to the error, I have seen this on heavily taxed systems. The > Travis jobs I have set up against my fork suffer with these from time to > time, presumably when that service is burdened (or

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Tony Kurc
Regarding my Fedora Core 23 and nifi-framework-core 4th time is a charm. Killed some other processes on the box, test finished in 19 seconds. (Not sure if this is the same as NIFI-1145, which looks very similar) On Tue, Dec 8, 2015 at 10:15 PM, Tony Kurc wrote: > Well, I've run into 2 known bug

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Aldrin Piri
Tony, With regards to the error, I have seen this on heavily taxed systems. The Travis jobs I have set up against my fork suffer with these from time to time, presumably when that service is burdened (or whatever allotment it is that Apache has negotiated with that platform). This pertains to NIF

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Tony Kurc
Well, I've run into 2 known bugs that are environment problems (must have java in path when building and DISPLAY being set with no X server), and a GetHTTP that timed out, but worked on retry.. Ubuntu 14.04 (no issues) built and run with java 1.8 (u65) and java 1.7 (u79) Centos 6.7 (no issues) bui

Re: [UI Bug] delete route of RouteOnAttribute processor

2015-12-08 Thread Aldrin Piri
Bob, The error indicates that there were files in the queue. This is as expected in terms of how connections are handled as these connections are the queues that hold the actual FlowFiles as they progress through their flow. A FlowFIle "passes through" a processor as it moves from one connection

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Tony Kurc
Verified Keys and Hashes. I've got a Fedora 23, CentOS 6.7 and Ubuntu 14.04 (all x86_64) and Windows 10 (64 bit) build all going simultaneously now. Should cover the problem children from last RC. So happy TestJdbcHugeStream is faster. On Tue, Dec 8, 2015 at 8:43 PM, Aldrin Piri wrote: > Foll

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Aldrin Piri
Followed helper provided by Joe. Keys good. Signatures good. Hashes good. Source release builds and passes contrib on both OS X 10.10.5, Oracle Java 1.8.0u60, Maven 3.3.9 & Win 7 Pro, Oracle Java 1.8.0u51, Maven 3.3.3 Required docs present and look correct. Checked out copy of repo for specified c

RE: PutSQL : feature enhancement - PutPropertyToSQL

2015-12-08 Thread Bob ZHao
Oh, wonderful! NIFI will be the golden bridge over the data lake! Date: Fri, 4 Dec 2015 07:07:16 -0700 From: ml-node+s39713n5599...@n7.nabble.com To: bob.zhao.w...@live.com Subject: Re: PutSQL : feature enhancement - PutPropertyToSQL Bob Please don’t feel like your question about Hive

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Bryan Bende
+1 (binding) - ran through joe's helper and all looked good - tested some sample flows and functioned as expected On Tue, Dec 8, 2015 at 5:58 PM, Ricky Saltzer wrote: > +1 > > build works > test works > hashes/keys check out > tested a couple simple workflows > > On Tue, Dec 8, 2015 at 4:57 PM,

[UI Bug] delete route of RouteOnAttribute processor

2015-12-08 Thread Bob ZHao
Hello, I build a working flow for testing. After finish the test, I decide to remove some conditional branches in *RouteOnAttribute* processor, so I just delete some property rows inside the processor. Then when I close the processor window and try to delete the according relations which linked t

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Ricky Saltzer
+1 build works test works hashes/keys check out tested a couple simple workflows On Tue, Dec 8, 2015 at 4:57 PM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Ran through the helper: validated keys, built binaries on Windows and Mac, > ran some templates. > Everything worked as expect

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Joe Percivall
Ran through the helper: validated keys, built binaries on Windows and Mac, ran some templates. Everything worked as expected. +1 Release this package as Apache NiFi 0.4.0. - - - - - - Joseph Percivalllinkedin.com/in/Percivalle: joeperciv...@yahoo.com On Tuesday, December 8, 2015 3:29 PM,

Re: [VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Matthew Burgess
I ran through Joe’s helper procedure: Signatures, digests, etc. look good. Source downloaded and built (with tests successful) and started successfully. Tried importing, instantiating, and running templates. Added, configured, and deleted processors. Looks good to me :) +1 (non-binding) On

Re: Helper for those interested in verifying 0.4.0 rc2

2015-12-08 Thread Joe Witt
All, This helper still applies for RC2. Thanks Joe On Sun, Dec 6, 2015 at 11:14 PM, Joe Percivall wrote: > I actually had a problem unzipping this package on Windows. I tried unzipping > in my Downloads folder and it gave me a "Path Too Long" error. Both the > built-in Windows extractor and W

[VOTE] Release Apache NiFi 0.4.0 (rc2)

2015-12-08 Thread Joe Witt
Hello NiFi Community, I am pleased to be calling this vote for the source release of Apache NiFi 0.4.0. The source zip, including signatures, digests, and associated convenience binaries can be found at https://dist.apache.org/repos/dist/dev/nifi/nifi-0.4.0/ The staged maven artifacts of the b

Re: nifi fails build on CentOS 7

2015-12-08 Thread Joe Witt
Jeff, Please be sure you're on latest master and manually delete those target dirs (as root) once more. I had a bug in that test last night. But it should now be fixed. the issue was that it made a file, changed its perms to be something we cannot delete, then moves on. Second pass, it will fail

Re: nifi fails build on CentOS 7

2015-12-08 Thread Jeff
I created a nifi user on my VM, moved the /root/nifi folder to / and changed the owner of /nifi to nifi:nifi recursively I executed mvn -e -X -T 2.0C clean install as the nifi user Below is the error; Downloaded: https://repo1.maven.org/maven2/com/yammer/metrics/metrics-ganglia/2.2.0/metrics-g

Re: Facing Issue while connecting with HDFS

2015-12-08 Thread Bryan Bende
Hello, The directory property should only need the path in HDFS. The other stuff like the file system, host, and port would be determined from the provided configuration files. Do you receive any different response if you set the directory to just "/root" (or some other path)? If you still recei

Facing Issue while connecting with HDFS

2015-12-08 Thread digvijayp
Hi Team, I have been exploring NiFi for couple of days now. NiFi is running on a machine which is not a part of Hadoop cluster. I want to put files into HDFS (On my machine I have configured the hortonworks sandbox by using virtual machine ). As to writ into HDFS I have created the process PUTH

Re: At what stage data become's NiFi's "problem"

2015-12-08 Thread Aldrin Piri
I think Joe's perspective maps more closely to what Andre was searching for in terms of a knowing when a consumer can be notified/guaranteed of successful handoff of data in the overall flow process. Primarily, the key factor is that this mechanism provides at least once delivery in that the unit o

Re: At what stage data become's NiFi's "problem"

2015-12-08 Thread Oleg Zhurakousky
At the high level we try not to copy anything unless we have to, so when you say “under NiFi care” it becomes a bit unclear. For example, one may be copying a file using zero-copy algorithm. Let’s assume that NiFi was the facilitator of that process. With that said, the data is/was never under N

Re: At what stage data become's NiFi's "problem"

2015-12-08 Thread Joe Witt
Andre, Excellent. Glad to hear you're making progress. NiFi is said to be under control of data once a FlowFile with its content has been generated in a ProcessSession and that session has been committed. A more detailed overview of this part of the process is here https://nifi.apache.org/docs/

At what stage data become's NiFi's "problem"

2015-12-08 Thread Andre
All, Still working on the lumberjack processor. Data is currently being decoded, SSL is sort of working but before I start wrapping up I wanted to confirm: Lumberjack is a protocol that includes the dispatch of an acknowledgement message to the producing agent. As consequence, usually a producer