Re: [VOTE] Release Apache NiFi 0.6.1 (RC2)

2016-04-14 Thread Tony Kurc
+1 (binding) built on Windows 10 with Java 7 without issue. Verification was successful On Apr 14, 2016 5:17 PM, "Matt Gilman" wrote: +1 (binding) Build, hashes, signatures, etc all check out. Ran application standalone/cluster in secure/unsecured mode and everything

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-14 Thread Oleg Zhurakousky
Thanks Chris Indeed let us know if/when/how to reproduce it so we can evaluate and see if it is something we can validate/handle in NiFi before it is passed to Kafka (e.g., validation etc) Cheers Oleg > On Apr 14, 2016, at 8:25 PM, McDermott, Chris Kevin (MSDU - > STaTS/StorefrontRemote)

RE: GetKafka blowing up with assertion error in Kafka client code

2016-04-14 Thread McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
I looked at the Kafka client code and it seemed to me to be a bug in the caller. There is a map passed that maps topics to number of consumers. In this case it asserting that the number of consumers is greater than zero. If I can repro the problem I'll try to isolate it in the debugger and

[GitHub] nifi-minifi pull request: MINIFI-15 Created a config file format w...

2016-04-14 Thread JPercivall
Github user JPercivall commented on a diff in the pull request: https://github.com/apache/nifi-minifi/pull/8#discussion_r59806518 --- Diff: minifi-bootstrap/src/main/java/org/apache/nifi/minifi/bootstrap/util/ConfigTransformer.java --- @@ -0,0 +1,571 @@ +/* + * Licensed

[GitHub] nifi-minifi pull request: MINIFI-12 initial commit of http config ...

2016-04-14 Thread JPercivall
GitHub user JPercivall opened a pull request: https://github.com/apache/nifi-minifi/pull/9 MINIFI-12 initial commit of http config change notifier You can merge this pull request into a Git repository by running: $ git pull https://github.com/JPercivall/nifi-minifi MINIFI-12

Re: [VOTE] Release Apache NiFi 0.6.1 (RC2)

2016-04-14 Thread Matt Gilman
+1 (binding) Build, hashes, signatures, etc all check out. Ran application standalone/cluster in secure/unsecured mode and everything functioned as expected. Matt On Thu, Apr 14, 2016 at 2:35 PM, Joe Skora wrote: > +1 (non-binding) > > * signature and hashes verify > * built

[GitHub] nifi pull request: NIFI-361 - Create Processors to mutate JSON dat...

2016-04-14 Thread YolandaMDavis
GitHub user YolandaMDavis opened a pull request: https://github.com/apache/nifi/pull/354 NIFI-361 - Create Processors to mutate JSON data This is an initial implementation of the TransformJSON processor using the Jolt library. TransformJSON supports Jolt specifications for the

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-14 Thread Joe Witt
As with any system to system interaction things can happen. All systems, including Kafka provide facilities to allow systems writing to or consuming from it, to recover from failure cases. So let's just focus on what the config/environment is and do our best to provide ways to work past these

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-14 Thread Oleg Zhurakousky
Chris That is correct and for a change I am pretty happy to see this stack trace as it clearly shows the problem and validates the approach we have. So here are more details. . . The root failure is in Kafka (as you can see from the stack trace). All we are doing is encapsulating interaction

GetKafka blowing up with assertion error in Kafka client code

2016-04-14 Thread McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
I’m running based of of 0.7.0 Snapshot. The GetKafka config is pretty generic. Batch size 1, 1 concurrent task. 2016-04-14 19:27:23,204 ERROR [Timer-Driven Process Thread-9] o.apache.nifi.processors.kafka.GetKafka java.lang.IllegalStateException: java.util.concurrent.ExecutionException:

Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

2016-04-14 Thread McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)
I’m seeing this a lot in my logs. Does anyone have any idea what it is about? The cluster view in the UI shows all nodes connected. 2016-04-14 19:45:29,310 INFO [Framework Task Thread Thread-2-SendThread(localhost:2181)] org.apache.zookeeper.ClientCnxn Opening socket connection to server

Re: Multiple nar/custom processors: advisable directory structure

2016-04-14 Thread Oleg Zhurakousky
Unfortunately I’ll answer the question with the question ;) Is the additional processor related to the previous one? For example we have a single bundle with more then one processor (e.g., Get/PutSomething). If so then you can create another Processor in the same bundle (NAR). If it is not then

[GitHub] nifi pull request: [NIFI-1761] Initial AngularJS application boots...

2016-04-14 Thread scottyaslan
Github user scottyaslan commented on a diff in the pull request: https://github.com/apache/nifi/pull/331#discussion_r59753289 --- Diff: nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/pom.xml --- @@ -628,8 +634,13 @@

Re: Multiple nar/custom processors: advisable directory structure

2016-04-14 Thread Russell Bateman
Welcome Idioma... 1) You'll want to subsume your new processors under deeper Java packages (you probably knew that). 2) In addition to the Java code, you'll add: -src -main - resources - META-INF - services - org.apache.nifi.processor.Processor containing a list

Re: [VOTE] Incorporate SHA256 part of release process

2016-04-14 Thread Michael Moser
+1 from me, too. On Thu, Apr 14, 2016 at 12:12 PM, Pierre Villard < pierre.villard...@gmail.com> wrote: > +1 > > Pierre > > 2016-04-14 14:24 GMT+02:00 Joe Percivall : > > > +1 > > - - - - - - Joseph Percivalllinkedin.com/in/Percivalle: > >

Multiple nar/custom processors: advisable directory structure

2016-04-14 Thread idioma
Hi, currently, I have one custom processor + test in a similar folder structure in my IDE (IntelliJ): -CustomProcessors -nifi-myprocessor-nar -nifi-myprocessor -src -main -java MyProcessor.java -test -MyProcessorTest.java I am

Re: [VOTE] Incorporate SHA256 part of release process

2016-04-14 Thread Pierre Villard
+1 Pierre 2016-04-14 14:24 GMT+02:00 Joe Percivall : > +1 > - - - - - - Joseph Percivalllinkedin.com/in/Percivalle: > joeperciv...@yahoo.com > > > On Thursday, April 14, 2016 7:55 AM, Joe Skora > wrote: > > > +1 for SHA256 > > Whatever

[GitHub] nifi pull request: NIFI-1762: Use Lambda Expressions in StandardNi...

2016-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/nifi/pull/352 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Interested to be a part of this list.

2016-04-14 Thread Joe Witt
Hello If you go to this link https://nifi.apache.org/mailing_lists.html you can then click on the 'subscribe' link for the mailing lists you'd like to join and then send the email. That registers you. You are able to register and unregister yourself. Hope that helps Thanks Joe On Thu, Apr

Interested to be a part of this list.

2016-04-14 Thread Balaji K Hari
Regards, ___ [Email_CBE.gif]Balaji KNV_Hari Technical Architect This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom

[GitHub] nifi pull request: NIFI-1762: Use Lambda Expressions in StandardNi...

2016-04-14 Thread mcgilman
Github user mcgilman commented on the pull request: https://github.com/apache/nifi/pull/352#issuecomment-209967571 Reviewing... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] nifi pull request: NIFI-361 - Create Processors to mutate JSON dat...

2016-04-14 Thread YolandaMDavis
Github user YolandaMDavis closed the pull request at: https://github.com/apache/nifi/pull/353 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: Clarifications/Suggestions on Using NIFI.

2016-04-14 Thread Joe Witt
Hello You received a near immediate response which you can find here [1]. But since you are not subscribed to the mailing list you did not receive the response. Please subscribe here [2]. [1]

Re: Clarifications/Suggestions on Using NIFI.

2016-04-14 Thread Joe Witt
On Thu, Apr 14, 2016 at 10:09 AM, Joe Witt wrote: > Hello > > You received a near immediate response which you can find here [1]. But > since you are not subscribed to the mailing list you did not receive the > response. Please subscribe here [2]. > > [1] >

[GitHub] nifi pull request: [NIFI-1761] Initial AngularJS application boots...

2016-04-14 Thread mcgilman
Github user mcgilman commented on the pull request: https://github.com/apache/nifi/pull/331#issuecomment-209961026 Ensure breadcrumb placement is correct when bottom banner is visible. --- If your project is set up for it, you can reply to this email and have your reply appear on

RE: Clarifications/Suggestions on Using NIFI.

2016-04-14 Thread Balaji K Hari
Hi Dev Team, Good Morning!! I hope you are trying hard by taking time from your busy schedule to provide the inputs for the below questions. It would be really helpful, if you can answer these at earliest as based on this we want to try with other options to achieve the functionalities as per

Re: catch commit error in OnTrigger to diversify session behaviour

2016-04-14 Thread Russell Bateman
Oleg, Agreed. As I started only a few months ago, I have been using AtomicReference and it has been reliable and satisfied all my needs. (Just sayin'.) Best On 04/14/2016 05:22 AM, Oleg Zhurakousky wrote: A bit unrelated, but how do you guys feel if we deprecate ObjectHolder so it could

[GitHub] nifi pull request: NIFI-361 - Create Processors to mutate JSON dat...

2016-04-14 Thread YolandaMDavis
GitHub user YolandaMDavis opened a pull request: https://github.com/apache/nifi/pull/353 NIFI-361 - Create Processors to mutate JSON data This is an initial implementation of the TransformJSON processor using the Jolt library. TransformJSON supports Jolt specifications for the

[GitHub] nifi pull request: [NIFI-1761] Initial AngularJS application boots...

2016-04-14 Thread mcgilman
Github user mcgilman commented on a diff in the pull request: https://github.com/apache/nifi/pull/331#discussion_r59717798 --- Diff: nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/pom.xml --- @@ -628,8 +634,13 @@

[GitHub] nifi pull request: NIFI-1771 deprecated ObjectHolder

2016-04-14 Thread olegz
GitHub user olegz opened a pull request: https://github.com/apache/nifi/pull/351 NIFI-1771 deprecated ObjectHolder You can merge this pull request into a Git repository by running: $ git pull https://github.com/olegz/nifi NIFI-1771 Alternatively you can review and apply

Re: [VOTE] Release Apache NiFi 0.6.1 (RC2)

2016-04-14 Thread Joe Percivall
+1 (non-binding) Went through helper to verify build. Also verified the zip using the SHA-512 that Joe linked in the second helper email. Ran a contrib check build on Windows 8 and OSX. Tested a couple templates as well. - - - - - - Joseph Percivall linkedin.com/in/Percivall e:

Re: catch commit error in OnTrigger to diversify session behaviour

2016-04-14 Thread Oleg Zhurakousky
Idioma Keep an eye on this https://issues.apache.org/jira/browse/NIFI-1771 and consider using java.util.concurrent.atomic.AtomicReference Cheers Oleg On Apr 14, 2016, at 7:01 AM, idioma > wrote: Bryan, thank you so much, this is

[GitHub] nifi pull request: NIFI-1764 fixed NPE in PutKafka

2016-04-14 Thread olegz
GitHub user olegz opened a pull request: https://github.com/apache/nifi/pull/350 NIFI-1764 fixed NPE in PutKafka NIFI-1764 removed obsolete comment for MESSAGE_DELIMITER You can merge this pull request into a Git repository by running: $ git pull https://github.com/olegz/nifi

Re: [VOTE] Incorporate SHA256 part of release process

2016-04-14 Thread Joe Percivall
+1  - - - - - - Joseph Percivalllinkedin.com/in/Percivalle: joeperciv...@yahoo.com On Thursday, April 14, 2016 7:55 AM, Joe Skora wrote: +1 for SHA256 Whatever process produces the checksums it would be nice if the checksum files could be made compatible with the

Re: [VOTE] Incorporate SHA256 part of release process

2016-04-14 Thread Joe Skora
+1 for SHA256 Whatever process produces the checksums it would be nice if the checksum files could be made compatible with the "--check" option on the md5sum, sha1sum, and sha256sum commands to simplify validation. That format is "". With the checksum in that format, running "md5sum --check

Re: catch commit error in OnTrigger to diversify session behaviour

2016-04-14 Thread Oleg Zhurakousky
A bit unrelated, but how do you guys feel if we deprecate ObjectHolder so it could be gone by 1.0? AtomicReference is available from Java 5 Cheers Oleg > On Apr 14, 2016, at 5:18 AM, Bryan Bende wrote: > > Hello, > > It may be easier to move the load() out of the

Re: Compression of Data in HDFS

2016-04-14 Thread jamesgreen
Hi Bryan Thanks for your input, I did get it to work now. Sorry for the delayed response Just to confirm if it reads from a certain file and compresses and writes the compressed file to the Target Directory - how does nifi know that its has read from a certain file already? Or does it continue

Re: catch commit error in OnTrigger to diversify session behaviour

2016-04-14 Thread idioma
Matt, thanks for your reply, but I am not sure I have actually understood what you mean. In my load method I have the following: try{ transaction.commit(); }catch (TitanException ex) { System.out.println("This is a failure message"); transaction.rollback(); } How are you