Re: Recommendation on getting started as a contibutor

2015-10-26 Thread Oleg Zhurakousky
Mark Yes there are a lot of projects since aside form core modules there are out-of-the-box NAR bundles and other supporting modules, and everything is a separate project. So, when importing you can chose to have a view into the entire NiFi or individual modules you interested in working on

Re: Recommendation on getting started as a contibutor

2015-10-27 Thread Oleg Zhurakousky
ilto:markpetro...@gmail.com>> wrote: On Mon, Oct 26, 2015 at 5:06 AM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: nifi-ide-integration Oleg, thanks for the nifi-ide-integration github. I was able to get up and running in the debugger in Ecli

Re: Recommendation on getting started as a contibutor

2015-10-27 Thread Oleg Zhurakousky
Also, validate that src/main/resources is one of the source directories, so log4j.properties is pulled into the startup class path. I was just able to reproduce your exact error by disassociating it from the class path. On Oct 27, 2015, at 6:51 AM, Oleg Zhurakousky <ozhura

Re: Recommendation on getting started as a contibutor

2015-10-27 Thread Oleg Zhurakousky
2015 at 6:55 AM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> I was just able to reproduce your exact error by disassociating it from the >> class path > > Oleg, thanks for the response. > > 1. I verified that my working directory is correct and po

Re: Recommendation on getting started as a contibutor

2015-10-27 Thread Oleg Zhurakousky
s is definitely configured to org.apache.nifi.NiFi per > instructions. That's what I see in the sample command lines I sent > you, too. Curious, what makes you think that was misconfigured? > > On Tue, Oct 27, 2015 at 8:52 AM, Oleg Zhurakousky > <ozhurakou...@hortonworks

Re: Configuration Driven Property Updates

2015-10-22 Thread Oleg Zhurakousky
I think the real issue is the treatment of Processor’s properties in general. In the currently discussed approach one of the discovered modules is itself a property of a Processor. On top of that a selected module's “property” presents a list of its own properties. IMHO the better way of

Re: fixing line endings

2015-11-09 Thread Oleg Zhurakousky
Agreed Sent from my iPhone > On Nov 9, 2015, at 20:38, Joe Witt wrote: > > I am strongly in favor of this. There is never a good time to do such > things and this time is as good as it gets. > > Thanks > Joe > >> On Mon, Nov 9, 2015 at 8:25 PM, Tony Kurc

Re: Master Branch Tests Failing on Windows

2015-11-11 Thread Oleg Zhurakousky
Joe, I’ll play the guilty one. This tests was @Ignored until https://issues.apache.org/jira/browse/NIFI-1124 (today i think) I can probably get a Windows VM going (so I can look) but would hope I don’t have to. Let me know if you dig something up otherwise I’ll look. Oleg On Nov 11, 2015, at

Re: Common scheduler and add-hock thread creation

2015-11-16 Thread Oleg Zhurakousky
somewhere about LinkedBlockingQueues > used in so many producer/consumer style processors and possibly needing a > library to have some consistency in using those queues in a consistent > thread safe manner. > > Also, I'm not quite sure of what you mean by taking liberties? >

Re: Master Branch Tests Failing on Windows

2015-11-11 Thread Oleg Zhurakousky
Joe I am gonna go out on the limb here, but do you think it may have something to do with forward slashes “target/test-classes”? Perhaps we may need to start using File.separator? Oleg On Nov 11, 2015, at 8:41 PM, Joe Percivall

Re: NiFI Custom Plugin - Yield Duration Ignored

2015-11-17 Thread Oleg Zhurakousky
gt; wrote: > > I appreciate the use of patterns, but given that non-devs will often be > interepeting these types of issues, I think the name is a miss in > recognizability. Regardless, we can and should do better about clarifying > the language in the logs and docs. > > On Tue,

Re: NiFI Custom Plugin - Yield Duration Ignored

2015-11-17 Thread Oleg Zhurakousky
Perhaps we may need to start explaining ‘administrative yield” as Circuit Breaker because that ’s what it is from known pattern perspective Question to DEV; Should we consider going as far as deprecating the name and incorporating CB in it somehow? That would definitely help to avoid the

Re: Next release?

2015-11-03 Thread Oleg Zhurakousky
May I suggest something that works so well in multitude of projects - one must never merge its own PR, essentially ensuring that there is a consensus Sent from my iPhone > On Nov 3, 2015, at 09:00, Joe Witt wrote: > > Ricky, > > Might I remind you, Sir, that you have the

Re: "External" extensions

2015-11-01 Thread Oleg Zhurakousky
ail.com> wrote: >>>> >>>> " but raises several questions, all pertaining to the relationship of >>>> this project with ASF, its ownership and control." >>>> >>>> ...that is what I'm struggling to respond to as well. >&

Re: Connecting to Oracle Database

2015-11-05 Thread Oleg Zhurakousky
I can’t seem to see the image or whatever you have attached. Would you be able to describe what is the problem you are facing? Also, u...@nifi.apache.org seems to be a more appropriate list for this question. Cheers Oleg On Nov 4, 2015, at 5:01 PM, Sathyan

Re: Newbie Dev Contribution : Questions

2015-10-20 Thread Oleg Zhurakousky
I was thinking the contributor guide, but anywhere we can add a URL to > is fine by me. :) > > On Tue, Oct 20, 2015 at 2:40 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Sure, although I am not sure how it would manifest itself since this is >> simply

Re: Newbie Dev Contribution : Questions

2015-10-20 Thread Oleg Zhurakousky
Sure, although I am not sure how it would manifest itself since this is simply a set of instructions which could go to docs/wiki etc. Is that what you meant? Cheers Oleg > On Oct 20, 2015, at 3:20 PM, Sean Busbey wrote: > > Oleg, > > Could we convince you to contribute a

Re: Ingest Original data from External system by data's dependent condition

2015-10-13 Thread Oleg Zhurakousky
You can simply have another relationship from GetKafka to MergeContent essentially allowing MergeContent to have the original message so it could be merged. See attached image for example: Oleg [cid:1F6F4F5A-85C9-4809-AECD-645E4F5054D3] On Oct 13, 2015, at 5:22 AM, yejug

Re: Ingest Original data from External system by data's dependent condition

2015-10-13 Thread Oleg Zhurakousky
Great points Joe! One point I want to add to the discussion. . . As I am still learning the internals of the NiFi, the use case at the core of this thread is actually a very common EIP problem and while Aggregator (Merger) receiving from multiple inbound sources is one approach, it is not the

Re: Can we get consensus on. .

2015-11-18 Thread Oleg Zhurakousky
t; Oleg >> >> How about you keep it in github for now. We can make a page or section on >> the website that points to community supported utilities that helps folks >> get underway? >> >> Anyone else see it differently? >> >> Thanks >> Joe >&g

Re: At what stage data become's NiFi's "problem"

2015-12-08 Thread Oleg Zhurakousky
At the high level we try not to copy anything unless we have to, so when you say “under NiFi care” it becomes a bit unclear. For example, one may be copying a file using zero-copy algorithm. Let’s assume that NiFi was the facilitator of that process. With that said, the data is/was never under

Re: [GitHub] nifi pull request: NIFI-1218 upgraded Kafka to 0.9.0.0 client API

2015-12-16 Thread Oleg Zhurakousky
com/apache/nifi/pull/143.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #143 commit 10cbc92873784a4a3871ae6937b8a43ac3e0abe8 Author: Oleg Zhurakousky <o...@suitcase.io<mailto:o...@suitcase

Re: discuss nifi 0.4.1

2015-12-17 Thread Oleg Zhurakousky
I think we want to exclude new features and make it a true maintenance release, so only bugs should go into 0.4.1 > On Dec 17, 2015, at 6:17 PM, Matt Gilman wrote: > > Are there some commits on master that we don't want included in 0.4.1? If > not, wouldn't we

Re: about the debug of nifi

2016-01-09 Thread Oleg Zhurakousky
Did you go through the last step in the README of identifying ‘main’? There are no sources since what you are running is ‘org.apache.nifi.NiFi’. Cheers Oleg On Jan 5, 2016, at 1:51 AM, 522250...@qq.com wrote: i want to debug nifi ,and i find the guidence in wiki.Then

Re: Groovy unit tests

2016-01-09 Thread Oleg Zhurakousky
Big +1 Sent from my iPhone On Jan 4, 2016, at 18:30, Andy LoPresto > wrote: I am considering writing unit tests in for new development/regression testing in Groovy. There are numerous advantages to this [1][2] (such as map

Re: Testing processor logging message in Junit tests

2016-01-09 Thread Oleg Zhurakousky
Are you looking for something similar to this: http://stackoverflow.com/questions/1827677/how-to-do-a-junit-assert-on-a-message-in-a-logger Sent from my iPhone On Jan 9, 2016, at 09:06, DAVID SMITH > wrote: Hi Does anyone know how to

Re: nfii-integration-tests

2015-12-21 Thread Oleg Zhurakousky
Joe Witt <joe.w...@gmail.com> wrote: > > profile activated i hope :-) > > Right under nifi seems fine to me. > > Thanks > Joe > > On Mon, Dec 21, 2015 at 3:22 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Not on github yet. Basica

Re: nfii-integration-tests

2015-12-21 Thread Oleg Zhurakousky
d if long let's > support profile activation'? > > On Mon, Dec 21, 2015 at 3:34 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Cool, I may need some help with maven, but I’ll push a PR when ready. >> Also, I don’t see these unit tests any different then

nfii-integration-tests

2015-12-21 Thread Oleg Zhurakousky
Guys I’ve created a module called nfii-integration-tests. The goal of this module is to facilitate unit testing of things that required collaboration between the modules (e.g., site-to-site) as well as discover potential improvements that could be made to the code base (e.g., NIFI-1318). It

Re: Processor name and type

2015-12-26 Thread Oleg Zhurakousky
Muddy I am not sure I understand the question, since you have all the info about the processor when you implement its onTrigger method. Oleg > On Dec 26, 2015, at 2:59 AM, Jagannathrao Mudda > wrote: > > Hi, > > How do I get processor name and the type in

Re: Testing handling of static class methods

2015-12-18 Thread Oleg Zhurakousky
Personally I am with Joe on this one Exposing visibility on the method just for testing is very dangerous as it breaks encapsulation. There are different expectations and consideration on things that are made private, protected and public. Yes, all of that is meaningless when one uses

Re: Processor name and type

2015-12-27 Thread Oleg Zhurakousky
ce CarProcessor with different name) > > Thanks > Mudda > > > On 12/27/15, 1:20 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> > wrote: > >> Mudda >> >> I think what Matt is saying is that you can simply use additional >> pro

Re: discuss nifi 0.4.1

2015-12-19 Thread Oleg Zhurakousky
;> for users so best to eliminate them. And big thanks to Matt Clarke >>>> for finding and reporting them! >>>> >>>> Gonna prep an RC. >>>> >>>> Thanks >>>> Joe >>>> >>>>> On Thu, Dec 17, 2015 at

Re: AWS processor changes - assist with "design review"

2015-12-29 Thread Oleg Zhurakousky
I can't say I've done my due diligence on this one (not yet), but the idea of using ControllerService for these type of things is becoming more and more reasonable. I am actually thinking about using the same approach for bringing different JMS providers, Hadoop libraries and other things

TestSuccess.jar

2015-11-24 Thread Oleg Zhurakousky
Tony I may have (accidentally) found what you were looking for. Somehow I can’t find the original email thread, but it was about something along the lines of who/where/how generated JAR for this: 'File exJar = new File("src/test/resources/ExecuteCommand/TestSuccess.jar");’ Well, here it is

Re: 2 questions, one on style, one on NOTICE for NIFI-1081

2015-11-18 Thread Oleg Zhurakousky
+1 for spelling it out. Those acronyms may save one from typing, but introduce more confusion. With modern IDE long names is no longer a problem. Sent from my iPhone > On Nov 18, 2015, at 18:40, Joe Percivall > wrote: > > Hey Tony, > > Regarding BAOS vs

Re: Direction for Integration Tests

2016-01-13 Thread Oleg Zhurakousky
Aldrin IMHO there are two types of integration testing; 1. Integration testing a Processor/ControllerService with the actual target system, 2. Integration testing of the flow or part of the flow. The second one essentially is the same as the first one but the target system is being NiFi itself

Re: [DISCUSS] - Markdown option for documentation artifacts

2016-06-07 Thread Oleg Zhurakousky
Personally I am ok either way, however the question I have is consistency and how different artifacts written via html will be different (look-and-feel) from the once created using mark up and then transformed. Oleg > On Jun 7, 2016, at 2:28 PM, Bryan Rosander wrote:

Re: unwedgeable flow caused by "Cannot create Provenance Event Record because FlowFile UUID is not set"

2016-06-14 Thread Oleg Zhurakousky
> Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > https://www.storefrontremote.com > > On 6/13/16, 3:10 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.co

Re: unwedgeable flow caused by "Cannot create Provenance Event Record because FlowFile UUID is not set"

2016-06-13 Thread Oleg Zhurakousky
Chris The fact that your flow is hosed means this is a bug. IMHO corrupted FlowFile should not render NiFi unavailable. So please raise the JIRA. Also, i think the real question here is not how the FF got corrupted but the fact that corrupted FF rendered NIFI unavailable and that is the core

Re: Apache NiFi 0.7.0 Release date ?

2016-06-13 Thread Oleg Zhurakousky
Unfortunately I just raised another relatively trivial JIRA which affects 0.7, but I should have it ready by tomorrow. Otherwise I am +1 to get 0.7 out asap Sent from my iPhone > On Jun 13, 2016, at 16:47, Joe Percivall > wrote: > > Looks like time to start

Re: Nifi Java 1.7 support

2016-05-31 Thread Oleg Zhurakousky
Yes, that would be with NIFI 1.0.0 Cheers Oleg > On May 31, 2016, at 4:51 PM, M Singh wrote: > > Hi Folks: > > Just wanted to find out if there is a timeline when Nifi will sunset support > for JDK 1.7. > Thanks > Mans

Re: [DISCUSS] Apache NiFi 0.7.0 and 1.0.0

2016-06-01 Thread Oleg Zhurakousky
>>>> >>>>>>> >>>>>>> On Tue, May 17, 2016 at 6:04 PM, Joe Witt <joe.w...@gmail.com> >>> wrote: >>>>>>> >>>>>>> I believe that is right Andy. The support guide articulates that we >&g

Re: [DISCUSS] Closing in on the Apache NiFi 0.7.0 Release

2016-06-17 Thread Oleg Zhurakousky
) but unless if they are critical I am not going > to hold up the release for them. > > The current status for those tagged as 0.7.0: > > - "Processors could be started before the Controller Services that they > depend on" NIFI-2032[1] [status] Critical bug that was a

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
Chris Given that we are deprecating Get/PutJMS* in favor of Publish/SubscribeJMS, I’d suggest start using those once. Cheers Oleg > On Jun 16, 2016, at 1:34 PM, McDermott, Chris Kevin (MSDU - > STaTS/StorefrontRemote) wrote: > > Folks, > > I’ve been trying to

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
S/StoreFront Remote HPE Storage Hewlett Packard Enterprise Mobile: +1 978-697-5315 https://www.storefrontremote.com On 6/16/16, 2:53 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: Yes, you can probably look at the test case for it since it uses embedded AMQP. Let

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
c bug? > > On Thu, Jun 16, 2016 at 3:13 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Chris >> >> That is correct. >> The idea was to make sure that we can support multiple clients and multiple >> vendors since Get/Put only supporte

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
> Thanks, > > Chris McDermott > > Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > https://www.storefrontremote.com > > On 6/16/16, 1:43 PM, "Oleg Zhurakousky" <ozh

Re: Component documentation improvements

2016-01-18 Thread Oleg Zhurakousky
for multiple languages? > > Joshua Davis > Senior Consultant > Hortonworks Professional Services > (407)476-6752 > > > > > > > On 1/18/16, 12:09 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> > wrote: > >> Guy

Re: Component documentation improvements

2016-01-18 Thread Oleg Zhurakousky
> I will comment on the Wiki page for the substance of this particular > proposal (documentation generation). > > Joe > > On Mon, Jan 18, 2016 at 1:22 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Josh >> >> FWIW, let’s use WIKI comm

Extension Registry

2016-01-18 Thread Oleg Zhurakousky
All I have just published initial set of updates to the Extension Registry page on the wiki - https://cwiki.apache.org/confluence/display/NIFI/Extension+Registry The initial work was started by Bryan Bende a while back and I hope I’ve managed to incorporate all of his points where relevant.

Re: [GitHub] nifi pull request: NIFI-865 added initial support for AMQP publish...

2016-02-06 Thread Oleg Zhurakousky
David Thank you so much for reaching out. The reason why I am using RabbitMQ client library is because I am familiar with it, but as you aware AMQP is a protocol-based specification therefore it doesn’t mater which client library is used as long as they are compliant with the protocol version

Re: [GitHub] nifi pull request: NIFI-865 added initial support for AMQP publish...

2016-02-06 Thread Oleg Zhurakousky
I hate spell checker. The last sentence in previous response should read compliant instead of compliment. Sent from my iPhone > On Feb 6, 2016, at 17:46, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > David > > Thank you so much for reaching out. >

Re: Nifi jobs support Mesos ?

2016-02-01 Thread Oleg Zhurakousky
Timothy In short it’s very possible. I personally haven’t done that, but I have written some custom code submitting jobs to YARN which I am assuming would be very similar. Would be happy and actually interested to take it a bit further. Could you elaborate on the use case a bit more? For

Re: Issue in Custom Processor in 0.4.1 version

2016-02-22 Thread Oleg Zhurakousky
Could you please look at the logs and post any exceptions you see there? Sent from my iPhone > On Feb 22, 2016, at 06:57, Venkat Sgk wrote: > > Hi Team, > > We are using apache Nifi 0.4.1 and trying to write custom processor to > convert CSV to avro. > when modifying

Re: OnStopped annotation

2016-02-28 Thread Oleg Zhurakousky
Pierre Can you paste the method definition? Just want to look at the signature and see if there is something obvious Sent from my iPhone > On Feb 28, 2016, at 10:26, Pierre Villard wrote: > > Hi, > > I am working on SNMP processors [1] and I'm almost ready for a

Re: OnStopped annotation

2016-02-28 Thread Oleg Zhurakousky
NiFi minus UI. Here is an example: https://github.com/apache/nifi/pull/210/files#diff-7be646c38c5447f7824e444343633829R92 Cheers Oleg On Feb 28, 2016, at 11:07 AM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: Pierre Can you past

Re: OnStopped annotation

2016-02-29 Thread Oleg Zhurakousky
d. > I correctly go through quietlyInvokeMethodsWithAnnotations() in > ReflectionUtils but since the method is not seen as annotated, the close > method is not called. > > Thanks, > Pierre > > 2016-02-28 22:24 GMT+01:00 Oleg Zhurakousky <ozhurakou...@hortonworks.com&g

Re: OnStopped annotation

2016-02-29 Thread Oleg Zhurakousky
I meant could you share the test code (via github) > On Feb 29, 2016, at 12:18 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > Ok, so you are invoking ‘quietlyInvokeMethodsWithAnnotations’ in your test > code? > If so could you your test code whe

Re: Getting Started with NiFi Development

2016-02-26 Thread Oleg Zhurakousky
Colin NiFi is pure Java, so any OS that has JDK distribution will run NiFi and or will be able to become a dev environment for it. The choice of IDE is also entirely up to you. On this list I am sure guys are using at least 3 different IDEs (me personally is Eclipse). You can get more

Re: [DISCUSS] NiFi 0.5.1 release

2016-02-19 Thread Oleg Zhurakousky
So I am working in Kafka and while its a bug it’s not easy to fix with the current state of things (see more details here https://issues.apache.org/jira/browse/NIFI-1534) So, there need to be some refactoring within NiFi core to address it right, so I’ve just changed the target to be 0.6.0.

Re: [DISCUSS] NiFi 0.5.1 release

2016-02-21 Thread Oleg Zhurakousky
1536 will be in shortly Sent from my iPhone > On Feb 21, 2016, at 14:17, Joe Witt wrote: > > Tony, > > Just chatted with Oleg. Sounds like he has a potential solution for > NIFI-1536. I did some testing for NIFI-1527 that I've reopened so we > can validate what was

Re: Cross NAR Controller Services

2016-03-15 Thread Oleg Zhurakousky
Devin Your problem is most likely in your NAR poms where you may satisfy compile dependency but not NAR to participate in class loader runtime inheritance. Is there a way to look at your poms and also the general structure of the project? Oleg Sent from my iPhone > On Mar 15, 2016, at

Re: [DISCUSS] - Class loader isolation per instance of the component

2016-03-09 Thread Oleg Zhurakousky
usage? Additional > complexity? > > Tony > On Mar 8, 2016 9:54 AM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> > wrote: > >> Was wondering what others are thinking on the following: >> >> We have several components (Processors, ControllerS

Re: [DISCUSS] - Class loader isolation per instance of the component

2016-03-09 Thread Oleg Zhurakousky
some of the others. We have seen over time that >> folks in the community not actively watching the mailing lists do >> notice those proposals and tend to bring them up or want to engage on >> them later. The Wiki/feature proposal section makes that easier. >> >>

Re: patch and pull request reviewing question

2016-03-19 Thread Oleg Zhurakousky
+1 here as well My apologies Tony Sent from my iPhone > On Mar 17, 2016, at 21:42, Joe Witt wrote: > > +1 > >> On Thu, Mar 17, 2016 at 9:37 PM, Tony Kurc wrote: >> As I was reviewing a pull request, i realized that it actually was a bit >> more mental

Re: [DISCUSS] - Class loader isolation per instance of the component

2016-03-09 Thread Oleg Zhurakousky
ess <mattyb...@gmail.com> wrote: > > Why not make UGI/Kerb stuff a Controller Service? Each CS instance can have > class loader isolation and can be shared among processor instances that want > to share UGI/Kerb/service config? > > Sent from my iPhone > >> On Mar 9

Re: Error using PutKafka with round robin partitioning

2016-03-28 Thread Oleg Zhurakousky
Need more information. It’s quite unfortunate that it all manifests itself through NiFi, but the real issue is with Kafka API and specifically this line in KafkaProducer int partition = partitioner.partition(serializedRecord, metadata.fetch()); It uses some internal partitioner if

Re: Error using PutKafka with round robin partitioning

2016-03-28 Thread Oleg Zhurakousky
+ numPartitions + "].”); So Kafka seem to have many different ways to get to the same number but it appears to me that the number is not the same. I’ll post the question on Kafka list and will let you know once I get a response. Oleg On Mar 28, 2016, at 4:19 PM, Oleg Zhurakousky

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Oleg Zhurakousky
is used > anywhere, so I think you can just remove it. > > The failures where pretty much the same on all 3 systems. But based on > Aldrin's question about the network I moved the OS X to a different network > and it passed. I'm running one of the Ubuntu boxes now. > >

Re: [VOTE] Release Apache NiFi 0.6.1 (RC1)

2016-04-09 Thread Oleg Zhurakousky
Joe Thanks for pointing that out. I’ll remove the quote from CNN article, just used it as sample text. Do you see any other issue with sample data? Also, which systems did you observe failures described below? Cheers Oleg > On Apr 9, 2016, at 2:47 PM, Joe Skora wrote: > >

Re: To help fulfill NIFI-513...

2016-03-23 Thread Oleg Zhurakousky
Russell First, thank you for taking initiative! Indeed we need to bring that JIRA to a closure. Having said that there is actually a link in our Contributor Guide on interactive debugging

Re: Can't add an attribute inside session read call-back

2016-03-23 Thread Oleg Zhurakousky
Russell This doesn’t sound right. Would you care to share a code snippet on how you set the attribute as well as stack trace? Cheers Oleg > On Mar 23, 2016, at 5:33 PM, Russell Bateman > wrote: > > I stumbled upon something peculiar in NiFi. I had

Re: Kafka error running latest 0.6.0.SNAPSHOT

2016-03-25 Thread Oleg Zhurakousky
Chris Indeed PutKafka had some significant survey lately. But what you see is actually a bug. Would you mind raising JIRA? Thanks Oleg > On Mar 25, 2016, at 3:42 PM, McDermott, Chris Kevin (MSDU - > STaTS/StorefrontRemote) wrote: > > I work around the problem by

Re: Kafka error running latest 0.6.0.SNAPSHOT

2016-03-25 Thread Oleg Zhurakousky
The spell checker got the best of me here, I meant to say ‘surgery’ instead of ‘survey’. Oleg > On Mar 25, 2016, at 3:50 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > Chris > > Indeed PutKafka had some significant survey lately. But what you see is

Re: Kafka error running latest 0.6.0.SNAPSHOT

2016-03-26 Thread Oleg Zhurakousky
I just commented, it will be fixed as part of https://issues.apache.org/jira/browse/NIFI-1684 Cheers Oleg On Mar 25, 2016, at 4:31 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: It is a problem with Random, it's bootstrapping the

Re: Error at startup

2016-03-22 Thread Oleg Zhurakousky
Pierre, no logs ;) > On Mar 22, 2016, at 10:03 AM, Pierre Villard > wrote: > > Hi, > > I updated my local checkout to current master and did a successful maven > build. When trying to start generated binaries, I have a bunch of errors and > NIFI does not start.

Re: patch and pull request reviewing question

2016-03-19 Thread Oleg Zhurakousky
ache.org/jira/browse/NIFI-1615 > [2] https://github.com/blog/2111-issue-and-pull-request-templates > > On Thu, Mar 17, 2016 at 9:55 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> +1 here as well >> My apologies Tony >> >> Sen

[DISCUSS] - Class loader isolation per instance of the component

2016-03-08 Thread Oleg Zhurakousky
Was wondering what others are thinking on the following: We have several components (Processors, ControllerServices etc.) both existing and coming down the pipeline which rely on class-level initializers (see example below from new SNMP PR) SecurityModels.getInstance().addSecurityModel(usm);

Re: OnStopped annotation

2016-03-05 Thread Oleg Zhurakousky
merged (Ill try to fast track it), so you can remove that code @OnStopped @Override public void close() { super.close(); } Cheers Oleg On Mar 5, 2016, at 4:48 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: Ok, I do s

Re: OnStopped annotation

2016-03-05 Thread Oleg Zhurakousky
sue I have on my side. > > 2016-03-05 20:46 GMT+01:00 Oleg Zhurakousky <ozhurakou...@hortonworks.com>: > >> Pierre >> >> Sorry, didn’t get a chance earlier. Just checked out your branch and >> building to see what’s going on. >> Just to

Re: OnStopped annotation

2016-03-05 Thread Oleg Zhurakousky
e. I can try to code a unit test and reproduce the issue using the example you gave. 2016-02-29 18:22 GMT+01:00 Oleg Zhurakousky < ozhurakou...@hortonworks.com <mailto:ozhurakou...@hortonworks.com>>: I meant could you share the test code (via github) On Feb 29, 2016, at 12:18 PM, Oleg

Re: OnStopped annotation

2016-03-02 Thread Oleg Zhurakousky
from my IDE >>> and I reproduced the issue just by starting/stopping the processor (with >> a >>> breakpoint in ReflectionUtils). I'll try to find some time to reproduce >> it >>> in a unit test if this can help to find the issue. >>> >>>

Re: NiFi 0.4.1 Very slow processing of flow files using PutKafka

2016-04-04 Thread Oleg Zhurakousky
Oscar Would you mind upgrading to NiFi 0.6.0? There were significant improvements to Kafka module Thanks Oleg On Apr 4, 2016, at 04:21, Oscar dela Pena > wrote: Hi NiFi team, This is our current NiFi flow: Our Kafka is version 0.8.2 and NiFi

Re: [DISCUSS] create apache nifi 0.6.1

2016-03-31 Thread Oleg Zhurakousky
+1 > On Mar 31, 2016, at 10:54 AM, Joe Witt wrote: > > I have updated the release notes to reflect that we will produce an > 0.6.1 to correct the PutKafka problem > > https://cwiki.apache.org/confluence/display/NIFI/Release+Notes > > I will start the RM work on this

Re: catch commit error in OnTrigger to diversify session behaviour

2016-04-14 Thread Oleg Zhurakousky
A bit unrelated, but how do you guys feel if we deprecate ObjectHolder so it could be gone by 1.0? AtomicReference is available from Java 5 Cheers Oleg > On Apr 14, 2016, at 5:18 AM, Bryan Bende wrote: > > Hello, > > It may be easier to move the load() out of the

Re: GetKafka blowing up with assertion error in Kafka client code

2016-04-28 Thread Oleg Zhurakousky
an > provide to you? > > Thanks, > Chris > > > >> On 4/14/16, 8:32 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: >> >> Thanks Chris >> >> Indeed let us know if/when/how to reproduce it so we can evaluate and see

Re: NIFI & IBM MQ

2016-05-24 Thread Oleg Zhurakousky
Christian Get/PutJMS* processors are effectively deprecated since they only work with ActiveMQ. The new processors that you should use that were specifically developed to support multiple JMS providers (tested with IBM MQ, Tibco and ActiveMQ) are PublishJMS and ConsumeJMS. Give it a try and

Re: [ANNOUNCE] New Apache NiFi PMC Member - Joe Percivall

2016-05-17 Thread Oleg Zhurakousky
Congrats Joe! > On May 16, 2016, at 11:00 PM, Joe Witt wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Joe Percivall has accepted the PMC's invitation to join the Apache > NiFi PMC. We greatly appreciate all of Joe's hard work and generous >

Re: [DISCUSS] nifi meetup/hackathon ground rules?

2016-05-17 Thread Oleg Zhurakousky
In any event, I think creating JIRA ticket (regardless of how right/wrong it may be) would be appropriate in such settings as well as producing a fix and a PR/Patch essentially allowing it to be vetted by ASF process. On the other hand I also hear Tony’s point about "short turnaround”. Certain

Re: [DISCUSS] Apache NiFi 0.7.0 and 1.0.0

2016-05-17 Thread Oleg Zhurakousky
Agreed! I would like to see 0.7 within 2-3 weeks as there are a lot of improvements and new features/components in it already, and would like to give it some miles before 1.0. Oleg > On May 17, 2016, at 4:02 PM, James Wing wrote: > > I'm definitely in favor of releasing

Re: [discuss] PropertyDescriptor name and displayName attributes

2016-05-03 Thread Oleg Zhurakousky
I am definitely +1 on this. The only question I have is related to "Add code to warn (without blocking) on processors missing displayName attributes”. Did you mean in he code itself where some validator in the abstract class would flag it with a WARN or some build plugin? Cheers Oleg On May

Re: Quick Question- Nifi Kafka

2016-05-03 Thread Oleg Zhurakousky
ill > it is not writing to kafka. Any suggestions? > > > Regards, > Sourav Gulati > > -Original Message- > From: Oleg Zhurakousky [mailto:ozhurakou...@hortonworks.com] > Sent: Tuesday, May 03, 2016 4:14 PM > To: dev@nifi.apache.org > Subject: Re: Quick Q

Re: Quick Question- Nifi Kafka

2016-05-03 Thread Oleg Zhurakousky
Hi It was tested with 0.8.2 and 0.9, but it does not use new consumer API. We are working on a new version of Kafka support slated for 0.7 release Cheers Oleg > On May 3, 2016, at 02:20, Sourav Gulati wrote: > > Hi All, > > Nifi-0.6.1 is compatible with

Re: Help Wanted

2016-05-03 Thread Oleg Zhurakousky
e PR's on GH are you just looking for code review or same process of apply local merge and test? Thanks, Andrew On 5/3/16, 9:58 AM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: Guys I’d like to use this opportunity to address all members of the NiFi community hence this e

Re: Help Wanted

2016-05-03 Thread Oleg Zhurakousky
ps://issues.apache.org/jira/browse/NIFI-1837?filter=12331874 > > As a community is there a preference given to JIRA's with Patch or GH PR's > or are they all treated with the same priority? > > Thanks, > Andrew > > On Tue, May 3, 2016 at 11:12 AM, Oleg Zhurakousky &l

Re: [discuss] PropertyDescriptor name and displayName attributes

2016-05-06 Thread Oleg Zhurakousky
I think the the main source of confusion (as it was for me) is the ‘name’ name itself. Basically the ‘name’ today is really an identifier of the property and therefore could/should never change while 'displayName' is volatile. Obviously changing “name’ to “id” is out of the question as it

Re: PutKafka-Message Delimiter

2016-05-05 Thread Oleg Zhurakousky
Please use Ctrl+Enter. The ‘\n’ is interpreted literally as a string (not new line). Let me know how it goes Cheers Oleg > On May 5, 2016, at 7:01 AM, Sourav Gulati wrote: > > Hi All, > > I am tried setting message delimiter in put kafka to /n . But it is not >

Re: PutKafka-Message Delimiter

2016-05-05 Thread Oleg Zhurakousky
; Sourav Gulati > > -Original Message- > From: Oleg Zhurakousky [mailto:ozhurakou...@hortonworks.com] > Sent: Thursday, May 05, 2016 4:41 PM > To: dev@nifi.apache.org > Subject: Re: PutKafka-Message Delimiter > > Please use Ctrl+Enter. > The ‘\n’ is interpreted li

Re: PutKafka-Message Delimiter

2016-05-05 Thread Oleg Zhurakousky
Sent: Thursday, May 05, 2016 5:01 PM > To: dev@nifi.apache.org > Subject: RE: PutKafka-Message Delimiter > > If I press " CTRL+Enter" on the value table of "Message delimiter" key. It > says "no value set". > > > > Regards, > Sourav Gula

  1   2   >