Re: [ANNOUNCE] New Apache NiFi PMC Member - Oleg Zhurakousky

2017-04-05 Thread Oleg Zhurakousky
Thank you all! *Joe Percivall* > e: joeperciv...@gmail.com

Re: [ANNOUNCE] New Apache NiFi Committer Bin Qiu

2017-04-05 Thread Oleg Zhurakousky
And of course I did it in the wrong thread ;) Congrats Bin!!! > On Apr 5, 2017, at 9:48 AM, Oleg Zhurakousky <o...@suitcase.io> wrote: > > Thank you all! > > > *Joe Percivall* >> e: joeperciv...@gmail.com >

Re: [ANNOUNCE] New Apache NiFi Committer Bin Qiu

2017-04-05 Thread Oleg Zhurakousky
Thank you all! *Joe Percivall* > e: joeperciv...@gmail.com

Re: When should MergeContent stop and proceed to next processor?

2017-03-16 Thread Oleg Zhurakousky
Ok, can you please set the “Correlation Identifier” to “fragment.identifier”? That is what I was trying to explain in the previous email. Cheers Oleg > On Mar 16, 2017, at 11:06 AM, srini wrote: > > Hi Oleg, > > Here is MergetContent screenshot. My flowfiles don't

Re: When should MergeContent stop and proceed to next processor?

2017-03-16 Thread Oleg Zhurakousky
Hi Is there any chance you can share your processor’s configuration? I am curious as to what are you using as “Correlation Attribute Name” in the MergeContent processor. Basically this attribute allows to distinguish groups of flow files so, since you have SplitJson as an upstream processor

Re: Connection Issue

2017-03-15 Thread Oleg Zhurakousky
the code to unwrap. But it is not allowing to cast that > connection object back to OracleConnection. It fails. > > On Wed, Mar 15, 2017 at 2:14 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> Ok, so it appears that DBCP does not like you to get access to th

Re: Connection Issue

2017-03-15 Thread Oleg Zhurakousky
sense. Will try and keep you posted. Regards Anil On Wed, Mar 15, 2017 at 9:56 AM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: Anil Thank you for details. That does help a lot. First, I want to make sure that it is clear that this is

Re: [VOTE] Release Apache NiFi nifi-nar-maven-plugin-1.2.0

2017-03-15 Thread Oleg Zhurakousky
Build successful, built sample NAR all is good +1 > On Mar 15, 2017, at 10:25 AM, Matt Burgess wrote: > > +1 Release this package as nifi-nar-maven-plugin-1.2.0 > > Verified checksums, verified and built from commit, built a NAR with > the updated plugin. > > On Tue, Mar

Re: Connection Issue

2017-03-15 Thread Oleg Zhurakousky
; at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > 2017-03-14 16:50:43,570 ERROR [NiFi logging handler] org.apache.nifi.StdErr > at java.lang.Thread.run(Thread.java:745) > 2017-03-14 16:50:43,570 ERROR [NiFi logging handler] org.apache.nifi.StdErr &

Re: Connection Issue

2017-03-15 Thread Oleg Zhurakousky
you want us to change the log levels and re-run and send you additional logs? On Tue, Mar 14, 2017 at 5:12 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: Anil I understand that you are having an issue and we are here to help, but we

Re: Connection Issue

2017-03-14 Thread Oleg Zhurakousky
1/ORPOGPB1 and this does not > work. aqSession = AQDriverManager.createAQSession(connection) fails > saying cannot create AQSession. > > Thanks > Anil > > > On Tue, Mar 14, 2017 at 4:13 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> Anil >> >> Whe

Re: Connection Issue

2017-03-14 Thread Oleg Zhurakousky
Anil When you say "it does not like the connection object. . .” what do you mean by that? Can you please provide stack trace or some other details? Cheers Oleg > On Mar 14, 2017, at 4:06 PM, Anil Rai wrote: > > Thanks Russ. Yes, we are doing exactly the same thing. >

Re: NiFI XProc Processor

2017-03-07 Thread Oleg Zhurakousky
Steve Thank you very much for desire to contribute and such a detailed explanation of your contribution. I left some comments in line [OLEG], so let us know what you think. Cheers Oleg > On Mar 7, 2017, at 10:17 AM, Steve Lawrence wrote: > > We have developed a NiFi

Re: Hosting API's on Nifi

2017-03-02 Thread Oleg Zhurakousky
Anil Aside from opening another port I don’t se how you can overcome this issue. HandleHttpRequest essentially starts another web server and this server needs a port to listen on. Further more, there are many other network based Processors that come with NiFi that would fall int the same

Re: [REMINDER] Please signoff when committing other people's changes

2017-03-02 Thread Oleg Zhurakousky
enient to see it in the git history > in my opinion. > > Personally, whenever merging someones contribution I use "git am > --signoff < patchfile" which I guess is equivalent to doing the ammend > after applying the patch. > > > On Thu, Mar 2, 2017 at 8:05 AM, O

Re: [REMINDER] Please signoff when committing other people's changes

2017-03-02 Thread Oleg Zhurakousky
Andre Thanks for the reminder. I admit that I did not know that we require it in the Contributor Guide, so thanks for pointing it out. However, your email did prompt me to look at the purpose and origin of the ‘-s’ flag and led me to this thread on Stack Overflow -

Re: session recover behaviour in nifi-jms-processor

2017-02-24 Thread Oleg Zhurakousky
Sorry, just noticed the typo. Instead of “limit the possibility of a message loads. . .” should be "limit the possibility of a message loss…" Cheers Oleg > On Feb 24, 2017, at 9:28 AM, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > Dominic > >

Re: session recover behaviour in nifi-jms-processor

2017-02-24 Thread Oleg Zhurakousky
Dominic Great to hear from you! As you can see from the inline comment in the code, the recover is there for a reason primarily to ensure or should I say limit the possibility of a message loads in the event of a processor and/or NiFi crash. As you may be aware, in NiFi we do prefer message

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-22 Thread Oleg Zhurakousky
having them NOT being part of official NiFi distribution is a value in itself. Cheers Oleg > On Feb 22, 2017, at 12:52 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > Adam > > I 100% agree with your comment on "official/sanctioned”. As an

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-22 Thread Oleg Zhurakousky
ralized > AbstractListProcessor (higher level that the one that already exists) could > make it easier to avoid this class of bug. > > Admittedly this could be a lot of work. > > Cheers, > Adam > > > > On Wed, Feb 22, 2017 at 8:38 AM, Oleg Zhurakousky < >

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

2017-02-22 Thread Oleg Zhurakousky
I’ll second Pierre Yes with the current deployment model the amount of processors and the size of NiFi distribution is a concern simply because it’s growing with each release. But it should not be the driver to start jamming more functionality into existing processors which on the surface may

Re: [ANNOUNCE] New Apache NiFi PMC Member - James Wing

2017-02-22 Thread Oleg Zhurakousky
Awesome! Well earned! Congrats! > On Feb 22, 2017, at 10:09 AM, Joe Witt wrote: > > congrats james and thanks for your efforts! > > On Wed, Feb 22, 2017 at 10:03 AM, Joe Skora wrote: >> Congrats James! >> >> On Wed, Feb 22, 2017 at 9:58 AM, Aldrin Piri

Re: [ANNOUNCE] New Apache NiFi Committer Jeff Storck

2017-02-22 Thread Oleg Zhurakousky
Congrats Jeff! Well earned! > On Feb 21, 2017, at 7:55 PM, Scott Aslan wrote: > > Congrats Jeff! Well deserved! > > On Tue, Feb 21, 2017 at 6:36 PM, Koji Kawamura > wrote: > >> Congratulations Jeff! >> >> On Wed, Feb 22, 2017 at 7:52 AM, Andre

Re: Email processor test failure

2017-02-21 Thread Oleg Zhurakousky
Chris ListenSMTP is essentially an email server. This processor essentially allows you to send emails to it. So by running it you are starting a simple email server. That said something is obviously not going well on your end. Any firewalls or other specific networking setup that you have

Re: Creating a custom DatabaseAdapter

2017-02-17 Thread Oleg Zhurakousky
Stanislav Sorry to hear you’re having problems. Is ether any way we can look at the code (i.e., via GitHub)? Also, when you say you don’t see your DatabaseAdapter is not picked up, do you see any messages in the logs? It is hard to determine the issue without more info, but usually symptoms

Re: [VOTE] Establish Registry, a sub-project of Apache NiFi

2017-02-10 Thread Oleg Zhurakousky
+1 Here as well. We desperately need it. > On Feb 10, 2017, at 12:11 PM, Jeremy Dyer wrote: > > +1 non-binding. I like the separation and I see a lot of need for this in > the community. > > On Fri, Feb 10, 2017 at 12:03 PM, Matt Burgess wrote: > >>

Re: [DISCUSS] Proposal for an Apache NiFi sub-project - NiFi Registry

2017-02-09 Thread Oleg Zhurakousky
Joe Versioning is probably the second main driver for the externalization as a concept. I believe in it so strongly that I would probably cast -1 if versioning was not part of it ;) And some of the existing ready to use solutions already provide versioning of artifacts (Binary, GitHub etc),

Re: [DISCUSS] Proposal for an Apache NiFi sub-project - NiFi Registry

2017-02-09 Thread Oleg Zhurakousky
Bryan While I am huge +1 for breaking up NiFi into manageable structure, I am still unclear as to the scope of this project. 1. As discussed in [3], there are public repositories and services out there that have been designed for the exact problem we are facing in NiFi today. Those

Re: GenerateFlowFile.java

2017-02-02 Thread Oleg Zhurakousky
Alessio The onScheduled() is only called once when processor is started. Started means scheduled to execute, hence the name of the operation. When the process is scheduled its scheduler triggers the execution of the processor and the same scheduler controls how often the onTrigger is called.

Re: problems with custom controller services, and other comments

2017-01-12 Thread Oleg Zhurakousky
leg On Jan 10, 2017, at 1:29 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: Michael That is indeed strange. Quick question, is there any chance we can look at your code (the custom CS). Also, what version of NiFi you are using? Will be

Re: [DISCUSS] Run Once scheduling

2017-01-12 Thread Oleg Zhurakousky
I was just about to suggest the same. Run-once would be a bit counter intuitive to the flow processing as a concept. Basically think of it this way; Flow or parts of it have only two states - RUNNING or STOPPED. In the RUNNING state it processes the data as it arrives (every second, every

Re: problems with custom controller services, and other comments

2017-01-10 Thread Oleg Zhurakousky
Michael That is indeed strange. Quick question, is there any chance we can look at your code (the custom CS). Also, what version of NiFi you are using? Will be looking into it, but any additional info is helpful Cheers Oleg > On Jan 10, 2017, at 1:14 PM, Knapp, Michael

Re: NiFi installation issues

2017-01-09 Thread Oleg Zhurakousky
Pushkar It appears that something is running on port 8080 so Jetty can not start. You can see at the bottom of the log the following (see below) 1. 2017-01-09 17:24:23,606 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down. 2.

Re: NiFi installation issues

2017-01-09 Thread Oleg Zhurakousky
Pushkar Any chance you can look and provide relevant logs? You can find them in the /log directory. Also, could you please be more specific as to what directions did you follow. Just want to make sure that if there are any issues with documentation it is corrected. Cheers Oleg > On Jan 9,

Re: [ANNOUNCE] New Apache NiFi Committer Joey Frazee

2017-01-03 Thread Oleg Zhurakousky
Congrats Joey! Nice to have you on board! Oleg On Jan 3, 2017, at 2:42 PM, Aldrin Piri > wrote: On behalf of the Apache NiFI PMC, I am very pleased to announce that Joey Frazee has accepted the PMC's invitation to become a committer on the Apache

Re: [ANNOUNCE] New Apache NiFi PMC Member - Joe Skora

2016-12-29 Thread Oleg Zhurakousky
Congrats Joe!!! Well earned! Oleg Sent from my iPhone > On Dec 29, 2016, at 14:23, Joe Percivall wrote: > > Congrats Joe! > >> On Thu, Dec 29, 2016 at 1:11 PM, Tony Kurc wrote: >> >> Glad to have you on the PMC, Joe! >> >>> On Thu, Dec 29, 2016 at

Re: GetKafka and ConvertAvroToJson returns blank

2016-12-22 Thread Oleg Zhurakousky
space": "mynamespace.com<http://mynamespace.com/>", "type": "record", "name": "TEST_DATA1", "fields": [ {"name": "ENAME", "type": "string"} ] }”) Cheers Oleg On Dec 22, 2016, at 1

Re: NiFi compilation error - master & 1.1.x branch

2016-12-22 Thread Oleg Zhurakousky
Andrew I believe I’ve seen something similar before and it persisted until up’ve upgraded JDK. Once on the latest (*_112) all was good, But discussing/testing it a bit internally even the older upgrades would do (e.g., *_65) FWIW, I has the same *_45 version until I started seeing this. Cheers

Re: [VOTE] Release Apache NiFi 1.1.1 (RC1)

2016-12-20 Thread Oleg Zhurakousky
+1 (non-binding) Built and tested on OSX with contrib-check. Ran several basic flows Validated Import/Export templates (single node and 3 node cluster) > On Dec 20, 2016, at 1:49 PM, Joey Frazee wrote: > > +1 (non-binding) > > - Verified commit hash, checksums and GPG

Re: [ANNOUNCE] New Apache NiFi Committer Jeremy Dyer

2016-12-20 Thread Oleg Zhurakousky
Congrats Jeremy! Well deserved! > On Dec 20, 2016, at 8:46 AM, Yolanda Davis wrote: > > Congratulations Jeremy! > > On Mon, Dec 19, 2016 at 8:23 PM, Aldrin Piri wrote: > >> On behalf of the Apache NiFI PMC, I am very pleased to announce that

Re: [VOTE] Release Apache NiFi 1.0.1 (RC1)

2016-12-19 Thread Oleg Zhurakousky
+1 (non-binding) Used Release Helper to run through steps on OSX with Java 1.8.0_112. Created and deployed few simple flows, played with templates etc., all is good. Oleg > On Dec 18, 2016, at 10:24 PM, Tony Kurc wrote: > > +1 (binding) > > Ran through helper, built on

Re: NIFI 1.1.0 build error

2016-12-15 Thread Oleg Zhurakousky
Alessio Any chance you have some network connectivity issues when you attempt too build or may be a proxy that restricts certain sites? This error is indeed strange and I can’t recall having it and I’ve tried to do the same (as you describe) on my mac and all builds fine. Also, just to

Re: Hello

2016-12-13 Thread Oleg Zhurakousky
Hi I am not sure I fully understand what ‘data’ you are referring to. Is this the usual Log data? If so it is still somewhat unusual requirement to log something during some time frame and ignore during others, so that is why I am asking if you can clarify what ‘data’ you are referring to. In

Re: NiFi Spark Processor

2016-11-18 Thread Oleg Zhurakousky
Shankha I know it may not always be all that obvious, but have you started the OutputPort? Also, have you defined ‘nifi.remote.input.socket.port’ property in wifi.properties? Also, unless you’ve already discovered it there is an excellent blog

Re: NiFi processor validation

2016-11-08 Thread Oleg Zhurakousky
Could it also be related to https://issues.apache.org/jira/browse/NIFI-1318? Cheers Oleg On Nov 8, 2016, at 7:52 AM, Joe Witt > wrote: +1 to both of those points: 1) Avoid validating that which it doesn't help (disabled and running) 2) Avoid using

Re: [ANNOUNCE] New Apache NiFi Committer Scott Aslan

2016-11-04 Thread Oleg Zhurakousky
Congrats Scott! Well earned! Oleg > On Nov 4, 2016, at 11:25 AM, Tony Kurc wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that Scott > Aslan has accepted the PMC's invitation to become a committer on the Apache > NiFi project. We greatly appreciate

Re: nifi git commit: This closes #1047

2016-11-02 Thread Oleg Zhurakousky
Andre Quick note for the future. . . I just noticed how this commit appears in the Git logs === commit 4acc9ad288cc005127d1709adbb1134f6dab94c6 Author: Andre F de Miranda Date: Thu Nov 3 02:29:11 2016 +1100 This closes #1047 === As you can see it does

Re: [ANNOUNCE] New Apache NiFi Committer Bryan Rosander

2016-10-26 Thread Oleg Zhurakousky
Congrats Bryan! Glad to have you! > On Oct 26, 2016, at 1:15 PM, Joe Witt wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Bryan Rosander has accepted the PMC's invitation to become a committer > on the Apache NiFi project. We greatly

Re: [ANNOUNCE] New Apache NiFi PMC Member - Matt Burgess

2016-10-07 Thread Oleg Zhurakousky
Matthew. . . congrats! Ohh wait, sorry I am actually referring to you Burgess, not that other one that is pounding your neighborhood at the moment. Anyway, stay safe and congrats once again! Cheers Oleg > On Oct 7, 2016, at 11:12 AM, Pierre Villard > wrote: >

Re: Mobile Support?

2016-10-05 Thread Oleg Zhurakousky
Tamar NiFi is Java-based product and thus runs in JVM. So any JVM-capable (e.g., Android etc) device can run NiFi. NiFi also has a Minify distribution specifically tailored to pervasive devices - https://nifi.apache.org/minifi/ That said, would you be able yo elaborate as to your use-case for

Re: How to Use Nifi Remote Debugger?

2016-09-22 Thread Oleg Zhurakousky
Also, keep in mind that while remote debugging helps with something that may already be running in production, for pure development there is a simpler way to run NiFi in debug mode without using remote debugger. Here is more information -

Re: [ANNOUNCE] New Apache NiFi Committer Rob Moran

2016-09-20 Thread Oleg Zhurakousky
Indeed, UI looks pretty awesome now and we all know who’s behind it. Congrats! > On Sep 19, 2016, at 6:05 PM, Joe Witt wrote: > > Pretty cool to see Rob obtain committer status. His efforts arent always > obviously tied to a commit but so much of what people see are his

Re: Custom Processor

2016-09-16 Thread Oleg Zhurakousky
Gunjan If I understand you correctly you are trying to do something that works with JMS and SQL in atomic fashion. Possibly (and that is purely a guess) you are having some XA transactional concerns. . . If so, that may be a bit counter-intuitive to micro-services nature of NiFi processors

Re: Custom Processor

2016-09-15 Thread Oleg Zhurakousky
Hi You can obviously extends the executesql processor, but I am more interested in understanding what exactly are you trying to accomplish that executesql doesn’t do today. Don’t get me wrong as I am sure you may have a legitimate reason, but there may also be missing functionality that we may

Re: ConsumeJMS and Acknowledgement Mode

2016-09-15 Thread Oleg Zhurakousky
ranch. > Should I share? > > Chris McDermott > > Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > > > > On 9/15/16, 9:45 AM, "Oleg Zhurakousky" <ozhurakou...@ho

Re: ConsumeJMS and Acknowledgement Mode

2016-09-15 Thread Oleg Zhurakousky
Remote) <chris.mcderm...@hpe.com> wrote: > > Will do. Thanks! > > Chris McDermott > > Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > > > > On 9/14/16, 10:10 AM

Re: ConsumeJMS and Acknowledgement Mode

2016-09-14 Thread Oleg Zhurakousky
ontRemote)" <chris.mcderm...@hpe.com<mailto:chris.mcderm...@hpe.com>> wrote: Yes. Chris McDermott Remote Business Analytics STaTS/StoreFront Remote HPE Storage Hewlett Packard Enterprise Mobile: +1 978-697-5315 On 9/14/16, 9:54 AM, "Oleg Zhurakou

Re: ConsumeJMS and Acknowledgement Mode

2016-09-14 Thread Oleg Zhurakousky
rd Enterprise > Mobile: +1 978-697-5315 > > > > > On 9/14/16, 9:54 AM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: > >So you’re asking about ConsumeJMS? > >> On Sep 14, 2016, at 9:49 AM, McDermott, Chris Kevin (MSDU - >> S

Re: ConsumeJMS and Acknowledgement Mode

2016-09-14 Thread Oleg Zhurakousky
for ACK mode. Screen shot attached. So my question is which > ACK mode does it use? > > Thanks, > > Chris McDermott > > Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 >

Re: ConsumeJMS and Acknowledgement Mode

2016-09-14 Thread Oleg Zhurakousky
Chris FWIW, the Get/PutJMS* are effectively deprecated processors since they only support one JMS provider (ActiiveMQ) and should not be used. Instead we recommend Publish/ConsumeJMS pair. As to your question, which specific ACK mode you are inquiring about? As the doc currently states, the

Re: Anyone having issues running nifi-kafka-0-9-processors junits?

2016-09-12 Thread Oleg Zhurakousky
most common failure but give me a >> few days and I will try to confirm that. >> >> Cheers >> >> >> >> On Mon, Sep 12, 2016 at 7:54 AM, Oleg Zhurakousky < >> ozhurakou...@hortonworks.com> wrote: >> >>> Andre >>> >>> Coup

Re: Anyone having issues running nifi-kafka-0-9-processors junits?

2016-09-11 Thread Oleg Zhurakousky
Andre Couple of questions 1. Since KafkaPublisher class exists in all 3 Kafka processors (0.9 and 0.10 Kafka clients) under the same package name, which one does it happen in? I am assuming its intermittent. 2. How often does it happen? My suspicion is that this test is using embedded Kafka

Re: Max Kafka message size

2016-08-21 Thread Oleg Zhurakousky
s > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > > > On 8/21/16, 3:43 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: > >Chris > >Sorry for getting late to this

Re: Max Kafka message size

2016-08-21 Thread Oleg Zhurakousky
Chris Sorry for getting late to this This indeed was intentional, primarily to follow Kafka’s best practices where Kafka was not designed to be a general data transfer system of arbitrary size but rather “manageable” size. Also, as you know we have ability to demarcate messages essentially

Re: Pooling connection factory for JMSConnectionFactoryProvider

2016-08-16 Thread Oleg Zhurakousky
gt; wrote: > > Oleg, > > I see that now. I was thinking at the service level for the caching > factory to allow more reuse, but am unsure if that would even be a good > idea. > > Chad > > On Tue, Aug 16, 2016 at 12:18 PM Oleg Zhurakousky < > ozhura

Re: Pooling connection factory for JMSConnectionFactoryProvider

2016-08-16 Thread Oleg Zhurakousky
Actually it is using caching connection factory (see AbstractJMSProcessor): private volatile CachingConnectionFactory cachingConnectionFactory; Can you please provide more details what you are doing and what/where you are seeing this? Cheers Oleg On Aug 16, 2016, at 12:10 PM, Chad Zobrisky

Re: 0.x Build Breaking on nifi-kafka-pubsub-processors?

2016-08-06 Thread Oleg Zhurakousky
JFK. Yeah I hope you got the iPhone spell tricks ;) Sent from my iPhone > On Aug 6, 2016, at 16:09, Oleg Zhurakousky <ozhurakou...@hortonworks.com> > wrote: > > Hmm, I build it before pushing those changes, but now I am thinking may be I > forgot to switch

Re: 0.x Build Breaking on nifi-kafka-pubsub-processors?

2016-08-06 Thread Oleg Zhurakousky
Hmm, I build it before pushing those changes, but now I am thinking may be I forgot to switch JFK to 1.7. I'll look at it tomorrow, thanks for the heads up Sent from my iPhone > On Aug 6, 2016, at 14:43, James Wing wrote: > > It looks like the 0.x build is breaking on

Re: [ANNOUNCE] New Apache NiFi Committer Yolanda Davis

2016-07-30 Thread Oleg Zhurakousky
Welcome aboard Yolanda! Oleg > On Jul 30, 2016, at 08:22, Joe Witt wrote: > > Congrats and thanks Yolanda! > >> On Jul 30, 2016 8:16 AM, "Tony Kurc" wrote: >> >> On behalf of the Apache NiFI PMC, I am very pleased to announce that >> Yolanda Davis has

Re: [ANNOUNCE] New Apache NiFi Committer Koji Kawamura

2016-07-19 Thread Oleg Zhurakousky
Congrats Koji! Glad to see you on board! Oleg On Jul 19, 2016, at 7:45 PM, Andy LoPresto > wrote: Congratulations Koji. Excited for even more great contributions. Andy LoPresto alopre...@apache.org

Re: ConsumeKafka vs getKafka

2016-07-17 Thread Oleg Zhurakousky
Sumo Thank you for pointing this out. Very valid comments and just in time for the upcoming 1.0 release. Would you mind to raise a JIRA and we'll address it promptly? Cheers Oleg > On Jul 17, 2016, at 16:38, Sumanth Chinthagunta wrote: > > Env: Linux , Kafka 9.0.x,

Re: GetJMSQueue does not detect dead connections

2016-07-13 Thread Oleg Zhurakousky
STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > > > On 6/16/16, 1:43 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: > >> Chris >> >> Given that we are deprecating Get/PutJMS*

Re: External Repositories (aka Extension Registry) for Dynamically-loaded Extensions

2016-07-13 Thread Oleg Zhurakousky
Matt, Due to “other tasks” I personally haven’t been able yet to follow everything that’s going on, nor had I have a chance to look at the POC you and Puspendu have created, so I think global update of the page would be too early at the moment as it doesn’t really capture all of the concerns

Re: Update on 0.7.0 RC2

2016-07-07 Thread Oleg Zhurakousky
Just as an FYI, the PRs for NIFI-2160 are merged and the issue is resolved. Hopefully https://issues.apache.org/jira/browse/NIFI-2192 won’t be a pain. Oleg On Jul 7, 2016, at 3:03 PM, Oleg Zhurakousky <ozhurakou...@hortonworks.com<mailto:ozhurakou...@hortonworks.com>> wrote: A

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

2016-07-07 Thread Oleg Zhurakousky
Way to go Andy! Well deserved! Cheers Oleg > On Jul 7, 2016, at 5:09 PM, Matt Burgess wrote: > > Congratulations Andy! Well deserved! > > >> On Jul 7, 2016, at 12:44 PM, Joe Witt wrote: >> >> On behalf of the Apache NiFI PMC, I am very pleased to

Re: Update on 0.7.0 RC2

2016-07-07 Thread Oleg Zhurakousky
as been found. > > - "Enabled ControllerServices disabled on restart" NIFI-2160[1] [status] PR > have been posted by Oleg Zhurakousky and Brandon DeVries gave a +1 on the > ticket but ambiguous about what is the next step. I commented asking for a > follow-up. > > - "PutK

Re: Question about Mock classes in ControllerServiceInitializer

2016-07-01 Thread Oleg Zhurakousky
orLogger Shutting down server". It > still doesn't seem like that should occur. > > > On Thu, Jun 30, 2016 at 6:30 PM, Oleg Zhurakousky < > ozhurakou...@hortonworks.com> wrote: > >> Guys >> >> FWIW, there are discussion points on the WIKI that may

Re: Question about Mock classes in ControllerServiceInitializer

2016-06-30 Thread Oleg Zhurakousky
Guys FWIW, there are discussion points on the WIKI that may be relevant to understanding of this issue especially in relation to what Mark just stated https://cwiki.apache.org/confluence/display/NIFI/Component+documentation+improvements There are also some points in the Extension Registry

Re: ControllerService Enabling and Processor onPropertyModified

2016-06-20 Thread Oleg Zhurakousky
Indeed this sounds like https://issues.apache.org/jira/browse/NIFI-2032. The PR for it has been out https://github.com/apache/nifi/pull/541 so if you get a chance to try it please let us know. Hopefully it will be merged soon. Cheers Oleg On Jun 20, 2016, at 4:25 PM, Michael Moser

Re: [DISCUSS] Closing in on the Apache NiFi 0.7.0 Release

2016-06-17 Thread Oleg Zhurakousky
) but unless if they are critical I am not going > to hold up the release for them. > > The current status for those tagged as 0.7.0: > > - "Processors could be started before the Controller Services that they > depend on" NIFI-2032[1] [status] Critical bug that was a

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
c bug? > > On Thu, Jun 16, 2016 at 3:13 PM, Oleg Zhurakousky > <ozhurakou...@hortonworks.com> wrote: >> Chris >> >> That is correct. >> The idea was to make sure that we can support multiple clients and multiple >> vendors since Get/Put only supporte

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
S/StoreFront Remote HPE Storage Hewlett Packard Enterprise Mobile: +1 978-697-5315 https://www.storefrontremote.com On 6/16/16, 2:53 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.com> wrote: Yes, you can probably look at the test case for it since it uses embedded AMQP. Let

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
> Thanks, > > Chris McDermott > > Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > https://www.storefrontremote.com > > On 6/16/16, 1:43 PM, "Oleg Zhurakousky" <ozh

Re: GetJMSQueue does not detect dead connections

2016-06-16 Thread Oleg Zhurakousky
Chris Given that we are deprecating Get/PutJMS* in favor of Publish/SubscribeJMS, I’d suggest start using those once. Cheers Oleg > On Jun 16, 2016, at 1:34 PM, McDermott, Chris Kevin (MSDU - > STaTS/StorefrontRemote) wrote: > > Folks, > > I’ve been trying to

Re: unwedgeable flow caused by "Cannot create Provenance Event Record because FlowFile UUID is not set"

2016-06-14 Thread Oleg Zhurakousky
> Remote Business Analytics > STaTS/StoreFront Remote > HPE Storage > Hewlett Packard Enterprise > Mobile: +1 978-697-5315 > > https://www.storefrontremote.com > > On 6/13/16, 3:10 PM, "Oleg Zhurakousky" <ozhurakou...@hortonworks.co

Re: Apache NiFi 0.7.0 Release date ?

2016-06-13 Thread Oleg Zhurakousky
Unfortunately I just raised another relatively trivial JIRA which affects 0.7, but I should have it ready by tomorrow. Otherwise I am +1 to get 0.7 out asap Sent from my iPhone > On Jun 13, 2016, at 16:47, Joe Percivall > wrote: > > Looks like time to start

Re: unwedgeable flow caused by "Cannot create Provenance Event Record because FlowFile UUID is not set"

2016-06-13 Thread Oleg Zhurakousky
Chris The fact that your flow is hosed means this is a bug. IMHO corrupted FlowFile should not render NiFi unavailable. So please raise the JIRA. Also, i think the real question here is not how the FF got corrupted but the fact that corrupted FF rendered NIFI unavailable and that is the core

Re: [DISCUSS] - Markdown option for documentation artifacts

2016-06-07 Thread Oleg Zhurakousky
Personally I am ok either way, however the question I have is consistency and how different artifacts written via html will be different (look-and-feel) from the once created using mark up and then transformed. Oleg > On Jun 7, 2016, at 2:28 PM, Bryan Rosander wrote:

Re: [DISCUSS] Apache NiFi 0.7.0 and 1.0.0

2016-06-01 Thread Oleg Zhurakousky
>>>> >>>>>>> >>>>>>> On Tue, May 17, 2016 at 6:04 PM, Joe Witt <joe.w...@gmail.com> >>> wrote: >>>>>>> >>>>>>> I believe that is right Andy. The support guide articulates that we >&g

Re: Nifi Java 1.7 support

2016-05-31 Thread Oleg Zhurakousky
Yes, that would be with NIFI 1.0.0 Cheers Oleg > On May 31, 2016, at 4:51 PM, M Singh wrote: > > Hi Folks: > > Just wanted to find out if there is a timeline when Nifi will sunset support > for JDK 1.7. > Thanks > Mans

Re: [ANNOUNCE] New Apache NiFi Committer Pierre Villard

2016-05-25 Thread Oleg Zhurakousky
Wow! Finally, very excited!!! Long overdue! Congrats and welcome Pierre! Oleg > On May 25, 2016, at 11:50, Joe Witt wrote: > > On behalf of the Apache NiFi PMC, I am pleased to announce that Pierre > Villard has accepted the PMC's invitation to become a committer on the >

Re: NIFI & IBM MQ

2016-05-25 Thread Oleg Zhurakousky
., SYSTEM.ADMIN.SVRCONN) - queueManeger: (e.g., FOO) - transportType: (make sure you put '1' as a value which states that TCP/IP will be used) You can get more from IBM docs for additional properties which could all be provided as dynamic properties Cheers Oleg On May 25, 2016, at 9:41 AM, Oleg

Re: NIFI & IBM MQ

2016-05-25 Thread Oleg Zhurakousky
Christian I’d suggest to look at the additional documentation of this new component as it provides some level of details, but it would be interesting to get your feedback as to what do you think is missing/confusing. In any event, here are some details. You need to configure ControllerService

Re: NIFI & IBM MQ

2016-05-24 Thread Oleg Zhurakousky
Christian Get/PutJMS* processors are effectively deprecated since they only work with ActiveMQ. The new processors that you should use that were specifically developed to support multiple JMS providers (tested with IBM MQ, Tibco and ActiveMQ) are PublishJMS and ConsumeJMS. Give it a try and

Re: [DISCUSS] Apache NiFi 0.7.0 and 1.0.0

2016-05-17 Thread Oleg Zhurakousky
Agreed! I would like to see 0.7 within 2-3 weeks as there are a lot of improvements and new features/components in it already, and would like to give it some miles before 1.0. Oleg > On May 17, 2016, at 4:02 PM, James Wing wrote: > > I'm definitely in favor of releasing

Re: [DISCUSS] nifi meetup/hackathon ground rules?

2016-05-17 Thread Oleg Zhurakousky
In any event, I think creating JIRA ticket (regardless of how right/wrong it may be) would be appropriate in such settings as well as producing a fix and a PR/Patch essentially allowing it to be vetted by ASF process. On the other hand I also hear Tony’s point about "short turnaround”. Certain

Re: [ANNOUNCE] New Apache NiFi PMC Member - Joe Percivall

2016-05-17 Thread Oleg Zhurakousky
Congrats Joe! > On May 16, 2016, at 11:00 PM, Joe Witt wrote: > > On behalf of the Apache NiFI PMC, I am very pleased to announce that > Joe Percivall has accepted the PMC's invitation to join the Apache > NiFi PMC. We greatly appreciate all of Joe's hard work and generous >

Re: [discuss] PropertyDescriptor name and displayName attributes

2016-05-06 Thread Oleg Zhurakousky
I think the the main source of confusion (as it was for me) is the ‘name’ name itself. Basically the ‘name’ today is really an identifier of the property and therefore could/should never change while 'displayName' is volatile. Obviously changing “name’ to “id” is out of the question as it

Re: PutKafka-Message Delimiter

2016-05-05 Thread Oleg Zhurakousky
as message delimiter. However, it is not working. > > Regards, > Sourav Gulati > > -Original Message- > From: Oleg Zhurakousky [mailto:ozhurakou...@hortonworks.com] > Sent: Thursday, May 05, 2016 6:08 PM > To: dev@nifi.apache.org > Subject: Re: PutKafka-Message Delimiter >

Re: PutKafka-Message Delimiter

2016-05-05 Thread Oleg Zhurakousky
Sent: Thursday, May 05, 2016 5:01 PM > To: dev@nifi.apache.org > Subject: RE: PutKafka-Message Delimiter > > If I press " CTRL+Enter" on the value table of "Message delimiter" key. It > says "no value set". > > > > Regards, > Sourav Gula

  1   2   >