Re: Automated Testing of Nifi Flow by injecting data into Processors

Hi Alexei, If you're talking about testing your flow with simulated data as if it's deployed, basically not unit tests. I've seen this done in several different ways: 1. Using the GenerateFlowFile processor and adding in custom text. At first, that may seem obvious, however, if you think about it

Re: Apache NiFi MiNiFi 0.5.0 RC2 Release Helper Guide

Y) < > jeremyd...@apache.org>" [full] > gpg: binary signature, digest algorithm SHA512, key algorithm rsa4096 > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 >

Re: Apache NiFi MiNiFi 0.5.0 RC2 Release Helper Guide

+1 (non-binding) - verified keys - verified signatures - verified README's, NOTICE and LICENSE - tested c2 NiFiRestConfigurationProvider with NiFi 1.6.0 and minifi from this build, various changes to template -- bumping versions, etc. One thing I noticed when verifying the keys, which I am not

Re: [ANNOUNCE] New Apache NiFi Committer Sivaprasanna Sethuraman

Congratulations Sivaprasanna! On Tue, Jun 5, 2018 at 12:25 PM, Pierre Villard wrote: > Congrats, well deserved! > > 2018-06-05 18:14 GMT+02:00 Mike Thomsen : > > > Congratulations, Sivaprasanna! > > > > On Tue, Jun 5, 2018 at 10:22 AM Bryan Bende wrote: > > > > > Congrats! and thank you for

Re: Publishing Kafka Topics via Apache Nifi cluster.

Pierre, Mentioning that JIRA is very timely, I was just talking with some yesterday about NiFi and Kafka and this exact scenario came up and was something they were keenly interested in being able to do. Route data for say different stocks to different NiFi nodes via an RPG. Happy to help our

Re: [ANNOUNCE] New Apache NiFi Committer Kevin Doran

Congrats Kevin! On Wed, Jan 3, 2018 at 9:17 AM, Bryan Bende wrote: > On behalf of the Apache NiFi PMC, I am very pleased to announce that > Kevin Doran has accepted the PMC's invitation to become a committer on > the Apache NiFi project. We greatly appreciate all of Kevin's

Re: [ANNOUNCE] New NiFi PMC member Scott Aslan

Congrats Scott!! All of your work on the UI is greatly appreciated by everyone that uses NiFi. On Sat, Dec 2, 2017 at 2:46 PM, Tony Kurc wrote: > NiFi community, > On behalf of the Apache NiFi PMC, I am pleased to announce that Scott Aslan > has accepted the PMC's invitation

Re: Syslog processing from cisco switches to Splunk

Dave, To clarify you are using the PutUDP processor, not the PutSplunk processor? On Thu, Oct 19, 2017 at 7:31 AM, DAVID SMITH wrote: > Hi > We are trying to do something which on the face of it seems fairly simple > but will not work.We have a cisco switch which is

Re: [DRAFT][REPORT] Apache NiFi Board Report Oct 2017

Joe -- LGTM On Mon, Oct 9, 2017 at 11:03 AM, Rob Moran wrote: > Joe, looks good with the couple changes Drew mentioned--thanks. > > On Mon, Oct 9, 2017 at 10:30 AM Andrew Lim > wrote: > > > Noticed the following: > > > > -In Health Report section:

Re: Using GregorianCalendar in apache nifi

3.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Documents

nning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Confluence wiki edit permission

Thanks Joe. On Fri, Jul 7, 2017 at 11:38 PM, Joe Witt <joe.w...@gmail.com> wrote: > Andrew > > You should now have permissions to edit the wiki. > > Thanks > Joe > > On Fri, Jul 7, 2017 at 11:34 PM, Andrew Psaltis > <psaltis.and...@gmail.com> wrote: > &g

Confluence wiki edit permission

Hi, I am interested in fixing an issue and adding more content in the contributor guide on the wiki. One change is pretty simple an invalid URL. The additional content I am thinking of at this time is around this process in particular. I searched around trying to understand the process of how to

Re: [DRAFT][REPORT] Apache NiFi - July 2017

> > > - New commmitters: > > > > > - Marc Parisi was added as a committer on Thu Jun 01 2017 > > > > > - Andrew M. Lim was added as a committer on Wed May 31 2017 > > > > > > > > > > ## Releases: > > > > >

Re: AvroSchemaRegistry doesn't enjoy copy and paste?

th single quotes and double quotes are pure ASCII characters. > > It turned out to be the issue is fixed by NIFI-4029 > > Are we targeting releasing 1.3.1 by any chance?  > > Cheers > > > PS-I wasn't familiar with avro-tools random, so thank for that!  > > > On

Re: AvroSchemaRegistry doesn't enjoy copy and paste?

crosoft Outlook >>> >> and Office) love to take double-quotes and change them into other >>> >> characters so that >>> >> they look nicer. But if you then copy that and paste it, it is not >>> pasting >>> >> a double-quote but >>> >> some other unicode character. >>> >> >>> >> Would recommend you open the below link in Chrome and copy from there >>> and >>> >> see if >>> >> that works? >>> >> >>> >> Thanks >>> >> -Mark >>> >> >>> >> >>> >> >>> >>> On Jun 22, 2017, at 8:56 AM, Andre <andre-li...@fucs.org> wrote: >>> >>> >>> >>> All, >>> >>> >>> >>> I was playing with the AvroSchemaRegistry and noticed it seems to not >>> >> play >>> >>> ball when the DFM pastes the schema into the dynamic property value. >>> >>> >>> >>> To test it I basically copied the demo schema from Mark's blog >>> post[1] >>> >> and >>> >>> pasted into a NiFi 1.3.0 instance. To my surprise the controller >>> would >>> >> not >>> >>> validate, instead it displayed: >>> >>> >>> >>> "was expecting double-quote to start field name" >>> >>> >>> >>> I also faced similar errors using the following schema: >>> >>> >>> >>> >>> >> https://github.com/fluenda/SecuritySchemas/blob/master/CEFRe >>> v23/cefRev23_nifi.avsc >>> >>> >>> >>> Has anyone else seen this? >>> >>> >>> >>> Cheers >>> >> >>> >> >>> >>> >> > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] New Apache NiFi Committer Drew Lim

- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [VOTE] Release Apache NiFi MiNiFi 0.2.0

; > from source, and test. Then please vote: > > > > [ ] +1 Release this package as minifi-0.2.0 > > [ ] +0 no opinion > > [ ] -1 Do not release this package because... > > > > Thanks! > > > > [1] You can determine this time for your local time zone at > > https://s.apache.org/minifi-0.2.0-rc1-close > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Pulling out hair over slf4j...

:nifi-api:jar:1.1.2:compile > [INFO] +- org.apache.nifi:nifi-utils:jar:1.1.2:compile > [INFO] +- org.apache.nifi:nifi-processor-utils:jar:1.1.2:compile > [INFO] | \- org.apache.nifi:nifi-security-utils:jar:1.1.2:compile > [INFO] | +- org.bouncycastle:bcprov-jdk15on:ja

Re: [VOTE] Release Apache NiFi 1.2.0 (RC2)

. > > On May 8, 2017 9:05 AM, "Andrew Psaltis" <psaltis.and...@gmail.com> wrote: > > > +0 (non-binding) -- failed building on Windows 10 using mvn clean install > > -Pcontrib-check -DskipTests (skipped test as build with tests failed) > > > > Apache Ma

Re: [VOTE] Release Apache NiFi 1.2.0 (RC2)

> >> KEYS file available here: > >> https://dist.apache.org/repos/dist/release/nifi/KEYS > >> > >> 381 issues were closed/resolved for this release: > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12316020=12338432 > >>

Re: [ANNOUNCE] New Apache NiFi PMC Member - Oleg Zhurakousky

active contributing code and on > the > > mailing lists, and becoming an ever more valuable member of our > community. > > > > > > Please join us in congratulating and welcoming Oleg to the Apache NiFi > PMC. > > > > Congratulations and welcome, Oleg! > > > > > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] New Apache NiFi Committer Bin Qiu

cation and > always being responsive to the community. > > > Congrats, Bin! > > > - Tony > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Nifi on Raspberry pi - jetty issues

-- this does not cover MiNiFi, thus it may have some pointers for solving the current problem you are having. Hope that helps. On Fri, Mar 3, 2017 at 3:27 PM, Andrew Psaltis <psaltis.and...@gmail.com> wrote: > Pushkar, > While it certainly should and has been possible to run regular Ni

Re: Nifi on Raspberry pi - jetty issues

jetty.util.component.AbstractLifeCycle. > start(AbstractLifeCycle.java:68) > ~[jetty-util-9.3.9.v20160517.jar:9.3.9.v20160517] > at > org.apache.nifi.web.server.JettyServer.start(JettyServer.java:675) > ~[nifi-jetty-1.1.2.jar:1.1.2] > at org.apache.nifi.NiFi.(N

Re: Need help with Custom Processor

t please do let me know how I could fix > this problem. > > Regards > Pushkar > > On Tue, Feb 28, 2017 at 12:40 PM, Andrew Psaltis <psaltis.and...@gmail.com > > > wrote: > > > Hi Pushkar, > > The preferred approach is to add the external dependency to th

Re: Need help with Custom Processor

omething else to > it? > > Thanks > Pushkar > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [VOTE] Establish Registry, a sub-project of Apache NiFi

majority rule vote. > >>> > >>> [ ] +1 Establish Registry, a subproject of Apache NiFi > >>> [ ] 0 Do not care > >>> [ ] -1 Do not establish Registry, a subproject of Apache NiFi > >>> > >>> Thanks, > >>> > >>> Bryan > >>> > >>> [1] http://mail-archives.apache.org/mod_mbox/nifi-dev/201702. > > mbox/%3CCALo_ > >>> M19euo2LLy0PVWmE70FzeLhQRcCtX6TC%3DqoiBVfn4zFQMA%40mail.gmail.com%3E > >>> > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] New Apache NiFi Committer Joey Frazee

Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

and evaluate the necessary items > including checking hashes, signatures, build from source, and test. Then > please vote: > > [ ] +1 Release this package as nifi-1.1.0 > [ ] +0 no opinion > [ ] -1 Do not release this package because... > > Thanks! > -- Thanks, And

Re: Need Information - Apache NiFi

e > >> > >> > >> -- Forwarded message -- > >> From: Mothilal M <moth...@gmail.com> > >> Date: Tue, Nov 8, 2016 at 1:25 PM > >> Subject: Need Information - Apache NiFi > >> To: dev@nifi.apache.org > >> > &g

Re: [ANNOUNCE] New Apache NiFi Committer Rob Moran

and feel > of the NiFi user interface, to include the awesome logos! > > Welcome and congratulations! > > Tony > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [VOTE] Release Apache NiFi MiNiFI C++ 0.0.1 (RC1)

SHA256: c72046d86a9dc34033fa40ad1b2300f1f7915acd369f763e7fc02095d09bb91e > > > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/aldrin > > > > KEYS file available here: > > https://dist.apache.org/repos/dist/release/nifi/KEYS > > > > 11 issues were closed/resolved for this release: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > > version=12337990=12319921 > > > > Release note highlights can be found here: > > https://cwiki.apache.org/confluence/display/MINIFI/ > > Release+Notes#ReleaseNotes-Versioncpp-0.0.1 > > > > The vote will be open for 72 hours. > > Please download the release candidate and evaluate the necessary items > > including checking hashes, signatures, build from source, and test. Then > > please vote: > > > > [ ] +1 Release this package as nifi-minifi-cpp-0.0.1 > > [ ] +0 no opinion > > [ ] -1 Do not release this package because... > > > > Thanks! > > > > > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: SOAP Service through InvokeHTTP

ext: > > http://apache-nifi-developer-list.39713.n7.nabble.com/SOAP- > Service-through-InvokeHTTP-tp13129.html > > Sent from the Apache NiFi Developer List mailing list archive at > > Nabble.com. > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Max Kafka message size

urs using PublishKafka, and PutKafka. Setting the Max Record Size > property in the PutKafka processor has no affect on this. Note the stack > trace above is from the PutKafka processor with Max Record Size set to 10MB. > > I believe that this a regression from 0.6.0. > > Chris McDerm

Re: Max Kafka message size

TaTS/StoreFront Remote > > HPE Storage > > Hewlett Packard Enterprise > > Mobile: +1 978-697-5315 > > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] Apache NiFi 1.0.0-Beta release

sion=12338066 > Release note highlights can be found here:https://cwiki.apache.org/ > confluence/display/NIFI/Release+Notes#ReleaseNotes-Version1.0.0-Beta > Thank youThe Apache NiFi team > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis>

Re: [ANNOUNCE] New Apache NiFi Committer Andre Fucs de Miranda

equests or jiras, and have benefited from his > > knowledge and contributions on log processing such as the Lumberjack > > bundle. > > > > Welcome Andre! > > > > Tony > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [DISCUSS] MiNiFi C++ Initial Release - cpp-0.0.1

t follows. This marks another nice milestone of > > progress > > > and will further generate a multitude of avenues for people to get > > > involved. > > > > > > Looking forward to the new possibilities and challenges ahead. > > > > > > --Aldrin > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] New Apache NiFi Committer Yolanda Davis

t;> the > > >>> project. > > >>> > > >>> In addition to contributing variable registry support and json > > >> conversion, > > >>> many of you may have heard one of her talks and experienced her > > >> enthusiasm > > >>> firsthand at a myriad of conferences and meetups. > > >>> > > >>> > > >>> Tony > > > > > > > > > > > > -- > > > -- > > > yolanda.m.da...@gmail.com > > > @YolandaMDavis > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Jira privileges request

Thank you sir! On Tue, Jul 12, 2016 at 5:11 PM, Tony Kurc <trk...@gmail.com> wrote: > Andrew, I added you to Contributors. > > On Tue, Jul 12, 2016 at 5:06 PM, Andrew Psaltis <psaltis.and...@gmail.com> > wrote: > > > Bryan, > > While you are in the

Re: Jira privileges request

l 12, 2016 at 1:06 PM, Andrew Lim < > > andrewlim.apa...@gmail.com> > > > > wrote: > > > > > > > >> There are some tickets that I would like to assist on and assign to > > > >> myself. Could I be given the privileges in Jira to do so? > > > >> > > > >> My username is: andrewmlim > > > >> > > > >> Thanks! > > > >> > > > >> -Drew > > > > > > > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andy LoPresto

rd to his continued involvement in the project. > > > > Welcome and congratulations! > > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: Build error with processor project

/commons-codec/1.3/commons-codec-1.3.jar > > [ERROR] urls[20] = > file:/Users/ben.meng/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar > > [ERROR] urls[21] = > file:/Users/ben.meng/.m2/repository/xmlunit/xmlunit/1.5/xmlunit-1.5.jar > > [ERROR] Number of foreign imports: 1 > > [ERROR] import: Entry[import from realm > ClassRealm[project>com.mydomain:testprocessor:1.0-SNAPSHOT, parent: > ClassRealm[maven.api, parent: null]]] > > [ERROR] > > [ERROR] -: > org.apache.maven.doxia.tools.SiteTool > > [ERROR] -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException > > > The information contained in this transmission may contain privileged and > confidential information. It is intended only for the use of the person(s) > named above. If you are not the intended recipient, you are hereby notified > that any review, dissemination, distribution or duplication of this > communication is strictly prohibited. If you are not the intended > recipient, please contact the sender by reply email and destroy all copies > of the original message. > > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: KITESDK fails creation of schema

05p12113.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. > -- Thanks, Andrew Subscribe to my book: Streaming Data <http://manning.com/psaltis> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata <http://twitter.com/intent/user?screen_name=itmdata>

Re: KITESDK fails creation of schema

; > > > -- > View this message in context: > http://apache-nifi-developer-list.39713.n7.nabble.com/KITESDK-fails-creation-of-schema-tp12105.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. > -- Thanks, Andrew Subscribe to my book: Streaming Da

Re: Target version for new procesors

of 0.7 is at full steam and I think targeting it would > just add to the stress. > > On the the other hand, targeting 1.x gives the reviewers the small courtesy > of extra time to go through your code. > > Cheers > On 18 Jun 2016 05:15, "Andrew Psaltis" <psaltis.and

Target version for new procesors

All, With the what appears to be a soon cut of 0.7.0 and 1.0.0 just around the corner, if one were to start on developing a new processor what version(s) should be targeted? -- Thanks, Andrew

Re: Help Wanted

iew. > > On Tue, May 3, 2016 at 11:29 AM, Andrew Psaltis <psaltis.and...@gmail.com> > wrote: > >> Totally agree on all fronts. Would seem like it makes sense for a >> documentation PR to be opened soon with updates to the >> https://cwiki.apache.org/confluence/dis

Re: Help Wanted

t;> specifically due to the inline review/comment capabilities provided by >>> GitHub. >>> >>> Cheers >>> Oleg >>> >>> > On May 3, 2016, at 11:18 AM, Andrew Psaltis <psaltis.and...@gmail.com> >>> wrote: >>> >

Re: Help Wanted

esn’t need testing. > > Thanks again > Cheers > Oleg > > On May 3, 2016, at 11:07 AM, Andrew Psaltis <psaltis.and...@gmail.com> > wrote: > > Oleg, > I would love to help -- couple of quick questions: > > The GH PR's are ~60 as you indicated, but the How To Co

Help Wanted

Oleg, I would love to help -- couple of quick questions: The GH PR's are ~60 as you indicated, but the How To Contribute guide (Code review process -- https://cwiki.apache.org/confluence/display/NIFI/Contributor+Guide#ContributorGuide-CodeReviewProcess ) shows a JIRA list with patches available.