Opinion wanted: Cyber orchestration "distro"

Folks, I have been privately working on a number of "processors" focused on orchestration of cyber security related activities (eg update firewall rules with data provided via an HTTP endpoint) etc. While some of these tasks can be easily solved with generic NiFi components or with little (or

Re: PutSyslog IP Address

John, In addition to what Andrew said, if by ESM you refer to McAfee ESM, then you need to be mindful it expects the system to send data in a particular format and the data source to be configured on what the call a Forwarder. Cheers On Fri, Feb 23, 2018 at 11:49 PM, John Smith

Re: [VOTE] Release Apache NiFi 1.5.0 (RC1)

Sending again as my previous vote seems to not have reached the mailing list: +1 (binding) On Fri, Jan 12, 2018 at 3:36 PM, James Wing wrote: > +1 (binding). Ran through the release helper, checked the signature, > hashes, the license/notice changes, etc. Tested the binary

Re: [DISCUSS] CI / Travis / Jenkins

Aldrin for getting this started and folks like > Andre and Pierre who have tweaked it to make it more usable as well. > After a long run of it helping us out as we all know it went poorly > with every build failing for what seemed like months. > > After some improvements and update

Re: [DISCUSS] CI / Travis / Jenkins

Joe & Joey, I believe setting the maven compilation job to noisy - instead of the current quiet setting - should help solving the issue. Have we tried that? Cheers On 5 Dec 2017 6:26 AM, "Joe Witt" wrote: I agree this would be extremely nice to get back on track. The

Re: The mystery of ListSFTP that stops working

was happening. Will upload to gist soon. Cheers On Thu, Nov 16, 2017 at 2:07 AM, Mark Payne <marka...@hotmail.com> wrote: > Andre, > > So I am guessing that backpressure is not an issue then if you're not > seeing it run :) > Have you tried reducing the scheduling period fro

Re: The mystery of ListSFTP that stops working

Mark, Timer driven, Primary Node, 5 min Yield is set to 1 sec Backpressure = 10k flows or 1GB nifi.administrative.yield.duration=30 sec Cheers On Thu, Nov 16, 2017 at 1:32 AM, Mark Payne <marka...@hotmail.com> wrote: > Hey Andre, > > I have not seen this personally. Can you sha

The mystery of ListSFTP that stops working

Folks, Has anyone ever seen a situation where ListSFTP simply stops working? I have observed a few occurrences of seems to be some weird bug. Symptoms are: - Processor looks healthy (i.e. no bulletins) - State is stalled (i.e. no changes to new files or timestamps) - No signs of a stuck thread

Re: Did 1.4.0 introduce a "breaking change" ?

Matt, Yes. It seems to be the case. Reason being the Config Mgmt techniques used to populate the files are different. Cheers On Wed, Nov 1, 2017 at 12:07 AM, Matt Gilman <matt.c.gil...@gmail.com> wrote: > Andre, > > Based on the error, it looks like you've retaine

Re: Did 1.4.0 introduce a "breaking change" ?

but I reckon we should document it. Cheers On Tue, Oct 31, 2017 at 1:43 PM, Matt Gilman <matt.c.gil...@gmail.com> wrote: > Andre, > > While 1.4.0 introduces a more granular authorizers configuration, the > existing 1.3.0 configurations should still be valid. What was breaking f

Did 1.4.0 introduce a "breaking change" ?

Folks, I was looking at the upgrade process from 1.3.x to 1.4.0 and it seems to me we introduced a breaking change around the authorizations? When I look at the 1.4.0 authorizers.xml and its version 1.3.0 there's a massive discrepancy on the XML tree and the existing 1.3.x version does not seem

[Discuss] DeleteSFTP

Folks, I was recently asked by a user if we have a DeleteSFTP processor to handle file deletion AFTER some logic has been performed. I noticed we don't have a processor covering that, and while ExecuteScript could be used to make this happen I wondered if it we should support that? The logic is

Re: Want to contribute Jira[NIFI-4360]

Milan, Would you be able to comment on the differences between NIFI-4360 and NIFI-1922 ? Cheers On Thu, Sep 14, 2017 at 1:00 PM, Milan Chandna < milan.chan...@microsoft.com.invalid> wrote: > Hi, > > Can admins please make me a contributor so that I can assign >

Re: nifi processor for IPFIX

Chris, I was planning to address the netflow processor sometime in August once I finish the work I am doing around consuming TAXII endpoints but I am also happy for someone to give it a go... The plan was to process IPFIX (as this is the open standard) and later on, depending on documentation

Connection - Status History - Expired Flows

Folks, Flowfile expiration is a great feature in NiFi however I noticed a small oddity in how one can detect expiration of Flowfiles. >From what I understand, currently, the only way possible to do that is searching the provenance events for the EXPIRE event type. I've searched JIRA and noticed

Re: Filesystem based Schema Registry, does it make sense?

into a directory and then have it be useable in the flow could be helpful. On Jul 5, 2017 9:00 AM, "Andre" <andre-li...@fucs.org> wrote: dev, As I continue to explore the Record based processors I got myself wondering: Does it make sense to have a file-system based schema r

Filesystem based Schema Registry, does it make sense?

dev, As I continue to explore the Record based processors I got myself wondering: Does it make sense to have a file-system based schema registry? Idea would be creating something like AvroSchemaRegistry but instead of the adding each schema as a controller service property, we would have a

Re: AvroSchemaRegistry doesn't enjoy copy and paste?

, Andrew Psaltis <psaltis.and...@gmail.com> wrote: > Andre, > I may be totally off-base here as it relates to the record related > processing in NiFi. From a pure Avro viewpoint the same JSON will not work > between those two schemas that you provided. The second one has a nest

Re: AvroSchemaRegistry doesn't enjoy copy and paste?

; }, { "name":"deviceVendor", "type":[ "null", "float" ], "default":null } ] } } ] } It fails. intelliJ seems to sugge

Re: AvroSchemaRegistry doesn't enjoy copy and paste?

Joey, Using Chrome on Windows. Tried with Firefox and faced the same issue. On Fri, Jun 23, 2017 at 12:14 AM, Joey Frazee <joey.fra...@icloud.com> wrote: > Andre, if there are any line breaks in the schema and leading spaces on > those new lines, then this occurs. So if you min

AvroSchemaRegistry doesn't enjoy copy and paste?

All, I was playing with the AvroSchemaRegistry and noticed it seems to not play ball when the DFM pastes the schema into the dynamic property value. To test it I basically copied the demo schema from Mark's blog post[1] and pasted into a NiFi 1.3.0 instance. To my surprise the controller would

Re: LookupAttribute + CSV Lookup handling of non-matches

PM, Joey Frazee <joey.fra...@icloud.com> wrote: > Andre, there's a flag for "Include Empty Values". If set to false then the > effect is that non-matches result in a transfer to unmatched. The default > is true so I'd expect to see what you're seeing. > > The desc

LookupAttribute + CSV Lookup handling of non-matches

Hi all, I have been playing with the lookup attribute and noticed a behavior that seems counter intuitive to me: When using the SimpleCSVLookupService I noticed that whenever the service fails to find a match to a particular value, the LookupAttribute processor still populated the respective

Re: [VOTE] Release Apache NiFi 1.3.0

+1 binding On Wed, Jun 7, 2017 at 1:08 PM, Aldrin Piri wrote: > +1, binding > > Hashes and signature looks good > Build and contrib check was clean > README, L look good > Verified some simple flows > > > Environment: > Apache Maven 3.3.1

WAL Repository - Deleted prov and TOC files held by the NiFi process

Folks, Is anyone aware of conditions where the WAL repo may hold deleted files open? Cheers

Re: [ANNOUNCE] New Apache NiFi PMC Member - Pierre Villard

Pierre, Your contribution to NiFi takes many forms but I would like to thank you for the amazing blogs you have put together! I am sure many in the user and dev lists will vouch that your blog contains some of the first posts people will refer to when they start to use NiFi and when they try to

Re: [ANNOUNCE] New Apache NiFi PMC Member - Yolanda Davis

Yolanda, Congratulations and it is great to have you onboard! Cheers On Thu, May 18, 2017 at 12:11 PM, Tony Kurc wrote: > On behalf of the Apache NiFi PMC, I am pleased to announce that Yolanda > Davis has accepted the PMC's invitation to join the Apache NiFi PMC. We >

Re: [VOTE] Release Apache NiFi 1.2.0 (RC2)

Bryan, Thank you for putting this together. Tested on flow with a diverse set of processors. +1 binding. Only notes: - I believe the release notes should mention the change of the randomness source. While I suspect most will simply ignore, I wouldn't be surprised some people will develop

Re: NiFi unsecure cluster setup issue on Windows.

Hi, could it be that the windows firewall is enabled and blocking the ZK communication between nodes? Cheers On Wed, May 3, 2017 at 10:53 PM, shahbazatta wrote: > Hi, > I am trying to setup the 3 node NiFi but i am unable to set it up. I > already > setup it on

Re: Closing in on a NiFi 1.2.0 release?

All, For some reason my canvas did not refresh after a process bounce (which generally occurs) but reloading page allows for modifications. Cheers On Wed, May 3, 2017 at 7:43 AM, Andre <andre-li...@fucs.org> wrote: > folks, > > I was just working to debug the final thorns found

Re: Closing in on a NiFi 1.2.0 release?

folks, I was just working to debug the final thorns found reviewing NIFI-3726 and noticed an odd behavior and wanted to confirm. If I recall correctly in the past users could simply replace a processor NAR file and even if that NAR existed the flow would continue to work. I just replaced cp

[CALL FOR ACTION] Peer reviews & testing of new code

Dev, Those following the git commit log probably noticed that there has been a lot of action by some of the developers behind some significant improvements in 1.2.0. As these developers get busy I would like to remind the rest of the list about importance of our contribution around code review

Re: [DISCUSS] Component deprecation annotation

> the canvas and the dialog to add components, with additional > explanation > >>>> (and maybe a target release for full deprecation) in the help notes. > >>>> > >>>> Andy LoPresto > >>>> alopre...@apache.org > >>>>

[DISCUSS] Component deprecation annotation

dev, In light of the some recent deprecations (ListenLumberjack) and some potential deprecation (PutJMS/GetJMS) I started some progress on how to document the depreciation of NiFi components using annotations. In the absence of any better name I called the annotation @DeprecationWarning (so not

Re: whats new in nifi 1.2.0 / careful use of marks and being clear about non released features

Anshuman, The GCS processors have been merged to master a few weeks ago so in my personal opinion it should be a fairly safe bet to assume they will make to 1.2.0. Emphasis on assume. :-) >From what I gather the code base is reaching stability and as per email from Bryan earlier this week we

Making NiFi upgrade smoother

dev, What do you think about the idea of allowing an user to configure overrides for the "master" configuration files in order to smooth upgrades? In my opinion candidates would be_ bootstrap.conf_ and _nifi.properties_ as they contain the links to all other files (logback.xml excluded). Upon

Re: ezmlm warning messages threatening removal from list

Joe, I get them as well. I strongly suspect is caused by your server (GMAIL) bouncing a ezlm message due to its original sender or perhaps message volumes. I happen to just have received one of those emails a few minutes ago (regarding another NiFi list). I also believe the issue tends to solve

Re: load balancer on nifi cluster

Pradeep, As Bryan mentioned, load balancing of clusters boils down to the input protocol you are using and desired load balance outcome. In general if using TCP based load balancing you will have to make up your mind on how to configure your load balancer. Common approaches are round robin, byte

Re: NiFi Cluster on Docker (Kubernetes) - HTTPS issues

Johny, Tell me more... tell me more... have you ensure the cluster cross communication has been set to https? I remember seeing something like that in the summer days when I partially setup the cluster nodes to use TLS (forgetting to do the whole job). Can you confirm the settings for:

Re: Stalled PR clean-up

e the assist. > > Thanks > > On Apr 10, 2017 11:51 AM, "James Wing" <jvw...@gmail.com> wrote: > > > +1, please close. It's worth adding that all of the above PRs were asked > > to provide proof-of-life back in February. > > > > On Mon, Apr 10,

Stalled PR clean-up

dev, The PR queue is back at 80 contributions and unless someone suggest otherwise I would love to be able to close the following four PRs: PR#254 - NIFI-1583 Added ConvertJSONtoCSV processor (No update since Oct 2016) PR#293 - NIFI-1613 Initial version, try to improve conversion for different

Re: [DRAFT REPORT] Apache NiFi - April 2017

Joe, Thanks for doing this. +1 On Tue, Apr 11, 2017 at 12:28 AM, Aldrin Piri wrote: > +1 with the changes noted, thanks for constructing > > On Mon, Apr 10, 2017 at 4:25 PM, Joe Witt wrote: > > > Tony > > > > Good call yes. > > > > Off-list it was

Re: [ANNOUNCE] New Apache NiFi Committer Bin Qiu

congrats Bin! Looking forward for building a NiFi-CPP cluster in the future (Late April fool... happy to keep it as MiNiFi-CPP :-) ) Cheers On Wed, Apr 5, 2017 at 6:17 AM, Tony Kurc wrote: > Apache NiFi community, > > > On behalf of the Apache NiFI PMC, I am very

Re: [ANNOUNCE] New Apache NiFi PMC Member - Oleg Zhurakousky

Oleg, Thank you for accepting the invitation to join the PMC and welcome aboard! Cheers On Wed, Apr 5, 2017 at 5:51 AM, Tony Kurc wrote: > Apache NiFi Community, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Oleg > Zhurakousky has accepted the PMC's

Re: Deconstructing SMTP /Mime emails

David, The original email is part of the content produced by ListenSMTP itself. The challenge with emails is that sometimes the body itself may be encoded and this may or may not be extracted via ExtractEmailAttachments. Do you have a particular example of message you want to process? Cheers

Re: Processor missing when attempting Add Processor

Russell, Not sure if this is a typo but have you noticed this? p//rocessor.Processor Cheers On 29 Mar 2017 8:57 AM, "Russell Bateman" wrote: I've built a NAR containing a custom processor that loads in NiFi, but the processor cannot be found. At the top of

Re: maybe a handy script for working with PRs

Trying to save key strokes? Just use gitg No wasted keystrokes, just use the mouse/trackball/touchpad/whatever :-D On Mon, Mar 27, 2017 at 12:52 PM, Matt Burgess wrote: > +1 for Yetus, also this for saving keystrokes :) > > https://dev.to/sendra/git-faster-with-mingit

Re: Commit d90cf84 seems to break build?

to potentially scrap caching in Travis? > > > > > > This is another time we have missed something like this that no caching > > > would have prevented. Additionally, given the large footprint of the > > > repository download it seems as though its benefit ma

[HEADS-UP] Travis is green again!

dev, Just as a friendly heads up: The last remaining issue of tests failing when using certain locales was fixed today when NIFI-3466 was merged into master. This means the test units are now working with 4 different Locales without any know issues and travis is back to green (yay!). Moving

Re: Kafkaesque Output port

Aldrin, Another point for consideration is the scope of this information. Core NiFi flows and those components are very much about data whereas those IPs may not necessarily be data for consumption, per se, but context that governs how the data flow is operating. In this case, there is a

Re: Kafkaesque Output port

t, AMQ AWS's SQS/SNS whatever makes sense in the context. There's no need to modify or extend Nifi then. S Aldrin Piri <mailto:aldrinp...@gmail.com> > Thursday, March 16, 2017 1:07 PMvia Postbox <https://www.postbox-inc.com/? > utm_source=email_medium=sumlink_campaign=reach&

Kafkaesque Output port

dev, I recently created a demo environment where two remote MiNiFi instances (m1 and m2) were sending diverse range of security telemetry (suspicious email attachments, syslog streams, individual session honeypot logs, merged honeypot session logs, etc) from edge to DC via S2S Input ports Once

Re: Nifi Output port Use case

Aditya, MapR Stream is Kafka compatible so you could in theory just push from NiFi into the MapR cluster and get Spark to consume from there. However, if you want to bypass MapR streams then you can use Output ports as documented here:

Re: Is anyone else having trouble downloading jBcrypt dependency?

rowse/NIFI-3554, just my > first contribution, not sure if I missed something in the process :-), let > me know. > > - purbon > > On Sat, Mar 4, 2017 at 2:11 PM Andre <andre-li...@fucs.org> wrote: > > > dev, > > > > Seems the name has always been jBCrypt.

Is anyone else having trouble downloading jBcrypt dependency?

dev, I was wondering if anyone else is having trouble building NiFi after purging their maven repositories? $ git rebase apache/master Current branch NIFI-871 is up to date. $ mvn -U -DskipTests=true clean install ... [WARNING] The POM for de.svenkubiak:jBcrypt:jar:0.4.1 is missing, no

Re: [REMINDER] Please signoff when committing other people's changes

James, There's no doubt the Sign-off-by is redundant (as GIT itself holds that information, reason why GH is still able to show the information without the sign-of-by stamp), however, I agree with your view around positive action and easy to refer as Bryan pointed. Joe, Thanks for the

[REMINDER] Please signoff when committing other people's changes

dev, May I remind you to ensure we follow the Contributor Guide and use: git commit --amend -s when merging commits from your peers? While git pretty-format can be used to reveal the committer, I am sure that all of us will agree that as an inclusive community we value both the pretty and ugly

Re: waitting for your hellp

ST API together with the InvokeHTTP processor (payload content must be processed to the desired format before reaching InvokeHTTP)" Cheers On Mon, Feb 27, 2017 at 10:58 PM, Andre <andre-li...@fucs.org> wrote: > Hi, > > Writing to OpenTSDB is a reasonably common pattern that can b

Re: waitting for your hellp

processor (payload content must be processed to the desired format before reaching PutTCP) Hope this help. Andre PS-Due to its (higher) number of subscribers, the user mailing list is usually a better channel for messages requesting guidance on use cases. On Mon, Feb 27, 2017 at 6:55 PM, sczylbh <s

Re: Processors for Google Cloud Platform

it back to dev as that is a more appropriate forum. On Mon, Feb 27, 2017 at 3:30 PM, Mikhail Sosonkin <mikh...@synack.com> wrote: > Andre, > > I would love to get the PubSub processors into nifi proper. I'm not too > familiar with your development processes, can you give me some d

Quick question on LICENSE/NOTICE when bundling controllers and processors

Hi there, Quick question on proper licensing: When bundling Processors, Services and APIs, where should the NOTICES and LICENSES be added to? The PR in question is https://github.com/apache/nifi/pull/1541 My current reading is that all NAR levels will have to include the proper references

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

Joe, Thanks for the comments! Slightly deviating from code consistency discussion but I think you raised some important points. I may on the glass half empty side, but being a user who witnessed many time how modularity played on other communities i am not particular excited about the prospect.

Re: [DISCUSS] Scale-out/Object Storage - taming the diversity of processors

Andrew, Thank you for contributing. On 22 Feb 2017 10:21 AM, "Andrew Grande" <apere...@gmail.com> wrote: Andre, I came across multiple NiFi use cases where going through the HDFS layer and the fs plugin may not be possible. I.e. when no HDFS layer present at all, so

[DISCUSS] Scale-out/Object Storage - taming the diversity of processors

dev, I was having a chat with Pierre around PR#379 and we thought it would be worth sharing this with the wider group: I recently noticed that we merged a number of PRs and merges around scale-out/cloud based object store into the master. Would it make sense to start considering adopting a

Scale-out/Object Storage - taming the deviersity of processors

dev, I was having a chat with Pierre around PR#379 and we thought it would be worth sharing this with the wider group: I recently noticed that we merged a number of PRs and merges around scale-out/cloud based object store into the master. Would it make sense to start considering adopting a

Re: Starting apache NiFi as a windows service

Joey, At the moment I am experimenting with https://github.com/kohsuke/winsw On 16 Feb 2017 01:53, "iCloud" <joey.fra...@icloud.com> wrote: Andre, can you share any details on how you’re approaching this? Are you using an existing service wrapper? The javapackager tool adde

Re: travis-ci auto cancellation

7, 2017 at 8:22 AM, Andre <andre-li...@fucs.org> wrote: > > > dev, > > > > Would you mind if I configured the NiFi, MiNiFi and MiNiFI-CPP travis-ci > > integration to perform auto-cancellation when new commits are pushed to > the > > same branch or PR? > &g

Re: [VOTE] Release Apache NiFi 0.7.2

+1 binding. On Sat, Feb 18, 2017 at 6:51 AM, Matt Gilman wrote: > +1 (binding) Release this package as nifi-0.7.2 > > On Thu, Feb 16, 2017 at 11:42 PM, Andy LoPresto > wrote: > > > Hello, > > > > I am pleased to be calling this vote for the source

Re: [VOTE] Release Apache NiFi 1.1.2

+1 - release On Fri, Feb 17, 2017 at 2:37 PM, Andy LoPresto wrote: > Hello, > > I am pleased to be calling this vote for the source release of Apache NiFi > nifi-1.1.2. > > The source zip, including signatures, digests, etc. can be found at: >

travis-ci auto cancellation

dev, Would you mind if I configured the NiFi, MiNiFi and MiNiFI-CPP travis-ci integration to perform auto-cancellation when new commits are pushed to the same branch or PR? This should significantly reduce the number of builds we do per busy days and offer benefits to the whole community.

NIFI-329 - IRC Processors

dev, I am starting to work on NIFI-329 and plan to soon introduce processors capable of interacting with IRC servers. At this stage I am looking to implement only PublishIRC, however, given the processor will use a controller service this may be later on expanded to handle IRC message

Re: Moving ZIP and TAR.GZ "formats" into an explicit profile

that since commit 7e97946c359bfcb62ef39a2ce37083554501f1b0, parallel test runs now seem to be far more stable. If things continue stable, we may later on re-introduce parallel test runs to travis. Cheers On Fri, Feb 3, 2017 at 11:04 PM, Andre <andre-li...@fucs.org> wrote: > devs, >

Re: Starting apache NiFi as a windows service

Chris, Not that I am aware of but I am working on this atm. Should have something baked until the weekend. On Wed, Feb 15, 2017 at 12:25 PM, Chris Bulleri wrote: > Are there any instructions for starting the latest apache NiFi as a windows > service? Server 2012 in particular.

Re: MiNiFi Target audience

Marc, I would say that lack IPv6 support was not intentional and certainly in favor of addressing it. Cheers On Tue, Feb 14, 2017 at 6:00 AM, Marc P. wrote: > Good Afternoon, >Given the plethora of devices that MiNiFi may be installed onto, would > it make sense to

Re: PR Builds

Joe, Perhaps we should float the following feature to the Apache INFRA folks? https://github.com/travis-ci/beta-features/issues/3 I am sure most ASF projects would incredibly benefit from travis queue deduping. Cheers On Sat, Feb 11, 2017 at 7:49 AM, Joe Witt wrote: >

Re: [VOTE] Establish Registry, a sub-project of Apache NiFi

+1 binding On Sat, Feb 11, 2017 at 3:40 AM, Bryan Bende wrote: > All, > > Following a solid discussion for the past few days [1] regarding the > establishment of Registry as a sub-project of Apache NiFi, I'd like to > call a formal vote to record this important community

[NIFI-1657] Heads-up: NiFi's travis-ci is going "multi-lingual"

devs, In order to improve our ability to detect locale related bugs during development, Pierre and I have been working on getting the surefire-plugin to support user defined languages and to add some of these languages to the travis-ci environment matrix. It took a bit of trial and error but it

Re: C++ Style Guide

Aldrin, I am also aware of someone trying to use googletest to streamline the creation of cpp test coverage. I believe we may see a PR sometime later this week. Cheers On Tue, Feb 7, 2017 at 8:51 AM, Aldrin Piri wrote: > Marc, > > I think that makes a lot of sense and

Re: PutFTP Port, Username and Password are EL evaluated but properties lack expressionLanguageSupported(true)

On Tue, Feb 7, 2017 at 12:40 AM, Mark Payne <marka...@hotmail.com> wrote: > Andre, > > "This design choice seems to trigger" -- I don't think this is a design > choice but rather, a bug :) > Given you are the authoritative source I will trust your assessmen

PutFTP Port, Username and Password are EL evaluated but properties lack expressionLanguageSupported(true)

devs, As part of NIFI-940 I am crafting test coverage for the PutFTP processor. Upon testing I noticed the following discrepancy: The port property lacks Expression Language Support

PutFile,PutHDFS handle similar properties differently

devs, I was working on NIFI-940 when I noticed that PutFile and PutHDFS, while similar in nature have different ways of handling some of its common properties, more precisely, permissions (there may be others). While PutHDFS validates permissions via custom validators[1], PutFile will only

Re: Moving ZIP and TAR.GZ "formats" into an explicit profile

AM, Andy LoPresto <alopre...@apache.org> wrote: > +1 to Russell’s point and thanks Andre for bringing up the topic. I’d > hesitate to change the default now because people probably are depending on > the default, but I wouldn’t object to a shift in the default at a major >

Moving ZIP and TAR.GZ "formats" into an explicit profile

devs, Currently calling 'mvn clean install' creates a ZIP, a TAR.GZ and a directory containing the same code. This leads to wasted disk space and a lot of wasted disk writes (something that a lot of folks using SSDs prefer to avoid). Would anyone oppose the idea of moving the ZIP and TAR.GZ

Re: [ANNOUNCE] New Apache NiFi PMC Member - Joe Skora

Congratulations Joe! On Fri, Dec 30, 2016 at 5:02 AM, Aldrin Piri wrote: > All, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Joe Skora has > accepted the PMC's invitation to join the Apache NiFi PMC. Joe has been > with NiFi for quite some time, even

Re: [VOTE] Release Apache NiFi 1.1.1 (RC1)

+1 binding. built and tested on CentOS OpenJDK 8 Had a few initial issues getting to building with -T 2.0C but once completed NiFi seems to work On Tue, Dec 20, 2016 at 9:35 AM, Joe Percivall < joeperciv...@yahoo.com.invalid> wrote: > Hello Apache NiFi Community, > > I am pleased to be calling

Re: [ANNOUNCE] New Apache NiFi Committer Jeremy Dyer

Welcome aboard Jeremy and thank you for the contributions! On Tue, Dec 20, 2016 at 12:23 PM, Aldrin Piri wrote: > On behalf of the Apache NiFI PMC, I am very pleased to announce that Jeremy > Dyer has accepted the PMC's invitation to become a committer on the > Apache NiFi

Re: NIFI 1.1.0 build error

Martian macnificent is a dependency via ParCEFone (ParseCEF processor). Will have a look On 16 Dec 2016 01:56, "Oleg Zhurakousky" wrote: > Actually, i’ll take that back. I believe I never did the ‘purge’ step, > just ‘clean install’, and that is where I thought

Secure Site to Site works when using HTTP but fails when using RAW fails

devs, I may be missing something but for some reason I am unable to use RAW protocol in secure mode. As par documentation I've set: nifi.remote.input.host=node1.textbed.internal nifi.remote.input.secure=true nifi.remote.input.socket.port=54321 nifi.remote.input.http.enabled=false

Re: Large scale Secure MiNiFi deployments

Bryan, Yes, I am trying to avoid creating one user for each MiNiFi. I am here thinking, what if I install MiNiFi n ephemeral EC2 machine or even containers? As instances are turned on an off as required, users.xml would keep growing, Unless you remove a machine after its use. My view is that it

Fwd: Large scale Secure MiNiFi deployments

y thoughts? Cheers -- Forwarded message ------ From: Andre <andre-li...@fucs.org> Date: Wed, Dec 7, 2016 at 8:40 AM Subject: Large scale Secure MiNiFi deployments To: us...@nifi.apache.org All, Is anyone else using a large number of MiNiFi agents together with secure Si

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

(and validated by you). Once again, thank you for testing the scenario, much appreciated. Kind regards On 27 Nov 2016 6:27 PM, "Yolanda Davis" <yolanda.m.da...@gmail.com> wrote: Andre, I attempted to reproduce your test case with a three node cluster (unsecured in my case since

Re: [VOTE] Release Apache NiFi 1.1.0 (RC2)

Joe, +1 (binding). Verified signature, built with mvn -Pcontrib (success), built with -Pmapr (non-blocking failure on range processors - will raise JIRA), performed a rolling upgrade into secure test cluster (success with no side effect), processed a few GB of generated data (using multiple

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

<joe.w...@gmail.com> wrote: > No problem. Thanks > > On Nov 25, 2016 10:42 AM, "Andre" <andre-li...@fucs.org> wrote: > > Joe, > > The non-binding was more in the sense it is not a show stopper (as I don't > foresee too many people upgrading that

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

before the version change. Testing again with the source packages... On Sat, Nov 26, 2016 at 2:25 AM, Joe Witt <joe.w...@gmail.com> wrote: > Andre > > BTW as a member of the PMC your votes are binding. > > I am not quite sure the state of your snapshot version relative to

Re: [VOTE] Release Apache NiFi 1.1.0 (RC1)

Joe, -0 (non-binding) When testing "rolling upgrade" I noticed that as nodes restarted they were given new Node Ids (I suspect the NodeId is related to the version they run?). This results on a cluster with 50% of nodes showing up as disconnected. Not sure if this is particular to my test

Re: [DISCUSS] NiFi 1.1.0 release

Search 5.0 > >> >>> >- new ParseCEF to parse CEF formatted logs > >> >>> >- improve ExtractEmail now supports TNEF files > >> >>> >- new Validate CSV > >> >>> >- improved Solr processors now sup

Re: [DISCUSS] NiFi 1.1.0 release

gt; > to > > squeeze in a much goodness as possible into the release, but the > > important > > bug fixes should come first. Getting 1.x into a state where the > > release > > notes don't say that it is geared toward developers and testers is > > really > > huge. >

Re: Secure Cluster Mode Issues

Rick, Can you confirm the certificate has a chain of trust with the default JDK trusted certs? (i.e. trusted by the JVM) Cheers On Mon, Nov 7, 2016 at 3:38 AM, Ricky Saltzer wrote: > Hey Andy - > > Thanks again for the help. > > The error message seems indicative that it

Re: [ANNOUNCE] New Apache NiFi PMC Member - Andre Fucs de Miranda

thanks folks! Now I can finally retire. :-) On Fri, Nov 4, 2016 at 1:37 PM, Joe Witt <joew...@apache.org> wrote: > Team, > > On behalf of the Apache NiFi PMC, I am pleased to announce that Andre > Fucs de Miranda has accepted the PMC's invitation to join the Apache &g

Re: [DISCUSS] Provided dependency on bcprov-jdk15on

+1 as well. On Tue, Nov 1, 2016 at 2:41 AM, Joe Witt wrote: > Team, > > In the 1.x line bcprov made its way into the root of the classpath/lib > folder to support the encrypted sensitive properties features. This > can be reworked to isolate it a bit more if we need to. > >

  1   2   >