Re: [VOTE] Move Apache Metron to the Apache Attic and Dissolve PMC

2020-11-16 Thread Otto Fowler
+1 From: Justin Leet Reply: dev@metron.apache.org Date: November 16, 2020 at 09:01:36 To: dev@metron.apache.org Subject: [VOTE] Move Apache Metron to the Apache Attic and Dissolve PMC Hi all, This is a vote thread to retire Metron to the Attic, and dissolve the PMC. This follows a disc

Re: [DISCUSS] Retire Metron to the Attic

2020-11-09 Thread Otto Fowler
I am in support of this as well, We have substantial work to do to get metron off of the HDP version it is on, which I think is the minimal work to keep it viable. We do not however have the people to finish the work that was started. Jon Zeolla and myself will be forking the metron-bro-kafka-p

Re: Metron-2340 - Geo Database

2020-05-20 Thread Otto Fowler
I “believe” that those files apply to the database that they ship, looking at the perl It doesn’t seem to mention any claim or restrictions on the databases produced. I don’t think you are talking about distributing the perl module, but rather making it a build dependency, Is that right? On May

Re: Development Activity has dropped to effectively 0, what should we do?

2020-04-21 Thread Otto Fowler
I think the difference is the maintenance of the core of metron that *has* to be, and other things that may still be done, but will be worked on for their merits or by community need and not be required for everything On April 21, 2020 at 10:29:24, Justin Leet (justinjl...@gmail.com) wrote: How

Re: Failing to Setup Apache Metron Dev Machine using Vagrant (Require Assistance and Guidance)

2020-03-03 Thread Otto Fowler
I have tried this on master, and progressed all the way to the failure to setup enrichment because of the geomind change. I believe that this issue is only with the 3.1 feature branch. On March 3, 2020 at 09:49:39, Michael Miklavcic (michael.miklav...@gmail.com) wrote: It looks like the binar

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

2020-02-03 Thread Otto Fowler
they need to clean > it up, but that may cause a lot of friction for our users. > > On Mon, Jan 13, 2020 at 5:52 PM Michael Miklavcic < > michael.miklav...@gmail.com> wrote: > > > +1 to Apache Legal advice > > > > On Mon, Jan 13, 2020 at 3:30 PM Otto Fow

Re: [DISCUSS] Next Release - Life After 0.7.1

2020-01-14 Thread Otto Fowler
yes On January 14, 2020 at 13:05:17, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: We should probably also get this resolved for this release. https://issues.apache.org/jira/browse/METRON-2340. Thoughts? On Mon, Dec 16, 2019 at 2:19 PM Shane Ardell wrote: > Both PR #1527

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

2020-01-13 Thread Otto Fowler
profiles using the data?). If they do have to remove it, I assume that's not directly out problem (since they have to do cleanup), but we're probably not making it easy on them in terms of providing the ability to clean up that sort of information and rerun profiles and such. On Mo

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

2020-01-13 Thread Otto Fowler
information and rerun profiles and such. On Mon, Jan 13, 2020 at 5:20 PM Otto Fowler wrote: > I agree with all of that, my only thinking on contrib is, if that component > is not tested and has no coverage, and needs manual steps, then we may want > to separate it. > We would h

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

2020-01-13 Thread Otto Fowler
ke On Mon, Jan 13, 2020 at 1:59 PM Otto Fowler wrote: > Hi Tom, that is true, and I think that is the only viable approach. We do > however use the database for testing during build, and we do however setup > the components that use the data base in the ’sample’ flow with the > simula

Re: [DISCUSS] GeoLite database licensing change, master build broken…..

2020-01-13 Thread Otto Fowler
it load files from the local file system into HDFS, how you get the files to the local file system is up to you? On 2020-01-13, 3:52 AM, "Otto Fowler" wrote: https://issues.apache.org/jira/browse/METRON–2340 https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing

[DISCUSS] GeoLite database licensing change, master build broken…..

2020-01-13 Thread Otto Fowler
https://issues.apache.org/jira/browse/METRON–2340 https://blog.maxmind.com/2019/12/18/significant-changes-to-accessing-and-using-geolite2-databases/ Maxmind has changed the way the distribute and license the geolite2 database that we use in our builds and distribution. Master build is broken, an

Re: [ANNOUNCE] Apache Metron-bro-plugin-kafka release 0.3.0

2019-10-17 Thread Otto Fowler
Just a reminder, if you used my script to verify the RC, please comment : https://github.com/apache/metron-bro-plugin-kafka/pull/38 On October 16, 2019 at 17:19:24, Justin Leet (l...@apache.org) wrote: Hi all, I’m pleased to announce the release of Metron 0.3.0! It's been a little while comin

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

2019-10-11 Thread Otto Fowler
Zeolla zeo...@gmail.com On Thu, Oct 10, 2019 at 3:10 PM Otto Fowler wrote: > +1 binding Ran RC script including the docker end to end testing > > > > > On October 10, 2019 at 14:38:45, Otto Fowler (ottobackwa...@gmail.com) > wrote: > > I have written a new script for v

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

2019-10-10 Thread Otto Fowler
+1 binding Ran RC script including the docker end to end testing On October 10, 2019 at 14:38:45, Otto Fowler (ottobackwa...@gmail.com) wrote: I have written a new script for validation of bro-kafka RC’s https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC3

2019-10-10 Thread Otto Fowler
I have written a new script for validation of bro-kafka RC’s https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron-bro-kafka-rc-check Please give it a shot. If there are no issues with it, it will go into the plugin project after the rc is done ( can’t test the rc

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

2019-10-01 Thread Otto Fowler
The fix has landed. Also, here is a quick script to try for validation https://github.com/ottobackwards/Metron-and-Nifi-Scripts/blob/master/bro-kafka/metron-bro-kafka-rc-check On October 1, 2019 at 07:41:02, Otto Fowler (ottobackwa...@gmail.com) wrote: https://github.com/apache/metron-bro

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

2019-10-01 Thread Otto Fowler
https://github.com/apache/metron-bro-plugin-kafka/pull/37 On September 30, 2019 at 18:44:29, Otto Fowler (ottobackwa...@gmail.com) wrote: –1 binding. A new feature to our docker testing to add support for the git version / branch of the plugin to test was added during development. This

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC2

2019-09-30 Thread Otto Fowler
–1 binding. A new feature to our docker testing to add support for the git version / branch of the plugin to test was added during development. This feature however makes it impossible to run the docker testing suite against the signed src tarball for verification. I have created METRON–2269 for

Re: [DISCUSS] Completing HDP 3.1 upgrade feature branch and next steps for Metron 1.x release

2019-09-30 Thread Otto Fowler
I think we also need: - Draft of upgrade guide, reviewed and tried. What is missing? What is hard? Possible refactoring from there. - Draft of the new supported versions of XX for Metron - How are we going to tell current users the change in support? I am not sure bu

Re: [VOTE] Metron-bro-plugin-kafka Release Candidate 0.3.0-RC1

2019-09-29 Thread Otto Fowler
If you are doing the RM duties, just go a head and cut the RC. On September 29, 2019 at 11:35:10, zeo...@gmail.com (zeo...@gmail.com) wrote: Hi everyone, This took much longer than expected, but we recently cleaned up the last blocker to getting a 0.3 release out. As a reminder, currently the

Re: [DISCUSS] Curator client upgrade

2019-09-17 Thread Otto Fowler
+1 On September 17, 2019 at 14:53:13, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: Also, caught this come through the HBase dev list - https://issues.apache.org/jira/browse/HBASE-23032. Might be worth a look at 4.2.0 while we're at it and possibly also avoid this issue that I was ru

Re: [DISCUSS] Metron installation and management - deprecating Ambari support

2019-09-12 Thread Otto Fowler
I need a little while to think about this, but I would just like to say that NiFi is a really bad example to compare Metron too. Nifi can be deployed as a single zip file and run from wherever it is unzipped. It is more of an application that can be clustered with other instances of that applicati

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

2019-08-27 Thread Otto Fowler
If anyone can think of the things that need to be backed up, please comment the jira. On August 27, 2019 at 17:07:20, Otto Fowler (ottobackwa...@gmail.com) wrote: Good idea METRON–2239 [blocker]. On August 27, 2019 at 16:30:13, Simon Elliston Ball ( si...@simonellistonball.com) wrote: You

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

2019-08-27 Thread Otto Fowler
Good idea METRON–2239 [blocker]. On August 27, 2019 at 16:30:13, Simon Elliston Ball ( si...@simonellistonball.com) wrote: You could always submit a Jira :) On Tue, 27 Aug 2019 at 21:27, Otto Fowler wrote: > You are right, that is much better than backup_metron_configs.sh. > &g

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

2019-08-27 Thread Otto Fowler
;>> >>> Something worth noting here is that HDP 2.6.5 is quite old and >>> approaching EoL rapidly, so the issue of upgrade is urgent. I am aware of a >>> large number of users who require this upgrade ASAP, and in fact an aware >>> of zero users who wish

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

2019-08-27 Thread Otto Fowler
an aware >> of zero users who wish to remain on HDP 2. >> >> Perhaps those users who want to stay on the old platform can stick their >> hands up and raise concerns, but this move will likely have to happen very >> soon. >> >> Simon >> >> On T

Re: [DISCUSS] HDP 3.1 Upgrade and release strategy

2019-08-27 Thread Otto Fowler
Although we had the discussion, and some great ideas where passed around, I do not believe we came to some kind of consensus on what 1.0 should look like. So that discussion would have to be picked up again so that we could know where we are at, and make it an actual thing if we were going to make

Re: [DISCUSS] Deprecate Least Recently Used Pruner

2019-08-13 Thread Otto Fowler
Can you summarize what it does? Is it from OpenSOC? On August 13, 2019 at 17:53:52, Nick Allen (n...@nickallen.org) wrote: As part of https://github.com/apache/metron/pull/1470, I found it difficult to update the "Least Recently Used Pruner" to work with HBase 2.0.2. I am sure that given more

Jira issue creation

2019-08-13 Thread Otto Fowler
I know that there are many times where the PR work precedes the jira creation, so that you are creating the jira to match the work you are doing, and that is fine as there are all sorts of workflows for contributors. That being said, I don’t think it is great to have empty jiras just to placeholde

Re: Contributing to Metron

2019-08-13 Thread Otto Fowler
What is your jira id? On August 13, 2019 at 13:06:36, Yerex, Tom (tom.ye...@ubc.ca) wrote: I would like to get access to JIRA (or be assigned a ticket), to add documentation to the Centos7 project folder under metron/metron-deployment/development/*centos7*/, similar to the README.md file that

Re: Hello Metron Dev Community

2019-07-30 Thread Otto Fowler
Welcome Dale! Btw: Dale is Tigerquoll on slack :) On July 30, 2019 at 03:09:22, Dale Richardson (tigerqu...@outlook.com) wrote: Hi folks, Greetings from down under! I just thought I'd introduce myself now that I am starting to spend some time hanging around the list. I'm Dale, I've been invol

Re: Metron/Docker failing - should I file a Jira?

2019-06-20 Thread Otto Fowler
Hi Phillip, The docker compose stuff is in contrib because it uses a different method to deploy the cluster than the official builds ( which use Ambari ), and thus has to be maintained separately, and will always lag behind. I don’t believe it is up to date with all the changes that have gone int

Re: What's the status of Metron

2019-06-07 Thread Otto Fowler
Hi Phillip and welcome! You certainly can help. As far as the status, there are several ways to look at it aren’t there? - we have active committers and reviewers, but not as many as we would like - we have an active users like, but not insanely so - metron _is_ part of a large bistro package HC

Storm 1.0.x eol

2019-06-03 Thread Otto Fowler
https://storm.apache.org/2019/05/30/storm200-released.html

Re: [DISCUSS] Bug maybe: Alert UI can't use two status filter

2019-05-31 Thread Otto Fowler
Bug On May 31, 2019 at 08:53:21, Tibor Meller (tibor.mel...@gmail.com) wrote: Hi all, tl;dr: Is it a bug if "* -alert_status:RESOLVE OR -alert_status:DISMISS" not works on Alert UI? I'm experimenting with filtering from the alert UI. What I found is I can run the following query directly again

Re: [DISCUSS] Travis CI Build Time Limits

2019-05-23 Thread Otto Fowler
Yes, that is what I’m proposing, but if we want to try to break things down to speed them up, we can still do that ;) On May 23, 2019 at 11:28:51, Michael Miklavcic (michael.miklav...@gmail.com) wrote: I think we're talking about killing the cache just 1 time for the purpose of verifying that th

Re: [DISCUSS] Build RPM/DEBs in Travis?

2019-05-22 Thread Otto Fowler
https://issues.apache.org/jira/browse/METRON-885 On May 22, 2019 at 10:43:22, Justin Leet (justinjl...@gmail.com) wrote: Yep, that's all I was doing. I'm in favor of adding it to Travis. On Wed, May 22, 2019 at 10:28 AM Michael Miklavcic < michael.miklav...@gmail.com> wrote: > I think Justin w

Re: [RESULT][VOTE] Metron Release Candidate 0.7.1-RC2

2019-05-14 Thread Otto Fowler
I would like the announcement to state to look into the new deployment readme for issues with the configuration ui. I was holding my +1 for discussion on this point, and the release notes. On May 13, 2019 at 22:34:58, Michael Miklavcic (michael.miklav...@gmail.com) wrote: 🙌🎉🍾 On Mon, May 13, 2

Re: [VOTE] Metron Release Candidate 0.7.1-RC2

2019-05-13 Thread Otto Fowler
We don’t have release notes do we? Is our only recourse for pointing out things to look out for the release announcement? On May 10, 2019 at 20:58:40, Michael Miklavcic (michael.miklav...@gmail.com) wrote: +1 binding Validated same as Nick. Mike On Thu, May 9, 2019 at 5:54 PM Nick Allen wro

Re: [DISCUSS] JsonMapParser original string functionality

2019-05-10 Thread Otto Fowler
recreation of original form for forensics and evidentiary purposes. Simon > On 11 May 2019, at 00:10, Otto Fowler wrote: > > What about parser chaining? Should the original string be from kafka, or > the last parsed? > > > On May 10, 2019 at 19:03:39, Simon

Re: [DISCUSS] JsonMapParser original string functionality

2019-05-10 Thread Otto Fowler
gt;> Just another approach to consider. >>> >>> -- >>> [1] >>> >>> >> https://github.com/apache/metron/blob/1b6ef88c79d60022542cda7e9abbea7e720773cc/metron-platform/metron-parsing/metron-parsers-common/src/main/java/org/apache/metron/parsers/Parse

Re: [DISCUSS] JsonMapParser original string functionality

2019-05-10 Thread Otto Fowler
+1 On May 10, 2019 at 13:57:55, Michael Miklavcic (michael.miklav...@gmail.com) wrote: When adding the capability for parsing messages in the JsonMapParser using JSON Path expressions the original behavior for managing original strings was changed. https://github.com/apache/metron/blob/master/m

Re: [DISCUSS] Parser Aggregation in Management UI

2019-05-08 Thread Otto Fowler
You need to be a committer, that is all I think. I would not use the github UI for it though, I do it through the cli On May 8, 2019 at 09:45:24, Michael Miklavcic (michael.miklav...@gmail.com) wrote: Not that I'm aware of. Nick and Otto, you've created them before, did you need any special per

Re: [DISCUSS] Metron Release - 0.7.1 next steps

2019-05-03 Thread Otto Fowler
instances for replacing in-memory components, but I'm still not sure that solves this problem, or adds more complexity. Given the current options on the table, I'm inclined to go with "full_dev" serves both dev and demo purposes. Otto, what do you think? On Thu, May 2, 2019, 4:

Re: [VOTE] Update dev guidelines with format for sharing architecture source files and rendered images

2019-05-03 Thread Otto Fowler
+1 On May 2, 2019 at 21:18:21, Michael Miklavcic (michael.miklav...@gmail.com) wrote: Here's the latest discussion on the subject: https://lists.apache.org/thread.html/0aa2b0b9ed4a0f0b0d8bb018c618e62de196565f9af71f347e504076@%3Cdev.metron.apache.org%3E I'd like to propose a vote to change our d

Re: [DISCUSS] Parser Aggregation in Management UI

2019-05-02 Thread Otto Fowler
I have commented the jira. On May 2, 2019 at 14:22:41, Shane Ardell (shane.m.ard...@gmail.com) wrote: Hello everyone, In response to discussions in the 0.7.1 release thread, I wanted to start a thread regarding the parser aggregation work for the Management UI. For anyone who has not already

Re: [DISCUSS] Metron Release - 0.7.1 next steps

2019-05-02 Thread Otto Fowler
gt;>> with >>> > > > this. >>> > > > >>> > > > While releasing this week or next may not matter in the grand >>> scheme, >>> > if >>> > > we >>> > > > want to cut releases regularly, then we need to bear down and

Re: [DISCUSS] Dev guideline changes for architecture diagrams

2019-05-02 Thread Otto Fowler
2, 2019 at 5:19 AM Otto Fowler wrote: > I’m all set with this, but for one question, why image and image-source as > opposed to diagram and diagram source? Isn’t it more descriptive? Is > there another reason ( like for doc gen )? > > > > On May 1, 2019 at 20:12:47, Michael Mi

Re: [DISCUSS] Metron Release - 0.7.1 next steps

2019-05-02 Thread Otto Fowler
.html/06a59ea42e8d9a9dea5f90aab4011e44434555f8b7f3cf21297c7c87@%3Cdev.metron.apache.org%3E On Thu, May 2, 2019 at 1:17 PM Otto Fowler wrote: > If you can find a link in the archives for that thread, it would really > help. > > I don’t think sending them up as one sensor would work…. as something

Re: [DISCUSS] Dev guideline changes for architecture diagrams

2019-05-02 Thread Otto Fowler
I’m all set with this, but for one question, why image and image-source as opposed to diagram and diagram source? Isn’t it more descriptive? Is there another reason ( like for doc gen )? On May 1, 2019 at 20:12:47, Michael Miklavcic (michael.miklav...@gmail.com) wrote: Picking up where thing

Re: [DISCUSS] Metron Release - 0.7.1 next steps

2019-05-02 Thread Otto Fowler
ing out info about Stellar > functions in a better manner, etc. > * The fact that parsers are handled in Ambari at all. It's awful and leads > to situations like this. To the best of my knowledge, once we can do > chaining and aggregation in the Management UI, we should be able

Re: [DISCUSS] Metron Release - 0.7.1 next steps

2019-05-01 Thread Otto Fowler
I think it would help if the full consequences of having the UI show the wrong status where listed. Someone trying metron, will, by default , see the wrong thing in the UI for the ONLY sensors they have that are running and doing data. What happens when they try to start them to make them work? O

Re: [VOTE] Metron Release Candidate 0.7.1-RC1

2019-04-27 Thread Otto Fowler
ange the bro, snort, and yaf > sensors to > aggregated bc full dev didn't have enough resources. The upshot is > that the > UI still works for single sensors, but the feature for enabling > aggregated > sensors has not yet been completed. > > On Sat, Apr 27, 2019, 11

Re: [VOTE] Metron Release Candidate 0.7.1-RC1

2019-04-27 Thread Otto Fowler
-1 Ran the script and ran full dev, all good. In the configuration ui, the status of the sensors is not correct. It does not show any running, but they are running in storm and the data was moved correctly. On April 26, 2019 at 09:58:02, Otto Fowler (ottobackwa...@gmail.com) wrote: Curious

Re: [VOTE] Update dev guidelines with format for sharing architecture source files and rendered images

2019-04-26 Thread Otto Fowler
from their respective modules, but I honestly don't see that as a problem. On Fri, Apr 26, 2019, 11:40 AM Otto Fowler wrote: > On April 26, 2019 at 13:19:05, Michael Miklavcic ( > michael.miklav...@gmail.com) wrote: > > @otto when I get your responses to my Q's inline below I can

Re: [VOTE] Update dev guidelines with format for sharing architecture source files and rendered images

2019-04-26 Thread Otto Fowler
On April 26, 2019 at 13:19:05, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: @otto when I get your responses to my Q's inline below I can post another revision. On Thu, Apr 25, 2019 at 11:52 AM Otto Fowler wrote: > - We need to specify the format I think, and then say that dr

Re: [VOTE] Metron Release Candidate 0.7.1-RC1

2019-04-26 Thread Otto Fowler
Curious Anand, are your steps for bringing up an open stack cluster something we could script like the AWS stuff? On April 26, 2019 at 09:35:29, Anand Subramanian ( asubraman...@hortonworks.com) wrote: +1 (non-binding) * Built RPMs and mpacks. * Brought up Metron stack on 12-node CentOS 7 opens

Re: [VOTE] Update dev guidelines with format for sharing architecture source files and rendered images

2019-04-25 Thread Otto Fowler
- We need to specify the format I think, and then say that draw io is the tool for the format and not just specify the tool. - Existing diagrams, in order to be modified, will have to be converted to this format, there should be jiras for that 2.1 "New features and significant bug fixes should be

Re: [DISCUSS] Format for sharing architecture source files and rendered images

2019-04-17 Thread Otto Fowler
Also, the section should either have a blurb and like for draw.io or a reference footnote etc. On April 17, 2019 at 21:36:03, Otto Fowler (ottobackwa...@gmail.com) wrote: I think we should try draw.io, and should add ( with vote i think ) a new section to the developer documention like

Re: [DISCUSS] Format for sharing architecture source files and rendered images

2019-04-17 Thread Otto Fowler
I think we should try draw.io, and should add ( with vote i think ) a new section to the developer documention like: Architecture Diagrams The project supports the XXX format along with accompanying image version in format for architectural diagrams. Architectural diagrams are important

Re: Problems with Dev deployment.

2019-04-10 Thread Otto Fowler
et it merged. It has been a while but I recall I was pretty happy with it after my review cycle with you. - Jon Zeolla zeo...@gmail.com On Wed, Apr 10, 2019 at 9:17 AM Otto Fowler wrote: > These issues are the reason https://github.com/apache/metron/pull/1261 was > done. It would be nice if w

Re: Problems with Dev deployment.

2019-04-10 Thread Otto Fowler
nstructions (I will add the MacOS Mojave Drive permission issue >> as well). Do you know if the minimum ansible version requirement has >> changed at all? (some documentation lists it as 2.0.0.2 or 2.2.2.0). Do >> you guys usually put in a Jira to cover small documentation cha

Re: Problems with Dev deployment.

2019-04-07 Thread Otto Fowler
Can you pull down https://github.com/apache/metron/pull/1261 and try? That should eliminate any env. issues. I’ll update it to latest master now. On April 7, 2019 at 08:33:52, Dale Richardson (tigerqu...@outlook.com) wrote: Hi Folks, I've been walking through some of the documentations on buil

Re: Problems with Dev deployment.

2019-04-07 Thread Otto Fowler
Check the readme for instructions On April 7, 2019 at 09:40:34, Otto Fowler (ottobackwa...@gmail.com) wrote: Can you pull down https://github.com/apache/metron/pull/1261 and try? That should eliminate any env. issues. I’ll update it to latest master now. On April 7, 2019 at 08:33:52, Dale

Master is failing RAT check

2019-03-30 Thread Otto Fowler
https://travis-ci.org/apache/metron Looks like an issue with node.

Re: [DISCUSS] Ambari MPacks, Metron upgrades

2019-03-29 Thread Otto Fowler
The long and the short of it is that I don't think there is likely to be much more time invested in enhancing, upgrading, or expanding the Ambari MPack features for Metron from this point on. We have many users that currently depend on the installation process, and I think the option should continu

Re: [DISCUSS] Central Navigation for Alerts and Management UI

2019-03-11 Thread Otto Fowler
Maybe you should post to the users@ list On March 11, 2019 at 06:25:48, Shane Ardell (shane.m.ard...@gmail.com) wrote: Thank you both for explaining the original design choice. That does make sense. However, like both of you point out, I am also curious if anyone has direct user feedback indica

Re: [DISCUSS] Upgrading HBase and Kafka support

2019-03-08 Thread Otto Fowler
On Fri, Mar 8, 2019 at 12:26 PM Otto Fowler wrote: > I believe that the TestContainers allows the ide case > > > On March 8, 2019 at 11:38:24, Michael Miklavcic ( > michael.miklav...@gmail.com) > wrote: > > I'm -1 on #1 unless there's some desperately co

Re: [DISCUSS] Upgrading HBase and Kafka support

2019-03-08 Thread Otto Fowler
I believe that the TestContainers allows the ide case On March 8, 2019 at 11:38:24, Michael Miklavcic (michael.miklav...@gmail.com) wrote: I'm -1 on #1 unless there's some desperately compelling reason to go that route. It would be a regression in our test coverage, and at that point it's really

Re: [DISCUSS] Upgrading HBase and Kafka support

2019-03-08 Thread Otto Fowler
I think I have mentioned it before, but https://www.testcontainers.org could be a viable approach for this methodology (3). I would think it would be worth looking at. On March 8, 2019 at 09:47:54, Ryan Merriman (merrim...@gmail.com) wrote: I have been researching the effort involved to upgrade

Re: [DISCUSS] Architecture documentation

2019-02-25 Thread Otto Fowler
I really like the idea of architecture.md -> **/architecture.md. We overall do not have javadoc in a lot of areas, and could maybe start working on it as we go and think about asking for it in reviews. We are also missing the Parser Programmer’s Guide, how to add a parser to the metron system/inst

RE: How to provide hbase-site.xml to Stellar Processor Java API

2019-01-25 Thread Otto Fowler
information. As per my understanding there seems to be no scope to pass my own build Hbase configuration object to execute Stellar queries in my extended API. I may need to re-write lot of things in my extended API in the way Stellar processor works to override the Hbase configuration. @Otto Fowler

Re: How to provide hbase-site.xml to Stellar Processor Java API

2019-01-24 Thread Otto Fowler
ethod: public HTableInterface getTable(Configuration config, String tableName) throws IOException if you implement your own where you ignore the config argument and resolve the hbase table with your own injected config that will work Thanks Mohan DV On 1/24/19, 8:56 PM, "Otto Fowler" wrote

Re: How to provide hbase-site.xml to Stellar Processor Java API

2019-01-24 Thread Otto Fowler
Hi Anil, Can you create a jira on this with these details and a general overview of your use case? It looks like the HbaseConfiguration we use in the HTableConnector is done using the create() method, which creates from resources. I think we would need to do some work to support the external file.

Re: [DISCUSS] Writer class refactor

2019-01-18 Thread Otto Fowler
Agreed On January 18, 2019 at 14:52:32, Ryan Merriman (merrim...@gmail.com) wrote: I am on board with that. In that case, I think it's even more important that we get the Writer interfaces right. On Fri, Jan 18, 2019 at 1:34 PM Otto Fowler wrote: > I think that the writers should b

Re: [DISCUSS] Writer class refactor

2019-01-18 Thread Otto Fowler
I think that the writers should be loaded as, and act as extension points, such that it is possible to have 3rd party writers, and would structure them as such. On January 18, 2019 at 13:55:00, Ryan Merriman (merrim...@gmail.com) wrote: Recently there was a bug reported by a user where a parser

Re: Site-book broken in master

2018-12-20 Thread Otto Fowler
https://github.com/oasp/asciidoc-link-checker On December 20, 2018 at 12:59:39, Otto Fowler (ottobackwa...@gmail.com) wrote: +1 for merging a fix. On December 20, 2018 at 12:43:57, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: Thanks for the feedback Otto. I'm not too fam

Re: Site-book broken in master

2018-12-20 Thread Otto Fowler
iod?* This is a broken master as far as I'm concerned, despite what Travis says. In a separate PR, I'd also like to add a simple mvn clean site run to our Travis builds, which should catch the bigger issues. On Wed, Dec 19, 2018 at 8:51 PM Otto Fowler wrote: > Maybe we should con

Re: Site-book broken in master

2018-12-19 Thread Otto Fowler
What would help is an automated test the tests all the links as well. On December 19, 2018 at 19:55:03, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: I'd also like to submit a call for suggestions for making this process simpler. I think we've made some excellent progress towards gett

Re: Site-book broken in master

2018-12-19 Thread Otto Fowler
Maybe we should consider ascii doc, it shows in github, and can generate multiple formats. On December 19, 2018 at 22:49:26, Otto Fowler (ottobackwa...@gmail.com) wrote: What would help is an automated test the tests all the links as well. On December 19, 2018 at 19:55:03, Michael Miklavcic

Re: [VOTE] Metron Release Candidate 0.7.0-RC1

2018-12-12 Thread Otto Fowler
+1 binding Ran through script On December 12, 2018 at 14:10:22, Nick Allen (n...@nickallen.org) wrote: +1 binding - All of the tarballs, checksums, and signatures are correct - All of the tests and integration tests ran successfully. - The release also spun-up correctly in the development envir

Re: [DISCUSS] Mandatory relocation of Apache git repositories on git-wip-us.apache.org

2018-12-09 Thread Otto Fowler
+1 We will need jiras and PR’s for updating our scripts post move however. On December 9, 2018 at 06:32:44, Roy Lenferink (rlenfer...@apache.org) wrote: Hi folks, Checking the mail-archives I noticed the message below missed the dev@metron list [1]. Does anyone have a problem with starting the

Re: [DISCUSS] Recurrent Large Indexing Error Messages

2018-12-05 Thread Otto Fowler
Why not have a second indexing topology configured just for errors? We can load the same code with two different configurations in two topologies. On December 5, 2018 at 03:55:59, Ali Nazemian (alinazem...@gmail.com) wrote: I think if you look at the indexing error management, it is pretty much

Re: [DISCUSS] Managing intermittent test failures

2018-11-29 Thread Otto Fowler
+1 On November 29, 2018 at 10:26:53, Michael Miklavcic ( michael.miklav...@gmail.com) wrote: Every now and then we see intermittent test failures, and rather than sweeping them under the rug, we should have a simple method to track and handle them. I started creating Jiras for tests that I've se

Re: Unzipping Cypress

2018-11-28 Thread Otto Fowler
brary/Caches/Cypress, but the path depends on your OS: https://docs.cypress.io/guides/getting-started/installing-cypress.html#Binary-cache On Wed, Nov 28, 2018 at 4:19 PM Otto Fowler wrote: > Where is the cache path? > > > On November 28, 2018 at 09:34:18, Shane Ardell (shane.m.ard...@g

Re: Unzipping Cypress

2018-11-28 Thread Otto Fowler
Where is the cache path? On November 28, 2018 at 09:34:18, Shane Ardell (shane.m.ard...@gmail.com) wrote: https://github.com/cypress-io/cypress/issues/1813

Re: Unzipping Cypress

2018-11-27 Thread Otto Fowler
o why tomorrow. > > On Mon, Nov 26, 2018 at 5:33 PM Michael Miklavcic < > michael.miklav...@gmail.com> wrote: > >> Shane, Tibor - Can you guys chime in on this? >> >> On Mon, Nov 26, 2018 at 9:13 AM Otto Fowler >> wrote: >> >> > Isn’t there a

Re: Unzipping Cypress

2018-11-26 Thread Otto Fowler
:49 AM Otto Fowler wrote: > Anyone else seeing a lot of time taken downloading and unzipping Cypress on > builds? > What is up with that?™ > > ottO >

Unzipping Cypress

2018-11-24 Thread Otto Fowler
Anyone else seeing a lot of time taken downloading and unzipping Cypress on builds? What is up with that?™ ottO

Re: [DISCUSS] Add ngrx to handle state management in Angular

2018-11-22 Thread Otto Fowler
Can you describe what you mean by “state” in a little more detail? Not a complete description, maybe just a crib list. On November 22, 2018 at 07:21:43, Shane Ardell (shane.m.ard...@gmail.com) wrote: As both the Management and Alerts UI grow in size, managing application state continues to beco

Re: [DISCUSS] Deprecating MySQL

2018-11-16 Thread Otto Fowler
I would like to understand the work required to move our JDBC support ( or adapt the current support to the abstraction ) to /contrib. We could default and only officially support LDAP, but have the /contrib ( or /extension_examples ) have a “this is how you would support jdbc for auth “ project.

Re: [DISCUSS] Knox SSO feature branch review and features

2018-11-16 Thread Otto Fowler
e that Knox owns, and then default to Knox on to give us our nice single access point. Simon On Fri, 16 Nov 2018 at 15:35, Otto Fowler wrote: > Those are all valid points. I think it is ( was ) worth discussion at > lease a little. > > WRT Knox and defaults: > >

Re: Running MAAS in batch

2018-11-16 Thread Otto Fowler
That may be the best MAAS explanation I’ve seen Simon. On November 16, 2018 at 10:28:57, Simon Elliston Ball ( si...@simonellistonball.com) wrote: MaaS is designed to wrap model inference (scoring) an event at a time, via a REST api. As such, running it batch doesn't make a lot of sense, since e

Re: [DISCUSS] Attribution and merging the Elasticsearch client migration

2018-11-16 Thread Otto Fowler
pattern easier for people. On Fri, Nov 16, 2018, 5:42 AM Otto Fowler > Maybe this is worth a confluence entry, not as a guide, but just to > document what you did. > > On November 15, 2018 at 19:07:40, Michael Miklavcic ( > michael.miklav...@gmail.com) wrote: > > Ok, this is

Re: [DISCUSS] Knox SSO feature branch review and features

2018-11-16 Thread Otto Fowler
dependent on a Knox release. > > Imagine how we would have done with the Ambari side if we’d had to wait > for them to release every time we needed to change something in the > mpack... we don’t want that happening with Knox. > > Simon > > > On 16 Nov 2018, at 13:22, Otto

Re: Metron Release 0.6.1 and/or Plugin release 0.3.0?

2018-11-16 Thread Otto Fowler
Can you generate the jiras that would be included in the release? On November 16, 2018 at 10:05:50, Justin Leet (justinjl...@gmail.com) wrote: Given that we've had a couple major PRs (the ES client migration along with the Angular upgrade stuff, and I'm sure others), I'd be in favor of releasing

Re: [DISCUSS] Knox SSO feature branch review and features

2018-11-16 Thread Otto Fowler
https://issues.apache.org/jira/browse/KNOX-841?jql=project%20%3D%20KNOX%20AND%20text%20~%20support Solr is angular for example. On November 16, 2018 at 08:12:55, Otto Fowler (ottobackwa...@gmail.com) wrote: Ok, here is something I don’t understand, but would like to. Knox comes configured

Re: [DISCUSS] Knox SSO feature branch review and features

2018-11-16 Thread Otto Fowler
Ok, here is something I don’t understand, but would like to. Knox comes configured with build in services for a number of other apache products and UI’s. It would seem to me, that the best integration with Knox would be to do what these other products have done. 1. Do whatever you have to do to

Re: [DISCUSS] Knox SSO feature branch review and features

2018-11-16 Thread Otto Fowler
Welcome and thanks! On November 12, 2018 at 10:12:44, Sandeep Moré (moresand...@gmail.com) wrote: Hello Ryan, I am still catching up on the architecture so let me know if I am misunderstanding anything. You could have multiple serviced deployed in Knox 1. for metron (metron/api/v1) 2. for alert

  1   2   3   4   5   6   7   >