[GitHub] incubator-metron pull request #465: METRON-741: Stellar Field Transformation...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/465 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #464: METRON-740: Normalizing and adding log4j...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/464 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #466: METRON-742: Generated code for profile w...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/466 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #438: METRON-686 Record Rule Set that Fired During Th...

2017-02-27 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/438 Ok, I'm +1 on this pending successful travis. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] incubator-metron pull request #463: METRON-728: ReaderSpliteratorTest fails ...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/463 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC5

2017-02-27 Thread Nick Allen
That's what this fix was for: https://github.com/apache/incubator-metron/pull/422. I realize it is getting deprecated, but would have preferred to have something actually working before we deprecate. But alas... On Sat, Feb 25, 2017 at 10:42 AM, David Lyle wrote: > I'm

Re: METRON-646 commit attribution

2017-02-27 Thread Kyle Richardson
Sounds like we're in agreement. I did a quick dry run and agree with Nick, easy fix. I'm ready to push but want to be sure everyone's good with the history. Here's what it will look like: commit 8b4fa79d19be992ad270df7d1780db7f4b8ce176 Author: kylerichardson Date:

Re: METRON-646 commit attribution

2017-02-27 Thread Casey Stella
Nick, what are your thoughts on adjusting the script to error out or prompt for an email address if one can't be found? On Mon, Feb 27, 2017 at 8:51 PM, Nick Allen wrote: > I think revert and commit again is the best way to go. Not a big deal. > > On Mon, Feb 27, 2017 at

[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...

2017-02-27 Thread kylerichardson
Github user kylerichardson commented on the issue: https://github.com/apache/incubator-metron/pull/467 +1 passes unit and integration tests, ran through @cestella's test script successfully Thanks for your patience and for fixing! --- If your project is set up for it, you

Re: METRON-646 commit attribution

2017-02-27 Thread Justin Leet
+1 On Feb 27, 2017 10:12 PM, "Casey Stella" wrote: > +1 > > On Mon, Feb 27, 2017 at 10:11 PM, Kyle Richardson < > kylerichards...@gmail.com > > wrote: > > > Just to confirm. Please reply +1 if you're okay for me to commit the > revert > > / re-commit of METRON-646 (PR#441).

Re: Travis CI Changes have broken my heart..... or my builds

2017-02-27 Thread Otto Fowler
This is in travis though On February 27, 2017 at 21:49:57, Ryan Merriman (merrim...@gmail.com) wrote: nodemanager.LocalDirsHandlerService (LocalDirsHandlerService.java:updateDirsAfterTest(356)) - Most of the disks failed. 1/1 local-dirs are bad:

Re: METRON-646 commit attribution

2017-02-27 Thread Nick Allen
I think revert and commit again is the best way to go. Not a big deal. On Mon, Feb 27, 2017 at 6:55 PM, Casey Stella wrote: > I think it should be changed, but I'm not sure how to change it. I think it > should be changed because our git history is our legal trail of >

Re: METRON-646 commit attribution

2017-02-27 Thread Nick Allen
Sure. It could validate the email address before letting you proceed. It tries to get the email from the author's Github profile. If the author doesn't make one public, it will come back as 'null' and prompt you to change it. Of course, it will just use 'null' if you don't provide an

Re: METRON-646 commit attribution

2017-02-27 Thread Kyle Richardson
Just to confirm. Please reply +1 if you're okay for me to commit the revert / re-commit of METRON-646 (PR#441). Thanks, Kyle On Mon, Feb 27, 2017 at 9:25 PM, Casey Stella wrote: > Yeah, I'd think there does not exist a time in which the email should be > null. I'd rather

Re: Travis CI Changes have broken my heart..... or my builds

2017-02-27 Thread Casey Stella
Nothing from me, sorry! On Mon, Feb 27, 2017 at 9:31 PM, Otto Fowler wrote: > I took out the parallel processing and now I see the error: > > --- > > T E S T S > >

Re: Travis CI Changes have broken my heart..... or my builds

2017-02-27 Thread Otto Fowler
I took out the parallel processing and now I see the error: --- T E S T S --- Running org.apache.metron.maas.service.MaasIntegrationTest 2017-02-28 00:15:17,056 ERROR [main]

Re: Travis CI Changes have broken my heart..... or my builds

2017-02-27 Thread Ryan Merriman
I run into this error every now and then. If I free up space on my hard drive it goes away. > On Feb 27, 2017, at 8:31 PM, Otto Fowler wrote: > > I took out the parallel processing and now I see the error: > > --- >

Re: METRON-646 commit attribution

2017-02-27 Thread Casey Stella
+1 On Mon, Feb 27, 2017 at 10:11 PM, Kyle Richardson wrote: > Just to confirm. Please reply +1 if you're okay for me to commit the revert > / re-commit of METRON-646 (PR#441). > > Thanks, > Kyle > > On Mon, Feb 27, 2017 at 9:25 PM, Casey Stella

[GitHub] incubator-metron pull request #468: METRON-744: Allow Stellar functions to b...

2017-02-27 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/incubator-metron/pull/468 METRON-744: Allow Stellar functions to be loaded from HDFS ## Description The benefit of Stellar is that adding new functionality is as simple as providing a Jar. This enables people

Re: [DISCUSS][PROPOSAL] Side Loading and Installation of telemetry sources [METRON-258]

2017-02-27 Thread Otto Fowler
Sure, I am not doing the ansible work for any other reason than ansible is what we have now, and what works. I realized that deployment of the current parsers needs to work with ambari etc, and it is next. I just did ansible first, because that is what works for quick-dev etc. As far as how to

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103235131 --- Diff: metron-deployment/roles/kibana/README.md --- @@ -1,35 +0,0 @@ -Kibana 4 --- End diff -- Is this documented

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103238671 --- Diff: metron-deployment/roles/kibana/README.md --- @@ -1,35 +0,0 @@ -Kibana 4 --- End diff -- The file I commented was

Re: [DISCUSS][PROPOSAL] Side Loading and Installation of telemetry sources [METRON-258]

2017-02-27 Thread David Lyle
Hi Otto, It will have a pretty major effect. We agreed a bit back that we wanted, as a community, to reduce reliance on Ansible, so I think an Ansible-based parser loader would be sub-optimal. You may be working on this a bit in early. There are some some major changes on the way that will could

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103239678 --- Diff: metron-deployment/roles/java_jdk/defaults/main.yml --- @@ -15,4 +15,4 @@ # limitations under the License. # ---

Re: [DISCUSS][PROPOSAL] Side Loading and Installation of telemetry sources [METRON-258]

2017-02-27 Thread Otto Fowler
Not sure how https://github.com/apache/incubator-metron/pull/436 is going to effect this, but it will. On February 26, 2017 at 23:04:32, Otto Fowler (ottobackwa...@gmail.com) wrote: OK, Current status Complete: * Parsers broken out into common, base ( raw types - csv, json, grok ) and

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103235875 --- Diff: metron-deployment/roles/kibana/README.md --- @@ -1,35 +0,0 @@ -Kibana 4 --- End diff -- Is what documented? I just

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103240842 --- Diff: metron-deployment/roles/kibana/README.md --- @@ -1,35 +0,0 @@ -Kibana 4 --- End diff -- Ah, it is, but not well. I'll

[GitHub] incubator-metron issue #467: METRON-743: Sort the files when reading results...

2017-02-27 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/incubator-metron/pull/467 Ok, I ran this up and tested it and I got the results I expect, but I'd like some independent confirmation by @kylerichardson --- If your project is set up for it, you can reply to this

Re: question about shading

2017-02-27 Thread Casey Stella
Metron-common is shaded so that we can use a more recent version of guava which some of our functionality relies upon but does not play nice with the version brought in with HBase (by relocating gauva). I, personally, believe that we should - Reduce our dependence on guava until we no longer

[GitHub] incubator-metron issue #316: METRON-503: Metron REST API

2017-02-27 Thread jjmeyer0
Github user jjmeyer0 commented on the issue: https://github.com/apache/incubator-metron/pull/316 @merrimanr Good catch on this. I'll take a look again, but I think it's looking good! --- If your project is set up for it, you can reply to this email and have your reply appear on

[RESULT] [VOTE] Releasing Apache Metron (incubating) 0.3.1-RC5

2017-02-27 Thread Casey Stella
The release passes: +1 (binding): - James Sirota - David Lyle - Ryan Merriman - Casey Stella +1 (non-binding): - Justin Leet

Re: question about shading

2017-02-27 Thread Otto Fowler
metron-api-0.3.1.jar, metron-common-0.3.1.jar, htrace-core-3.1.0-incubating.jar define 756 overlapping classes: [WARNING] - org.apache.htrace.fasterxml.jackson.databind.introspect.BasicBeanDescription [WARNING] - org.apache.htrace.fasterxml.jackson.databind.KeyDeserializer$None [WARNING]

question about shading

2017-02-27 Thread Otto Fowler
Is there a reason why we shade ALL of the jars? For example - metron-common is shaded. But it is never ‘deployed’ to storm or yarn or mr as a stand alone… I would think that only the ‘outward’ facing libs would be shaded.

Re: [DISCUSS] Making adding new 3rd-party Stellar functions easier

2017-02-27 Thread Matt Foley
Couple thoughts: 1. I see the Accumulo class loader allows multiple clients with potentially conflicting loads, via the “context” mechanism. That’s good. NiFi also used a multi-classloader mechanism to support potentially conflicting side-loads of their Processor bundles (“nars”), but I don’t

[GitHub] incubator-metron issue #316: METRON-503: Metron REST API

2017-02-27 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/incubator-metron/pull/316 Finally figured this one out. I wasn't able to reproduce the issue because my maven version was a couple minor releases behind (on 3.3.9 now for what it's worth). Once I got past that

[GitHub] incubator-metron pull request #441: METRON-646: Add index templates to metro...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/441 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #441: METRON-646: Add index templates to metron-docke...

2017-02-27 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/incubator-metron/pull/441 +1 from me --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] incubator-metron pull request #436: METRON-671: Refactor existing Ansible de...

2017-02-27 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/436#discussion_r103241052 --- Diff: metron-deployment/roles/java_jdk/defaults/main.yml --- @@ -15,4 +15,4 @@ # limitations under the License. # ---

[DISCUSS] Making adding new 3rd-party Stellar functions easier

2017-02-27 Thread Casey Stella
Hi All, The benefit of Stellar is that adding new functionality is as simple as providing a Jar. This enables people who want to integrate with Metron to easy add enrichments or other functionality. The snag currently with this is that we provide a single jar, so all stellar functions that we

Re: [DISCUSS][PROPOSAL] Side Loading and Installation of telemetry sources [METRON-258]

2017-02-27 Thread Otto Fowler
After some discussion with David, I am going to rebase my work off of PR-436 ( ansible deploys with mpack ) On February 27, 2017 at 10:31:26, Otto Fowler (ottobackwa...@gmail.com) wrote: Sure, I am not doing the ansible work for any other reason than ansible is what we have now, and what

[GitHub] incubator-metron issue #449: METRON-701 Triage Metrics Produced by the Profi...

2017-02-27 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/incubator-metron/pull/449 I made the required changes and updated the PR description to reflect that. Please take a look and review. --- If your project is set up for it, you can reply to this email and have

[GitHub] incubator-metron pull request #438: METRON-686 Record Rule Set that Fired Du...

2017-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/438 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

METRON-646 commit attribution

2017-02-27 Thread Kyle Richardson
Ok, so here's the story... Ryan was nice enough to commit my recent PR and for whatever reason my github username but not my email address appears in the commit author (see below). commit 41fc0ddc9881d9cfdd8bae129c0bb7800a116d4c Author: kylerichardson Date: Mon Feb 27 11:38:55 2017 -0600

Re: METRON-646 commit attribution

2017-02-27 Thread Casey Stella
I think it should be changed, but I'm not sure how to change it. I think it should be changed because our git history is our legal trail of attribution. Mucking with it is relatively serious business. As to how, normally I'd say git commit --amend --author "kylerichardson <