[GitHub] incubator-metron pull request #572: METRON-633: Create better logging for Hb...

2017-05-08 Thread zezutom
GitHub user zezutom opened a pull request: https://github.com/apache/incubator-metron/pull/572 METRON-633: Create better logging for HbaseEnrichmentWriter ## Contributor Comments I have added logging to critical paths, so that issues can be tracked down more easily. ##

[GitHub] incubator-metron pull request #571: METRON-633: Create better logging for Hb...

2017-05-08 Thread zezutom
Github user zezutom closed the pull request at: https://github.com/apache/incubator-metron/pull/571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: Parser Docs

2017-05-08 Thread Otto Fowler
There is a readme.md PER parser in 777. I only stubbed them out however. Each parser created by the archetype has one as well. What I was hoping to do was to include the parser docs in the package assembly so the UI could load it. On May 8, 2017 at 19:35:41, Simon Elliston Ball

Re: [DISCUSS] Code Style

2017-05-08 Thread Michael Miklavcic
+1 Justin. Thanks. On Mon, May 8, 2017 at 2:55 PM, Matt Foley wrote: > +1. I originally suggested the Sun style as a starting point, and I find > Justin’s arguments convincing, especially if there is a pre-packaged Google > style checking plug-in. > --Matt > > On

Re: Parser Docs

2017-05-08 Thread zeo...@gmail.com
Definitely worthwhile. I discussed something similar (but more general) a little while back here . Totally worth the effort IMO. Jon On Mon, May 8, 2017 at 7:36 PM Casey

[GitHub] incubator-metron pull request #571: METRON-633: Create better logging for Hb...

2017-05-08 Thread zezutom
GitHub user zezutom reopened a pull request: https://github.com/apache/incubator-metron/pull/571 METRON-633: Create better logging for HbaseEnrichmentWriter ## Contributor Comments I have added logging to critical paths, so that issues can be tracked down more easily.

[GitHub] incubator-metron pull request #571: METRON-633: Create better logging for Hb...

2017-05-08 Thread zezutom
Github user zezutom closed the pull request at: https://github.com/apache/incubator-metron/pull/571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #571: METRON-633: Create better logging for Hb...

2017-05-08 Thread zezutom
GitHub user zezutom opened a pull request: https://github.com/apache/incubator-metron/pull/571 METRON-633: Create better logging for HbaseEnrichmentWriter ## Contributor Comments I have added logging to critical paths, so that issues can be tracked down more easily.

[GitHub] incubator-metron pull request #570: METRON-937 Pycapa Consume Messages from ...

2017-05-08 Thread nickwallen
GitHub user nickwallen opened a pull request: https://github.com/apache/incubator-metron/pull/570 METRON-937 Pycapa Consume Messages from Begin, End, or Stored Offsets ## Changes * I have altered Pycapa so that it can consume messages from either the beginning, end or the

Re: [DISCUSS] Code Style

2017-05-08 Thread Matt Foley
+1. I originally suggested the Sun style as a starting point, and I find Justin’s arguments convincing, especially if there is a pre-packaged Google style checking plug-in. --Matt On 5/8/17, 9:47 AM, "Kyle Richardson" wrote: +1 Thanks, Justin. I'm all for

[GitHub] incubator-metron pull request #569: METRON-936: PCAP topology properties in ...

2017-05-08 Thread mmiklavc
GitHub user mmiklavc reopened a pull request: https://github.com/apache/incubator-metron/pull/569 METRON-936: PCAP topology properties in flux not correctly using pcap.properties Properties weren't being exposed and required users to modify the flux file directly for pcap.

[GitHub] incubator-metron issue #569: METRON-936: PCAP topology properties in flux no...

2017-05-08 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/incubator-metron/pull/569 Kick Travis - appears to be a test failure in the rest api --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] incubator-metron pull request #569: METRON-936: PCAP topology properties in ...

2017-05-08 Thread mmiklavc
Github user mmiklavc closed the pull request at: https://github.com/apache/incubator-metron/pull/569 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #564: Metron-905 Fix square-bracket behavior a...

2017-05-08 Thread mattf-horton
Github user mattf-horton commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/564#discussion_r115328348 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/ELASTICSEARCH/2.3.3/configuration/elastic-site.xml

Re: [DISCUSS] Update Metron Release Documentation

2017-05-08 Thread Matt Foley
It would be nice if someone more familiar with javascript than I added this functionality to the site. Thanks, --Matt On 5/5/17, 8:11 AM, "zeo...@gmail.com" wrote: So I'm not hearing any opposition to the idea. What do we need to handle for the eventual 0.4.0

Metron REST not starting

2017-05-08 Thread Laurens Vets
Hello list, I've installed Metron via Ambari and everything works except the Metron REST interface. It fails with the following error message: "Cannot load driver class: com.mysql.jdbc.Driver". I got the MySQL configuration items from here:

[GitHub] incubator-metron pull request #564: Metron-905 Fix square-bracket behavior a...

2017-05-08 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/564#discussion_r115301858 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/ELASTICSEARCH/2.3.3/configuration/elastic-site.xml ---

Re: [DISCUSS] Code Style

2017-05-08 Thread Kyle Richardson
+1 Thanks, Justin. I'm all for adopting the Google style guide. -Kyle On Mon, May 8, 2017 at 10:24 AM, Justin Leet wrote: > Sigh, the message was hidden below the fold. > > Part of what I've been playing around with is doing this. It's pretty easy > to set up both

[GitHub] incubator-metron issue #560: METRON-912: Metron vagrant setup steps no longe...

2017-05-08 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/incubator-metron/pull/560 Ok, sounds good. The biggest part of this is that I have not been able to find anybody who got Metron working on vagrant after only installing docker via `brew cask install docker`. I

[GitHub] incubator-metron issue #568: METRON-935: EC2 Deployment Failure - Could Not ...

2017-05-08 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/incubator-metron/pull/568 I deployed this to EC2 along with the code for #563 and #564. The deployment was successful, Elasticsearch started and was green/happy, and telemetry was flowing through end-to-end.

[GitHub] incubator-metron pull request #564: Metron-905 Fix square-bracket behavior a...

2017-05-08 Thread nickwallen
Github user nickwallen commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/564#discussion_r115272704 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/ELASTICSEARCH/2.3.3/configuration/elastic-site.xml

Re: [DISCUSS] Code Style

2017-05-08 Thread Justin Leet
Accidentally sent this to only Otto, instead of the whole group. Part of what I've been playing around with is doing this. It's pretty easy to set up both autoformatting and warnings in idea. There's a checkstyle plugin, and you can just import the appropriate file on each. As a fair warning,

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Simon Elliston Ball
Not from an ENV variable per-se, but from the spring config. Hence anything in the application.yml can be pushed into a field in a REST service endpoint with the @Value annotation. Simon > On 8 May 2017, at 14:59, Otto Fowler wrote: > > So that stuff is read from

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Otto Fowler
Can anyone describe the configuration flow from packaging/ambari to the rest application FooConfig? If I was going to add a new ambari variable from metron_env.xml and expose it to rest? On May 8, 2017 at 09:59:10, Otto Fowler (ottobackwa...@gmail.com) wrote: So that stuff is read from the

[GitHub] incubator-metron issue #560: METRON-912: Metron vagrant setup steps no longe...

2017-05-08 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/incubator-metron/pull/560 I tend to 'pin' my versions in Brew. I am more risk averse than you. ;) But your argument sounds reasonable. You convinced me. If we start to get negative reports from users,

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Otto Fowler
So that stuff is read from the environment variable? On May 8, 2017 at 09:27:48, Otto Fowler (ottobackwa...@gmail.com) wrote: OK, that is great. My works has bridged the move of rest into ambari. Mentally, I obviously haven’t caught up :) I’ll look for an example where we are reading

[GitHub] incubator-metron issue #560: METRON-912: Metron vagrant setup steps no longe...

2017-05-08 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/incubator-metron/pull/560 What versions of Vagrant or Virtualbox have you tested on? I would be hesitant to throw on a blanket "+" unless we have specifically tested on newer versions. --- If your project is

Re: [DISCUSS] Code Style

2017-05-08 Thread Otto Fowler
+1. Does anyone have an idea setup for this? On May 8, 2017 at 09:29:15, Justin Leet (justinjl...@gmail.com) wrote: I've been taking a look at setting up checkstyle per https://issues.apache.org/jira/browse/METRON-746. Given that we don't actually enforce any style right now (saying we use

Re: [DISCUSS] Code Style

2017-05-08 Thread Nick Allen
+1 Good points, Justin. I am onboard. On Mon, May 8, 2017 at 9:29 AM, Justin Leet wrote: > I've been taking a look at setting up checkstyle per > https://issues.apache.org/jira/browse/METRON-746. > > Given that we don't actually enforce any style right now (saying we

[GitHub] incubator-metron pull request #553: METRON-896: Document Having Kerberos Iss...

2017-05-08 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[DISCUSS] Code Style

2017-05-08 Thread Justin Leet
I've been taking a look at setting up checkstyle per https://issues.apache.org/jira/browse/METRON-746. Given that we don't actually enforce any style right now (saying we use Sun's is not the same as enforcing it!), and plan to do a blanket format after we get checkstyle setup, this seems like a

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Otto Fowler
OK, that is great. My works has bridged the move of rest into ambari. Mentally, I obviously haven’t caught up :) I’ll look for an example where we are reading application configuration variables out in the rest service. Thanks! On May 8, 2017 at 09:08:46, Simon Elliston Ball

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Ryan Merriman
It already works the way Simon describes. On Mon, May 8, 2017 at 8:08 AM, Simon Elliston Ball < si...@simonellistonball.com> wrote: > My proposal would be that the REST api use it’s application.yml for all > the parameters and have settings it needs included in that. E.g. the metron > directory

[GitHub] incubator-metron issue #555: METRON-902 ES improperly indexes Bro logs

2017-05-08 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/incubator-metron/pull/555 bump --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Simon Elliston Ball
My proposal would be that the REST api use it’s application.yml for all the parameters and have settings it needs included in that. E.g. the metron directory you need is set as a property of that yml, which is then accessible through the spring config auto-wiring - @Value(“${metron.directory}”)

[GitHub] incubator-metron pull request #568: METRON-935: EC2 Deployment Failure - Cou...

2017-05-08 Thread merrimanr
GitHub user merrimanr opened a pull request: https://github.com/apache/incubator-metron/pull/568 METRON-935: EC2 Deployment Failure - Could Not Create Blueprint ## Contributor Comments Has not been tested on ec2 yet but should resolve this issue or at least fix the error in the

Re: [DISCUSS] REST + ambari

2017-05-08 Thread Otto Fowler
The issue is that we have services that need to access the ambari rest api from inside the rest server. Technically, if someone changes the defaults for the metron directory etc, the rest won’t pick it up. I have a PR coming as a follow on to METRON-777 for installing extensions, and I write to