[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread bbende
Github user bbende commented on the pull request: https://github.com/apache/incubator-metron/pull/67#issuecomment-204616131 @merrimanr I think using the auto commits would be the way to go and gives you the flexibility to tune the values to your needs. You could still leave the option

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread merrimanr
Github user merrimanr commented on the pull request: https://github.com/apache/incubator-metron/pull/67#issuecomment-204588375 Casey and David, just pushed a commit to address your comments (integration tests ran). Bryan, thanks for commenting, that's a great point. It's a

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread bbende
Github user bbende commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58244766 --- Diff: metron-streaming/Metron-Solr/src/main/java/org/apache/metron/writer/solr/SolrWriter.java --- @@ -0,0 +1,115 @@ +/** + * Licensed to

[GitHub] incubator-metron pull request: METRON-93: Generalize the HBase thr...

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/66#discussion_r58237558 --- Diff: metron-streaming/Metron-DataLoads/src/main/java/org/apache/metron/dataloads/hbase/mr/PrunerMapper.java --- @@ -48,7 +48,7 @@ public void

[GitHub] incubator-metron pull request: METRON-93: Generalize the HBase thr...

2016-04-01 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/66#discussion_r58236854 --- Diff: metron-streaming/Metron-DataLoads/src/main/java/org/apache/metron/dataloads/hbase/mr/PrunerMapper.java --- @@ -48,7 +48,7 @@ public voi

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58224354 --- Diff: metron-streaming/Metron-Solr/src/main/java/org/apache/metron/writer/solr/MetronSolrClient.java --- @@ -0,0 +1,83 @@ +/** + * Lice

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58223640 --- Diff: metron-streaming/Metron-Elasticsearch/pom.xml --- @@ -0,0 +1,202 @@ + + + +http://maven.apache.org/POM/4.0.0"; xmlns:xsi="

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58223216 --- Diff: metron-streaming/Metron-Common/src/main/java/org/apache/metron/bolt/ConfiguredBolt.java --- @@ -77,15 +82,37 @@ public void childEvent(Cu

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58223047 --- Diff: deployment/inventory/multinode-vagrant/group_vars/all --- @@ -49,17 +49,23 @@ snort_version: "2.9.8.0-1" snort_alert_csv_path: "/var/l

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58222887 --- Diff: deployment/inventory/singlenode-vagrant/group_vars/all --- @@ -62,7 +62,7 @@ threat_intel_bulk_load: False #Sensors install_pycap

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58221773 --- Diff: metron-streaming/Metron-Solr/src/main/java/org/apache/metron/writer/solr/MetronSolrClient.java --- @@ -0,0 +1,83 @@ +/** + * Lice

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58221656 --- Diff: metron-streaming/Metron-Solr/src/main/java/org/apache/metron/writer/solr/MetronSolrClient.java --- @@ -0,0 +1,83 @@ +/** + * Lice

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread cestella
Github user cestella commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58221412 --- Diff: metron-streaming/Metron-Solr/src/main/java/org/apache/metron/writer/solr/MetronSolrClient.java --- @@ -0,0 +1,83 @@ +/** + * Lice

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread dlyle65535
Github user dlyle65535 commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/67#discussion_r58220672 --- Diff: metron-streaming/Metron-Common/src/test/java/org/apache/metron/pcap/PcapUtilsTest.java --- @@ -6,17 +6,26 @@ * to you under the A

[GitHub] incubator-metron pull request: Metron 86 - SolrWriter

2016-04-01 Thread merrimanr
GitHub user merrimanr opened a pull request: https://github.com/apache/incubator-metron/pull/67 Metron 86 - SolrWriter This pull request adds support for Solr. Adding Solr required a change to how code is built and deployed because a) Solr and Elasticsearch both depend on Apache L

Re: Metron-Streaming Modules...

2016-04-01 Thread Debo Dutta (dedutta)
Hi Casey Thanks. What I meant was this - are we discussing the changes in arch and the re-factoring plans somewhere in the open? Is there any UI design work happening in the open? debo On 4/1/16, 7:54 AM, "Casey Stella" wrote: >Hi Debo, > >Thanks! I'm glad that it's useful. The issue is t

Re: Metron-Streaming Modules...

2016-04-01 Thread John
Awesome Casey & Ryan! I wasn't aware of the wiki, so I'll definitely be reading through that. And the extra details you sent Casey will definitely help too. Thanks! On Fri, Apr 1, 2016 at 10:54 AM, Casey Stella wrote: > Hi Debo, > > Thanks! I'm glad that it's useful. The issue is that most thi

Re: Metron-Streaming Modules...

2016-04-01 Thread Casey Stella
Hi Debo, Thanks! I'm glad that it's useful. The issue is that most things are in flux at the moment. That being said, we have some pretty complete documentation at https://cwiki.apache.org/confluence/display/METRON/Metron+Architecture This email was an attempt to connect the code to the archite

[GitHub] incubator-metron pull request: METRON-93: Generalize the HBase thr...

2016-04-01 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/incubator-metron/pull/66 METRON-93: Generalize the HBase threat intel infrastructure to support enrichments As it stands, the threat intel infrastructure is awkward. Namely, different threat intelligence sources

Re: Metron-Streaming Modules...

2016-04-01 Thread Debo Dutta (dedutta)
Hi Casey This is a good intro. We should have this on our web pages. On the topic of metron streaming re-arch and re-factor, is there a document that is being worked on? The dev list is quiet :) debo On 4/1/16, 6:08 AM, "Casey Stella" wrote: >Hey John, > >First of all, thanks for the con

Unsuccessful

2016-04-01 Thread Kuba Sienkiewicz
Hi, I have a question regarding installation of metron. Since week ago I has tried to get metron working without success. Is it an usual situation or am I just doing something wrong? Also I would be grateful if somebody could help me with threading problem in enrichment bolt. Storm page says that

Re: Unsuccesfull installation

2016-04-01 Thread Casey Stella
Hey Jakub, Sorry, my last email must've not made it to you. What kind of error are you seeing? Any stack traces or error messages in the logs? Also, could you elaborate on what the issue is with the enrichment bolts? Thanks, Casey On Fri, Apr 1, 2016 at 9:19 AM, Kuba Sienkiewicz wrote: >

Unsuccesfull installation

2016-04-01 Thread Kuba Sienkiewicz
Hi, I have a question regarding installation of metron. Since week ago I has tried to get metron working without success. Is it an usual situation or am I just doing something wrong? Also I would be grateful if somebody could help me with threading problem in enrichment bolt. Storm page says that

[GitHub] incubator-metron pull request: METRON-92: Snort has moved their re...

2016-04-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/65 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] incubator-metron pull request: METRON-92: Snort has moved their re...

2016-04-01 Thread cestella
Github user cestella commented on the pull request: https://github.com/apache/incubator-metron/pull/65#issuecomment-204392919 +1 from me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

Re: Metron-Streaming Modules...

2016-04-01 Thread Casey Stella
Hey John, First of all, thanks for the contributions. Contributions make open source work, so thanks so much for that. The structure of metron-streaming will likely be shifting. The lay of the land is that the last few months have seen a rearchitecture of a lot of the old opensoc code. As it s

Re: Metron-Streaming Modules...

2016-04-01 Thread Ryan Merriman
John, Thanks so much for your interest. I feel like you have a pretty good understanding of how things fit together. The existing project structure is left over from the legacy OpenSOC implementation so it¹s not as clear and organized as it could be. We are currently working on reorganizing Met