Disable Metron parser output writer entirely

2018-02-01 Thread Ali Nazemian
Hi All, I am trying to investigate whether we can disable a Metron parser output writer entirely and manage it via KAFKA_PUT Stellar function instead. First, is it possible via configuration? Second, will be any performance difference between normal Kafka writer and the Stellar version of it

[GitHub] metron pull request #922: METRON-1441: Create complementary Solr schemas for...

2018-02-01 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/922#discussion_r165548937 --- Diff: metron-platform/metron-solr/src/test/java/org/apache/metron/solr/schema/SchemaTranslatorTest.java --- @@ -0,0 +1,188 @@ +/** + *

[GitHub] metron pull request #922: METRON-1441: Create complementary Solr schemas for...

2018-02-01 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/922#discussion_r165548986 --- Diff: metron-platform/metron-solr/src/test/java/org/apache/metron/solr/schema/SchemaTranslatorTest.java --- @@ -0,0 +1,188 @@ +/** + *

Re: [DISCUSS] Persistence store for user profile settings

2018-02-01 Thread Michael Miklavcic
Personally, I'd be in favor of something like Maria DB as an open source repo. Or any other ansi sql store. On the positive side, it should mesh seamlessly with ORM tools. And the schema for this should be pretty vanilla, I'd imagine. I might even consider skipping ORM for straight JDBC and simple

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-02-01 Thread merrimanr
Github user merrimanr closed the pull request at: https://github.com/apache/metron/pull/911 ---

Re: [DISCUSS] Persistence store for user profile settings

2018-02-01 Thread Casey Stella
So, I'll answer your question with some questions: - No matter the data store we use upgrading will take some care, right? - Do we currently depend on a RDBMS anywhere? I want to say that we do in the REST layer already, right? - If we don't use a RDBMs, what's the other option?

[GitHub] metron pull request #921: METRON-1441: Create complementary Solr schemas for...

2018-02-01 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/metron/pull/921 ---

[GitHub] metron pull request #922: METRON-1441: Create complementary Solr schemas for...

2018-02-01 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/metron/pull/922 METRON-1441: Create complementary Solr schemas for the main sensors ## Contributor Comments We have ES templates for bro, snort, yaf, and error, we need corresponding solr schemas for these

[GitHub] metron issue #911: METRON-1419: Create a SolrDao

2018-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/911 actually, it may be that feature branch PRs don't automatically close..or hmm, not sure. Anyway, close it please :) ---

[GitHub] metron issue #911: METRON-1419: Create a SolrDao

2018-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/911 well, I botched the stupid commit message and put `apache/metron` when I meant `apache/feature/METRON-1416-upgrade-solr`. Can you close this PR @merrimanr ? ---

[GitHub] metron issue #921: METRON-1441: Create complementary Solr schemas for the ma...

2018-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/921 I know that commit history looks pretty awful, but it's because I branched off of @merrimanr 's SolrDao PR initially. Now that PR is in the branch, so the comparison should be more sensible. ---

[GitHub] metron issue #918: METRON-1436: Manually Install Solr Cloud in Full Dev

2018-02-01 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/918 I got full dev spinning spun up with this, and it looks good. I think the latest couple comments are still to be addressed, but otherwise good to go. ---

[GitHub] metron pull request #921: METRON-1441: Create complementary Solr schemas for...

2018-02-01 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/metron/pull/921 METRON-1441: Create complementary Solr schemas for the main sensors ## Contributor Comments We have ES templates for bro, snort, yaf, and error, we need corresponding solr schemas for these

[GitHub] metron issue #911: METRON-1419: Create a SolrDao

2018-02-01 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/911 I looked over the changes and refactor. Thanks a lot for taking care of that, it looks a lot better and is definitely easier to grok, imo, than the old way. I'm +1 on merging this into

[GitHub] metron pull request #919: METRON-1439: Turn off git pager in platform-info s...

2018-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/919 ---

[GitHub] metron pull request #920: METRON-1438 Move SHELL functions from metron-manag...

2018-02-01 Thread ottobackwards
GitHub user ottobackwards opened a pull request: https://github.com/apache/metron/pull/920 METRON-1438 Move SHELL functions from metron-management to stellar-common Part of making stellar more modular and stand alone is consolidation of stellar functionality scattered through

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/919 No, I am sorry, I thought that was understood. I have not reviewed, but I would go ahead based on @cestella ---

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/919 @ottobackwards Any objections to having the discussion outside of this and merging this in as-is? ---

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/919 so, I'm +1 on this and we probably want a discussion outside of this about where to move `platform-info.sh` ---

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/919 this is a user utility though, not a dev one. I would create a new support-scripts folder ---

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/919 > Sidenote, do we want to move this script to the dev-utilities dir? I do think it would be good to move that script. Not sure where under dev-utilities though. And we can tackle as

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/919 +1 works great for me. Thanks ---

[GitHub] metron issue #919: METRON-1439: Turn off git pager in platform-info script

2018-02-01 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/919 Sidenote, do we want to move this script to the dev-utilities dir? ---

[GitHub] metron pull request #919: METRON-1439: Turn off git pager in platform-info s...

2018-02-01 Thread justinleet
GitHub user justinleet opened a pull request: https://github.com/apache/metron/pull/919 METRON-1439: Turn off git pager in platform-info script ## Contributor Comments Just added a couple --no-pager args. Before you'd have to progress past the couple git pages, now they should

[GitHub] metron issue #917: METRON-1435: Management UI cannot save json objects in ad...

2018-02-01 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/917 +1 by inspection, great work! ---

[GitHub] metron issue #579: METRON-941 fix PaloAltoParser

2018-02-01 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/579 @ctramnitz thank you! Let us know where you are at and if we can help ---

[GitHub] metron issue #579: METRON-941 fix PaloAltoParser

2018-02-01 Thread ctramnitz
Github user ctramnitz commented on the issue: https://github.com/apache/metron/pull/579 Rebasing to master to see where we are. If this comes back clean please don't merge yet, I want to add 8.0 log format first. ---

[DISCUSS] Persistence store for user profile settings

2018-02-01 Thread Ryan Merriman
There is currently a PR up for review that allows a user to configure and save the list of facet fields that appear in the left column of the Alerts UI: https://github.com/apache/metron/pull/853. The REST layer has ORM support which means we can store those in a relational database. However I'm

[GitHub] metron issue #865: METRON-1212 The bundle System and Maven Plugin (Feature B...

2018-02-01 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/865 Ping ---

[GitHub] metron issue #915: METRON-1433: Only emit debugging timing fields in enrichm...

2018-02-01 Thread mraliagha
Github user mraliagha commented on the issue: https://github.com/apache/metron/pull/915 @cestella Definitely there will be value for having an ability to turn it on and off especially since you have already implemented that. However, won't be a sort of premature disk optimization? We