[GitHub] metron issue #915: METRON-1433: Only emit debugging timing fields in enrichm...

2018-01-30 Thread mraliagha
Github user mraliagha commented on the issue: https://github.com/apache/metron/pull/915 @simonellistonball We are using threat intel joiner timestamp currently. I am not sure indexing timestamp is added to the latest version or not, but we need the ES indexing one as well. ---

[GitHub] metron pull request #918: METRON-1436: Manually Install Solr Cloud in Full D...

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/918#discussion_r164925885 --- Diff: metron-platform/metron-solr/src/main/scripts/install_solr.sh --- @@ -0,0 +1,62 @@ +#!/bin/bash +# +# Licensed to the Apache Software

[GitHub] metron pull request #918: METRON-1436: Manually Install Solr Cloud in Full D...

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/918#discussion_r164925950 --- Diff: metron-platform/metron-solr/src/main/scripts/install_solr.sh --- @@ -0,0 +1,62 @@ +#!/bin/bash +# +# Licensed to the Apache Software

[GitHub] metron pull request #918: METRON-1436: Manually Install Solr Cloud in Full D...

2018-01-30 Thread mmiklavc
GitHub user mmiklavc opened a pull request: https://github.com/apache/metron/pull/918 METRON-1436: Manually Install Solr Cloud in Full Dev https://issues.apache.org/jira/browse/METRON-1436 Provide script for starting Solr Cloud in quickstart mode for testing purposes

[GitHub] metron issue #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/690 Perfect, ty. ---

[GitHub] metron pull request #917: METRON-1435: Management UI cannot save json object...

2018-01-30 Thread merrimanr
GitHub user merrimanr opened a pull request: https://github.com/apache/metron/pull/917 METRON-1435: Management UI cannot save json objects in advanced config ## Contributor Comments This PR fixes a bug in the Management UI that limits a user to only entering strings in the

[GitHub] metron pull request #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/690 ---

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread merrimanr
Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164881484 --- Diff: metron-platform/metron-indexing/src/test/java/org/apache/metron/indexing/dao/SearchIntegrationTest.java --- @@ -443,11 +495,11 @@ public void

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread merrimanr
Github user merrimanr commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164881237 --- Diff: metron-platform/metron-indexing/src/main/java/org/apache/metron/indexing/dao/search/SearchDao.java --- @@ -0,0 +1,34 @@ +/** + *

[GitHub] metron issue #873: METRON-1367 Stellar should have some instrumentation of f...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/873 bump ---

Re: When things change in hdfs, how do we know

2018-01-30 Thread Otto Fowler
It is still @unstable, but the jiras : https://issues.apache.org/jira/browse/HDFS-8940?jql=project%20%3D%20HDFS%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22)%20AND%20text%20~%20%22INotify%22 that I see are stall from over the summer. They also seem geared to scale or changing the filter

Re: When things change in hdfs, how do we know

2018-01-30 Thread JJ Meyer
Hello all, I had created a NiFi processor a long time back that used the inotify API. One thing I noticed while working with it is that it is marked with the `Unstable` annotation. It may be worth checking if anymore work is going on with it and if it will impact this (if it hasn't already been

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164847601 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164842112 --- Diff: metron-platform/metron-solr/src/test/java/org/apache/metron/solr/integration/SolrSearchIntegrationTest.java --- @@ -0,0 +1,152 @@ +/**

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164840018 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164839532 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164841557 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrUpdateDao.java --- @@ -0,0 +1,101 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164844818 --- Diff: metron-platform/metron-indexing/src/main/java/org/apache/metron/indexing/dao/search/SearchDao.java --- @@ -0,0 +1,34 @@ +/** + *

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164840108 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164841286 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164842946 --- Diff: metron-platform/metron-solr/src/test/java/org/apache/metron/solr/integration/components/SolrComponent.java --- @@ -158,4 +162,16 @@ public

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164846538 --- Diff: metron-platform/metron-indexing/src/test/java/org/apache/metron/indexing/dao/SearchIntegrationTest.java --- @@ -443,11 +495,11 @@ public void

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164838120 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrDao.java --- @@ -0,0 +1,118 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164838944 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/dao/SolrSearchDao.java --- @@ -0,0 +1,315 @@ +/** + * Licensed to the

[GitHub] metron pull request #911: METRON-1419: Create a SolrDao

2018-01-30 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/911#discussion_r164836556 --- Diff: metron-platform/metron-indexing/src/test/java/org/apache/metron/indexing/dao/SearchIntegrationTest.java --- @@ -655,83 +699,54 @@ public void

[GitHub] metron pull request #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/907 ---

[GitHub] metron issue #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/907 +1 I ran it up on 2 separate Macs, one running Ansible 2.2.2.0 and the other 2.0.0.2. Both spun up without issue today. ---

[GitHub] metron issue #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/690 Done, let me know if the changes are sufficient @JonZeolla ---

[GitHub] metron issue #830: METRON-1298: TimeRange Picker doesn't work on Safari

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/830 Can you take master again? This pr still builds metron twice when doing vagrant up. ---

[GitHub] metron pull request #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/690#discussion_r164805799 --- Diff: metron-stellar/stellar-common/README.md --- @@ -1413,6 +1413,46 @@ Please note that functions are loading lazily in the background and will be

[GitHub] metron pull request #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/690#discussion_r164805617 --- Diff: metron-stellar/stellar-common/README.md --- @@ -1346,6 +1346,46 @@ Please note that functions are loading lazily in the background and will be

[GitHub] metron pull request #690: METRON-1091 Package STELLAR shell as stand alone

2018-01-30 Thread JonZeolla
Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/690#discussion_r164805812 --- Diff: metron-stellar/stellar-common/README.md --- @@ -1413,6 +1413,46 @@ Please note that functions are loading lazily in the background and will be

[GitHub] metron issue #684: DO NOT MERGE: METRON-1086: Create a Blockly-based user in...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/684 We should make this a feature branch ---

[GitHub] metron issue #775: [METRON-1214] rpm build fails due to npm absence in Docke...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/775 @DimDroll any reproduction? Is this still happening for you? ---

[GitHub] metron issue #670: METRON-1065 grok pattern for cisco asa parser expects sys...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/670 Deconflict and bump? ---

[GitHub] metron issue #890: METRON-1391 Fix for README.md in Metron Management

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/890 Thanks! please take care of the jira ---

[GitHub] metron pull request #890: METRON-1391 Fix for README.md in Metron Management

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/890 ---

[GitHub] metron issue #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/907 +1 Ran it up with all of our fixes in the Ubuntu dev environment. Works great. Thanks! ---

[GitHub] metron pull request #888: METRON-1389: Zeppelin notebook import does not wor...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/888 ---

[GitHub] metron issue #915: METRON-1433: Only emit debugging timing fields in enrichm...

2018-01-30 Thread simonellistonball
Github user simonellistonball commented on the issue: https://github.com/apache/metron/pull/915 Does anyone anticipate using (or even use) these fields to do things like monitor the flow and latency of their pipelines? I can imagine people wanting to build data quality monitoring

[GitHub] metron issue #915: METRON-1433: Only emit debugging timing fields in enrichm...

2018-01-30 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/915 +1, lgtm via inspection. ---

[GitHub] metron issue #858: METRON-1344: Externalize the infrastructural components u...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/858 Re-upping what I said before ---

[GitHub] metron issue #789: METRON-1233: Remove description of Global configuration f...

2018-01-30 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/789 This needs deconflict, and a relevant check ---

[GitHub] metron issue #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/907 I also just merged #913 so I will run this up just to be sure the whole package is working in the Ubuntu dev environment. ---

[GitHub] metron pull request #913: METRON-1432 JDK Install Fails on Ubuntu Developmen...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/913 ---

[GitHub] metron issue #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/907 @nickwallen Awesome, your PR is merged in here and I'll spin it up one last time to verify that it works for 2.0.0.2. @anandsubbu Awesome, thanks! ---

[GitHub] metron issue #915: METRON-1433: Only emit debugging timing fields in enrichm...

2018-01-30 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/915 Whoops, missed one. Thanks @mmiklavc ! ---

Re: [DISCUSS] Time to remove github updates from dev?

2018-01-30 Thread Otto Fowler
We could also just skip ‘b’ and go directly to ‘c’ like apache-commons and have commits@ issues@. On January 30, 2018 at 08:03:37, Andre (andre-li...@fucs.org) wrote: James, Give nobody opposed, I would suggest one of the PMCs contact the INFRA to get this actioned. They would need to

Re: [DISCUSS] Time to remove github updates from dev?

2018-01-30 Thread Andre
James, Give nobody opposed, I would suggest one of the PMCs contact the INFRA to get this actioned. They would need to assist with: 1. Creation of the new "issues" list 2. redirect both GitHub and JIRA integrations to the new list Cheers On Sat, Jan 27, 2018 at 9:40 AM, James Sirota

[DISCUSS] Quick Poll - How You are Using & Contributing to Metron? - 2018-01-30

2018-01-30 Thread Ahmed Shah
Hello Metron developers and users; The following questionnaire will help gather information on how the community is using Metron. It will also help understand which areas people are most interested in contributing. The questionnaire shouldn't take long to complete (less then 10 minutes) and

Re: Ability to deploy metron full dev as a single node to aws with vagrant

2018-01-30 Thread Ahmed Shah
Hello, I have made the following pull request for two new ways to deploy to AWS. https://github.com/apache/metron/pull/916 i) AWS Single Node Cluster Deployment Using Vagrant I was able to deploy Metron as a Single node to AWS using the latest Metron code in git as of 2018-01-30 8AM UTC.

[GitHub] metron pull request #916: METRON-1434 - Ability to deploy Metron full dev as...

2018-01-30 Thread as22323
GitHub user as22323 opened a pull request: https://github.com/apache/metron/pull/916 METRON-1434 - Ability to deploy Metron full dev as a single node (centos6) to AWS with Vagran and AMI ## Contributor Comments [Please place any comments here. A description of the

[GitHub] metron issue #907: METRON-1427: Add support for storm 1.1 and hdp 2.6

2018-01-30 Thread anandsubbu
Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/907 Hi @cestella , with the latest commit having the normalized producer, I was able to spin up a 12-node Centos 7 cluster, install with HDP 2.6 base and kerberize as well without issues. Ran the