[GitHub] metron pull request #888: METRON-1389: Zeppelin notebook import does not wor...

2018-01-04 Thread anandsubbu
GitHub user anandsubbu opened a pull request: https://github.com/apache/metron/pull/888 METRON-1389: Zeppelin notebook import does not work with Ambari 2.6 ## Contributor Comments In recent versions of Ambari, [Shiro

[GitHub] metron issue #831: METRON-1302: Split up Indexing Topology into batch and ra...

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/831 I'm looking at this deeper and thinking through how status_params.py works with the config files. I'm looking for a dynamic way to manage the endpoints, in the future (not for this PR). For

[GitHub] metron issue #831: METRON-1302: Split up Indexing Topology into batch and ra...

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/831 > I went with adjusting the display names rather than variable prefixes. @cestella I agree with this approach. On the front-end, make it specific to the technology for the administrator. In

[GitHub] metron issue #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/840 I spun this up in full dev and spent all day testing it. From a functional perspective, I can not find anything wrong with it. I ran through the test plan in this PR and everything worked as

Re: [ANNOUNCE] Apache Metron release 0.4.2 and Apache Metron bro plugin for Kafka release 0.1

2018-01-04 Thread Otto Fowler
Thank you Matt, and congratulations everyone! On January 4, 2018 at 16:11:50, Matt Foley (ma...@apache.org) wrote: Metron Community: Happy New Year. I’m happy to announce the release of Metron 0.4.2. A great deal of work from across the community went into this, with over 100 enhancements,

[ANNOUNCE] Apache Metron release 0.4.2 and Apache Metron bro plugin for Kafka release 0.1

2018-01-04 Thread Matt Foley
Metron Community: Happy New Year. I’m happy to announce the release of Metron 0.4.2. A great deal of work from across the community went into this, with over 100 enhancements, improvements, and bug fixes since 0.4.1. Thanks to all contributors, and may all users enjoy the new features!

[GitHub] metron pull request #887: METRON-1388 update public web site to point at 0.4...

2018-01-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/887 ---

[GitHub] metron issue #886: METRON-1385: Missing "properties" in index template cause...

2018-01-04 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/886 +1 by inspection. Thanks for the fix! ---

Re: [DISCUSS] Generating and Interacting with serialized summary objects

2018-01-04 Thread Michael Miklavcic
I mentioned this earlier, but I'll reiterate that I think this approach gives us the ability to make specific use cases via a UI, or other interface should we choose to add one, while keeping the core adaptable and flexible. This is ideal for middle tier as I think this effectively gives us the

[GitHub] metron issue #831: METRON-1302: Split up Indexing Topology into batch and ra...

2018-01-04 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/831 Ok, I thought the general consensus was different. As per my comment: ``` That sounds good. Which one would you guys prefer: * display names in the mpack of "Elasticsearch" and

Re: [DISCUSS] Generating and Interacting with serialized summary objects

2018-01-04 Thread Casey Stella
It also occurs to me that even in this situation, it's not a sufficient generalization for just Bloom, but this is a bloom filter of the output of the all the typosquatted domains for the domain in each row. If we wanted to hard code, we'd have to hard code specifically the bloom filter *for*

[GitHub] metron issue #831: METRON-1302: Split up Indexing Topology into batch and ra...

2018-01-04 Thread nickwallen
Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/831 > I also am a little confused by the ra/batch vs es/hdfs issue. I think the general consensus was to be explicit and use "hdfs" and "elasticsearch". @cestella Let us know when you've

Re: [DISCUSS] Generating and Interacting with serialized summary objects

2018-01-04 Thread Casey Stella
So, there is value outside of just bloom usage. The most specific example of this would be in order to configure a bloom filter, we need to know at least an upper bound of the number of items that are going to be added to the bloom filter. In order to do that, we need to count the number of

[GitHub] metron pull request #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread justinleet
Github user justinleet commented on a diff in the pull request: https://github.com/apache/metron/pull/840#discussion_r159681034 --- Diff: pom.xml --- @@ -159,7 +159,7 @@ ${global_surefire_version}

[GitHub] metron pull request #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/840#discussion_r159680669 --- Diff: pom.xml --- @@ -159,7 +159,7 @@ ${global_surefire_version} -

[GitHub] metron pull request #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/840#discussion_r159680299 --- Diff: metron-platform/metron-elasticsearch/README.md --- @@ -33,7 +42,217 @@ For instance, an `es.date.format` of `.MM.dd.HH` would have the

[GitHub] metron pull request #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/840#discussion_r159680218 --- Diff: metron-deployment/README.md --- @@ -1,3 +1,16 @@ +# Metron Deployment --- End diff -- All set ---

[GitHub] metron issue #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/840 This is going to take some time to resolve, but everything else in this branch is still unhindered.

[GitHub] metron pull request #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/840#discussion_r159674941 --- Diff: metron-deployment/other-examples/manual-install/Manual_Install_CentOS6.md --- @@ -441,7 +441,7 @@ Client - Kibana: * Set

[GitHub] metron issue #840: METRON-939: Upgrade ElasticSearch and Kibana

2018-01-04 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/840 Looking at the additional deployment readme merge conflicts now ---

[GitHub] metron issue #887: METRON-1388 update public web site to point at 0.4.2 new ...

2018-01-04 Thread cestella
Github user cestella commented on the issue: https://github.com/apache/metron/pull/887 +1 by inspection ---