[GitHub] metron issue #927: METRON-1447 Heap Size Not Set Correctly by MPack for ES 5...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/927 +1. This looks great @nickwallen. Thanks for fixing this! Everything spun up with the appropriate mem settings. Modifying the template and heap reflect in the jvm.options and process display. ---

[GitHub] metron issue #863: METRON-1347: Indexing Topology should fail tuples without...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/863 My +1 still stands on this and this PR has been up for quite some time. I will merge by EOD unless there are any additional concerns. ---

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/929 Should we explore auto-commit? Also, maybe we should rename all this stuff to SolrCloud, since Solr and SolrCloud *are* different in some use of terms and concepts? ---

[GitHub] metron issue #830: METRON-1298: TimeRange Picker doesn't work on Safari

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/830 Bump. @iraghumitra ---

[GitHub] metron issue #927: METRON-1447 Heap Size Not Set Correctly by MPack for ES 5...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/927 Thanks for the review @mmiklavc and making sure the merge was solid. ---

[GitHub] metron pull request #927: METRON-1447 Heap Size Not Set Correctly by MPack f...

Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/927 ---

[GitHub] metron issue #812: METRON-1273: Website documentation link should point to t...

Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/812 Thanks @mmiklavc this totally fell off my plate ---

[GitHub] metron issue #812: METRON-1273: Website documentation link should point to t...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/812 I'm going to attempt to do this now - https://cwiki.apache.org/confluence/display/METRON/Website+PR+Merge. Link copied here so I can hopefully Google search for "how to update the apache metron

[GitHub] metron issue #853: METRON-1337: List of facets should not be hardcoded

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/853 Bump @merrimanr ---

[GitHub] metron issue #916: METRON-1434 - Ability to deploy Metron full dev as a sing...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/916 Thanks for the contribution! I'm just starting to look at this so expect some comments rolling in as I have time. ---

[GitHub] metron pull request #916: METRON-1434 - Ability to deploy Metron full dev as...

Github user mmiklavc commented on a diff in the pull request: https://github.com/apache/metron/pull/916#discussion_r166804712 --- Diff: metron-deployment/README.md --- @@ -112,6 +115,130 @@ To build the DEB packages, follow the instructions at [packaging/docker/deb-dock

[GitHub] metron issue #439: METRON-571 add stellar external functions feature - code ...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/439 Bump? Sorry @ottobackwards, your streak ends at 4. ---

[GitHub] metron issue #914: METRON-1397 Support for JSON Path and complex documents i...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/914 http://goessner.net/articles/JsonPath/ https://github.com/json-path/JsonPath http://jsonpath.herokuapp.com

[GitHub] metron issue #914: METRON-1397 Support for JSON Path and complex documents i...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/914 yeah, you said in the docs, will do ---

[GitHub] metron pull request #930: METRON-1318 updated MacOS instructions and explain...

GitHub user wardbekker opened a pull request: https://github.com/apache/metron/pull/930 METRON-1318 updated MacOS instructions and explain AWS defaults ## Contributor Comments updated MacOS instructions and explain AWS defaults, also covers METRON-1318 for MacOS

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/929 What do you mean "auto-commit"? By default it will commit at the batch level as the other writers do. You can turn that behavior off and it'll commit when the Solr client decides at the cost of

[GitHub] metron issue #914: METRON-1397 Support for JSON Path and complex documents i...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/914 This seems cool. Can you provide some guidance via some examples or just a link to what's possible syntax/query-wise with JSON path queries in the docs for this? ---

[GitHub] metron issue #914: METRON-1397 Support for JSON Path and complex documents i...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/914 Just a note on parser docs, part of the mythical 777 is support for per parser readme, that would be nice here. ---

[GitHub] metron pull request #929: METRON-1448: Update SolrWriter to conform to new c...

Github user cestella commented on a diff in the pull request: https://github.com/apache/metron/pull/929#discussion_r166798136 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/writer/SolrWriter.java --- @@ -33,17 +39,19 @@ import

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/929 Cool, I'll run the test plan ---

[GitHub] metron issue #812: METRON-1273: Website documentation link should point to t...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/812 Yeesh, getting Jekyll to work was a pain. I re-installed Ruby from Homebrew and then had to install a number of packages to get it to compile. I've updated the wiki with notes on this as well.

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/929 LOL, nah, I was just being crotchety. Let me see what I can do and you tell me what you think :) ---

[GitHub] metron issue #812: METRON-1273: Website documentation link should point to t...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/812 Sigh, will push to the asf-site branch asap. My Jekyll config is broken. ---

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/929 See, we explored it. Thanks!! ---

[GitHub] metron pull request #930: METRON-1318 updated MacOS instructions and explain...

Github user wardbekker commented on a diff in the pull request: https://github.com/apache/metron/pull/930#discussion_r166752716 --- Diff: metron-deployment/amazon-ec2/README.md --- @@ -41,11 +50,13 @@ Any platform that supports these tools is suitable, but the following instructio

[GitHub] metron pull request #930: METRON-1318 updated MacOS instructions and explain...

Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/930#discussion_r166752581 --- Diff: metron-deployment/amazon-ec2/README.md --- @@ -41,11 +50,13 @@ Any platform that supports these tools is suitable, but the following instructio

[GitHub] metron pull request #931: METRON-1449 Set Zookeeper URL for Stellar Running ...

GitHub user nickwallen opened a pull request: https://github.com/apache/metron/pull/931 METRON-1449 Set Zookeeper URL for Stellar Running in Zeppelin Notebook ## Changes * This enhances the Stellar interpreter for Zeppelin to allow the user to set a `zookeeper.url`

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/929 Actually, I can make an option to let you do a soft commit instead of a hard commit if that'll be an extra layer of configuration. ---

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/929 Ok, I updated the configs to expose all the settings that I could find for committing and documented them. By default we operate safely, though. Though now you can use soft commits rather than

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/929 Sorry, maybe I misunderstood what I have read here: https://lucidworks.com/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ I thought that you could

[GitHub] metron issue #929: METRON-1448: Update SolrWriter to conform to new collecti...

Github user cestella commented on the issue: https://github.com/apache/metron/pull/929 You can set it to not manually commit (set `solr.commitPerBatch` to `false` and no committing happens), but you're risking losing data if a worker dies. Honestly, want a durable commit with a

[GitHub] metron issue #928: METRON-1444: Add Ubuntu Repositories for Elasticsearch to...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/928 Shouldn't the title of this PR be "Update ambari from 2.5.x to 2.6.x"? That seems the bigger thing :) ---

Re: Apache Website Required Links

I can take a shot at this if there are no other takers. Regards, Anand On 2/5/18, 8:59 PM, "Justin Leet" wrote: I'd created a Jira awhile ago, but it deserves a callout to the community. Especially if someone wants to grab it, it's probably something pretty easy

[GitHub] metron issue #928: METRON-1444: Add Ubuntu Repositories for Elasticsearch to...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/928 I disagree @ottobackwards . The core problem is that there is a bug in Ambari that prevented us from loading the repos directly in the Mpack. The only way to fix this is to upgrade.

[GitHub] metron issue #928: METRON-1444: Add Ubuntu Repositories for Elasticsearch to...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/928 I'll add 2 smileys next time, to help get my point across. I would have expected a response more along the lines of: "Upgrading Ambari to the 2.6 release line shows little risk when I

Re: [DISCUSS] Profiler Enhancement

Scenario 2 is one that I'm specifically interested in, I have that exact use case right now. I can see Scenario 1 being useful in the future as well. I'm also interested in a conversation along the lines of what Otto brought up (i.e. I would like to re-ingest data to redo parsing, enrichments,

[GitHub] metron issue #928: METRON-1444: Add Ubuntu Repositories for Elasticsearch to...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/928 +1 Ran this up on Ubuntu. Thanks for the fix! ---

[GitHub] metron pull request #922: METRON-1441: Create complementary Solr schemas for...

Github user cestella closed the pull request at: https://github.com/apache/metron/pull/922 ---

[GitHub] metron pull request #929: METRON-1448: Update SolrWriter to conform to new c...

GitHub user cestella opened a pull request: https://github.com/apache/metron/pull/929 METRON-1448: Update SolrWriter to conform to new collection strategy ## Contributor Comments Currently the SolrWriter presumes a single collection to be written to. The new collection

[GitHub] metron pull request #929: METRON-1448: Update SolrWriter to conform to new c...

Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/929#discussion_r166680167 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/writer/SolrWriter.java --- @@ -33,17 +39,19 @@ import

[GitHub] metron pull request #929: METRON-1448: Update SolrWriter to conform to new c...

Github user cestella commented on a diff in the pull request: https://github.com/apache/metron/pull/929#discussion_r166682417 --- Diff: metron-platform/metron-solr/src/main/java/org/apache/metron/solr/writer/SolrWriter.java --- @@ -33,17 +39,19 @@ import

DataWorks Summit San Jose

Hi All, Just a heads up that *the San Jose DataWorks Summit's call for papers is coming to a close soon *(February 9th, in 2 days!). If you are doing anything cool with open source big data and security that you want to talk about, please submit to the Cyber Security track. I'm hoping to attend

[GitHub] metron issue #928: METRON-1444: Add Ubuntu Repositories for Elasticsearch to...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/928 @ottobackwards, @nickwallen is correct. This was originally intended to deal with the Ubuntu repo problem, which ended up being fixed via the Ambari upgrade (due to fixes they made to how they

[GitHub] metron issue #927: METRON-1447 Heap Size Not Set Correctly by MPack for ES 5...

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/927 Spinning this up now, merged with https://github.com/apache/metron/pull/928 to make sure all is well with Ambari 2.6.1. I expect the changes in this PR will not be affected. ---