Re: [DISCUSS] Deprecate Least Recently Used Pruner

2019-08-13 Thread Casey Stella
Ah, that feature. Yes, it never seemed to catch on. It actually wasn't from OpenSOC, but a very early feature of Metron. The use-case was that enrichments may go stale and removing them based on TTL was easy to do, but not ideal. The LeastRecentlyUsedPruner was a MR job which would allow

Re: [DISCUSS] Deprecate Least Recently Used Pruner

2019-08-13 Thread Nick Allen
Sure. I should have provided some more context. I can tell you what I do know about it. Perhaps others can provide some more color. - This is functionality accessed by a user by running the script; ${ METRON_HOME}/bin/threatintel_bulk_prune.sh - If you are using access trackers with

Re: [DISCUSS] Deprecate Least Recently Used Pruner

2019-08-13 Thread Otto Fowler
Can you summarize what it does? Is it from OpenSOC? On August 13, 2019 at 17:53:52, Nick Allen (n...@nickallen.org) wrote: As part of https://github.com/apache/metron/pull/1470, I found it difficult to update the "Least Recently Used Pruner" to work with HBase 2.0.2. I am sure that given more

[DISCUSS] Deprecate Least Recently Used Pruner

2019-08-13 Thread Nick Allen
As part of https://github.com/apache/metron/pull/1470, I found it difficult to update the "Least Recently Used Pruner" to work with HBase 2.0.2. I am sure that given more time and effort, I could make it work, but is it worth it? This is a feature that I myself am not familiar with. I do not

[DISCUSS] Metron build times and Travis

2019-08-13 Thread Michael Miklavcic
It looks like we have come pretty close to our build time limit with Travis again. Some builds are sneaking in under 50 minutes while others are surpassing the limit and tripping the Travis timeout. This is a separate issue from the maven binary download issue

Re: Jira issue creation

2019-08-13 Thread Michael Miklavcic
I want to tease out your thoughts on this a bit - I've also thought that we might want to do a bit more on the primary Jiras independent of the associated PR. How about for PRs that go up immediately? The main PR commend field should (or at least has traditionally, anyhow) cover all necessary

Jira issue creation

2019-08-13 Thread Otto Fowler
I know that there are many times where the PR work precedes the jira creation, so that you are creating the jira to match the work you are doing, and that is fine as there are all sorts of workflows for contributors. That being said, I don’t think it is great to have empty jiras just to

Re: Contributing to Metron

2019-08-13 Thread Otto Fowler
What is your jira id? On August 13, 2019 at 13:06:36, Yerex, Tom (tom.ye...@ubc.ca) wrote: I would like to get access to JIRA (or be assigned a ticket), to add documentation to the Centos7 project folder under metron/metron-deployment/development/*centos7*/, similar to the README.md file that

Contributing to Metron

2019-08-13 Thread Yerex, Tom
I would like to get access to JIRA (or be assigned a ticket), to add documentation to the Centos7 project folder under metron/metron-deployment/development/centos7/, similar to the README.md file that is under the centos6 folder. I am new to open source development, hopefully this is a