Re: [DISCUSS] Are/how are you using the ES data pruner?

Sure. I will have a chat internally and come back to you shortly. It was a quick and dirty work actually just to fix this temporarily. However, it might be a good starting point. On Thu, Nov 23, 2017 at 3:31 PM, Michael Miklavcic < michael.miklav...@gmail.com> wrote: > Thanks Ali, that's good fee

[GitHub] metron issue #841: METRON-1316 Fastcapa Fails to Compile in Test Environment

Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/841 As always, very crisp @nickwallen ! My +1 (non-binding) still holds. ---

Re: [DISCUSS] Are/how are you using the ES data pruner?

Thanks Ali, that's good feedback. Would you be willing to share any of your Curator calls/config and use cases with the community? I'd love to add it to a document around ES pruning in the short term, and maybe we could look at how to build this into indexing at some point. Cheers, Mike On Nov 22

Re: [DISCUSS] Are/how are you using the ES data pruner?

We tried to use it, but we had the same issue. It was not documented. We tried to use it, and we had some issues. It also was not exactly what we wanted, so we decided to create something from scratch by using Elasticsearch Curator. We wanted to have an ability to manage different prune mechanism f

Re: [MENTORS][DISCUSS] Release Procedure + 'Kafka Plugin for Bro'

I propose that we coordinate the review of METRON-1329 and METRON-1313 , then merge METRON-1329, pursue a 0.1 release for apache/metron-bro-plugin-kafka, and then finalize METRON-1313

[GitHub] metron pull request #847: METRON-1313: Update metron-deployment to use bro-p...

Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron/pull/847#discussion_r152715716 --- Diff: metron-deployment/roles/bro/tasks/metron-bro-plugin-kafka.yml --- @@ -15,36 +15,34 @@ # limitations under the License. # --- -

[GitHub] metron pull request #844: METRON-1088: Upgrade bro to 2.5.2

Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/844 ---

[DISCUSS] Are/how are you using the ES data pruner?

>From what I can tell, the data pruner isn't documented anywhere, so I'm curious if anybody is using this, and if so, how are you using it? - https://github.com/apache/metron/blob/master/metron-platform/metron-data-management/README.md - https://github.com/apache/metron/blob/master/m

[GitHub] metron pull request #847: METRON-1313: Update metron-deployment to use bro-p...

GitHub user JonZeolla opened a pull request: https://github.com/apache/metron/pull/847 METRON-1313: Update metron-deployment to use bro-pkg to install the kafka plugin ## Contributor Comments This PR requires #844. For testing, this PR currently references my fork of m

Re: Using Storm Resource Aware Scheduler

30 mins average of CPU load by checking Ambari. On 23 Nov. 2017 00:51, "Otto Fowler" wrote: How are you measuring the utilization? On November 22, 2017 at 08:12:51, Ali Nazemian (alinazem...@gmail.com) wrote: Hi all, One of the issues that we are dealing with is the fact that not all of the

[GitHub] metron-bro-plugin-kafka pull request #4: METRON-1329: Simplify metron-bro-pl...

GitHub user JonZeolla opened a pull request: https://github.com/apache/metron-bro-plugin-kafka/pull/4 METRON-1329: Simplify metron-bro-plugin-kafka package loading This is a very simple change that normalizes the process of loading this package in an existing bro system. #

[GitHub] metron-bro-plugin-kafka pull request #2: DO NOT MERGE METRON-1304: Allow met...

Github user JonZeolla commented on a diff in the pull request: https://github.com/apache/metron-bro-plugin-kafka/pull/2#discussion_r152674806 --- Diff: scripts/Bro/Kafka/logs-to-kafka.bro --- @@ -14,32 +14,37 @@ # See the License for the specific language governing permission

[GitHub] metron issue #840: METRON-939: Upgrade ElasticSearch and Kibana

Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/840 Modified the Kibana chart colors per @ottobackwards request. I don't know if Kibana ever offered fine-grained control over the bar chart colors, but they do not offer it now. This is as close as I w

[GitHub] metron issue #846: METRON-1328: Enhance platform-info.sh script to check if ...

Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/846 +1 tested on my mac with and without the daemon running. ---

[GitHub] metron issue #803: Metron-1252: Build ui for grouping alerts into meta alert...

Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/803 @nickwallen This is unfortunate I am not seeing these failures Spec started login to application ✓ should display error message for invalid credentials ✓ should

[GitHub] metron issue #841: METRON-1316 Fastcapa Fails to Compile in Test Environment

Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/841 @nickwallen - Yup, it makes sense to update the README for just the centos 7.4. I was able to replicate the timeout issue for centos 7.4 with VirtualBox ver 5.0.16 r105871. When I upgraded to Virt

[GitHub] metron issue #803: Metron-1252: Build ui for grouping alerts into meta alert...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/803 @iraghumitra Are all these e2e tests passing for you? I am still getting failures. I manually truncated the `metron_updates` table before running them also. ``` *

[GitHub] metron issue #846: METRON-1328: Enhance platform-info.sh script to check if ...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/846 I would prefer it always say docker is running or not, but this will work. +1 ---

[GitHub] metron issue #846: METRON-1328: Enhance platform-info.sh script to check if ...

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/846 +1 Thanks, Anand. I tested with Docker daemon running, not running and not installed. Worked as advertised. ---

[GitHub] metron issue #841: METRON-1316 Fastcapa Fails to Compile in Test Environment

Github user nickwallen commented on the issue: https://github.com/apache/metron/pull/841 @anandsubbu Yes, I think that is a good point. I can add that to a README in the centos-7.4/ directory. I'm sure someone will run across this problem. Can you share what exact versions

[GitHub] metron issue #846: METRON-1328: Enhance platform-info.sh script to check if ...

Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/846 Hi @ottobackwards , thanks for your review. I prefixed a 'WARNING' to the message text so it would catch the eye of the user. Also, I removed the else bit for docker running scenario, sinc

[GitHub] metron issue #846: METRON-1328: Enhance platform-info.sh script to check if ...

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/846 Thanks for the contribution! This is a great idea. If I may, I think this may be more clear: ```bash if docker info 2>&1 | grep -q 'Cannot connect to the Docker daemon' then

[GitHub] metron issue #803: Metron-1252: Build ui for grouping alerts into meta alert...

Github user iraghumitra commented on the issue: https://github.com/apache/metron/pull/803 @merrimanr Added the test case for searching an alert inside meta-alert. Also took the liberty to fix the timezone issue it was a one-liner. ---

[GitHub] metron issue #774: METRON-1212 The bundle system and maven plugin

Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/774 I have refactored to have a top level metron-bundles directory, with the bundles lib and bundles testing under there. ---

[GitHub] metron pull request #846: METRON-1328: Enhance platform-info.sh script to ch...

GitHub user anandsubbu opened a pull request: https://github.com/apache/metron/pull/846 METRON-1328: Enhance platform-info.sh script to check if docker daemon is running ## Contributor Comments Run the `docker info` command along with checking the version. **Case A -

Re: Using Storm Resource Aware Scheduler

How are you measuring the utilization? On November 22, 2017 at 08:12:51, Ali Nazemian (alinazem...@gmail.com) wrote: Hi all, One of the issues that we are dealing with is the fact that not all of the Metron feeds have the same type of resource requirements. For example, we have some feeds that

Using Storm Resource Aware Scheduler

Hi all, One of the issues that we are dealing with is the fact that not all of the Metron feeds have the same type of resource requirements. For example, we have some feeds that even a single Strom slot is way more than what it needs. We thought we could make it more utilised in total by limiting

[GitHub] metron issue #841: METRON-1316 Fastcapa Fails to Compile in Test Environment

Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/841 +1 (non-binding), btw ---

[GitHub] metron issue #841: METRON-1316 Fastcapa Fails to Compile in Test Environment

Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/841 Hm... you're right @nickwallen . It was indeed due to older vagrant and VirtualBox versions. I confirmed that after upgrading to the versions you noted, I was able to spin up both CentOS 7.1 and 7