Re: [DISCUSS] Build Log Usability

2016-10-27 Thread David Lyle
I'd prefer not to see a file output by default, it's non-standard and people won't know to look there without additional documentation. If we default to ERROR logging and suppress ERROR output in the case of "expected" errors, we should be able to keep the test output under 4MB. Then, if

Re: [DISCUSS] Build Log Usability

2016-10-27 Thread Casey Stella
I can get behind logging to a file, but can we see the file as an output of Travis? Sometimes the problem is that it is failing in Travis but not locally or it is a situation that you want to give guidance on a PR but don't want to pull a branch and rerun tests. If we log to a file, I'd like to

Re: [DISCUSS] Build Log Usability

2016-10-27 Thread Ryan Merriman
I definitely agree with Otto that we need to make our build logs less verbose. I think the first step is to get control of the log levels across various components. Are there specific examples of the types of messages we want to suppress? For instance:

Re: [DISCUSS] Time-base flushing of all Writer queues

2016-10-27 Thread Matt Foley
Hi all, For those who are interested, answers to the below questions have been posted in the jira, METRON-322. Second, I am splitting the work into (1) implementing batchTimeout parameter for all queues that have batchSize parameter; (2) modifying each Writer to make use of the

[GitHub] incubator-metron pull request #324: METRON-515: Stellar IS_EMPTY() function ...

2016-10-27 Thread merrimanr
GitHub user merrimanr reopened a pull request: https://github.com/apache/incubator-metron/pull/324 METRON-515: Stellar IS_EMPTY() function does not work as expected The "IS_EMPTY" Stellar function is always returning true if the field value is not a String type. This PR changes

[GitHub] incubator-metron pull request #324: METRON-515: Stellar IS_EMPTY() function ...

2016-10-27 Thread merrimanr
Github user merrimanr closed the pull request at: https://github.com/apache/incubator-metron/pull/324 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #324: METRON-515: Stellar IS_EMPTY() function does no...

2016-10-27 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/incubator-metron/pull/324 +1, pending Travis cooperating. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-metron issue #315: METRON-464: Force co-location of all Metron com...

2016-10-27 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/315 @justinleet - if you're still good with my latest change, I'll go ahead and merge this. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] incubator-metron pull request #322: METRON-513: Ambari MP Metainfo should no...

2016-10-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-metron/pull/322 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron issue #326: METRON-510: Update the bro_index elasticsearch ...

2016-10-27 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/incubator-metron/pull/326 Not the best, but from my install node, inside the docker container I used to install, I inserted the updated template to my ES cluster via: `curl --data

[GitHub] incubator-metron issue #329: METRON-148 compress logs with logrotate

2016-10-27 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/329 Looks good to me, Otto. How did you test it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] incubator-metron pull request #315: METRON-464: Force co-location of all Met...

2016-10-27 Thread dlyle65535
Github user dlyle65535 closed the pull request at: https://github.com/apache/incubator-metron/pull/315 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-metron pull request #315: METRON-464: Force co-location of all Met...

2016-10-27 Thread dlyle65535
GitHub user dlyle65535 reopened a pull request: https://github.com/apache/incubator-metron/pull/315 METRON-464: Force co-location of all Metron components Now the Ambari Add Service will show an error in the case that: a) The Metron Parsers service is not deployed with the

[GitHub] incubator-metron issue #315: METRON-464: Force co-location of all Metron com...

2016-10-27 Thread dlyle65535
Github user dlyle65535 commented on the issue: https://github.com/apache/incubator-metron/pull/315 reopening for travis error. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-metron issue #315: METRON-464: Force co-location of all Metron com...

2016-10-27 Thread anandsubbu
Github user anandsubbu commented on the issue: https://github.com/apache/incubator-metron/pull/315 Thank you @dlyle65535 for a nice fix. I'm +1 (non-binding) I did tests with the modified commit and here are my observations: 1) The metron_mpack jar does not

[GitHub] incubator-metron issue #329: METRON-148 compress logs with logrotate

2016-10-27 Thread ottobackwards
Github user ottobackwards commented on the issue: https://github.com/apache/incubator-metron/pull/329 kicking travis --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-metron pull request #329: METRON-148 compress logs with logrotate

2016-10-27 Thread ottobackwards
Github user ottobackwards closed the pull request at: https://github.com/apache/incubator-metron/pull/329 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] incubator-metron pull request #329: METRON-148 compress logs with logrotate

2016-10-27 Thread ottobackwards
GitHub user ottobackwards reopened a pull request: https://github.com/apache/incubator-metron/pull/329 METRON-148 compress logs with logrotate Add compress configuration for logrotate.d/ configurations Tested using the logrotate -f /etc/logrotate.d/metron-* commands You

[GitHub] incubator-metron pull request #329: METRON-148 compress logs with logrotate

2016-10-27 Thread ottobackwards
GitHub user ottobackwards opened a pull request: https://github.com/apache/incubator-metron/pull/329 METRON-148 compress logs with logrotate Add compress configuration for logrotate.d/ configurations Tested using the logrotate -f /etc/logrotate.d/metron-* commands You can

Re: [DISCUSS] Metron REST API Architecture and Design

2016-10-27 Thread zeo...@gmail.com
Another thought that came to me recently - Has there been any consideration of using some of the newer standards such as pxGrid , DXL , etc. to integrate with other systems and allow data

[GitHub] incubator-metron pull request #315: METRON-464: Force co-location of all Met...

2016-10-27 Thread anandsubbu
Github user anandsubbu commented on a diff in the pull request: https://github.com/apache/incubator-metron/pull/315#discussion_r85333482 --- Diff: metron-deployment/packaging/ambari/metron-mpack/src/main/resources/common-services/METRON/0.2.1BETA/service_advisor.py --- @@ -54,11

[GitHub] incubator-metron issue #315: METRON-464: Force co-location of all Metron com...

2016-10-27 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/incubator-metron/pull/315 I'm +1 (by inspection in conjunction with Anand's testing and the most recent fixes). Great work figuring this out. --- If your project is set up for it, you can reply to this email