[GitHub] metron issue #591: METRON-959 Trivial documentation formatting bugs

2017-05-19 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/591 Thanks. Just waiting on [INFRA-14159](https://issues.apache.org/jira/browse/INFRA-14159) so I can commit it. --- If your project is set up for it, you can reply to this email and have your

[GitHub] metron issue #547: METRON-858 bro-plugin-kafka is throwing segfaults

2017-05-19 Thread JonZeolla
Github user JonZeolla commented on the issue: https://github.com/apache/metron/pull/547 @nickwallen This should be ready to review now. Sorry about the delay --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] metron pull request #597: METRON-966: Pcap topology does not commit offsets

2017-05-19 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/metron/pull/597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #596: METRON-965: In the case where we specify the syncp...

2017-05-19 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/metron/pull/596 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #597: METRON-966: Pcap topology does not commit offsets

2017-05-19 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/metron/pull/597 METRON-966: Pcap topology does not commit offsets ## Contributor Comments Due to a bug in the storm-kafka-client in 1.1.0, offsets are not committed in the pcap topology. This can be worked

[GitHub] metron pull request #596: METRON-965: In the case where we specify the syncp...

2017-05-19 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/metron/pull/596 METRON-965: In the case where we specify the syncpolicy in the HDFS Writer, we do not properly clone and end up syncing for every record ## Contributor Comments Right now the SyncPolicy

[GitHub] metron issue #592: METRON-961: Spooky intermittent exceptions in pcap during...

2017-05-19 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/592 +1 by inspection --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] metron issue #596: METRON-965: In the case where we specify the syncpolicy i...

2017-05-19 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/596 Thanks, Casey, +1 pending Travis. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] metron pull request #597: METRON-966: Pcap topology does not commit offsets

2017-05-19 Thread cestella
GitHub user cestella opened a pull request: https://github.com/apache/metron/pull/597 METRON-966: Pcap topology does not commit offsets ## Contributor Comments Due to a bug in the storm-kafka-client in 1.1.0, offsets are not committed in the pcap topology. This can be worked

[GitHub] metron issue #593: METRON-958: PCAP Query job throws exception when no files...

2017-05-19 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/593 Kick to the Travis --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] metron pull request #593: METRON-958: PCAP Query job throws exception when n...

2017-05-19 Thread mmiklavc
Github user mmiklavc closed the pull request at: https://github.com/apache/metron/pull/593 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #593: METRON-958: PCAP Query job throws exception when n...

2017-05-19 Thread mmiklavc
GitHub user mmiklavc reopened a pull request: https://github.com/apache/metron/pull/593 METRON-958: PCAP Query job throws exception when no files returned by time range query https://issues.apache.org/jira/browse/METRON-958 When the PCAP topology is run against a Kafka

[GitHub] metron issue #583: METRON-949 Change from error to warning message for Metro...

2017-05-19 Thread anandsubbu
Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/583 Please see METRON-592 where we fixed the Kafka broker and Enrichment checks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] metron issue #583: METRON-949 Change from error to warning message for Metro...

2017-05-19 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/583 Why is the [Kafka Broker check for parsers

[GitHub] metron issue #583: METRON-949 Change from error to warning message for Metro...

2017-05-19 Thread anandsubbu
Github user anandsubbu commented on the issue: https://github.com/apache/metron/pull/583 @merrimanr , this is because of the following reason: In the "Assign Masters" page of the Ambari deployment wizard, there is a check for the Metron REST host to have storm supervisor

Re: [Discuss] Improving new developer onboarding experience

2017-05-19 Thread Nick Allen
Also, there are usually people on #apache-metron on Freenode. If you are having trouble and need to ask a question, you can try there too. Jon and Otto tend to be our community leaders there. Many, many thanks to them for that. They are super helpful. I need to join more often. On Fri, May

Re: [Discuss] Improving new developer onboarding experience

2017-05-19 Thread Nick Allen
Hi Marc - Welcome to the community. > Vagrant quick dev env does not boot for me. This relies on an image stored in Atlas. There was recently a commit that broke that image. We just need to update the image stored in Atlas. Until we do, feel free to use Full Dev. > The environment variables

[Discuss] Improving new developer onboarding experience

2017-05-19 Thread Marc Solanas Tarre (msolanas)
Hi All, I’m Marc, a Sr. Soft Eng at Cisco and I’ve been playing with Metron a bit for the last few days, while trying to get ideas on how I can best contribute. My main interest is Model as a Service. I wanted to write this email to share a few issues I’ve faced while onboarding myself. *

Re: Trying to spin up Metron in EC2: Failed

2017-05-19 Thread Laurens Vets
Thanks, I'll try your suggestion of deploying from AWS itself. On 2017-05-19 10:52, Nick Allen wrote: I am not sure what the issue is. Nothing is jumping out at me. Weird issues can arise when the machine that you are running the Ansible deployment from has intermittent connectivity issues

Re: Trying to spin up Metron in EC2: Failed

2017-05-19 Thread Nick Allen
Missed one important point. You actually choose the data center here [2] in the configuration file. [2] https://github.com/apache/metron/blob/master/metron-deployment/amazon-ec2/conf/defaults.yml#L43 On Fri, May 19, 2017 at 1:52 PM, Nick Allen wrote: > I am not sure what

[GitHub] metron issue #593: METRON-958: PCAP Query job throws exception when no files...

2017-05-19 Thread mmiklavc
Github user mmiklavc commented on the issue: https://github.com/apache/metron/pull/593 Here are some instructions for getting pycapa setup ``` Installing pycapa env vars PYCAPA_HOME=/opt/pycapa PYTHON27_HOME =/opt/rh/python27/root

Re: Trying to spin up Metron in EC2: Failed

2017-05-19 Thread Nick Allen
I am not sure what the issue is. Nothing is jumping out at me. Weird issues can arise when the machine that you are running the Ansible deployment from has intermittent connectivity issues to the AWS data center. Is Amazon's us-west-2 data center the one closest to you? You might try a

[GitHub] metron pull request #596: METRON-965: In the case where we specify the syncp...

2017-05-19 Thread cestella
Github user cestella closed the pull request at: https://github.com/apache/metron/pull/596 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #596: METRON-965: In the case where we specify the syncp...

2017-05-19 Thread cestella
GitHub user cestella reopened a pull request: https://github.com/apache/metron/pull/596 METRON-965: In the case where we specify the syncpolicy in the HDFS Writer, we do not properly clone and end up syncing for every record ## Contributor Comments Right now the SyncPolicy

[GitHub] metron issue #583: METRON-949 Change from error to warning message for Metro...

2017-05-19 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/583 Why was this changed to WARN? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] metron pull request #582: METRON-948 Corrected license abbreviation in packa...

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/582 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron issue #582: METRON-948 Corrected license abbreviation in package.json...

2017-05-19 Thread merrimanr
Github user merrimanr commented on the issue: https://github.com/apache/metron/pull/582 +1 thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] metron pull request #594: METRON-963 Update document for Kerberos manual set...

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron pull request #567: METRON-891: Changed Kafka API to Create a KafkaCon...

2017-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/567 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] metron issue #594: METRON-963 Update document for Kerberos manual setup

2017-05-19 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/594 +1 by inspection. Thanks a lot for cleaning this up! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] metron issue #596: METRON-965: In the case where we specify the syncpolicy i...

2017-05-19 Thread justinleet
Github user justinleet commented on the issue: https://github.com/apache/metron/pull/596 Are there any unit tests we can/should add to add this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] metron pull request #596: METRON-965: In the case where we specify the syncp...

2017-05-19 Thread ottobackwards
Github user ottobackwards commented on a diff in the pull request: https://github.com/apache/metron/pull/596#discussion_r117447902 --- Diff: metron-platform/metron-writer/src/main/java/org/apache/metron/writer/hdfs/HdfsWriter.java --- @@ -85,7 +85,17 @@ public void init(Map