Podling Report Reminder - October 2016

2016-09-29 Thread johndament
Dear podling,

This email was sent by an automated system on behalf of the Apache
Incubator PMC. It is an initial reminder to give you plenty of time to
prepare your quarterly board report.

The board meeting is scheduled for Wed, 19 October 2016, 10:30 am PDT.
The report for your podling will form a part of the Incubator PMC
report. The Incubator PMC requires your report to be submitted 2 weeks
before the board meeting, to allow sufficient time for review and
submission (Wed, October 05).

Please submit your report with sufficient time to allow the Incubator
PMC, and subsequently board members to review and digest. Again, the
very latest you should submit your report is 2 weeks prior to the board
meeting.

Thanks,

The Apache Incubator PMC

Submitting your Report

--

Your report should contain the following:

*   Your project name
*   A brief description of your project, which assumes no knowledge of
the project or necessarily of its field
*   A list of the three most important issues to address in the move
towards graduation.
*   Any issues that the Incubator PMC or ASF Board might wish/need to be
aware of
*   How has the community developed since the last report
*   How has the project developed since the last report.

This should be appended to the Incubator Wiki page at:

http://wiki.apache.org/incubator/October2016

Note: This is manually populated. You may need to wait a little before
this page is created from a template.

Mentors
---

Mentors should review reports for their project(s) and sign them off on
the Incubator wiki page. Signing off reports shows that you are
following the project - projects that are not signed may raise alarms
for the Incubator PMC.

Incubator PMC


Re: [CANCELLED][VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread Michael Miklavcic
https://issues.apache.org/jira/browse/METRON-476 is committed to master

On Thu, Sep 29, 2016 at 6:09 PM, James Sirota  wrote:

> This vote is cancelled due to 2 binding -1s.  We will cut RC2 and re-post
> a thread for a re-vote
>
> 29.09.2016, 13:58, "Casey Stella" :
> > Ok, looks like PR is out. For the record, I'm -1 (binding).
> >
> > On Thu, Sep 29, 2016 at 4:32 PM, David Lyle 
> wrote:
> >
> >>  Hi Mike,
> >>
> >>  Yeah, that's all it is. We just crossed is all.
> >>
> >>  -D...
> >>
> >>  On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic <
> >>  michael.miklav...@gmail.com> wrote:
> >>
> >>  > Sweet! Thanks David.
> >>  >
> >>  > On Thu, Sep 29, 2016 at 4:18 PM, David Lyle 
> >>  wrote:
> >>  >
> >>  > > Sounds good to me. I can push up a pr straightaway. Testing the fix
> >>  now.
> >>  > >
> >>  > > -D...
> >>  > >
> >>  > >
> >>  > > On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella 
> >>  > wrote:
> >>  > >
> >>  > > > Let's cancel the vote, someone put up a PR to correct and cut a
> rc2.
> >>  > How
> >>  > > > about that?
> >>  > > >
> >>  > > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle <
> dlyle65...@gmail.com>
> >>  > > wrote:
> >>  > > >
> >>  > > > > Okay, so it looks like METRON-466 and METRON-389 crossed paths
> and
> >>  > the
> >>  > > > > metron_version in the quick dev is still 0.2.0BETA.
> >>  > > > >
> >>  > > > > Easy to fix, how do you want to proceed?
> >>  > > > >
> >>  > > > > -D...
> >>  > > > >
> >>  > > > >
> >>  > > > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle <
> dlyle65...@gmail.com>
> >>  > > > wrote:
> >>  > > > >
> >>  > > > > > Correction, the solr bundle didn't deploy - let me retract
> that
> >>  +1
> >>  > > for
> >>  > > > a
> >>  > > > > > sec.
> >>  > > > > >
> >>  > > > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle <
> >>  dlyle65...@gmail.com>
> >>  > > > > wrote:
> >>  > > > > >
> >>  > > > > >> +1 (binding)
> >>  > > > > >>
> >>  > > > > >> checksums/gpg - checked
> >>  > > > > >> Rat Check - passed
> >>  > > > > >> Integration Tests - passed
> >>  > > > > >> Package Builds - success
> >>  > > > > >> Quick Dev - worked as expected
> >>  > > > > >>
> >>  > > > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota <
> >>  jsir...@apache.org
> >>  > >
> >>  > > > > wrote:
> >>  > > > > >>
> >>  > > > > >>> +1, binding
> >>  > > > > >>>
> >>  > > > > >>> 29.09.2016, 11:31, "James Sirota" :
> >>  > > > > >>> > This is a call to vote on releasing Apache Metron
> >>  0.2.1BETA-RC1
> >>  > > > > >>> incubating
> >>  > > > > >>> >
> >>  > > > > >>> > Full list of changes in this release:
> >>  > > > > >>> >
> >>  > > > > >>> > https://dist.apache.org/repos/
> dist/dev/incubator/metron/0.2.
> >>  > > > > >>> 1BETA-RC1-incubating/CHANGES
> >>  > > > > >>> >
> >>  > > > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> >>  > > > > >>> >
> >>  > > > > >>> > https://git-wip-us.apache.org/
> repos/asf?p=incubator-metron.g
> >>  > > > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> >>  > > > > >>> >
> >>  > > > > >>> > The source archive being voted upon can be found here:
> >>  > > > > >>> >
> >>  > > > > >>> > https://dist.apache.org/repos/
> dist/dev/incubator/metron/0.2.
> >>  > > > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-
> >>  > incubating.tar.gz
> >>  > > > > >>> >
> >>  > > > > >>> > Other release files, signatures and digests can be found
> >>  here:
> >>  > > > > >>> > https://dist.apache.org/repos/
> dist/dev/incubator/metron/0.2.
> >>  > > > > >>> 1BETA-RC1-incubating/
> >>  > > > > >>> >
> >>  > > > > >>> > The release artifacts are signed with the following key:
> >>  > > > > >>> >
> >>  > > > > >>> > https://git-wip-us.apache.org/
> repos/asf?p=incubator-metron.g
> >>  > > > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd8
> 90f1070a18;
> >>  > > > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> >>  > > > > >>> >
> >>  > > > > >>> > Please vote on releasing this package as Apache Metron
> >>  > > > 0.2.1BETA-RC1
> >>  > > > > >>> incubating
> >>  > > > > >>> >
> >>  > > > > >>> > When voting, please list the actions taken to verify the
> >>  > release.
> >>  > > > > >>> > Recommended build validation and verification
> instructions
> >>  are
> >>  > > > posted
> >>  > > > > >>> here:
> >>  > > > > >>> > https://cwiki.apache.org/confluence/display/METRON/
> >>  > > > Verifying+Builds
> >>  > > > > >>> >
> >>  > > > > >>> > This vote will be open for at least 72 hours.
> >>  > > > > >>> >
> >>  > > > > >>> > [ ] +1 Release this package as Apache Metron
> 0.2.0BETA-RC2
> >>  > > > incubating
> >>  > > > > >>> > [ ] 0 No opinion
> >>  > > > > >>> > [ ] -1 Do not release this package because...
> >>  > > > > >>> >
> >>  > > > > >>> > ---
> >>  > > > > >>> > Thank you,
> >>  > > > > >>> >
> >>  > > > > >>> > James Sirota
> >>  > > > > >>> > PPMC- Apache Metron (Incubating)
> >> 

[GitHub] incubator-metron pull request #285: METRON-476: Bump release version to 0.2....

2016-09-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-metron/pull/285


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[CANCELLED][VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread James Sirota
This vote is cancelled due to 2 binding -1s.  We will cut RC2 and re-post a 
thread for a re-vote 

29.09.2016, 13:58, "Casey Stella" :
> Ok, looks like PR is out. For the record, I'm -1 (binding).
>
> On Thu, Sep 29, 2016 at 4:32 PM, David Lyle  wrote:
>
>>  Hi Mike,
>>
>>  Yeah, that's all it is. We just crossed is all.
>>
>>  -D...
>>
>>  On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic <
>>  michael.miklav...@gmail.com> wrote:
>>
>>  > Sweet! Thanks David.
>>  >
>>  > On Thu, Sep 29, 2016 at 4:18 PM, David Lyle 
>>  wrote:
>>  >
>>  > > Sounds good to me. I can push up a pr straightaway. Testing the fix
>>  now.
>>  > >
>>  > > -D...
>>  > >
>>  > >
>>  > > On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella 
>>  > wrote:
>>  > >
>>  > > > Let's cancel the vote, someone put up a PR to correct and cut a rc2.
>>  > How
>>  > > > about that?
>>  > > >
>>  > > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle 
>>  > > wrote:
>>  > > >
>>  > > > > Okay, so it looks like METRON-466 and METRON-389 crossed paths and
>>  > the
>>  > > > > metron_version in the quick dev is still 0.2.0BETA.
>>  > > > >
>>  > > > > Easy to fix, how do you want to proceed?
>>  > > > >
>>  > > > > -D...
>>  > > > >
>>  > > > >
>>  > > > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
>>  > > > wrote:
>>  > > > >
>>  > > > > > Correction, the solr bundle didn't deploy - let me retract that
>>  +1
>>  > > for
>>  > > > a
>>  > > > > > sec.
>>  > > > > >
>>  > > > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle <
>>  dlyle65...@gmail.com>
>>  > > > > wrote:
>>  > > > > >
>>  > > > > >> +1 (binding)
>>  > > > > >>
>>  > > > > >> checksums/gpg - checked
>>  > > > > >> Rat Check - passed
>>  > > > > >> Integration Tests - passed
>>  > > > > >> Package Builds - success
>>  > > > > >> Quick Dev - worked as expected
>>  > > > > >>
>>  > > > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota <
>>  jsir...@apache.org
>>  > >
>>  > > > > wrote:
>>  > > > > >>
>>  > > > > >>> +1, binding
>>  > > > > >>>
>>  > > > > >>> 29.09.2016, 11:31, "James Sirota" :
>>  > > > > >>> > This is a call to vote on releasing Apache Metron
>>  0.2.1BETA-RC1
>>  > > > > >>> incubating
>>  > > > > >>> >
>>  > > > > >>> > Full list of changes in this release:
>>  > > > > >>> >
>>  > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > > >>> 1BETA-RC1-incubating/CHANGES
>>  > > > > >>> >
>>  > > > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
>>  > > > > >>> >
>>  > > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>  > > > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
>>  > > > > >>> >
>>  > > > > >>> > The source archive being voted upon can be found here:
>>  > > > > >>> >
>>  > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-
>>  > incubating.tar.gz
>>  > > > > >>> >
>>  > > > > >>> > Other release files, signatures and digests can be found
>>  here:
>>  > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > > >>> 1BETA-RC1-incubating/
>>  > > > > >>> >
>>  > > > > >>> > The release artifacts are signed with the following key:
>>  > > > > >>> >
>>  > > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>  > > > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
>>  > > > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
>>  > > > > >>> >
>>  > > > > >>> > Please vote on releasing this package as Apache Metron
>>  > > > 0.2.1BETA-RC1
>>  > > > > >>> incubating
>>  > > > > >>> >
>>  > > > > >>> > When voting, please list the actions taken to verify the
>>  > release.
>>  > > > > >>> > Recommended build validation and verification instructions
>>  are
>>  > > > posted
>>  > > > > >>> here:
>>  > > > > >>> > https://cwiki.apache.org/confluence/display/METRON/
>>  > > > Verifying+Builds
>>  > > > > >>> >
>>  > > > > >>> > This vote will be open for at least 72 hours.
>>  > > > > >>> >
>>  > > > > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
>>  > > > incubating
>>  > > > > >>> > [ ] 0 No opinion
>>  > > > > >>> > [ ] -1 Do not release this package because...
>>  > > > > >>> >
>>  > > > > >>> > ---
>>  > > > > >>> > Thank you,
>>  > > > > >>> >
>>  > > > > >>> > James Sirota
>>  > > > > >>> > PPMC- Apache Metron (Incubating)
>>  > > > > >>> > jsirota AT apache DOT org
>>  > > > > >>>
>>  > > > > >>> ---
>>  > > > > >>> Thank you,
>>  > > > > >>>
>>  > > > > >>> James Sirota
>>  > > > > >>> PPMC- Apache Metron (Incubating)
>>  > > > > >>> jsirota AT apache DOT org
>>  > > > > >>>
>>  > > > > >>
>>  > > > > >>
>>  > > > > >
>>  > > > >
>>  > > >
>>  > >
>>  >

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT 

Re: new committer: Justin Leet

2016-09-29 Thread Houshang Livian
Congrats Justin!




On 9/29/16, 1:19 PM, "Nick Allen"  wrote:

>Many congrats to Justin and Mike.  Good people.
>
>On Thu, Sep 29, 2016 at 3:59 PM, Justin Leet  wrote:
>
>> Thanks a lot, James, Casey, and everyone else.
>>
>> I'm very excited for the opportunity and look forward to diving in!
>>
>> Justin
>>
>> On Thu, Sep 29, 2016 at 3:38 PM, Casey Stella  wrote:
>>
>> > Congratulations, Justin.  Welcome aboard!  Now, I have some PRs for you
>> to
>> > review... ;)
>> >
>> > Casey
>> >
>> > On Thu, Sep 29, 2016 at 3:36 PM, James Sirota 
>> wrote:
>> >
>> > >
>> > > The Podling Project Management Committee (PPMC) for Apache Metron
>> > > (Incubating)
>> > > has asked Justin Leet to become a committer and we are pleased
>> > > to announce that they have accepted.
>> > >
>> > > Being a committer enables easier contribution to the
>> > > project since there is no need to go via the patch
>> > > submission process. This should enable better productivity.
>> > > Being a PPMC member enables assistance with the management
>> > > and to guide the direction of the project.
>> > >
>> > > ---
>> > > Thank you,
>> > >
>> > > James Sirota
>> > > PPMC- Apache Metron (Incubating)
>> > > jsirota AT apache DOT org
>> > >
>> >
>>
>
>
>
>-- 
>Nick Allen 


Re: new committer: Michael Miklavcic

2016-09-29 Thread Houshang Livian
Congrats Michael!




On 9/29/16, 12:53 PM, "Michael Miklavcic"  wrote:

>Pleased and honored to join the community. Thank you James and the rest of
>the PPMC!
>
>Best,
>Michael Miklavcic
>
>On Thu, Sep 29, 2016 at 3:43 PM, James Sirota  wrote:
>
>> The Podling Project Management Committee (PPMC) for Apache Metron
>> (Incubating)
>> has asked Michael Miklavcic  to become a committer and we are pleased
>> to announce that they have accepted.
>>
>>
>> Being a committer enables easier contribution to the
>> project since there is no need to go via the patch
>> submission process. This should enable better productivity.
>> Being a PMC member enables assistance with the management
>> and to guide the direction of the project.
>>
>> ---
>> Thank you,
>>
>> James Sirota
>> PPMC- Apache Metron (Incubating)
>> jsirota AT apache DOT org
>>


[DISCUSS] Metron REST API Requirements

2016-09-29 Thread Ryan Merriman
I would like to start a discussion around adding a REST API to Metron.  I
believe this is well worth the effort and would provide several benefits
including:

   - Giving users a uniform, well-tested and well-documented interface for
   interacting with Metron
   - Providing a layer of security (role-based, ACL, etc) around Metron
   functions
   - Enabling developers to build tools and interfaces on top of Metron
   without needing detailed knowledge of Metron internals

 The purpose of this discussion is to gather requirements around what the
REST API should include and the features it should provide.  Assuming we
decide a REST API is a worthy addition and can agree on a comprehensive
list of requirements, I will start a separate more technical discussion
around architecture and design.

I will start it off with a list of requirements that I think are
important.  The REST API should:

   - Be secure and adhere to modern web security standards
   - Provide a pluggable authentication mechanism
   - Be written in Java since the majority of Metron is written in Java
   - Be powered by a mature, open source web development framework with
   strong community support
   - Be as comprehensive as possible, meaning any task or function in
   Metron should be available in the REST API (are there exceptions?)
   - Have detailed documentation that always reflects the current version
   - Have the same level of installation tooling as Metron platform

The following is a initial list of functions I think should be included:

   - CRUD functions for parser, enrichment, and indexing zookeeper
   configurations
   - A function to retrieve versioning and auditing information for
   zookeeper configs
   - Functions for starting/stopping/enabling/disabling various Storm
   topologies
   - A function to retrieve sample data from various Kafka topics
   - A function to test Grok statements
   - A function to test parsers against sample data
   - A function to test enrichments against sample data
   - Functions that give status for the various components in Metron
   (HBase, Storm topologies, enrichments, etc)
   - A function that tests and runs Stellar statements against sample data.

I will continue to add to these lists as I think of more.  Looking forward
to hearing everyone’s ideas and input.

Ryan Merriman


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread James Sirota
Good catch, guys.  Will cancel the vote and put up RC2

29.09.2016, 13:32, "David Lyle" :
> Hi Mike,
>
> Yeah, that's all it is. We just crossed is all.
>
> -D...
>
> On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic <
> michael.miklav...@gmail.com> wrote:
>
>>  Sweet! Thanks David.
>>
>>  On Thu, Sep 29, 2016 at 4:18 PM, David Lyle  wrote:
>>
>>  > Sounds good to me. I can push up a pr straightaway. Testing the fix now.
>>  >
>>  > -D...
>>  >
>>  >
>>  > On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella 
>>  wrote:
>>  >
>>  > > Let's cancel the vote, someone put up a PR to correct and cut a rc2.
>>  How
>>  > > about that?
>>  > >
>>  > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle 
>>  > wrote:
>>  > >
>>  > > > Okay, so it looks like METRON-466 and METRON-389 crossed paths and
>>  the
>>  > > > metron_version in the quick dev is still 0.2.0BETA.
>>  > > >
>>  > > > Easy to fix, how do you want to proceed?
>>  > > >
>>  > > > -D...
>>  > > >
>>  > > >
>>  > > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
>>  > > wrote:
>>  > > >
>>  > > > > Correction, the solr bundle didn't deploy - let me retract that +1
>>  > for
>>  > > a
>>  > > > > sec.
>>  > > > >
>>  > > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle 
>>  > > > wrote:
>>  > > > >
>>  > > > >> +1 (binding)
>>  > > > >>
>>  > > > >> checksums/gpg - checked
>>  > > > >> Rat Check - passed
>>  > > > >> Integration Tests - passed
>>  > > > >> Package Builds - success
>>  > > > >> Quick Dev - worked as expected
>>  > > > >>
>>  > > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota >  >
>>  > > > wrote:
>>  > > > >>
>>  > > > >>> +1, binding
>>  > > > >>>
>>  > > > >>> 29.09.2016, 11:31, "James Sirota" :
>>  > > > >>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
>>  > > > >>> incubating
>>  > > > >>> >
>>  > > > >>> > Full list of changes in this release:
>>  > > > >>> >
>>  > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > >>> 1BETA-RC1-incubating/CHANGES
>>  > > > >>> >
>>  > > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
>>  > > > >>> >
>>  > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>  > > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
>>  > > > >>> >
>>  > > > >>> > The source archive being voted upon can be found here:
>>  > > > >>> >
>>  > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-
>>  incubating.tar.gz
>>  > > > >>> >
>>  > > > >>> > Other release files, signatures and digests can be found here:
>>  > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>  > > > >>> 1BETA-RC1-incubating/
>>  > > > >>> >
>>  > > > >>> > The release artifacts are signed with the following key:
>>  > > > >>> >
>>  > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>  > > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
>>  > > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
>>  > > > >>> >
>>  > > > >>> > Please vote on releasing this package as Apache Metron
>>  > > 0.2.1BETA-RC1
>>  > > > >>> incubating
>>  > > > >>> >
>>  > > > >>> > When voting, please list the actions taken to verify the
>>  release.
>>  > > > >>> > Recommended build validation and verification instructions are
>>  > > posted
>>  > > > >>> here:
>>  > > > >>> > https://cwiki.apache.org/confluence/display/METRON/
>>  > > Verifying+Builds
>>  > > > >>> >
>>  > > > >>> > This vote will be open for at least 72 hours.
>>  > > > >>> >
>>  > > > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
>>  > > incubating
>>  > > > >>> > [ ] 0 No opinion
>>  > > > >>> > [ ] -1 Do not release this package because...
>>  > > > >>> >
>>  > > > >>> > ---
>>  > > > >>> > Thank you,
>>  > > > >>> >
>>  > > > >>> > James Sirota
>>  > > > >>> > PPMC- Apache Metron (Incubating)
>>  > > > >>> > jsirota AT apache DOT org
>>  > > > >>>
>>  > > > >>> ---
>>  > > > >>> Thank you,
>>  > > > >>>
>>  > > > >>> James Sirota
>>  > > > >>> PPMC- Apache Metron (Incubating)
>>  > > > >>> jsirota AT apache DOT org
>>  > > > >>>
>>  > > > >>
>>  > > > >>
>>  > > > >
>>  > > >
>>  > >
>>  >

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread Casey Stella
Ok, looks like PR is out.  For the record, I'm -1 (binding).

On Thu, Sep 29, 2016 at 4:32 PM, David Lyle  wrote:

> Hi Mike,
>
> Yeah, that's all it is. We just crossed is all.
>
> -D...
>
> On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic <
> michael.miklav...@gmail.com> wrote:
>
> > Sweet! Thanks David.
> >
> > On Thu, Sep 29, 2016 at 4:18 PM, David Lyle 
> wrote:
> >
> > > Sounds good to me. I can push up a pr straightaway. Testing the fix
> now.
> > >
> > > -D...
> > >
> > >
> > > On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella 
> > wrote:
> > >
> > > > Let's cancel the vote, someone put up a PR to correct and cut a rc2.
> > How
> > > > about that?
> > > >
> > > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle 
> > > wrote:
> > > >
> > > > > Okay, so it looks like METRON-466 and METRON-389 crossed paths and
> > the
> > > > > metron_version in the quick dev is still 0.2.0BETA.
> > > > >
> > > > > Easy to fix, how do you want to proceed?
> > > > >
> > > > > -D...
> > > > >
> > > > >
> > > > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
> > > > wrote:
> > > > >
> > > > > > Correction, the solr bundle didn't deploy - let me retract that
> +1
> > > for
> > > > a
> > > > > > sec.
> > > > > >
> > > > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle <
> dlyle65...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > >> +1 (binding)
> > > > > >>
> > > > > >> checksums/gpg - checked
> > > > > >> Rat Check - passed
> > > > > >> Integration Tests - passed
> > > > > >> Package Builds - success
> > > > > >> Quick Dev - worked as expected
> > > > > >>
> > > > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota <
> jsir...@apache.org
> > >
> > > > > wrote:
> > > > > >>
> > > > > >>> +1, binding
> > > > > >>>
> > > > > >>> 29.09.2016, 11:31, "James Sirota" :
> > > > > >>> > This is a call to vote on releasing Apache Metron
> 0.2.1BETA-RC1
> > > > > >>> incubating
> > > > > >>> >
> > > > > >>> > Full list of changes in this release:
> > > > > >>> >
> > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > > >>> 1BETA-RC1-incubating/CHANGES
> > > > > >>> >
> > > > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> > > > > >>> >
> > > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> > > > > >>> >
> > > > > >>> > The source archive being voted upon can be found here:
> > > > > >>> >
> > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-
> > incubating.tar.gz
> > > > > >>> >
> > > > > >>> > Other release files, signatures and digests can be found
> here:
> > > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > > >>> 1BETA-RC1-incubating/
> > > > > >>> >
> > > > > >>> > The release artifacts are signed with the following key:
> > > > > >>> >
> > > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
> > > > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> > > > > >>> >
> > > > > >>> > Please vote on releasing this package as Apache Metron
> > > > 0.2.1BETA-RC1
> > > > > >>> incubating
> > > > > >>> >
> > > > > >>> > When voting, please list the actions taken to verify the
> > release.
> > > > > >>> > Recommended build validation and verification instructions
> are
> > > > posted
> > > > > >>> here:
> > > > > >>> > https://cwiki.apache.org/confluence/display/METRON/
> > > > Verifying+Builds
> > > > > >>> >
> > > > > >>> > This vote will be open for at least 72 hours.
> > > > > >>> >
> > > > > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
> > > > incubating
> > > > > >>> > [ ] 0 No opinion
> > > > > >>> > [ ] -1 Do not release this package because...
> > > > > >>> >
> > > > > >>> > ---
> > > > > >>> > Thank you,
> > > > > >>> >
> > > > > >>> > James Sirota
> > > > > >>> > PPMC- Apache Metron (Incubating)
> > > > > >>> > jsirota AT apache DOT org
> > > > > >>>
> > > > > >>> ---
> > > > > >>> Thank you,
> > > > > >>>
> > > > > >>> James Sirota
> > > > > >>> PPMC- Apache Metron (Incubating)
> > > > > >>> jsirota AT apache DOT org
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>


[GitHub] incubator-metron issue #285: METRON-476: Bump release version to 0.2.1BETA f...

2016-09-29 Thread mmiklavc
Github user mmiklavc commented on the issue:

https://github.com/apache/incubator-metron/pull/285
  
Looks good by inspection. +1 pending @dlyle65535's Vagrant check.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-metron pull request #285: METRON-476: Bump release version to 0.2....

2016-09-29 Thread dlyle65535
GitHub user dlyle65535 opened a pull request:

https://github.com/apache/incubator-metron/pull/285

METRON-476: Bump release version to 0.2.1BETA for Quick Dev

Vagrant testing is in progress, I'll update when it completes.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dlyle65535/incubator-metron METRON-476

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-metron/pull/285.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #285


commit 3c6ca3b530722d3c9e353dccc1c207d422fe1660
Author: David Lyle 
Date:   2016-09-29T20:33:16Z

METRON-476: Bump release version to 0.2.1BETA for Quick Dev




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Hi Mike,

Yeah, that's all it is. We just crossed is all.

-D...

On Thu, Sep 29, 2016 at 4:29 PM, Michael Miklavcic <
michael.miklav...@gmail.com> wrote:

> Sweet! Thanks David.
>
> On Thu, Sep 29, 2016 at 4:18 PM, David Lyle  wrote:
>
> > Sounds good to me. I can push up a pr straightaway. Testing the fix now.
> >
> > -D...
> >
> >
> > On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella 
> wrote:
> >
> > > Let's cancel the vote, someone put up a PR to correct and cut a rc2.
> How
> > > about that?
> > >
> > > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle 
> > wrote:
> > >
> > > > Okay, so it looks like METRON-466 and METRON-389 crossed paths and
> the
> > > > metron_version in the quick dev is still 0.2.0BETA.
> > > >
> > > > Easy to fix, how do you want to proceed?
> > > >
> > > > -D...
> > > >
> > > >
> > > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
> > > wrote:
> > > >
> > > > > Correction, the solr bundle didn't deploy - let me retract that +1
> > for
> > > a
> > > > > sec.
> > > > >
> > > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle 
> > > > wrote:
> > > > >
> > > > >> +1 (binding)
> > > > >>
> > > > >> checksums/gpg - checked
> > > > >> Rat Check - passed
> > > > >> Integration Tests - passed
> > > > >> Package Builds - success
> > > > >> Quick Dev - worked as expected
> > > > >>
> > > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota  >
> > > > wrote:
> > > > >>
> > > > >>> +1, binding
> > > > >>>
> > > > >>> 29.09.2016, 11:31, "James Sirota" :
> > > > >>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
> > > > >>> incubating
> > > > >>> >
> > > > >>> > Full list of changes in this release:
> > > > >>> >
> > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > >>> 1BETA-RC1-incubating/CHANGES
> > > > >>> >
> > > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> > > > >>> >
> > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> > > > >>> >
> > > > >>> > The source archive being voted upon can be found here:
> > > > >>> >
> > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-
> incubating.tar.gz
> > > > >>> >
> > > > >>> > Other release files, signatures and digests can be found here:
> > > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > > >>> 1BETA-RC1-incubating/
> > > > >>> >
> > > > >>> > The release artifacts are signed with the following key:
> > > > >>> >
> > > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
> > > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> > > > >>> >
> > > > >>> > Please vote on releasing this package as Apache Metron
> > > 0.2.1BETA-RC1
> > > > >>> incubating
> > > > >>> >
> > > > >>> > When voting, please list the actions taken to verify the
> release.
> > > > >>> > Recommended build validation and verification instructions are
> > > posted
> > > > >>> here:
> > > > >>> > https://cwiki.apache.org/confluence/display/METRON/
> > > Verifying+Builds
> > > > >>> >
> > > > >>> > This vote will be open for at least 72 hours.
> > > > >>> >
> > > > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
> > > incubating
> > > > >>> > [ ] 0 No opinion
> > > > >>> > [ ] -1 Do not release this package because...
> > > > >>> >
> > > > >>> > ---
> > > > >>> > Thank you,
> > > > >>> >
> > > > >>> > James Sirota
> > > > >>> > PPMC- Apache Metron (Incubating)
> > > > >>> > jsirota AT apache DOT org
> > > > >>>
> > > > >>> ---
> > > > >>> Thank you,
> > > > >>>
> > > > >>> James Sirota
> > > > >>> PPMC- Apache Metron (Incubating)
> > > > >>> jsirota AT apache DOT org
> > > > >>>
> > > > >>
> > > > >>
> > > > >
> > > >
> > >
> >
>


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread Michael Miklavcic
Sweet! Thanks David.

On Thu, Sep 29, 2016 at 4:18 PM, David Lyle  wrote:

> Sounds good to me. I can push up a pr straightaway. Testing the fix now.
>
> -D...
>
>
> On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella  wrote:
>
> > Let's cancel the vote, someone put up a PR to correct and cut a rc2.  How
> > about that?
> >
> > On Thu, Sep 29, 2016 at 4:16 PM, David Lyle 
> wrote:
> >
> > > Okay, so it looks like METRON-466 and METRON-389 crossed paths and the
> > > metron_version in the quick dev is still 0.2.0BETA.
> > >
> > > Easy to fix, how do you want to proceed?
> > >
> > > -D...
> > >
> > >
> > > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
> > wrote:
> > >
> > > > Correction, the solr bundle didn't deploy - let me retract that +1
> for
> > a
> > > > sec.
> > > >
> > > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle 
> > > wrote:
> > > >
> > > >> +1 (binding)
> > > >>
> > > >> checksums/gpg - checked
> > > >> Rat Check - passed
> > > >> Integration Tests - passed
> > > >> Package Builds - success
> > > >> Quick Dev - worked as expected
> > > >>
> > > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota 
> > > wrote:
> > > >>
> > > >>> +1, binding
> > > >>>
> > > >>> 29.09.2016, 11:31, "James Sirota" :
> > > >>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
> > > >>> incubating
> > > >>> >
> > > >>> > Full list of changes in this release:
> > > >>> >
> > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > >>> 1BETA-RC1-incubating/CHANGES
> > > >>> >
> > > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> > > >>> >
> > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> > > >>> >
> > > >>> > The source archive being voted upon can be found here:
> > > >>> >
> > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
> > > >>> >
> > > >>> > Other release files, signatures and digests can be found here:
> > > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > > >>> 1BETA-RC1-incubating/
> > > >>> >
> > > >>> > The release artifacts are signed with the following key:
> > > >>> >
> > > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
> > > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> > > >>> >
> > > >>> > Please vote on releasing this package as Apache Metron
> > 0.2.1BETA-RC1
> > > >>> incubating
> > > >>> >
> > > >>> > When voting, please list the actions taken to verify the release.
> > > >>> > Recommended build validation and verification instructions are
> > posted
> > > >>> here:
> > > >>> > https://cwiki.apache.org/confluence/display/METRON/
> > Verifying+Builds
> > > >>> >
> > > >>> > This vote will be open for at least 72 hours.
> > > >>> >
> > > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
> > incubating
> > > >>> > [ ] 0 No opinion
> > > >>> > [ ] -1 Do not release this package because...
> > > >>> >
> > > >>> > ---
> > > >>> > Thank you,
> > > >>> >
> > > >>> > James Sirota
> > > >>> > PPMC- Apache Metron (Incubating)
> > > >>> > jsirota AT apache DOT org
> > > >>>
> > > >>> ---
> > > >>> Thank you,
> > > >>>
> > > >>> James Sirota
> > > >>> PPMC- Apache Metron (Incubating)
> > > >>> jsirota AT apache DOT org
> > > >>>
> > > >>
> > > >>
> > > >
> > >
> >
>


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread Michael Miklavcic
David, is line 42 in
incubator-metron/metron-deployment/inventory/quick-dev-platform/group_vars/all
the only issue you see?

On Thu, Sep 29, 2016 at 4:17 PM, Casey Stella  wrote:

> Let's cancel the vote, someone put up a PR to correct and cut a rc2.  How
> about that?
>
> On Thu, Sep 29, 2016 at 4:16 PM, David Lyle  wrote:
>
> > Okay, so it looks like METRON-466 and METRON-389 crossed paths and the
> > metron_version in the quick dev is still 0.2.0BETA.
> >
> > Easy to fix, how do you want to proceed?
> >
> > -D...
> >
> >
> > On Thu, Sep 29, 2016 at 4:13 PM, David Lyle 
> wrote:
> >
> > > Correction, the solr bundle didn't deploy - let me retract that +1 for
> a
> > > sec.
> > >
> > > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle 
> > wrote:
> > >
> > >> +1 (binding)
> > >>
> > >> checksums/gpg - checked
> > >> Rat Check - passed
> > >> Integration Tests - passed
> > >> Package Builds - success
> > >> Quick Dev - worked as expected
> > >>
> > >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota 
> > wrote:
> > >>
> > >>> +1, binding
> > >>>
> > >>> 29.09.2016, 11:31, "James Sirota" :
> > >>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
> > >>> incubating
> > >>> >
> > >>> > Full list of changes in this release:
> > >>> >
> > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > >>> 1BETA-RC1-incubating/CHANGES
> > >>> >
> > >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> > >>> >
> > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> > >>> >
> > >>> > The source archive being voted upon can be found here:
> > >>> >
> > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
> > >>> >
> > >>> > Other release files, signatures and digests can be found here:
> > >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> > >>> 1BETA-RC1-incubating/
> > >>> >
> > >>> > The release artifacts are signed with the following key:
> > >>> >
> > >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> > >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
> > >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> > >>> >
> > >>> > Please vote on releasing this package as Apache Metron
> 0.2.1BETA-RC1
> > >>> incubating
> > >>> >
> > >>> > When voting, please list the actions taken to verify the release.
> > >>> > Recommended build validation and verification instructions are
> posted
> > >>> here:
> > >>> > https://cwiki.apache.org/confluence/display/METRON/
> Verifying+Builds
> > >>> >
> > >>> > This vote will be open for at least 72 hours.
> > >>> >
> > >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2
> incubating
> > >>> > [ ] 0 No opinion
> > >>> > [ ] -1 Do not release this package because...
> > >>> >
> > >>> > ---
> > >>> > Thank you,
> > >>> >
> > >>> > James Sirota
> > >>> > PPMC- Apache Metron (Incubating)
> > >>> > jsirota AT apache DOT org
> > >>>
> > >>> ---
> > >>> Thank you,
> > >>>
> > >>> James Sirota
> > >>> PPMC- Apache Metron (Incubating)
> > >>> jsirota AT apache DOT org
> > >>>
> > >>
> > >>
> > >
> >
>


Re: new committer: Justin Leet

2016-09-29 Thread Nick Allen
Many congrats to Justin and Mike.  Good people.

On Thu, Sep 29, 2016 at 3:59 PM, Justin Leet  wrote:

> Thanks a lot, James, Casey, and everyone else.
>
> I'm very excited for the opportunity and look forward to diving in!
>
> Justin
>
> On Thu, Sep 29, 2016 at 3:38 PM, Casey Stella  wrote:
>
> > Congratulations, Justin.  Welcome aboard!  Now, I have some PRs for you
> to
> > review... ;)
> >
> > Casey
> >
> > On Thu, Sep 29, 2016 at 3:36 PM, James Sirota 
> wrote:
> >
> > >
> > > The Podling Project Management Committee (PPMC) for Apache Metron
> > > (Incubating)
> > > has asked Justin Leet to become a committer and we are pleased
> > > to announce that they have accepted.
> > >
> > > Being a committer enables easier contribution to the
> > > project since there is no need to go via the patch
> > > submission process. This should enable better productivity.
> > > Being a PPMC member enables assistance with the management
> > > and to guide the direction of the project.
> > >
> > > ---
> > > Thank you,
> > >
> > > James Sirota
> > > PPMC- Apache Metron (Incubating)
> > > jsirota AT apache DOT org
> > >
> >
>



-- 
Nick Allen 


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread Casey Stella
Let's cancel the vote, someone put up a PR to correct and cut a rc2.  How
about that?

On Thu, Sep 29, 2016 at 4:16 PM, David Lyle  wrote:

> Okay, so it looks like METRON-466 and METRON-389 crossed paths and the
> metron_version in the quick dev is still 0.2.0BETA.
>
> Easy to fix, how do you want to proceed?
>
> -D...
>
>
> On Thu, Sep 29, 2016 at 4:13 PM, David Lyle  wrote:
>
> > Correction, the solr bundle didn't deploy - let me retract that +1 for a
> > sec.
> >
> > On Thu, Sep 29, 2016 at 4:09 PM, David Lyle 
> wrote:
> >
> >> +1 (binding)
> >>
> >> checksums/gpg - checked
> >> Rat Check - passed
> >> Integration Tests - passed
> >> Package Builds - success
> >> Quick Dev - worked as expected
> >>
> >> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota 
> wrote:
> >>
> >>> +1, binding
> >>>
> >>> 29.09.2016, 11:31, "James Sirota" :
> >>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
> >>> incubating
> >>> >
> >>> > Full list of changes in this release:
> >>> >
> >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> >>> 1BETA-RC1-incubating/CHANGES
> >>> >
> >>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
> >>> >
> >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> >>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
> >>> >
> >>> > The source archive being voted upon can be found here:
> >>> >
> >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> >>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
> >>> >
> >>> > Other release files, signatures and digests can be found here:
> >>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
> >>> 1BETA-RC1-incubating/
> >>> >
> >>> > The release artifacts are signed with the following key:
> >>> >
> >>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
> >>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
> >>> hb=refs/tags/Metron_0.2.1BETA_rc1
> >>> >
> >>> > Please vote on releasing this package as Apache Metron 0.2.1BETA-RC1
> >>> incubating
> >>> >
> >>> > When voting, please list the actions taken to verify the release.
> >>> > Recommended build validation and verification instructions are posted
> >>> here:
> >>> > https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
> >>> >
> >>> > This vote will be open for at least 72 hours.
> >>> >
> >>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2 incubating
> >>> > [ ] 0 No opinion
> >>> > [ ] -1 Do not release this package because...
> >>> >
> >>> > ---
> >>> > Thank you,
> >>> >
> >>> > James Sirota
> >>> > PPMC- Apache Metron (Incubating)
> >>> > jsirota AT apache DOT org
> >>>
> >>> ---
> >>> Thank you,
> >>>
> >>> James Sirota
> >>> PPMC- Apache Metron (Incubating)
> >>> jsirota AT apache DOT org
> >>>
> >>
> >>
> >
>


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Okay, so it looks like METRON-466 and METRON-389 crossed paths and the
metron_version in the quick dev is still 0.2.0BETA.

Easy to fix, how do you want to proceed?

-D...


On Thu, Sep 29, 2016 at 4:13 PM, David Lyle  wrote:

> Correction, the solr bundle didn't deploy - let me retract that +1 for a
> sec.
>
> On Thu, Sep 29, 2016 at 4:09 PM, David Lyle  wrote:
>
>> +1 (binding)
>>
>> checksums/gpg - checked
>> Rat Check - passed
>> Integration Tests - passed
>> Package Builds - success
>> Quick Dev - worked as expected
>>
>> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota  wrote:
>>
>>> +1, binding
>>>
>>> 29.09.2016, 11:31, "James Sirota" :
>>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
>>> incubating
>>> >
>>> > Full list of changes in this release:
>>> >
>>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>> 1BETA-RC1-incubating/CHANGES
>>> >
>>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
>>> >
>>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
>>> >
>>> > The source archive being voted upon can be found here:
>>> >
>>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
>>> >
>>> > Other release files, signatures and digests can be found here:
>>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>>> 1BETA-RC1-incubating/
>>> >
>>> > The release artifacts are signed with the following key:
>>> >
>>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
>>> hb=refs/tags/Metron_0.2.1BETA_rc1
>>> >
>>> > Please vote on releasing this package as Apache Metron 0.2.1BETA-RC1
>>> incubating
>>> >
>>> > When voting, please list the actions taken to verify the release.
>>> > Recommended build validation and verification instructions are posted
>>> here:
>>> > https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>>> >
>>> > This vote will be open for at least 72 hours.
>>> >
>>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2 incubating
>>> > [ ] 0 No opinion
>>> > [ ] -1 Do not release this package because...
>>> >
>>> > ---
>>> > Thank you,
>>> >
>>> > James Sirota
>>> > PPMC- Apache Metron (Incubating)
>>> > jsirota AT apache DOT org
>>>
>>> ---
>>> Thank you,
>>>
>>> James Sirota
>>> PPMC- Apache Metron (Incubating)
>>> jsirota AT apache DOT org
>>>
>>
>>
>


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread David Lyle
Correction, the solr bundle didn't deploy - let me retract that +1 for a
sec.

On Thu, Sep 29, 2016 at 4:09 PM, David Lyle  wrote:

> +1 (binding)
>
> checksums/gpg - checked
> Rat Check - passed
> Integration Tests - passed
> Package Builds - success
> Quick Dev - worked as expected
>
> On Thu, Sep 29, 2016 at 2:32 PM, James Sirota  wrote:
>
>> +1, binding
>>
>> 29.09.2016, 11:31, "James Sirota" :
>> > This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1
>> incubating
>> >
>> > Full list of changes in this release:
>> >
>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>> 1BETA-RC1-incubating/CHANGES
>> >
>> > The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
>> >
>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>> it;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
>> >
>> > The source archive being voted upon can be found here:
>> >
>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>> 1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
>> >
>> > Other release files, signatures and digests can be found here:
>> > https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.
>> 1BETA-RC1-incubating/
>> >
>> > The release artifacts are signed with the following key:
>> >
>> > https://git-wip-us.apache.org/repos/asf?p=incubator-metron.g
>> it;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;
>> hb=refs/tags/Metron_0.2.1BETA_rc1
>> >
>> > Please vote on releasing this package as Apache Metron 0.2.1BETA-RC1
>> incubating
>> >
>> > When voting, please list the actions taken to verify the release.
>> > Recommended build validation and verification instructions are posted
>> here:
>> > https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>> >
>> > This vote will be open for at least 72 hours.
>> >
>> > [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2 incubating
>> > [ ] 0 No opinion
>> > [ ] -1 Do not release this package because...
>> >
>> > ---
>> > Thank you,
>> >
>> > James Sirota
>> > PPMC- Apache Metron (Incubating)
>> > jsirota AT apache DOT org
>>
>> ---
>> Thank you,
>>
>> James Sirota
>> PPMC- Apache Metron (Incubating)
>> jsirota AT apache DOT org
>>
>
>


[GitHub] incubator-metron issue #282: Metron 430: Ability to load specific GeoIP data...

2016-09-29 Thread nickwallen
Github user nickwallen commented on the issue:

https://github.com/apache/incubator-metron/pull/282
  
+1 looks good pending travis build



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


new committer: Michael Miklavcic

2016-09-29 Thread James Sirota
The Podling Project Management Committee (PPMC) for Apache Metron (Incubating)
has asked Michael Miklavcic  to become a committer and we are pleased 
to announce that they have accepted.


Being a committer enables easier contribution to the
project since there is no need to go via the patch
submission process. This should enable better productivity.
Being a PMC member enables assistance with the management
and to guide the direction of the project.

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org


[GitHub] incubator-metron pull request #284: METRON-474 - fix vagrant ansible default...

2016-09-29 Thread ottobackwards
GitHub user ottobackwards opened a pull request:

https://github.com/apache/incubator-metron/pull/284

METRON-474 - fix vagrant ansible defaults for quick and full

Added defaults to match the run.sh parameters and removed the run.sh files. 
 Added a mention in the readmes as well.

Now, instead of running run.sh and having to add parameters to vagrant 
provision, in both quick and full simply running vagrant up and vagrant 
provision will maintain the correct parameters.

Tested by executing vagrant up and provision, vagrant ssh, ambari login

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ottobackwards/incubator-metron METRON-474

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-metron/pull/284.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #284






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread James Sirota
+1, binding 

29.09.2016, 11:31, "James Sirota" :
> This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1 incubating
>
> Full list of changes in this release:
>
> https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/CHANGES
>
> The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:
>
> https://git-wip-us.apache.org/repos/asf?p=incubator-metron.git;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319
>
> The source archive being voted upon can be found here:
>
> https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz
>
> Other release files, signatures and digests can be found here:
> https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/
>
> The release artifacts are signed with the following key:
>
> https://git-wip-us.apache.org/repos/asf?p=incubator-metron.git;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;hb=refs/tags/Metron_0.2.1BETA_rc1
>
> Please vote on releasing this package as Apache Metron 0.2.1BETA-RC1 
> incubating
>
> When voting, please list the actions taken to verify the release.
> Recommended build validation and verification instructions are posted here:
> https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds
>
> This vote will be open for at least 72 hours.
>
> [ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2 incubating
> [ ] 0 No opinion
> [ ] -1 Do not release this package because...
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org


[VOTE] Releasing Apache Metron 0.2.1BETA-RC1

2016-09-29 Thread James Sirota
This is a call to vote on releasing Apache Metron 0.2.1BETA-RC1 incubating

Full list of changes in this release:

https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/CHANGES

The tag/commit to be voted upon is Metron_0.2.1BETA_rc1:

https://git-wip-us.apache.org/repos/asf?p=incubator-metron.git;a=commit;h=823cd2a83063bf232d25d3f58c08ab1fa8e06319

The source archive being voted upon can be found here:

https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/apache-metron-0.2.1BETA-RC1-incubating.tar.gz

Other release files, signatures and digests can be found here:
https://dist.apache.org/repos/dist/dev/incubator/metron/0.2.1BETA-RC1-incubating/

The release artifacts are signed with the following key:

https://git-wip-us.apache.org/repos/asf?p=incubator-metron.git;a=blob;f=KEYS;h=c11bcb9b7385b4d155501aa097afd890f1070a18;hb=refs/tags/Metron_0.2.1BETA_rc1


Please vote on releasing this package as Apache Metron 0.2.1BETA-RC1 incubating

When voting, please list the actions taken to verify the release.
Recommended build validation and verification instructions are posted here:
https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds

This vote will be open for at least 72 hours.

[ ] +1 Release this package as Apache Metron 0.2.0BETA-RC2 incubating
[ ]  0 No opinion
[ ] -1 Do not release this package because...

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org


Re: [DISCUSS] Metron IRC channel

2016-09-29 Thread zeo...@gmail.com
+1 #apache-metron

On Thu, Sep 29, 2016 at 1:45 PM David Lyle  wrote:

> ditto.
>
> On Thu, Sep 29, 2016 at 1:29 PM, Casey Stella  wrote:
>
> > I'd agree; let's focus on #apache-metron
> >
> > On Thu, Sep 29, 2016 at 11:55 AM, James Sirota 
> wrote:
> >
> > > I would just keep #apache-metron and open it up to general public
> > >
> > > 29.09.2016, 08:54, "Yohann Lepage" :
> > > > Hi everyone,
> > > >
> > > > There are currently two IRC channels on FreeNode for Metron:
> > > > - #apache-metron
> > > > - #apache-metron-dev
> > > >
> > > > One channel is maybe enough as we are less than 5 users.
> > > >
> > > > What do you think? Which one to keep ?
> > > >
> > > > Related issue: https://issues.apache.org/jira/browse/METRON-337 -
> > > > Invite ASFBot to #apache-metron-dev IRC channel
> > > > --
> > > > Yohann L.
> > >
> > > ---
> > > Thank you,
> > >
> > > James Sirota
> > > PPMC- Apache Metron (Incubating)
> > > jsirota AT apache DOT org
> > >
> >
>
-- 

Jon


Re: [DISCUSS] Metron IRC channel

2016-09-29 Thread David Lyle
ditto.

On Thu, Sep 29, 2016 at 1:29 PM, Casey Stella  wrote:

> I'd agree; let's focus on #apache-metron
>
> On Thu, Sep 29, 2016 at 11:55 AM, James Sirota  wrote:
>
> > I would just keep #apache-metron and open it up to general public
> >
> > 29.09.2016, 08:54, "Yohann Lepage" :
> > > Hi everyone,
> > >
> > > There are currently two IRC channels on FreeNode for Metron:
> > > - #apache-metron
> > > - #apache-metron-dev
> > >
> > > One channel is maybe enough as we are less than 5 users.
> > >
> > > What do you think? Which one to keep ?
> > >
> > > Related issue: https://issues.apache.org/jira/browse/METRON-337 -
> > > Invite ASFBot to #apache-metron-dev IRC channel
> > > --
> > > Yohann L.
> >
> > ---
> > Thank you,
> >
> > James Sirota
> > PPMC- Apache Metron (Incubating)
> > jsirota AT apache DOT org
> >
>


Re: [DISCUSS] Metron IRC channel

2016-09-29 Thread Casey Stella
I'd agree; let's focus on #apache-metron

On Thu, Sep 29, 2016 at 11:55 AM, James Sirota  wrote:

> I would just keep #apache-metron and open it up to general public
>
> 29.09.2016, 08:54, "Yohann Lepage" :
> > Hi everyone,
> >
> > There are currently two IRC channels on FreeNode for Metron:
> > - #apache-metron
> > - #apache-metron-dev
> >
> > One channel is maybe enough as we are less than 5 users.
> >
> > What do you think? Which one to keep ?
> >
> > Related issue: https://issues.apache.org/jira/browse/METRON-337 -
> > Invite ASFBot to #apache-metron-dev IRC channel
> > --
> > Yohann L.
>
> ---
> Thank you,
>
> James Sirota
> PPMC- Apache Metron (Incubating)
> jsirota AT apache DOT org
>


Re: [DISCUSS] Upcoming Metron Build

2016-09-29 Thread James Sirota
Ok. Lets get the build out today and then we'll send 474 for the next build 

29.09.2016, 09:50, "Otto Fowler" :
> METRON-474 is going to build on top of 466’s functionality. I am testing
> it now and should have a PR later today, although I’m not sure it is worth
> waiting for. Just mentioning it.
>
> On September 29, 2016 at 12:20:38, Casey Stella (ceste...@gmail.com) wrote:
>
> Ok, with METRON-466 and METRON-398 being committed, I think we have
> everything in.
>
> On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
> michael.miklav...@gmail.com> wrote:
>
>>  https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
>>  committed
>>
>>  On Wed, Sep 28, 2016 at 5:41 PM, James Sirota  wrote:
>>
>>  > Sounds like we are still debating METRON-466. I want to make sure we
>
> get
>>  > consensus on it before we wend up the build. Lets wait a day until we
>>  get
>>  > resolution
>>  >
>>  > 28.09.2016, 12:34, "David Lyle" :
>>  > > No. METRON-466 is in review.
>>  > >
>>  > > On Wednesday, September 28, 2016, James Sirota 
>>  > wrote:
>>  > >
>>  > >> Do we now have everything we wanted in there?
>>  > >>
>>  > >> 27.09.2016, 08:59, "David Lyle" >  >:
>>  > >> > I'd like to hold out for https://issues.apache.org/
>>  > >> jira/browse/METRON-466.
>>  > >> > I'm testing this now, so am a few hours out.
>>  > >> >
>>  > >> > -D...
>>  > >> >
>>  > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
>>  > >> > michael.miklav...@gmail.com > wrote:
>>  > >> >
>>  > >> >> Also need this Jira to bump the version.
>>  > >> >>
>>  > >> >> https://issues.apache.org/jira/browse/METRON-398
>>  > >> >>
>>  > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
>>  jsir...@apache.org
>>  > >> > wrote:
>>  > >> >>
>>  > >> >> > We are preparing the next release (will be put up for a vote
>>  > within
>>  > >> the
>>  > >> >> > next few days) with the following list of Jiras. Do you feel
>>  there
>>  > >> are
>>  > >> >> any
>>  > >> >> > other Jiras that should go into this release or are there any
>>  > >> critical
>>  > >> >> bugs
>>  > >> >> > that anyone knows of that we should address before releasing?
>>  > Please
>>  > >> >> > comment on this thread. Otherwise, we will put up the release
>>  for
>>  > a
>>  > >> vote
>>  > >> >> > shortly.
>>  > >> >> >
>>  > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
>>  via
>>  > >> >> > cestella) closes apache/incubator-metron#274
>>  > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
>>  > >> >> closes
>>  > >> >> > apache/incubator-metron#271
>>  > >> >> > METRON-453: Add a stellar shell function to open an external
>>  > editor
>>  > >> >> > and return the editor's contents closes
>>  > apache/incubator-metron#272
>>  > >> >> > METRON-452: Add rudimentary configuration management functions
>>  to
>>  > >> >> > Stellar closes apache/incubator-metron#269
>>  > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
>
> NOTICE
>>  > and
>>  > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
>>  > >> >> > METRON-427 Create Ambari Management Pack for Metron
>
> Installation
>>  > >> >> > closes apache/incubator-metron#266
>>  > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
>>  > >> >> > METRON-437 Profile Definition's 'inputTopic' field is
>
> Extraneous
>>  > >> >> > (nickwallen) closes apache/incubator-metron#264
>>  > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
>>  > >> >> > nickwallen) closes apache/incubator-metron#267
>>  > >> >> > METRON-438: Back the Stellar REPL with a readline
>
> implementation
>>  > >> >> > closes apache/incubator-metron#265
>>  > >> >> > METRON-426: Stellar does not support scientific notation as a
>>  > literal
>>  > >> >> > closes apache/incubator-metron#257
>>  > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
>
> closes
>>  > >> >> > apache/incubator-metron#262
>>  > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
>>  > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
>>  > >> >> > METRON-433: Documentation update closes
>>  > apache/incubator-metron#260
>>  > >> >> > METRON-428: Allow a kafka offset to be passed to the
>>  > ParserTopology
>>  > >> >> > CLI closes apache/incubator-metron#258
>>  > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
>>  > >> >> > (nickwallen) closes apache/incubator-metron#259
>>  > >> >> > METRON-384 Deployment fails at task Wait for
>
> Elasticsearch
>>  > >> >> Host
>>  > >> >> > to Start (2xyo via dlyle65535) closes
>>  > >> apache/incubator-metron#221
>>  > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
>>  > (mmiklavc
>>  > >> >> > via cestella) closes apache/incubator-metron#256
>>  > >> >> > METRON-420 Add 

Re: [DISCUSS] Upcoming Metron Build

2016-09-29 Thread Otto Fowler
METRON-474 is going to build on top of 466’s functionality.  I am testing
it now and should have a PR later today, although I’m not sure it is worth
waiting for.  Just mentioning it.



On September 29, 2016 at 12:20:38, Casey Stella (ceste...@gmail.com) wrote:

Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.

On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklav...@gmail.com> wrote:

> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota  wrote:
>
> > Sounds like we are still debating METRON-466. I want to make sure we
get
> > consensus on it before we wend up the build. Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" :
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota 
> > wrote:
> > >
> > >> Do we now have everything we wanted in there?
> > >>
> > >> 27.09.2016, 08:59, "David Lyle"  >:
> > >> > I'd like to hold out for https://issues.apache.org/
> > >> jira/browse/METRON-466.
> > >> > I'm testing this now, so am a few hours out.
> > >> >
> > >> > -D...
> > >> >
> > >> > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >> > michael.miklav...@gmail.com > wrote:
> > >> >
> > >> >> Also need this Jira to bump the version.
> > >> >>
> > >> >> https://issues.apache.org/jira/browse/METRON-398
> > >> >>
> > >> >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsir...@apache.org
> > >> > wrote:
> > >> >>
> > >> >> > We are preparing the next release (will be put up for a vote
> > within
> > >> the
> > >> >> > next few days) with the following list of Jiras. Do you feel
> there
> > >> are
> > >> >> any
> > >> >> > other Jiras that should go into this release or are there any
> > >> critical
> > >> >> bugs
> > >> >> > that anyone knows of that we should address before releasing?
> > Please
> > >> >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >> vote
> > >> >> > shortly.
> > >> >> >
> > >> >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >> >> > cestella) closes apache/incubator-metron#274
> > >> >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >> >> closes
> > >> >> > apache/incubator-metron#271
> > >> >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >> >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >> >> > METRON-452: Add rudimentary configuration management functions
> to
> > >> >> > Stellar closes apache/incubator-metron#269
> > >> >> > METRON-374: Add appropriate bundled 3rd party licenses to
NOTICE
> > and
> > >> >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >> >> > METRON-427 Create Ambari Management Pack for Metron
Installation
> > >> >> > closes apache/incubator-metron#266
> > >> >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >> >> > METRON-437 Profile Definition's 'inputTopic' field is
Extraneous
> > >> >> > (nickwallen) closes apache/incubator-metron#264
> > >> >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >> >> > nickwallen) closes apache/incubator-metron#267
> > >> >> > METRON-438: Back the Stellar REPL with a readline
implementation
> > >> >> > closes apache/incubator-metron#265
> > >> >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >> >> > closes apache/incubator-metron#257
> > >> >> > METRON-435: Create Stellar REPL (nickwallen via cestella)
closes
> > >> >> > apache/incubator-metron#262
> > >> >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >> >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >> >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >> >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >> >> > CLI closes apache/incubator-metron#258
> > >> >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >> >> > (nickwallen) closes apache/incubator-metron#259
> > >> >> > METRON-384 Deployment fails at task Wait for
Elasticsearch
> > >> >> Host
> > >> >> > to Start (2xyo via dlyle65535) closes
> > >> apache/incubator-metron#221
> > >> >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >> >> > via cestella) closes apache/incubator-metron#256
> > >> >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >> >> > apache/incubator-metron#254
> > >> >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >> >> > (nickwallen) closes apache/incubator-metron#249
> > >> >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >> >> > closes apache/incubator-metron#252
> > >> >> 

[GitHub] incubator-metron issue #282: Metron 430: Ability to load specific GeoIP data...

2016-09-29 Thread nickwallen
Github user nickwallen commented on the issue:

https://github.com/apache/incubator-metron/pull/282
  
Neha and I just talked through this.  The other issue that we discovered is 
that the PR has a canned tarball containing geoip data from Maxmind.  Since 
this is proprietary data we cannot host it in Metron.

We agreed that we just want to cover two use cases:
1. The user wants to download the latest data from MaxMind.  This is the 
default behavior.
2. The user wants to use data that is hosted at an alternative URL.  The 
alternative URL could be HTTP, HTTPS, or FTP.  This might occur when running 
Metron on an isolated/secure network or a test environment.

To cover these two use cases, we won't need the 
`metron-deployment/roles/mysql_server/files/geodata.tar.xz` tarball.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [DISCUSS] Upcoming Metron Build

2016-09-29 Thread Casey Stella
Ok, with METRON-466 and METRON-398 being committed, I think we have
everything in.

On Thu, Sep 29, 2016 at 12:08 PM, Michael Miklavcic <
michael.miklav...@gmail.com> wrote:

> https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
> committed
>
>
> On Wed, Sep 28, 2016 at 5:41 PM, James Sirota  wrote:
>
> > Sounds like we are still debating METRON-466.  I want to make sure we get
> > consensus on it before we wend up the build.  Lets wait a day until we
> get
> > resolution
> >
> > 28.09.2016, 12:34, "David Lyle" :
> > > No. METRON-466 is in review.
> > >
> > > On Wednesday, September 28, 2016, James Sirota 
> > wrote:
> > >
> > >>  Do we now have everything we wanted in there?
> > >>
> > >>  27.09.2016, 08:59, "David Lyle"  >:
> > >>  > I'd like to hold out for https://issues.apache.org/
> > >>  jira/browse/METRON-466.
> > >>  > I'm testing this now, so am a few hours out.
> > >>  >
> > >>  > -D...
> > >>  >
> > >>  > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> > >>  > michael.miklav...@gmail.com > wrote:
> > >>  >
> > >>  >> Also need this Jira to bump the version.
> > >>  >>
> > >>  >> https://issues.apache.org/jira/browse/METRON-398
> > >>  >>
> > >>  >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota <
> jsir...@apache.org
> > >>  > wrote:
> > >>  >>
> > >>  >> > We are preparing the next release (will be put up for a vote
> > within
> > >>  the
> > >>  >> > next few days) with the following list of Jiras. Do you feel
> there
> > >>  are
> > >>  >> any
> > >>  >> > other Jiras that should go into this release or are there any
> > >>  critical
> > >>  >> bugs
> > >>  >> > that anyone knows of that we should address before releasing?
> > Please
> > >>  >> > comment on this thread. Otherwise, we will put up the release
> for
> > a
> > >>  vote
> > >>  >> > shortly.
> > >>  >> >
> > >>  >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc
> via
> > >>  >> > cestella) closes apache/incubator-metron#274
> > >>  >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> > >>  >> closes
> > >>  >> > apache/incubator-metron#271
> > >>  >> > METRON-453: Add a stellar shell function to open an external
> > editor
> > >>  >> > and return the editor's contents closes
> > apache/incubator-metron#272
> > >>  >> > METRON-452: Add rudimentary configuration management functions
> to
> > >>  >> > Stellar closes apache/incubator-metron#269
> > >>  >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> > and
> > >>  >> > LICENSE where appropriate closes apache/incubator-metron#229
> > >>  >> > METRON-427 Create Ambari Management Pack for Metron Installation
> > >>  >> > closes apache/incubator-metron#266
> > >>  >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> > >>  >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> > >>  >> > (nickwallen) closes apache/incubator-metron#264
> > >>  >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> > >>  >> > nickwallen) closes apache/incubator-metron#267
> > >>  >> > METRON-438: Back the Stellar REPL with a readline implementation
> > >>  >> > closes apache/incubator-metron#265
> > >>  >> > METRON-426: Stellar does not support scientific notation as a
> > literal
> > >>  >> > closes apache/incubator-metron#257
> > >>  >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> > >>  >> > apache/incubator-metron#262
> > >>  >> > METRON-436: Updated architecture diagrams for Metron READMEs
> > >>  >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> > >>  >> > METRON-433: Documentation update closes
> > apache/incubator-metron#260
> > >>  >> > METRON-428: Allow a kafka offset to be passed to the
> > ParserTopology
> > >>  >> > CLI closes apache/incubator-metron#258
> > >>  >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> > >>  >> > (nickwallen) closes apache/incubator-metron#259
> > >>  >> > METRON-384 Deployment fails at task Wait for Elasticsearch
> > >>  >> Host
> > >>  >> > to Start (2xyo via dlyle65535) closes
> > >>  apache/incubator-metron#221
> > >>  >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> > (mmiklavc
> > >>  >> > via cestella) closes apache/incubator-metron#256
> > >>  >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> > closes
> > >>  >> > apache/incubator-metron#254
> > >>  >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> > API
> > >>  >> > (nickwallen) closes apache/incubator-metron#249
> > >>  >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> > (nickwallen)
> > >>  >> > closes apache/incubator-metron#252
> > >>  >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> > >>  >> > apache/incubator-metron#255
> > >>  >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> > >>  >> > 

Re: [DISCUSS] Upcoming Metron Build

2016-09-29 Thread Michael Miklavcic
https://issues.apache.org/jira/browse/METRON-398 (version bump) is now
committed


On Wed, Sep 28, 2016 at 5:41 PM, James Sirota  wrote:

> Sounds like we are still debating METRON-466.  I want to make sure we get
> consensus on it before we wend up the build.  Lets wait a day until we get
> resolution
>
> 28.09.2016, 12:34, "David Lyle" :
> > No. METRON-466 is in review.
> >
> > On Wednesday, September 28, 2016, James Sirota 
> wrote:
> >
> >>  Do we now have everything we wanted in there?
> >>
> >>  27.09.2016, 08:59, "David Lyle" >:
> >>  > I'd like to hold out for https://issues.apache.org/
> >>  jira/browse/METRON-466.
> >>  > I'm testing this now, so am a few hours out.
> >>  >
> >>  > -D...
> >>  >
> >>  > On Tue, Sep 27, 2016 at 11:41 AM, Michael Miklavcic <
> >>  > michael.miklav...@gmail.com > wrote:
> >>  >
> >>  >> Also need this Jira to bump the version.
> >>  >>
> >>  >> https://issues.apache.org/jira/browse/METRON-398
> >>  >>
> >>  >> On Tue, Sep 27, 2016 at 11:38 AM, James Sirota  >>  > wrote:
> >>  >>
> >>  >> > We are preparing the next release (will be put up for a vote
> within
> >>  the
> >>  >> > next few days) with the following list of Jiras. Do you feel there
> >>  are
> >>  >> any
> >>  >> > other Jiras that should go into this release or are there any
> >>  critical
> >>  >> bugs
> >>  >> > that anyone knows of that we should address before releasing?
> Please
> >>  >> > comment on this thread. Otherwise, we will put up the release for
> a
> >>  vote
> >>  >> > shortly.
> >>  >> >
> >>  >> > METRON-457 Correct GrokParser logging spelling error (mmiklavc via
> >>  >> > cestella) closes apache/incubator-metron#274
> >>  >> > METRON-449 JSONMapParser should unfold maps to arbitrary depths
> >>  >> closes
> >>  >> > apache/incubator-metron#271
> >>  >> > METRON-453: Add a stellar shell function to open an external
> editor
> >>  >> > and return the editor's contents closes
> apache/incubator-metron#272
> >>  >> > METRON-452: Add rudimentary configuration management functions to
> >>  >> > Stellar closes apache/incubator-metron#269
> >>  >> > METRON-374: Add appropriate bundled 3rd party licenses to NOTICE
> and
> >>  >> > LICENSE where appropriate closes apache/incubator-metron#229
> >>  >> > METRON-427 Create Ambari Management Pack for Metron Installation
> >>  >> > closes apache/incubator-metron#266
> >>  >> > METRON-434: JSON Parser closes apache/incubator-metron#261
> >>  >> > METRON-437 Profile Definition's 'inputTopic' field is Extraneous
> >>  >> > (nickwallen) closes apache/incubator-metron#264
> >>  >> > METRON-445 Fix typos in metron-deployment roles (JonZeolla via
> >>  >> > nickwallen) closes apache/incubator-metron#267
> >>  >> > METRON-438: Back the Stellar REPL with a readline implementation
> >>  >> > closes apache/incubator-metron#265
> >>  >> > METRON-426: Stellar does not support scientific notation as a
> literal
> >>  >> > closes apache/incubator-metron#257
> >>  >> > METRON-435: Create Stellar REPL (nickwallen via cestella) closes
> >>  >> > apache/incubator-metron#262
> >>  >> > METRON-436: Updated architecture diagrams for Metron READMEs
> >>  >> > (anandsubbu via cestella) closes apache/incubator-metron#263
> >>  >> > METRON-433: Documentation update closes
> apache/incubator-metron#260
> >>  >> > METRON-428: Allow a kafka offset to be passed to the
> ParserTopology
> >>  >> > CLI closes apache/incubator-metron#258
> >>  >> > METRON-429 Profiler Missing Dependencies When Uber Jar Deployed
> >>  >> > (nickwallen) closes apache/incubator-metron#259
> >>  >> > METRON-384 Deployment fails at task Wait for Elasticsearch
> >>  >> Host
> >>  >> > to Start (2xyo via dlyle65535) closes
> >>  apache/incubator-metron#221
> >>  >> > METRON-257 Enable pcap result pagination from the Pcap CLI
> (mmiklavc
> >>  >> > via cestella) closes apache/incubator-metron#256
> >>  >> > METRON-420 Add Expiration to a Profile Definition (nickwallen)
> closes
> >>  >> > apache/incubator-metron#254
> >>  >> > METRON-413 Allow Start/End Time Range Search in Profiler Client
> API
> >>  >> > (nickwallen) closes apache/incubator-metron#249
> >>  >> > METRON-419 Update Tuple to HBase Mapper/Bolt to Set TTL
> (nickwallen)
> >>  >> > closes apache/incubator-metron#252
> >>  >> > METRON-422 Remove bluecoat.json (cestella via nickwallen) closes
> >>  >> > apache/incubator-metron#255
> >>  >> > METRON-418 Set TTL on HBase Puts (nickwallen) closes
> >>  >> > apache/incubator-metron#251
> >>  >> > METRON-415: Allow a Profile to Store Any Type as its Value closes
> >>  >> > apache/incubator-metron#253
> >>  >> > METRON-411 Support Greater Range of Profile Periods (nickwallen)
> >>  >> > closes apache/incubator-metron#246
> >>  >> > METRON-416: Provide the ability to store mergeable data structures
> >>  >> for
> >>  >> > summarizing data on-line closes 

[GitHub] incubator-metron pull request #280: Metron 398: Bump release version to 0.2....

2016-09-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-metron/pull/280


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: [DISCUSS] Metron IRC channel

2016-09-29 Thread James Sirota
I would just keep #apache-metron and open it up to general public

29.09.2016, 08:54, "Yohann Lepage" :
> Hi everyone,
>
> There are currently two IRC channels on FreeNode for Metron:
> - #apache-metron
> - #apache-metron-dev
>
> One channel is maybe enough as we are less than 5 users.
>
> What do you think? Which one to keep ?
>
> Related issue: https://issues.apache.org/jira/browse/METRON-337 -
> Invite ASFBot to #apache-metron-dev IRC channel
> --
> Yohann L.

--- 
Thank you,

James Sirota
PPMC- Apache Metron (Incubating)
jsirota AT apache DOT org


Re: Storm Topology total workers

2016-09-29 Thread Nick Allen
If you would like, share a link to a Github repo that has your changes.  We
can take a closer look at what the problem might be.

On Thu, Sep 29, 2016 at 10:34 AM, Nick Allen  wrote:

> It is very difficult to do much with Metron on single node Vagrant.  I
> think Dave is right in saying that adding slots to Storm is probably just
> going to make things worse.  You are probably running out of memory, which
> is causing various core services to either die or be killed by the OS. Many
> weird, annoying things will happen in this case.  You will lose sleep,
> probably lose hair, and may become extremely anti-social.  All have
> happened to me.
>
> I would highly advise working on a multi-node cluster like AWS.  If that
> is not possible, I would do the following.
>
> 1. Edit `metron-deployment/inventory/full-dev-platform/group_vars/all`
> and remove everything from the list of `services_to_start` that you do not
> absolutely need.  After METRON-466, which was just committed to master this
> morning, full-dev and quick-dev will each have their own configuration file
> with this setting.  Choose the appropriate one.
> 2. Spin up a fresh Vagrant deployment.
> 3. Use `monit summary` and make sure things look as you would expect.  Use
> `top` just to make sure there is nothing else unexpected running.
> 4. Login to Ambari and make sure the core services that you need are all
> running and happy.  While in there stop anything you don't need.  For
> example, maybe you do not need MR running.
> 5. Then start-up just the components that you need.
>
>
> Personally, I start things up from the edge in.
>
>- Start sensor.  Check that sensor data is hitting the topic.
>- Start parser topology.  Check sensor data is hitting 'enrichments'
>topic.
>- Start enrichment topology.  Check that data is hitting 'indexing'
>topic.
>- etc
>
>
>
> On Thu, Sep 29, 2016 at 10:04 AM, Otto Fowler 
> wrote:
>
>> I have changed all the .yml to have the exact slots you mentioned, and
>> still ended up with 4.
>> Late late last night I just turned off the snort and bro parsers in monit
>> and restarted my topology and got a worker.
>> But…..
>> Now i’m seeing data die in enrichment.  I have exceptions on several of
>> the
>> bolts that i’m going send a mail about, I’m not sure if I need to stop
>> more
>> services besides the parsers and I’m hitting a memory thing or what.  I
>> really want to validate my end-to-end before redeploying my cluster.
>>
>> I have ‘hand’ applied the start ambari cluster fix.  I still see death of
>> the deployment at times with setting up the kafka topics because there are
>> 0 brokers, but restarting with the right vagrant provision call gets me to
>> completion ( see METRON-472 ).
>>
>> Can someone else try changing the slots - is it just me?
>>
>> On September 29, 2016 at 07:28:34, David Lyle (dlyle65...@gmail.com)
>> wrote:
>>
>> IIRC, you're trying to persist a parser as a default in your single node
>> machine? If that's the case, changing lines 75 of single_node_vm.yml to
>> supervisor.slots.ports: "[6700, 6701, 6702, 6703, 6704]" and running full
>> dev should do the trick. You'll need to apply a patch to get full dev to
>> build. [1]
>>
>> Can you post a link to the changes you've made so far?
>>
>> Alternatively, if you're testing out your parser, you could, and I would
>> recommend you do, change the configuration of Quick Dev after launch.
>>
>> Full dev is more for testing the HDP install itself. I don't recommend it
>> for normal Metron testing and development. Currently, it's a
>> bit...ah...challenging to get the cluster running using full dev, that's
>> what METRON-467 [2] was created to address.
>>
>> To add slots, add additional ports to supervisor.slots.ports to
>> 6700,6701,6702,6703,6704 in the Storm config that Ambari exposes after
>> launch of Quick Dev and restart Storm. It may help to tail the Storm logs
>> during restart to see if there is a port conflict or something odd like
>> that.
>>
>> It looks like you're on the right track, if you've tried changing the
>> configuration in Ambari and restarting Storm, please post your storm.yaml
>>
>> Also, remember, each slot will require additional memory on an already
>> constrained machine. Rather than adding slots, I'd shut down an existing
>> sensor topology and sensor probe prior to adding my parser.
>>
>> That said, if you do land on a configuration that runs reliably with
>> additional slots, please post it back here.
>>
>> Thanks for sticking with this!
>>
>> -D...
>>
>> [1] https://github.com/apache/incubator-metron/pull/279
>> [2] https://issues.apache.org/jira/browse/METRON-467
>>
>> On Thu, Sep 29, 2016 at 6:20 AM, Nick Allen  wrote:
>>
>> > Are you trying this with Full-dev, not Quick-dev? Quick-dev uses a
>> > pre-built image that is downloaded from Atlas. This image already has
>> HDP
>> > installed. Since you want to deploy with custom 

[GitHub] incubator-metron pull request #279: METRON-466: Full Dev Platform build some...

2016-09-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-metron/pull/279


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Storm Topology total workers

2016-09-29 Thread Otto Fowler
I have changed all the .yml to have the exact slots you mentioned, and
still ended up with 4.
Late late last night I just turned off the snort and bro parsers in monit
and restarted my topology and got a worker.
But…..
Now i’m seeing data die in enrichment.  I have exceptions on several of the
bolts that i’m going send a mail about, I’m not sure if I need to stop more
services besides the parsers and I’m hitting a memory thing or what.  I
really want to validate my end-to-end before redeploying my cluster.

I have ‘hand’ applied the start ambari cluster fix.  I still see death of
the deployment at times with setting up the kafka topics because there are
0 brokers, but restarting with the right vagrant provision call gets me to
completion ( see METRON-472 ).

Can someone else try changing the slots - is it just me?

On September 29, 2016 at 07:28:34, David Lyle (dlyle65...@gmail.com) wrote:

IIRC, you're trying to persist a parser as a default in your single node
machine? If that's the case, changing lines 75 of single_node_vm.yml to
supervisor.slots.ports: "[6700, 6701, 6702, 6703, 6704]" and running full
dev should do the trick. You'll need to apply a patch to get full dev to
build. [1]

Can you post a link to the changes you've made so far?

Alternatively, if you're testing out your parser, you could, and I would
recommend you do, change the configuration of Quick Dev after launch.

Full dev is more for testing the HDP install itself. I don't recommend it
for normal Metron testing and development. Currently, it's a
bit...ah...challenging to get the cluster running using full dev, that's
what METRON-467 [2] was created to address.

To add slots, add additional ports to supervisor.slots.ports to
6700,6701,6702,6703,6704 in the Storm config that Ambari exposes after
launch of Quick Dev and restart Storm. It may help to tail the Storm logs
during restart to see if there is a port conflict or something odd like
that.

It looks like you're on the right track, if you've tried changing the
configuration in Ambari and restarting Storm, please post your storm.yaml

Also, remember, each slot will require additional memory on an already
constrained machine. Rather than adding slots, I'd shut down an existing
sensor topology and sensor probe prior to adding my parser.

That said, if you do land on a configuration that runs reliably with
additional slots, please post it back here.

Thanks for sticking with this!

-D...

[1] https://github.com/apache/incubator-metron/pull/279
[2] https://issues.apache.org/jira/browse/METRON-467

On Thu, Sep 29, 2016 at 6:20 AM, Nick Allen  wrote:

> Are you trying this with Full-dev, not Quick-dev? Quick-dev uses a
> pre-built image that is downloaded from Atlas. This image already has HDP
> installed. Since you want to deploy with custom changes to HDP, you need
> to use Full-Dev for this.
>
> On Sep 29, 2016 12:49 AM, "Otto Fowler"  wrote:
>
> > I have changed these settings for all the configurations ( after having
> > single node not do the trick ) and it has not worked.
> > No matter how many slots.ports I have in the vars, I still get just 4
> > slots.
> > I don’t see anywhere else that it can be changed, or any other ‘slots’
or
> > ‘workers’ in metron-development.
> >
> > Does it work for anyone else?
> >
> > --
> >
> > On September 28, 2016 at 17:26:20, Nick Allen (n...@nickallen.org)
> wrote:
> >
> > To do it so that it is deployed with more slots then look at
> > `metron-deployment/roles/ambari_config`. Under vars/ are the initial
> > settings that get thrown at Ambari.
> >
> > On Wed, Sep 28, 2016 at 4:56 PM, Otto Fowler 
> > wrote:
> >
> > > Where can I increase the number of workers for storm in
> > metron-deployment
> > > ? Turns out if you add a new parser but don’t have a worker for it,
it
> > > doesn’t …. um work.
> > >
> >
> >
> >
> > --
> > Nick Allen 
> >
> >
>


[GitHub] incubator-metron issue #279: METRON-466: Full Dev Platform build sometimes f...

2016-09-29 Thread dlyle65535
Github user dlyle65535 commented on the issue:

https://github.com/apache/incubator-metron/pull/279
  
Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-metron issue #280: Metron 398: Bump release version to 0.2.1BETA i...

2016-09-29 Thread nickwallen
Github user nickwallen commented on the issue:

https://github.com/apache/incubator-metron/pull/280
  
@mmiklavc You are right.  I was comparing Github's diff against the wrong 
branch.  
+1 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-metron issue #279: METRON-466: Full Dev Platform build sometimes f...

2016-09-29 Thread dlyle65535
Github user dlyle65535 commented on the issue:

https://github.com/apache/incubator-metron/pull/279
  
@nickwallen - I think the discussion has died down. Are you good with me 
committing this?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Storm Topology total workers

2016-09-29 Thread David Lyle
IIRC, you're trying to persist a parser as a default in your single node
machine? If that's the case, changing lines 75 of single_node_vm.yml to
  supervisor.slots.ports: "[6700, 6701, 6702, 6703, 6704]" and running full
dev should do the trick. You'll need to apply a patch to get full dev to
build. [1]

Can you post a link to the changes you've made so far?

Alternatively, if you're testing out your parser, you could, and I would
recommend you do, change the configuration of Quick Dev after launch.

Full dev is more for testing the HDP install itself. I don't recommend it
for normal Metron testing and development. Currently, it's a
bit...ah...challenging to get the cluster running using full dev, that's
what METRON-467 [2] was created to address.

To add slots, add additional ports to supervisor.slots.ports to
6700,6701,6702,6703,6704 in the Storm config that Ambari exposes after
launch of Quick Dev and restart Storm. It may help to tail the Storm logs
during restart to see if there is a port conflict or something odd like
that.

It looks like you're on the right track, if you've tried changing the
configuration in Ambari and restarting Storm, please post your storm.yaml

Also, remember, each slot will require additional memory on an already
constrained machine. Rather than adding slots, I'd shut down an existing
sensor topology and sensor probe prior to adding my parser.

That said, if you do land on a configuration that runs reliably with
additional slots, please post it back here.

Thanks for sticking with this!

-D...

[1] https://github.com/apache/incubator-metron/pull/279
[2] https://issues.apache.org/jira/browse/METRON-467

On Thu, Sep 29, 2016 at 6:20 AM, Nick Allen  wrote:

> Are you trying this with Full-dev, not Quick-dev? Quick-dev uses a
> pre-built image that is downloaded from Atlas.  This image already has HDP
> installed.  Since you want to deploy with custom changes to HDP, you need
> to use Full-Dev for this.
>
> On Sep 29, 2016 12:49 AM, "Otto Fowler"  wrote:
>
> > I have changed these settings for all the configurations ( after having
> > single node not do the trick ) and it has not worked.
> > No matter how many slots.ports I have in the vars, I still get just 4
> > slots.
> > I don’t see anywhere else that it can be changed, or any other ‘slots’ or
> > ‘workers’ in metron-development.
> >
> > Does it work for anyone else?
> >
> > --
> >
> > On September 28, 2016 at 17:26:20, Nick Allen (n...@nickallen.org)
> wrote:
> >
> > To do it so that it is deployed with more slots then look at
> > `metron-deployment/roles/ambari_config`. Under vars/ are the initial
> > settings that get thrown at Ambari.
> >
> > On Wed, Sep 28, 2016 at 4:56 PM, Otto Fowler 
> > wrote:
> >
> > > Where can I increase the number of workers for storm in
> > metron-deployment
> > > ? Turns out if you add a new parser but don’t have a worker for it, it
> > > doesn’t …. um work.
> > >
> >
> >
> >
> > --
> > Nick Allen 
> >
> >
>


Re: Storm Topology total workers

2016-09-29 Thread Nick Allen
Are you trying this with Full-dev, not Quick-dev? Quick-dev uses a
pre-built image that is downloaded from Atlas.  This image already has HDP
installed.  Since you want to deploy with custom changes to HDP, you need
to use Full-Dev for this.

On Sep 29, 2016 12:49 AM, "Otto Fowler"  wrote:

> I have changed these settings for all the configurations ( after having
> single node not do the trick ) and it has not worked.
> No matter how many slots.ports I have in the vars, I still get just 4
> slots.
> I don’t see anywhere else that it can be changed, or any other ‘slots’ or
> ‘workers’ in metron-development.
>
> Does it work for anyone else?
>
> --
>
> On September 28, 2016 at 17:26:20, Nick Allen (n...@nickallen.org) wrote:
>
> To do it so that it is deployed with more slots then look at
> `metron-deployment/roles/ambari_config`. Under vars/ are the initial
> settings that get thrown at Ambari.
>
> On Wed, Sep 28, 2016 at 4:56 PM, Otto Fowler 
> wrote:
>
> > Where can I increase the number of workers for storm in
> metron-deployment
> > ? Turns out if you add a new parser but don’t have a worker for it, it
> > doesn’t …. um work.
> >
>
>
>
> --
> Nick Allen 
>
>


Re: Storm Topology total workers

2016-09-29 Thread zeo...@gmail.com
I've been working a lot in this area of metron lately.  I would be happy to
help this afternoon - hop on the IRC channel (freenode, #apache-metron and
#apache-metron-dev) sometime and we can chat, then circle back to the list
with a resolution if we find it.

Jon

On Thu, Sep 29, 2016, 00:49 Otto Fowler  wrote:

> I have changed these settings for all the configurations ( after having
> single node not do the trick ) and it has not worked.
> No matter how many slots.ports I have in the vars, I still get just 4
> slots.
> I don’t see anywhere else that it can be changed, or any other ‘slots’ or
> ‘workers’ in metron-development.
>
> Does it work for anyone else?
>
> --
>
> On September 28, 2016 at 17:26:20, Nick Allen (n...@nickallen.org) wrote:
>
> To do it so that it is deployed with more slots then look at
> `metron-deployment/roles/ambari_config`. Under vars/ are the initial
> settings that get thrown at Ambari.
>
> On Wed, Sep 28, 2016 at 4:56 PM, Otto Fowler 
> wrote:
>
> > Where can I increase the number of workers for storm in metron-deployment
> > ? Turns out if you add a new parser but don’t have a worker for it, it
> > doesn’t …. um work.
> >
>
>
>
> --
> Nick Allen 
>
-- 

Jon