Re: [DISCUSS] Metron Release 0.6.0?

2018-09-08 Thread zeo...@gmail.com
Yup, your first paragraph is exactly right.

Jon

On Fri, Sep 7, 2018 at 1:23 PM Michael Miklavcic <
michael.miklav...@gmail.com> wrote:

> I'm a little rusty on my C++, but to summarize what I've gathered from this
> thread and linked code: The Bro plugin infrastructure does not support a
> patch version currently, only major.minor (x.y). But bro-pkg, the bro
> package installation mechanism, does support it now. Which is unfortunately
> moot bc unlike other 3rd party scripts that can support vX.Y.Z, this is a
> plugin and the API does not support the 'Y'.
>
> I think I'm in favor of keeping X.Y (0.2) for now. I would urge this
> approach by comparison to calculating significant figures - if my tooling
> is only able to calculate 2 decimal places, e.g. 1.23, I shouldn't be
> recording 1.230 or 1.23 as this isn't reflective of the tool's actual
> fidelity. Likewise, the Bro plugin API doesn't allow X.Y.Z right now, only
> X.Y per Jon's comments. Not strictly speaking an apples to apples
> comparison, but it's a justifiable approach imho. Once the plugin
> infrastructure supports it, we can add the extra patch version to reflect
> this additional available state info.
>
> Best,
> Mike
>
>
> On Thu, Sep 6, 2018 at 7:34 PM zeo...@gmail.com  wrote:
>
> > I'm not aware of the bro plugin artifacts being used in any way.
> >
> > Jon
> >
> > On Thu, Sep 6, 2018, 10:59 Justin Leet  wrote:
> >
> > > Do we use the artifacts directly at all? Or is it through bro-pkg only?
> > >
> > > Also, It's very possible I'm making a mountain out of a molehill here,
> > and
> > > if it's something that's not particularly important, it might be
> > worthwhile
> > > to just stick with what we did last time, and just table this
> discussion
> > > until post release.  It feels pretty nitpicky at this point, and if the
> > > practical implications are pretty minor, I'd rather just get an RC out.
> > >
> > > On Thu, Sep 6, 2018 at 10:02 AM zeo...@gmail.com 
> > wrote:
> > >
> > > > Either is fine with me.  If it's x.y in some parts of the app I
> prefer
> > to
> > > > keep it consistent throughout, but I'm also fine with lining up with
> > > > Apache/Metron where we can.
> > > >
> > > > I also refreshed myself on why we avoided x.y.z initially and it was
> > > > actually for this exact reason, we wanted consistent versioning
> > > throughout
> > > > a repo.  This issue is with the bro plugins themselves, not bro-pkg,
> > so I
> > > > submit a JIRA .
> > > >
> > > > Jon
> > > >
> > > >
> > > > On Wed, Sep 5, 2018, 21:51 Justin Leet 
> wrote:
> > > >
> > > > > Makes sense. Do we have any objection to just going to the artifact
> > > being
> > > > > 0.2?  Or do we want to keep the mixed versioning and just live with
> > it,
> > > > at
> > > > > least for now?
> > > > >
> > > > > On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com 
> > > > wrote:
> > > > >
> > > > > > I think mattf-horton just did that as a part of convention.  He
> > > handled
> > > > > > that part, and I did the 0.1 tagging (as a prereq to this
> > > > > > <
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> > > > > > >)
> > > > > > last time the package was released.
> > > > > >
> > > > > > Jon
> > > > > >
> > > > > > On Wed, Sep 5, 2018 at 8:28 PM Justin Leet <
> justinjl...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > > Any idea why we released it as 0.1.0 in the artifacts version?
> > I'm
> > > > > fine
> > > > > > > with doing x.y if we need to, but I would like the artifact
> > > > versioning
> > > > > to
> > > > > > > be consistent if possible.
> > > > > > >
> > > > > > > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com <
> > zeo...@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > I lied, we didn't need to update our btests because it's
> > limited
> > > > to a
> > > > > > > major
> > > > > > > > and minor version.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > > > > > > >
> > > > > > > > Jon
> > > > > > > >
> > > > > > > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com <
> > > zeo...@gmail.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > I looked into x.y.z back when we released 0.1 and it was
> not
> > > > > possible
> > > > > > > in
> > > > > > > > > bro-pkg at the time but now it is
> > > > > > > > > .  In
> > order
> > > to
> > > > > do
> > > > > > > > this,
> > > > > > > > > we'll also need to configure bro-pkg.meta to require the
> > proper
> > > > > > version
> > > > > > > > of
> > > > > > > > > bro-pkg, as well as update the btests for the new version
> > > string.
> > > > > I
> > > > > > > will
> > > > > > > > > throw together a JIRA and PR to do all this in case we
> 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-07 Thread Michael Miklavcic
I'm a little rusty on my C++, but to summarize what I've gathered from this
thread and linked code: The Bro plugin infrastructure does not support a
patch version currently, only major.minor (x.y). But bro-pkg, the bro
package installation mechanism, does support it now. Which is unfortunately
moot bc unlike other 3rd party scripts that can support vX.Y.Z, this is a
plugin and the API does not support the 'Y'.

I think I'm in favor of keeping X.Y (0.2) for now. I would urge this
approach by comparison to calculating significant figures - if my tooling
is only able to calculate 2 decimal places, e.g. 1.23, I shouldn't be
recording 1.230 or 1.23 as this isn't reflective of the tool's actual
fidelity. Likewise, the Bro plugin API doesn't allow X.Y.Z right now, only
X.Y per Jon's comments. Not strictly speaking an apples to apples
comparison, but it's a justifiable approach imho. Once the plugin
infrastructure supports it, we can add the extra patch version to reflect
this additional available state info.

Best,
Mike


On Thu, Sep 6, 2018 at 7:34 PM zeo...@gmail.com  wrote:

> I'm not aware of the bro plugin artifacts being used in any way.
>
> Jon
>
> On Thu, Sep 6, 2018, 10:59 Justin Leet  wrote:
>
> > Do we use the artifacts directly at all? Or is it through bro-pkg only?
> >
> > Also, It's very possible I'm making a mountain out of a molehill here,
> and
> > if it's something that's not particularly important, it might be
> worthwhile
> > to just stick with what we did last time, and just table this discussion
> > until post release.  It feels pretty nitpicky at this point, and if the
> > practical implications are pretty minor, I'd rather just get an RC out.
> >
> > On Thu, Sep 6, 2018 at 10:02 AM zeo...@gmail.com 
> wrote:
> >
> > > Either is fine with me.  If it's x.y in some parts of the app I prefer
> to
> > > keep it consistent throughout, but I'm also fine with lining up with
> > > Apache/Metron where we can.
> > >
> > > I also refreshed myself on why we avoided x.y.z initially and it was
> > > actually for this exact reason, we wanted consistent versioning
> > throughout
> > > a repo.  This issue is with the bro plugins themselves, not bro-pkg,
> so I
> > > submit a JIRA .
> > >
> > > Jon
> > >
> > >
> > > On Wed, Sep 5, 2018, 21:51 Justin Leet  wrote:
> > >
> > > > Makes sense. Do we have any objection to just going to the artifact
> > being
> > > > 0.2?  Or do we want to keep the mixed versioning and just live with
> it,
> > > at
> > > > least for now?
> > > >
> > > > On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com 
> > > wrote:
> > > >
> > > > > I think mattf-horton just did that as a part of convention.  He
> > handled
> > > > > that part, and I did the 0.1 tagging (as a prereq to this
> > > > > <
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> > > > > >)
> > > > > last time the package was released.
> > > > >
> > > > > Jon
> > > > >
> > > > > On Wed, Sep 5, 2018 at 8:28 PM Justin Leet 
> > > > wrote:
> > > > >
> > > > > > Any idea why we released it as 0.1.0 in the artifacts version?
> I'm
> > > > fine
> > > > > > with doing x.y if we need to, but I would like the artifact
> > > versioning
> > > > to
> > > > > > be consistent if possible.
> > > > > >
> > > > > > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com <
> zeo...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > > I lied, we didn't need to update our btests because it's
> limited
> > > to a
> > > > > > major
> > > > > > > and minor version.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > > > > > >
> > > > > > > Jon
> > > > > > >
> > > > > > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com <
> > zeo...@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > I looked into x.y.z back when we released 0.1 and it was not
> > > > possible
> > > > > > in
> > > > > > > > bro-pkg at the time but now it is
> > > > > > > > .  In
> order
> > to
> > > > do
> > > > > > > this,
> > > > > > > > we'll also need to configure bro-pkg.meta to require the
> proper
> > > > > version
> > > > > > > of
> > > > > > > > bro-pkg, as well as update the btests for the new version
> > string.
> > > > I
> > > > > > will
> > > > > > > > throw together a JIRA and PR to do all this in case we decide
> > to
> > > > > align
> > > > > > > with
> > > > > > > > x.y.z; we can trash it if we decide to stay with x.y.
> > > > > > > >
> > > > > > > > Jon
> > > > > > > >
> > > > > > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet <
> > > justinjl...@gmail.com>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > >> Long story short, while preparing the release candidate, I
> > > > > discovered
> > > > > > > our
> > > > > > > >> 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-06 Thread zeo...@gmail.com
I'm not aware of the bro plugin artifacts being used in any way.

Jon

On Thu, Sep 6, 2018, 10:59 Justin Leet  wrote:

> Do we use the artifacts directly at all? Or is it through bro-pkg only?
>
> Also, It's very possible I'm making a mountain out of a molehill here, and
> if it's something that's not particularly important, it might be worthwhile
> to just stick with what we did last time, and just table this discussion
> until post release.  It feels pretty nitpicky at this point, and if the
> practical implications are pretty minor, I'd rather just get an RC out.
>
> On Thu, Sep 6, 2018 at 10:02 AM zeo...@gmail.com  wrote:
>
> > Either is fine with me.  If it's x.y in some parts of the app I prefer to
> > keep it consistent throughout, but I'm also fine with lining up with
> > Apache/Metron where we can.
> >
> > I also refreshed myself on why we avoided x.y.z initially and it was
> > actually for this exact reason, we wanted consistent versioning
> throughout
> > a repo.  This issue is with the bro plugins themselves, not bro-pkg, so I
> > submit a JIRA .
> >
> > Jon
> >
> >
> > On Wed, Sep 5, 2018, 21:51 Justin Leet  wrote:
> >
> > > Makes sense. Do we have any objection to just going to the artifact
> being
> > > 0.2?  Or do we want to keep the mixed versioning and just live with it,
> > at
> > > least for now?
> > >
> > > On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com 
> > wrote:
> > >
> > > > I think mattf-horton just did that as a part of convention.  He
> handled
> > > > that part, and I did the 0.1 tagging (as a prereq to this
> > > > <
> > > >
> > >
> >
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> > > > >)
> > > > last time the package was released.
> > > >
> > > > Jon
> > > >
> > > > On Wed, Sep 5, 2018 at 8:28 PM Justin Leet 
> > > wrote:
> > > >
> > > > > Any idea why we released it as 0.1.0 in the artifacts version?  I'm
> > > fine
> > > > > with doing x.y if we need to, but I would like the artifact
> > versioning
> > > to
> > > > > be consistent if possible.
> > > > >
> > > > > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com 
> > > > wrote:
> > > > >
> > > > > > I lied, we didn't need to update our btests because it's limited
> > to a
> > > > > major
> > > > > > and minor version.
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > > > > >
> > > > > > Jon
> > > > > >
> > > > > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com <
> zeo...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > > I looked into x.y.z back when we released 0.1 and it was not
> > > possible
> > > > > in
> > > > > > > bro-pkg at the time but now it is
> > > > > > > .  In order
> to
> > > do
> > > > > > this,
> > > > > > > we'll also need to configure bro-pkg.meta to require the proper
> > > > version
> > > > > > of
> > > > > > > bro-pkg, as well as update the btests for the new version
> string.
> > > I
> > > > > will
> > > > > > > throw together a JIRA and PR to do all this in case we decide
> to
> > > > align
> > > > > > with
> > > > > > > x.y.z; we can trash it if we decide to stay with x.y.
> > > > > > >
> > > > > > > Jon
> > > > > > >
> > > > > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet <
> > justinjl...@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > >> Long story short, while preparing the release candidate, I
> > > > discovered
> > > > > > our
> > > > > > >> metron-bro-plugin-kafka is inconsistently versioned.
> > > > > > >>
> > > > > > >> In the repo, it's x.y (e.g. 0.2)
> > > > > > >> See:
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> > > > > > >>
> > > > > > >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> > > > > > >> See http://archive.apache.org/dist/metron/0.4.2/
> > > > > > >>
> > > > > > >> Going forward from this release, I'd like the artifact to be
> > > > > consistent
> > > > > > >> with the repo.  I'd personally prefer x.y.z to be entirely
> > > > consistent
> > > > > > >> throughout Metron, but if there's a particular reason why it
> was
> > > x.y
> > > > > I'm
> > > > > > >> happy to entertain it.
> > > > > > >>
> > > > > > >> If we choose to move to x.y.z, I can provide a PR to update
> the
> > > > > version
> > > > > > to
> > > > > > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd
> > like
> > > to
> > > > > > >> release the artifact as
> > apache-metron-bro-plugin-kafka_0.2.tar.gz
> > > > > > >>
> > > > > > >> Justin
> > > > > > >>
> > > > > > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet <
> > > justinjl...@gmail.com>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > As an update, I'll be working on starting the release
> process
> > > > > rolling
> > > > > > >> > today. The PCAP Query 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-06 Thread Justin Leet
Do we use the artifacts directly at all? Or is it through bro-pkg only?

Also, It's very possible I'm making a mountain out of a molehill here, and
if it's something that's not particularly important, it might be worthwhile
to just stick with what we did last time, and just table this discussion
until post release.  It feels pretty nitpicky at this point, and if the
practical implications are pretty minor, I'd rather just get an RC out.

On Thu, Sep 6, 2018 at 10:02 AM zeo...@gmail.com  wrote:

> Either is fine with me.  If it's x.y in some parts of the app I prefer to
> keep it consistent throughout, but I'm also fine with lining up with
> Apache/Metron where we can.
>
> I also refreshed myself on why we avoided x.y.z initially and it was
> actually for this exact reason, we wanted consistent versioning throughout
> a repo.  This issue is with the bro plugins themselves, not bro-pkg, so I
> submit a JIRA .
>
> Jon
>
>
> On Wed, Sep 5, 2018, 21:51 Justin Leet  wrote:
>
> > Makes sense. Do we have any objection to just going to the artifact being
> > 0.2?  Or do we want to keep the mixed versioning and just live with it,
> at
> > least for now?
> >
> > On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com 
> wrote:
> >
> > > I think mattf-horton just did that as a part of convention.  He handled
> > > that part, and I did the 0.1 tagging (as a prereq to this
> > > <
> > >
> >
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> > > >)
> > > last time the package was released.
> > >
> > > Jon
> > >
> > > On Wed, Sep 5, 2018 at 8:28 PM Justin Leet 
> > wrote:
> > >
> > > > Any idea why we released it as 0.1.0 in the artifacts version?  I'm
> > fine
> > > > with doing x.y if we need to, but I would like the artifact
> versioning
> > to
> > > > be consistent if possible.
> > > >
> > > > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com 
> > > wrote:
> > > >
> > > > > I lied, we didn't need to update our btests because it's limited
> to a
> > > > major
> > > > > and minor version.
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > > > >
> > > > > Jon
> > > > >
> > > > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com 
> > > > wrote:
> > > > >
> > > > > > I looked into x.y.z back when we released 0.1 and it was not
> > possible
> > > > in
> > > > > > bro-pkg at the time but now it is
> > > > > > .  In order to
> > do
> > > > > this,
> > > > > > we'll also need to configure bro-pkg.meta to require the proper
> > > version
> > > > > of
> > > > > > bro-pkg, as well as update the btests for the new version string.
> > I
> > > > will
> > > > > > throw together a JIRA and PR to do all this in case we decide to
> > > align
> > > > > with
> > > > > > x.y.z; we can trash it if we decide to stay with x.y.
> > > > > >
> > > > > > Jon
> > > > > >
> > > > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet <
> justinjl...@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > >> Long story short, while preparing the release candidate, I
> > > discovered
> > > > > our
> > > > > >> metron-bro-plugin-kafka is inconsistently versioned.
> > > > > >>
> > > > > >> In the repo, it's x.y (e.g. 0.2)
> > > > > >> See:
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> > > > > >>
> > > > > >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> > > > > >> See http://archive.apache.org/dist/metron/0.4.2/
> > > > > >>
> > > > > >> Going forward from this release, I'd like the artifact to be
> > > > consistent
> > > > > >> with the repo.  I'd personally prefer x.y.z to be entirely
> > > consistent
> > > > > >> throughout Metron, but if there's a particular reason why it was
> > x.y
> > > > I'm
> > > > > >> happy to entertain it.
> > > > > >>
> > > > > >> If we choose to move to x.y.z, I can provide a PR to update the
> > > > version
> > > > > to
> > > > > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd
> like
> > to
> > > > > >> release the artifact as
> apache-metron-bro-plugin-kafka_0.2.tar.gz
> > > > > >>
> > > > > >> Justin
> > > > > >>
> > > > > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet <
> > justinjl...@gmail.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > As an update, I'll be working on starting the release process
> > > > rolling
> > > > > >> > today. The PCAP Query panel feature branch is in master and I
> > > > haven't
> > > > > >> heard
> > > > > >> > of any other potential blockers. I'd appreciate everyone
> > updating
> > > > > their
> > > > > >> > JIRAs with their state (complete, etc.) and version (0.6.0) as
> > > > needed.
> > > > > >> >
> > > > > >> > Do we have anything that needs to go into the UPGRADING.md
> file?
> > > > > >> >
> > > > > >> > A PR is out for updating the version from 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-06 Thread zeo...@gmail.com
Either is fine with me.  If it's x.y in some parts of the app I prefer to
keep it consistent throughout, but I'm also fine with lining up with
Apache/Metron where we can.

I also refreshed myself on why we avoided x.y.z initially and it was
actually for this exact reason, we wanted consistent versioning throughout
a repo.  This issue is with the bro plugins themselves, not bro-pkg, so I
submit a JIRA .

Jon


On Wed, Sep 5, 2018, 21:51 Justin Leet  wrote:

> Makes sense. Do we have any objection to just going to the artifact being
> 0.2?  Or do we want to keep the mixed versioning and just live with it, at
> least for now?
>
> On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com  wrote:
>
> > I think mattf-horton just did that as a part of convention.  He handled
> > that part, and I did the 0.1 tagging (as a prereq to this
> > <
> >
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> > >)
> > last time the package was released.
> >
> > Jon
> >
> > On Wed, Sep 5, 2018 at 8:28 PM Justin Leet 
> wrote:
> >
> > > Any idea why we released it as 0.1.0 in the artifacts version?  I'm
> fine
> > > with doing x.y if we need to, but I would like the artifact versioning
> to
> > > be consistent if possible.
> > >
> > > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com 
> > wrote:
> > >
> > > > I lied, we didn't need to update our btests because it's limited to a
> > > major
> > > > and minor version.
> > > >
> > > >
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > > >
> > > > Jon
> > > >
> > > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com 
> > > wrote:
> > > >
> > > > > I looked into x.y.z back when we released 0.1 and it was not
> possible
> > > in
> > > > > bro-pkg at the time but now it is
> > > > > .  In order to
> do
> > > > this,
> > > > > we'll also need to configure bro-pkg.meta to require the proper
> > version
> > > > of
> > > > > bro-pkg, as well as update the btests for the new version string.
> I
> > > will
> > > > > throw together a JIRA and PR to do all this in case we decide to
> > align
> > > > with
> > > > > x.y.z; we can trash it if we decide to stay with x.y.
> > > > >
> > > > > Jon
> > > > >
> > > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet 
> > > > wrote:
> > > > >
> > > > >> Long story short, while preparing the release candidate, I
> > discovered
> > > > our
> > > > >> metron-bro-plugin-kafka is inconsistently versioned.
> > > > >>
> > > > >> In the repo, it's x.y (e.g. 0.2)
> > > > >> See:
> > > > >>
> > > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> > > > >>
> > > > >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> > > > >> See http://archive.apache.org/dist/metron/0.4.2/
> > > > >>
> > > > >> Going forward from this release, I'd like the artifact to be
> > > consistent
> > > > >> with the repo.  I'd personally prefer x.y.z to be entirely
> > consistent
> > > > >> throughout Metron, but if there's a particular reason why it was
> x.y
> > > I'm
> > > > >> happy to entertain it.
> > > > >>
> > > > >> If we choose to move to x.y.z, I can provide a PR to update the
> > > version
> > > > to
> > > > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like
> to
> > > > >> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
> > > > >>
> > > > >> Justin
> > > > >>
> > > > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet <
> justinjl...@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > As an update, I'll be working on starting the release process
> > > rolling
> > > > >> > today. The PCAP Query panel feature branch is in master and I
> > > haven't
> > > > >> heard
> > > > >> > of any other potential blockers. I'd appreciate everyone
> updating
> > > > their
> > > > >> > JIRAs with their state (complete, etc.) and version (0.6.0) as
> > > needed.
> > > > >> >
> > > > >> > Do we have anything that needs to go into the UPGRADING.md file?
> > > > >> >
> > > > >> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please
> > see
> > > > >> > https://github.com/apache/metron/pull/1183. I still need to
> spin
> > up
> > > > >> full
> > > > >> > dev etc. before this is ready to be merged.
> > > > >> >
> > > > >> > Updated list of PRs that have made it into master as of Sept 4,
> > 2018
> > > > >> >
> > > > >> > 6 days ago METRON-1751 Storm Profiler dies when consuming null
> > > message
> > > > >> > (nickwallen) closes apache/metron#1176
> > > > >> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
> > > > >> (nickwallen)
> > > > >> > closes apache/metron#1178
> > > > >> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a
> confusing
> > > > >> variable
> > > > >> > name (JonZeolla via justinleet) closes apache/metron#1173
> > > > >> > 8 days ago METRON-1752 Prevent 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread Justin Leet
Makes sense. Do we have any objection to just going to the artifact being
0.2?  Or do we want to keep the mixed versioning and just live with it, at
least for now?

On Wed, Sep 5, 2018 at 8:58 PM zeo...@gmail.com  wrote:

> I think mattf-horton just did that as a part of convention.  He handled
> that part, and I did the 0.1 tagging (as a prereq to this
> <
> https://github.com/apache/metron/commit/2e78df67c12a6fcad726551128e9753ad36d5ee9#diff-8e3bdd364219306b1fad91047208e6e4R30
> >)
> last time the package was released.
>
> Jon
>
> On Wed, Sep 5, 2018 at 8:28 PM Justin Leet  wrote:
>
> > Any idea why we released it as 0.1.0 in the artifacts version?  I'm fine
> > with doing x.y if we need to, but I would like the artifact versioning to
> > be consistent if possible.
> >
> > On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com 
> wrote:
> >
> > > I lied, we didn't need to update our btests because it's limited to a
> > major
> > > and minor version.
> > >
> > >
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> > >
> > > Jon
> > >
> > > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com 
> > wrote:
> > >
> > > > I looked into x.y.z back when we released 0.1 and it was not possible
> > in
> > > > bro-pkg at the time but now it is
> > > > .  In order to do
> > > this,
> > > > we'll also need to configure bro-pkg.meta to require the proper
> version
> > > of
> > > > bro-pkg, as well as update the btests for the new version string.  I
> > will
> > > > throw together a JIRA and PR to do all this in case we decide to
> align
> > > with
> > > > x.y.z; we can trash it if we decide to stay with x.y.
> > > >
> > > > Jon
> > > >
> > > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet 
> > > wrote:
> > > >
> > > >> Long story short, while preparing the release candidate, I
> discovered
> > > our
> > > >> metron-bro-plugin-kafka is inconsistently versioned.
> > > >>
> > > >> In the repo, it's x.y (e.g. 0.2)
> > > >> See:
> > > >>
> > >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> > > >>
> > > >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> > > >> See http://archive.apache.org/dist/metron/0.4.2/
> > > >>
> > > >> Going forward from this release, I'd like the artifact to be
> > consistent
> > > >> with the repo.  I'd personally prefer x.y.z to be entirely
> consistent
> > > >> throughout Metron, but if there's a particular reason why it was x.y
> > I'm
> > > >> happy to entertain it.
> > > >>
> > > >> If we choose to move to x.y.z, I can provide a PR to update the
> > version
> > > to
> > > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
> > > >> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
> > > >>
> > > >> Justin
> > > >>
> > > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet 
> > > >> wrote:
> > > >>
> > > >> > As an update, I'll be working on starting the release process
> > rolling
> > > >> > today. The PCAP Query panel feature branch is in master and I
> > haven't
> > > >> heard
> > > >> > of any other potential blockers. I'd appreciate everyone updating
> > > their
> > > >> > JIRAs with their state (complete, etc.) and version (0.6.0) as
> > needed.
> > > >> >
> > > >> > Do we have anything that needs to go into the UPGRADING.md file?
> > > >> >
> > > >> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please
> see
> > > >> > https://github.com/apache/metron/pull/1183. I still need to spin
> up
> > > >> full
> > > >> > dev etc. before this is ready to be merged.
> > > >> >
> > > >> > Updated list of PRs that have made it into master as of Sept 4,
> 2018
> > > >> >
> > > >> > 6 days ago METRON-1751 Storm Profiler dies when consuming null
> > message
> > > >> > (nickwallen) closes apache/metron#1176
> > > >> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
> > > >> (nickwallen)
> > > >> > closes apache/metron#1178
> > > >> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing
> > > >> variable
> > > >> > name (JonZeolla via justinleet) closes apache/metron#1173
> > > >> > 8 days ago METRON-1752 Prevent package.lock from changing during
> > build
> > > >> > (sardell via merrimanr) closes apache/metron#1177
> > > >> > 8 days ago METRON-1724 Date/time validation missing in PCAP query
> > > >> (tiborm
> > > >> > via nickwallen) closes apache/metron#1172
> > > >> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
> > > >> > apache/metron#1169
> > > >> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr)
> > closes
> > > >> > apache/metron#1168
> > > >> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI
> > > after
> > > >> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
> > > >> > apache/metron#1141
> > > >> > 3 weeks ago METRON-1738: Pcap directories should have correct
> > > >> permissions
> > > >> > (merrimanr via mmiklavc) closes apache/metron#1166

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread zeo...@gmail.com
I think mattf-horton just did that as a part of convention.  He handled
that part, and I did the 0.1 tagging (as a prereq to this
)
last time the package was released.

Jon

On Wed, Sep 5, 2018 at 8:28 PM Justin Leet  wrote:

> Any idea why we released it as 0.1.0 in the artifacts version?  I'm fine
> with doing x.y if we need to, but I would like the artifact versioning to
> be consistent if possible.
>
> On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com  wrote:
>
> > I lied, we didn't need to update our btests because it's limited to a
> major
> > and minor version.
> >
> >
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
> >
> > Jon
> >
> > On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com 
> wrote:
> >
> > > I looked into x.y.z back when we released 0.1 and it was not possible
> in
> > > bro-pkg at the time but now it is
> > > .  In order to do
> > this,
> > > we'll also need to configure bro-pkg.meta to require the proper version
> > of
> > > bro-pkg, as well as update the btests for the new version string.  I
> will
> > > throw together a JIRA and PR to do all this in case we decide to align
> > with
> > > x.y.z; we can trash it if we decide to stay with x.y.
> > >
> > > Jon
> > >
> > > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet 
> > wrote:
> > >
> > >> Long story short, while preparing the release candidate, I discovered
> > our
> > >> metron-bro-plugin-kafka is inconsistently versioned.
> > >>
> > >> In the repo, it's x.y (e.g. 0.2)
> > >> See:
> > >>
> >
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> > >>
> > >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> > >> See http://archive.apache.org/dist/metron/0.4.2/
> > >>
> > >> Going forward from this release, I'd like the artifact to be
> consistent
> > >> with the repo.  I'd personally prefer x.y.z to be entirely consistent
> > >> throughout Metron, but if there's a particular reason why it was x.y
> I'm
> > >> happy to entertain it.
> > >>
> > >> If we choose to move to x.y.z, I can provide a PR to update the
> version
> > to
> > >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
> > >> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
> > >>
> > >> Justin
> > >>
> > >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet 
> > >> wrote:
> > >>
> > >> > As an update, I'll be working on starting the release process
> rolling
> > >> > today. The PCAP Query panel feature branch is in master and I
> haven't
> > >> heard
> > >> > of any other potential blockers. I'd appreciate everyone updating
> > their
> > >> > JIRAs with their state (complete, etc.) and version (0.6.0) as
> needed.
> > >> >
> > >> > Do we have anything that needs to go into the UPGRADING.md file?
> > >> >
> > >> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
> > >> > https://github.com/apache/metron/pull/1183. I still need to spin up
> > >> full
> > >> > dev etc. before this is ready to be merged.
> > >> >
> > >> > Updated list of PRs that have made it into master as of Sept 4, 2018
> > >> >
> > >> > 6 days ago METRON-1751 Storm Profiler dies when consuming null
> message
> > >> > (nickwallen) closes apache/metron#1176
> > >> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
> > >> (nickwallen)
> > >> > closes apache/metron#1178
> > >> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing
> > >> variable
> > >> > name (JonZeolla via justinleet) closes apache/metron#1173
> > >> > 8 days ago METRON-1752 Prevent package.lock from changing during
> build
> > >> > (sardell via merrimanr) closes apache/metron#1177
> > >> > 8 days ago METRON-1724 Date/time validation missing in PCAP query
> > >> (tiborm
> > >> > via nickwallen) closes apache/metron#1172
> > >> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
> > >> > apache/metron#1169
> > >> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr)
> closes
> > >> > apache/metron#1168
> > >> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI
> > after
> > >> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
> > >> > apache/metron#1141
> > >> > 3 weeks ago METRON-1738: Pcap directories should have correct
> > >> permissions
> > >> > (merrimanr via mmiklavc) closes apache/metron#1166
> > >> > 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via
> mmiklavc)
> > >> > closes apache/metron#1164
> > >> > 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
> > >> > finalizer file writing (mmiklavc via mmiklavc) closes
> > apache/metron#1157
> > >> > 3 weeks ago METRON-1735 Empty print status option causes NPE
> > (merrimanr)
> > >> > closes apache/metron#1160
> > >> > 3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on
> > Safari
> > >> > 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread Justin Leet
Any idea why we released it as 0.1.0 in the artifacts version?  I'm fine
with doing x.y if we need to, but I would like the artifact versioning to
be consistent if possible.

On Wed, Sep 5, 2018 at 8:26 PM zeo...@gmail.com  wrote:

> I lied, we didn't need to update our btests because it's limited to a major
> and minor version.
>
>
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34
>
> Jon
>
> On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com  wrote:
>
> > I looked into x.y.z back when we released 0.1 and it was not possible in
> > bro-pkg at the time but now it is
> > .  In order to do
> this,
> > we'll also need to configure bro-pkg.meta to require the proper version
> of
> > bro-pkg, as well as update the btests for the new version string.  I will
> > throw together a JIRA and PR to do all this in case we decide to align
> with
> > x.y.z; we can trash it if we decide to stay with x.y.
> >
> > Jon
> >
> > On Wed, Sep 5, 2018 at 7:35 PM Justin Leet 
> wrote:
> >
> >> Long story short, while preparing the release candidate, I discovered
> our
> >> metron-bro-plugin-kafka is inconsistently versioned.
> >>
> >> In the repo, it's x.y (e.g. 0.2)
> >> See:
> >>
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
> >>
> >> In our released artifact, it's x.y.z (e.g. 0.1.0)
> >> See http://archive.apache.org/dist/metron/0.4.2/
> >>
> >> Going forward from this release, I'd like the artifact to be consistent
> >> with the repo.  I'd personally prefer x.y.z to be entirely consistent
> >> throughout Metron, but if there's a particular reason why it was x.y I'm
> >> happy to entertain it.
> >>
> >> If we choose to move to x.y.z, I can provide a PR to update the version
> to
> >> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
> >> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
> >>
> >> Justin
> >>
> >> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet 
> >> wrote:
> >>
> >> > As an update, I'll be working on starting the release process rolling
> >> > today. The PCAP Query panel feature branch is in master and I haven't
> >> heard
> >> > of any other potential blockers. I'd appreciate everyone updating
> their
> >> > JIRAs with their state (complete, etc.) and version (0.6.0) as needed.
> >> >
> >> > Do we have anything that needs to go into the UPGRADING.md file?
> >> >
> >> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
> >> > https://github.com/apache/metron/pull/1183. I still need to spin up
> >> full
> >> > dev etc. before this is ready to be merged.
> >> >
> >> > Updated list of PRs that have made it into master as of Sept 4, 2018
> >> >
> >> > 6 days ago METRON-1751 Storm Profiler dies when consuming null message
> >> > (nickwallen) closes apache/metron#1176
> >> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
> >> (nickwallen)
> >> > closes apache/metron#1178
> >> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing
> >> variable
> >> > name (JonZeolla via justinleet) closes apache/metron#1173
> >> > 8 days ago METRON-1752 Prevent package.lock from changing during build
> >> > (sardell via merrimanr) closes apache/metron#1177
> >> > 8 days ago METRON-1724 Date/time validation missing in PCAP query
> >> (tiborm
> >> > via nickwallen) closes apache/metron#1172
> >> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
> >> > apache/metron#1169
> >> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes
> >> > apache/metron#1168
> >> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI
> after
> >> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
> >> > apache/metron#1141
> >> > 3 weeks ago METRON-1738: Pcap directories should have correct
> >> permissions
> >> > (merrimanr via mmiklavc) closes apache/metron#1166
> >> > 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc)
> >> > closes apache/metron#1164
> >> > 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
> >> > finalizer file writing (mmiklavc via mmiklavc) closes
> apache/metron#1157
> >> > 3 weeks ago METRON-1735 Empty print status option causes NPE
> (merrimanr)
> >> > closes apache/metron#1160
> >> > 3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on
> Safari
> >> > (sardell via merrimanr) closes apache/metron#1158
> >> > 3 weeks ago METRON-1734 Src and Dst port filters are incorrect after
> >> > changing to empty (merrimanr) closes apache/metron#1159
> >> > 4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap
> jobs
> >> > (merrimanr) closes apache/metron#1153
> >> > 4 weeks ago METRON-1731: PCAP - Escape colons in output dir names
> >> > (mmiklavc via mmiklavc) closes apache/metron#1155
> >> > 4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr)
> >> closes
> >> > apache/metron#1156
> >> > 4 weeks ago METRON-1722 PcapCLI 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread zeo...@gmail.com
I lied, we didn't need to update our btests because it's limited to a major
and minor version.

https://github.com/apache/metron-bro-plugin-kafka/blob/master/src/Plugin.cc#L33-L34

Jon

On Wed, Sep 5, 2018 at 8:10 PM zeo...@gmail.com  wrote:

> I looked into x.y.z back when we released 0.1 and it was not possible in
> bro-pkg at the time but now it is
> .  In order to do this,
> we'll also need to configure bro-pkg.meta to require the proper version of
> bro-pkg, as well as update the btests for the new version string.  I will
> throw together a JIRA and PR to do all this in case we decide to align with
> x.y.z; we can trash it if we decide to stay with x.y.
>
> Jon
>
> On Wed, Sep 5, 2018 at 7:35 PM Justin Leet  wrote:
>
>> Long story short, while preparing the release candidate, I discovered our
>> metron-bro-plugin-kafka is inconsistently versioned.
>>
>> In the repo, it's x.y (e.g. 0.2)
>> See:
>> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
>>
>> In our released artifact, it's x.y.z (e.g. 0.1.0)
>> See http://archive.apache.org/dist/metron/0.4.2/
>>
>> Going forward from this release, I'd like the artifact to be consistent
>> with the repo.  I'd personally prefer x.y.z to be entirely consistent
>> throughout Metron, but if there's a particular reason why it was x.y I'm
>> happy to entertain it.
>>
>> If we choose to move to x.y.z, I can provide a PR to update the version to
>> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
>> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
>>
>> Justin
>>
>> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet 
>> wrote:
>>
>> > As an update, I'll be working on starting the release process rolling
>> > today. The PCAP Query panel feature branch is in master and I haven't
>> heard
>> > of any other potential blockers. I'd appreciate everyone updating their
>> > JIRAs with their state (complete, etc.) and version (0.6.0) as needed.
>> >
>> > Do we have anything that needs to go into the UPGRADING.md file?
>> >
>> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
>> > https://github.com/apache/metron/pull/1183. I still need to spin up
>> full
>> > dev etc. before this is ready to be merged.
>> >
>> > Updated list of PRs that have made it into master as of Sept 4, 2018
>> >
>> > 6 days ago METRON-1751 Storm Profiler dies when consuming null message
>> > (nickwallen) closes apache/metron#1176
>> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
>> (nickwallen)
>> > closes apache/metron#1178
>> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing
>> variable
>> > name (JonZeolla via justinleet) closes apache/metron#1173
>> > 8 days ago METRON-1752 Prevent package.lock from changing during build
>> > (sardell via merrimanr) closes apache/metron#1177
>> > 8 days ago METRON-1724 Date/time validation missing in PCAP query
>> (tiborm
>> > via nickwallen) closes apache/metron#1172
>> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
>> > apache/metron#1169
>> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes
>> > apache/metron#1168
>> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI after
>> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
>> > apache/metron#1141
>> > 3 weeks ago METRON-1738: Pcap directories should have correct
>> permissions
>> > (merrimanr via mmiklavc) closes apache/metron#1166
>> > 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc)
>> > closes apache/metron#1164
>> > 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
>> > finalizer file writing (mmiklavc via mmiklavc) closes apache/metron#1157
>> > 3 weeks ago METRON-1735 Empty print status option causes NPE (merrimanr)
>> > closes apache/metron#1160
>> > 3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on Safari
>> > (sardell via merrimanr) closes apache/metron#1158
>> > 3 weeks ago METRON-1734 Src and Dst port filters are incorrect after
>> > changing to empty (merrimanr) closes apache/metron#1159
>> > 4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap jobs
>> > (merrimanr) closes apache/metron#1153
>> > 4 weeks ago METRON-1731: PCAP - Escape colons in output dir names
>> > (mmiklavc via mmiklavc) closes apache/metron#1155
>> > 4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr)
>> closes
>> > apache/metron#1156
>> > 4 weeks ago METRON-1722 PcapCLI should print progress to stdout
>> > (merrimanr) closes apache/metron#1138
>> > 4 weeks ago Merge branch 'master' into
>> feature/METRON-1554-pcap-query-panel
>> > 4 weeks ago METRON-1728: Handle null values in config in Pcap backend
>> more
>> > gracefully (mmiklavc via mmiklavc) closes apache/metron#1151
>> > 4 weeks ago METRON-1730: Update steps to run pycapa on Centos 6
>> (mmiklavc
>> > via mmiklavc) closes apache/metron#1152
>> > 4 weeks ago 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread zeo...@gmail.com
I looked into x.y.z back when we released 0.1 and it was not possible in
bro-pkg at the time but now it is
.  In order to do this,
we'll also need to configure bro-pkg.meta to require the proper version of
bro-pkg, as well as update the btests for the new version string.  I will
throw together a JIRA and PR to do all this in case we decide to align with
x.y.z; we can trash it if we decide to stay with x.y.

Jon

On Wed, Sep 5, 2018 at 7:35 PM Justin Leet  wrote:

> Long story short, while preparing the release candidate, I discovered our
> metron-bro-plugin-kafka is inconsistently versioned.
>
> In the repo, it's x.y (e.g. 0.2)
> See:
> https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18
>
> In our released artifact, it's x.y.z (e.g. 0.1.0)
> See http://archive.apache.org/dist/metron/0.4.2/
>
> Going forward from this release, I'd like the artifact to be consistent
> with the repo.  I'd personally prefer x.y.z to be entirely consistent
> throughout Metron, but if there's a particular reason why it was x.y I'm
> happy to entertain it.
>
> If we choose to move to x.y.z, I can provide a PR to update the version to
> 0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
> release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz
>
> Justin
>
> On Tue, Sep 4, 2018 at 12:15 PM Justin Leet  wrote:
>
> > As an update, I'll be working on starting the release process rolling
> > today. The PCAP Query panel feature branch is in master and I haven't
> heard
> > of any other potential blockers. I'd appreciate everyone updating their
> > JIRAs with their state (complete, etc.) and version (0.6.0) as needed.
> >
> > Do we have anything that needs to go into the UPGRADING.md file?
> >
> > A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
> > https://github.com/apache/metron/pull/1183. I still need to spin up full
> > dev etc. before this is ready to be merged.
> >
> > Updated list of PRs that have made it into master as of Sept 4, 2018
> >
> > 6 days ago METRON-1751 Storm Profiler dies when consuming null message
> > (nickwallen) closes apache/metron#1176
> > 6 days ago METRON-1757 Storm Profiler Serialization Exception
> (nickwallen)
> > closes apache/metron#1178
> > 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing
> variable
> > name (JonZeolla via justinleet) closes apache/metron#1173
> > 8 days ago METRON-1752 Prevent package.lock from changing during build
> > (sardell via merrimanr) closes apache/metron#1177
> > 8 days ago METRON-1724 Date/time validation missing in PCAP query (tiborm
> > via nickwallen) closes apache/metron#1172
> > 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
> > apache/metron#1169
> > 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes
> > apache/metron#1168
> > 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI after
> > enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
> > apache/metron#1141
> > 3 weeks ago METRON-1738: Pcap directories should have correct permissions
> > (merrimanr via mmiklavc) closes apache/metron#1166
> > 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc)
> > closes apache/metron#1164
> > 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
> > finalizer file writing (mmiklavc via mmiklavc) closes apache/metron#1157
> > 3 weeks ago METRON-1735 Empty print status option causes NPE (merrimanr)
> > closes apache/metron#1160
> > 3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on Safari
> > (sardell via merrimanr) closes apache/metron#1158
> > 3 weeks ago METRON-1734 Src and Dst port filters are incorrect after
> > changing to empty (merrimanr) closes apache/metron#1159
> > 4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap jobs
> > (merrimanr) closes apache/metron#1153
> > 4 weeks ago METRON-1731: PCAP - Escape colons in output dir names
> > (mmiklavc via mmiklavc) closes apache/metron#1155
> > 4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr) closes
> > apache/metron#1156
> > 4 weeks ago METRON-1722 PcapCLI should print progress to stdout
> > (merrimanr) closes apache/metron#1138
> > 4 weeks ago Merge branch 'master' into
> feature/METRON-1554-pcap-query-panel
> > 4 weeks ago METRON-1728: Handle null values in config in Pcap backend
> more
> > gracefully (mmiklavc via mmiklavc) closes apache/metron#1151
> > 4 weeks ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> > via mmiklavc) closes apache/metron#1152
> > 4 weeks ago METRON-1713 PCAP UI - Add a way to kill a pcap job (tiborm
> via
> > merrimanr) closes apache/metron#1143
> > 4 weeks ago METRON-1723 PCAP UI - Unable to select/copy from packets
> > details in PCAP query panel (sardell via merrimanr) closes
> > apache/metron#1139
> > 4 weeks ago METRON-1712 PCAP UI - Input validation (tiborm via merrimanr)
> > closes apache/metron#1142
> 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-05 Thread Justin Leet
Long story short, while preparing the release candidate, I discovered our
metron-bro-plugin-kafka is inconsistently versioned.

In the repo, it's x.y (e.g. 0.2)
See:
https://github.com/apache/metron-bro-plugin-kafka/blob/master/VERSION#L18

In our released artifact, it's x.y.z (e.g. 0.1.0)
See http://archive.apache.org/dist/metron/0.4.2/

Going forward from this release, I'd like the artifact to be consistent
with the repo.  I'd personally prefer x.y.z to be entirely consistent
throughout Metron, but if there's a particular reason why it was x.y I'm
happy to entertain it.

If we choose to move to x.y.z, I can provide a PR to update the version to
0.2.0 unless someone else wants to volunteer. Otherwise, I'd like to
release the artifact as apache-metron-bro-plugin-kafka_0.2.tar.gz

Justin

On Tue, Sep 4, 2018 at 12:15 PM Justin Leet  wrote:

> As an update, I'll be working on starting the release process rolling
> today. The PCAP Query panel feature branch is in master and I haven't heard
> of any other potential blockers. I'd appreciate everyone updating their
> JIRAs with their state (complete, etc.) and version (0.6.0) as needed.
>
> Do we have anything that needs to go into the UPGRADING.md file?
>
> A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
> https://github.com/apache/metron/pull/1183. I still need to spin up full
> dev etc. before this is ready to be merged.
>
> Updated list of PRs that have made it into master as of Sept 4, 2018
>
> 6 days ago METRON-1751 Storm Profiler dies when consuming null message
> (nickwallen) closes apache/metron#1176
> 6 days ago METRON-1757 Storm Profiler Serialization Exception (nickwallen)
> closes apache/metron#1178
> 6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing variable
> name (JonZeolla via justinleet) closes apache/metron#1173
> 8 days ago METRON-1752 Prevent package.lock from changing during build
> (sardell via merrimanr) closes apache/metron#1177
> 8 days ago METRON-1724 Date/time validation missing in PCAP query (tiborm
> via nickwallen) closes apache/metron#1172
> 3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
> apache/metron#1169
> 3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes
> apache/metron#1168
> 3 weeks ago METRON-1727: Alerts are not populated on the alerts UI after
> enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
> apache/metron#1141
> 3 weeks ago METRON-1738: Pcap directories should have correct permissions
> (merrimanr via mmiklavc) closes apache/metron#1166
> 3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc)
> closes apache/metron#1164
> 3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
> finalizer file writing (mmiklavc via mmiklavc) closes apache/metron#1157
> 3 weeks ago METRON-1735 Empty print status option causes NPE (merrimanr)
> closes apache/metron#1160
> 3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on Safari
> (sardell via merrimanr) closes apache/metron#1158
> 3 weeks ago METRON-1734 Src and Dst port filters are incorrect after
> changing to empty (merrimanr) closes apache/metron#1159
> 4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap jobs
> (merrimanr) closes apache/metron#1153
> 4 weeks ago METRON-1731: PCAP - Escape colons in output dir names
> (mmiklavc via mmiklavc) closes apache/metron#1155
> 4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr) closes
> apache/metron#1156
> 4 weeks ago METRON-1722 PcapCLI should print progress to stdout
> (merrimanr) closes apache/metron#1138
> 4 weeks ago Merge branch 'master' into feature/METRON-1554-pcap-query-panel
> 4 weeks ago METRON-1728: Handle null values in config in Pcap backend more
> gracefully (mmiklavc via mmiklavc) closes apache/metron#1151
> 4 weeks ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> via mmiklavc) closes apache/metron#1152
> 4 weeks ago METRON-1713 PCAP UI - Add a way to kill a pcap job (tiborm via
> merrimanr) closes apache/metron#1143
> 4 weeks ago METRON-1723 PCAP UI - Unable to select/copy from packets
> details in PCAP query panel (sardell via merrimanr) closes
> apache/metron#1139
> 4 weeks ago METRON-1712 PCAP UI - Input validation (tiborm via merrimanr)
> closes apache/metron#1142
> 4 weeks ago METRON-1720 Better error messages when there are no results or
> wireshark is not installed (merrimanr) closes apache/metron#1154
> 4 weeks ago METRON-1726: Refactor PcapTopologyIntegrationTest (mmiklavc
> via mmiklavc) closes apache/metron#1140
> 4 weeks ago METRON-1683 PCAP UI - Fix the download progress bar (sardell
> via merrimanr) closes apache/metron#1122
> 4 weeks ago METRON-1675 PCAP UI - Introduce the paging capability (sardell
> via merrimanr) closes apache/metron#1121
> 4 weeks ago METRON-1721 New default input path is wrong in pcap CLI
> (merrimanr) closes apache/metron#1137
> 4 weeks ago Merge branch 'master' into feature/METRON-1554-pcap-query-panel
> 4 weeks 

Re: [DISCUSS] Metron Release 0.6.0?

2018-09-04 Thread Justin Leet
As an update, I'll be working on starting the release process rolling
today. The PCAP Query panel feature branch is in master and I haven't heard
of any other potential blockers. I'd appreciate everyone updating their
JIRAs with their state (complete, etc.) and version (0.6.0) as needed.

Do we have anything that needs to go into the UPGRADING.md file?

A PR is out for updating the version from 0.5.1 to 0.6.0. Please see
https://github.com/apache/metron/pull/1183. I still need to spin up full
dev etc. before this is ready to be merged.

Updated list of PRs that have made it into master as of Sept 4, 2018

6 days ago METRON-1751 Storm Profiler dies when consuming null message
(nickwallen) closes apache/metron#1176
6 days ago METRON-1757 Storm Profiler Serialization Exception (nickwallen)
closes apache/metron#1178
6 days ago METRON-1743 CEF testPaloAltoCEF test using a confusing variable
name (JonZeolla via justinleet) closes apache/metron#1173
8 days ago METRON-1752 Prevent package.lock from changing during build
(sardell via merrimanr) closes apache/metron#1177
8 days ago METRON-1724 Date/time validation missing in PCAP query (tiborm
via nickwallen) closes apache/metron#1172
3 weeks ago METRON-1554 Pcap Query Panel (merrimanr) closes
apache/metron#1169
3 weeks ago METRON-1739 UDP packets are not handled (merrimanr) closes
apache/metron#1168
3 weeks ago METRON-1727: Alerts are not populated on the alerts UI after
enabling X-pack for Elastic search (MohanDV via mmiklavc) closes
apache/metron#1141
3 weeks ago METRON-1738: Pcap directories should have correct permissions
(merrimanr via mmiklavc) closes apache/metron#1166
3 weeks ago METRON-1737: Document Job cleanup (merrimanr via mmiklavc)
closes apache/metron#1164
3 weeks ago METRON-1732: Fix job status liveness bug and parallelize
finalizer file writing (mmiklavc via mmiklavc) closes apache/metron#1157
3 weeks ago METRON-1735 Empty print status option causes NPE (merrimanr)
closes apache/metron#1160
3 weeks ago METRON-1733 PCAP UI - PCAP queries dont work on Safari
(sardell via merrimanr) closes apache/metron#1158
3 weeks ago METRON-1734 Src and Dst port filters are incorrect after
changing to empty (merrimanr) closes apache/metron#1159
4 weeks ago METRON-1725 Add ability to specify YARN queue for pcap jobs
(merrimanr) closes apache/metron#1153
4 weeks ago METRON-1731: PCAP - Escape colons in output dir names (mmiklavc
via mmiklavc) closes apache/metron#1155
4 weeks ago METRON-1702 Reload a running job in the UI (merrimanr) closes
apache/metron#1156
4 weeks ago METRON-1722 PcapCLI should print progress to stdout (merrimanr)
closes apache/metron#1138
4 weeks ago Merge branch 'master' into feature/METRON-1554-pcap-query-panel
4 weeks ago METRON-1728: Handle null values in config in Pcap backend more
gracefully (mmiklavc via mmiklavc) closes apache/metron#1151
4 weeks ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
via mmiklavc) closes apache/metron#1152
4 weeks ago METRON-1713 PCAP UI - Add a way to kill a pcap job (tiborm via
merrimanr) closes apache/metron#1143
4 weeks ago METRON-1723 PCAP UI - Unable to select/copy from packets
details in PCAP query panel (sardell via merrimanr) closes
apache/metron#1139
4 weeks ago METRON-1712 PCAP UI - Input validation (tiborm via merrimanr)
closes apache/metron#1142
4 weeks ago METRON-1720 Better error messages when there are no results or
wireshark is not installed (merrimanr) closes apache/metron#1154
4 weeks ago METRON-1726: Refactor PcapTopologyIntegrationTest (mmiklavc via
mmiklavc) closes apache/metron#1140
4 weeks ago METRON-1683 PCAP UI - Fix the download progress bar (sardell
via merrimanr) closes apache/metron#1122
4 weeks ago METRON-1675 PCAP UI - Introduce the paging capability (sardell
via merrimanr) closes apache/metron#1121
4 weeks ago METRON-1721 New default input path is wrong in pcap CLI
(merrimanr) closes apache/metron#1137
4 weeks ago Merge branch 'master' into feature/METRON-1554-pcap-query-panel
4 weeks ago METRON-1676 PCAP UI - Add data range selector to the filter bar
(tiborm via merrimanr) closes apache/metron#1119
5 weeks ago METRON-1662 PCAP UI - Downloading PCAP page files (tiborm via
merrimanr) closes apache/metron#1118
5 weeks ago METRON-1700 Create REST endpoint to get job configuration
(merrimanr) closes apache/metron#1135
5 weeks ago METRON-1671 Create PCAP UI (tiborm via merrimanr) closes
apache/metron#1103
5 weeks ago METRON-1701 Update General notes on the installation of Pycapa
on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
6 weeks ago METRON-1650 Packaging docker containers are too large
(jameslamb via merrimanr) closes apache/metron#1091
6 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
management pack repo info closes apache/incubator-metron#1052
6 weeks ago Merge branch 'master' into feature/METRON-1554-pcap-query-panel
6 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Michael Miklavcic
+1 here as well to the proposed releases.

On Wed, Aug 15, 2018 at 11:06 AM Casey Stella  wrote:

> +1 to both releases, this is plenty for an 0.6.0 and a 0.2.0
>
> On Wed, Aug 15, 2018 at 11:04 AM Justin Leet 
> wrote:
>
> > I just sent a thread about release cadence. Jon, I'd recommend starting a
> > thread on a 1.0 roadmap.  I thought about merging the threads, but I
> think
> > that's just going to result in more crosstalk, so I'll let you start that
> > conversation.
> >
> > On Wed, Aug 15, 2018 at 10:37 AM Nick Allen  wrote:
> >
> > > +1 to a 0.6.0 release that includes the Pcap Panel and Solr work.
> > >
> > > +1 to doing a 0.2.0 release for metron-bro-plugin-kafka.  I *think* we
> > need
> > > to do the plugin release first, so that the 0.6.0 Metron release will
> > point
> > > to plugin 0.2.0.
> > >
> > > FWIW, here are the changes since the last release.
> > >
> > > 6 days ago METRON-1730: Update steps to run pycapa on Centos 6
> (mmiklavc
> > > via mmiklavc) closes apache/metron#1152
> > > 2 weeks ago METRON-1701 Update General notes on the installation of
> > Pycapa
> > > on Kerberized cluster (MohanDV via nickwallen) closes
> apache/metron#1136
> > > 3 weeks ago METRON-1650 Packaging docker containers are too large
> > > (jameslamb via merrimanr) closes apache/metron#1091
> > > 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
> > > management pack repo info closes apache/incubator-metron#1052
> > > 3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
> > > apache/incubator-metron#1126
> > > 3 weeks ago METRON-1694: Clean up Metron REST docs closes
> > > apache/incubator-metron#1131
> > > 4 weeks ago METRON-1606 Add a wrap to incoming messages in
> > the
> > > metron json parser (ottobackwards) closes apache/metron#1054
> > > 4 weeks ago METRON-1672 Add metron-alertss UI unit tests to
> travis
> > > build process (justinleet) closes apache/metron#1106
> > > 4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
> > > (justinleet) closes apache/metron#1110
> > > 4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
> > > apache/metron#1099
> > > 4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
> > > merrimanr) closes apache/metron#1095
> > > 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
> > > apache/metron#1107
> > > 4 weeks ago METRON-1620: Fixes for forensic clustering use case example
> > > (mmiklavc via mmiklavc) closes apache/metron#1065
> > > 4 weeks ago METRON-1659: The platform-info.sh should check for the
> > vagrant
> > > hostmanager plugin closes apache/incubator-metron#1100
> > > 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
> > > apache/incubator-metron#1101
> > > 4 weeks ago METRON-1236 Add start/stop/restart commands that execute
> > > successfully, when ambari agents run as non-root user closes
> > > apache/incubator-metron#1105
> > > 4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive
> > > closes apache/incubator-metron#1104
> > > 5 weeks ago METRON-1660 On Solr, sorting by threat score fails
> > (justinleet)
> > > closes apache/metron#1102
> > > 5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes
> > > apache/metron#1097
> > > 5 weeks ago METRON-1644: Support parser chaining closes
> > > apache/incubator-metron#1084
> > > 5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the
> 2nd
> > > arg (ottobackwards) closes apache/metron#1098
> > > 6 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation
> > closes
> > > apache/incubator-metron#1083
> > > 6 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen)
> > closes
> > > apache/metron#1092
> > > 6 weeks ago METRON-1649 Intermittent Test Failure
> > > ProfileBuilderBoltTest#testFlushExpiredProfiles
> > > (nickwallen) closes apache/metron#1090
> > > 6 weeks ago METRON-1635 Alerts UI status update doesnt
> immediately
> > > show up (merrimanr) closes apache/metron#1080
> > > 6 weeks ago METRON-1642: KafkaWriter should be able choose the topic
> > from a
> > > field in addition to topology construction time closes
> > > apache/incubator-metron#1082
> > > 6 weeks ago METRON-1636: Fix broken unit test setup in metron-alerts
> > closes
> > > apache/incubator-metron#1085
> > > 7 weeks ago METRON-1631 Alerts UI: Dash score does not show if only
> > > filtering by one group (sardell via merrimanr) closes
> apache/metron#1079
> > > 7 weeks ago METRON-1647 Fix logging level score closes
> > > apache/incubator-metron#1089
> > > 7 weeks ago METRON-1621: Sorting alerts table by score closes
> > > apache/incubator-metron#1088
> > > 7 weeks ago METRON-1619: Stellar empty collections should be considered
> > > false in boolean expressions closes apache/incubator-metron#1064
> > > 7 weeks ago METRON-1646 Sensor Stubs should work when kerberized
> > > (nickwallen) closes apache/metron#1087
> > > 7 weeks ago METRON-1645: Check wether the Solr management pack 

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Casey Stella
+1 to both releases, this is plenty for an 0.6.0 and a 0.2.0

On Wed, Aug 15, 2018 at 11:04 AM Justin Leet  wrote:

> I just sent a thread about release cadence. Jon, I'd recommend starting a
> thread on a 1.0 roadmap.  I thought about merging the threads, but I think
> that's just going to result in more crosstalk, so I'll let you start that
> conversation.
>
> On Wed, Aug 15, 2018 at 10:37 AM Nick Allen  wrote:
>
> > +1 to a 0.6.0 release that includes the Pcap Panel and Solr work.
> >
> > +1 to doing a 0.2.0 release for metron-bro-plugin-kafka.  I *think* we
> need
> > to do the plugin release first, so that the 0.6.0 Metron release will
> point
> > to plugin 0.2.0.
> >
> > FWIW, here are the changes since the last release.
> >
> > 6 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> > via mmiklavc) closes apache/metron#1152
> > 2 weeks ago METRON-1701 Update General notes on the installation of
> Pycapa
> > on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
> > 3 weeks ago METRON-1650 Packaging docker containers are too large
> > (jameslamb via merrimanr) closes apache/metron#1091
> > 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
> > management pack repo info closes apache/incubator-metron#1052
> > 3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
> > apache/incubator-metron#1126
> > 3 weeks ago METRON-1694: Clean up Metron REST docs closes
> > apache/incubator-metron#1131
> > 4 weeks ago METRON-1606 Add a wrap to incoming messages in
> the
> > metron json parser (ottobackwards) closes apache/metron#1054
> > 4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
> > build process (justinleet) closes apache/metron#1106
> > 4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
> > (justinleet) closes apache/metron#1110
> > 4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
> > apache/metron#1099
> > 4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
> > merrimanr) closes apache/metron#1095
> > 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
> > apache/metron#1107
> > 4 weeks ago METRON-1620: Fixes for forensic clustering use case example
> > (mmiklavc via mmiklavc) closes apache/metron#1065
> > 4 weeks ago METRON-1659: The platform-info.sh should check for the
> vagrant
> > hostmanager plugin closes apache/incubator-metron#1100
> > 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
> > apache/incubator-metron#1101
> > 4 weeks ago METRON-1236 Add start/stop/restart commands that execute
> > successfully, when ambari agents run as non-root user closes
> > apache/incubator-metron#1105
> > 4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive
> > closes apache/incubator-metron#1104
> > 5 weeks ago METRON-1660 On Solr, sorting by threat score fails
> (justinleet)
> > closes apache/metron#1102
> > 5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes
> > apache/metron#1097
> > 5 weeks ago METRON-1644: Support parser chaining closes
> > apache/incubator-metron#1084
> > 5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the 2nd
> > arg (ottobackwards) closes apache/metron#1098
> > 6 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation
> closes
> > apache/incubator-metron#1083
> > 6 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen)
> closes
> > apache/metron#1092
> > 6 weeks ago METRON-1649 Intermittent Test Failure
> > ProfileBuilderBoltTest#testFlushExpiredProfiles
> > (nickwallen) closes apache/metron#1090
> > 6 weeks ago METRON-1635 Alerts UI status update doesnt immediately
> > show up (merrimanr) closes apache/metron#1080
> > 6 weeks ago METRON-1642: KafkaWriter should be able choose the topic
> from a
> > field in addition to topology construction time closes
> > apache/incubator-metron#1082
> > 6 weeks ago METRON-1636: Fix broken unit test setup in metron-alerts
> closes
> > apache/incubator-metron#1085
> > 7 weeks ago METRON-1631 Alerts UI: Dash score does not show if only
> > filtering by one group (sardell via merrimanr) closes apache/metron#1079
> > 7 weeks ago METRON-1647 Fix logging level score closes
> > apache/incubator-metron#1089
> > 7 weeks ago METRON-1621: Sorting alerts table by score closes
> > apache/incubator-metron#1088
> > 7 weeks ago METRON-1619: Stellar empty collections should be considered
> > false in boolean expressions closes apache/incubator-metron#1064
> > 7 weeks ago METRON-1646 Sensor Stubs should work when kerberized
> > (nickwallen) closes apache/metron#1087
> > 7 weeks ago METRON-1645: Check wether the Solr management pack is
> installed
> > before configuring the solr principal name. closes
> > apache/incubator-metron#1086
> > 7 weeks ago Merge branch 'master' into feature/METRON-1416-upgrade-solr
> > 7 weeks ago METRON-1634 Alerts UI add comment doesnt immediately
> show
> > up. (merrimanr) closes apache/metron#1077
> > 7 

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Justin Leet
I just sent a thread about release cadence. Jon, I'd recommend starting a
thread on a 1.0 roadmap.  I thought about merging the threads, but I think
that's just going to result in more crosstalk, so I'll let you start that
conversation.

On Wed, Aug 15, 2018 at 10:37 AM Nick Allen  wrote:

> +1 to a 0.6.0 release that includes the Pcap Panel and Solr work.
>
> +1 to doing a 0.2.0 release for metron-bro-plugin-kafka.  I *think* we need
> to do the plugin release first, so that the 0.6.0 Metron release will point
> to plugin 0.2.0.
>
> FWIW, here are the changes since the last release.
>
> 6 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> via mmiklavc) closes apache/metron#1152
> 2 weeks ago METRON-1701 Update General notes on the installation of Pycapa
> on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
> 3 weeks ago METRON-1650 Packaging docker containers are too large
> (jameslamb via merrimanr) closes apache/metron#1091
> 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
> management pack repo info closes apache/incubator-metron#1052
> 3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
> apache/incubator-metron#1126
> 3 weeks ago METRON-1694: Clean up Metron REST docs closes
> apache/incubator-metron#1131
> 4 weeks ago METRON-1606 Add a wrap to incoming messages in the
> metron json parser (ottobackwards) closes apache/metron#1054
> 4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
> build process (justinleet) closes apache/metron#1106
> 4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
> (justinleet) closes apache/metron#1110
> 4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
> apache/metron#1099
> 4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
> merrimanr) closes apache/metron#1095
> 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
> apache/metron#1107
> 4 weeks ago METRON-1620: Fixes for forensic clustering use case example
> (mmiklavc via mmiklavc) closes apache/metron#1065
> 4 weeks ago METRON-1659: The platform-info.sh should check for the vagrant
> hostmanager plugin closes apache/incubator-metron#1100
> 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
> apache/incubator-metron#1101
> 4 weeks ago METRON-1236 Add start/stop/restart commands that execute
> successfully, when ambari agents run as non-root user closes
> apache/incubator-metron#1105
> 4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive
> closes apache/incubator-metron#1104
> 5 weeks ago METRON-1660 On Solr, sorting by threat score fails (justinleet)
> closes apache/metron#1102
> 5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes
> apache/metron#1097
> 5 weeks ago METRON-1644: Support parser chaining closes
> apache/incubator-metron#1084
> 5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the 2nd
> arg (ottobackwards) closes apache/metron#1098
> 6 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation closes
> apache/incubator-metron#1083
> 6 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen) closes
> apache/metron#1092
> 6 weeks ago METRON-1649 Intermittent Test Failure
> ProfileBuilderBoltTest#testFlushExpiredProfiles
> (nickwallen) closes apache/metron#1090
> 6 weeks ago METRON-1635 Alerts UI status update doesnt immediately
> show up (merrimanr) closes apache/metron#1080
> 6 weeks ago METRON-1642: KafkaWriter should be able choose the topic from a
> field in addition to topology construction time closes
> apache/incubator-metron#1082
> 6 weeks ago METRON-1636: Fix broken unit test setup in metron-alerts closes
> apache/incubator-metron#1085
> 7 weeks ago METRON-1631 Alerts UI: Dash score does not show if only
> filtering by one group (sardell via merrimanr) closes apache/metron#1079
> 7 weeks ago METRON-1647 Fix logging level score closes
> apache/incubator-metron#1089
> 7 weeks ago METRON-1621: Sorting alerts table by score closes
> apache/incubator-metron#1088
> 7 weeks ago METRON-1619: Stellar empty collections should be considered
> false in boolean expressions closes apache/incubator-metron#1064
> 7 weeks ago METRON-1646 Sensor Stubs should work when kerberized
> (nickwallen) closes apache/metron#1087
> 7 weeks ago METRON-1645: Check wether the Solr management pack is installed
> before configuring the solr principal name. closes
> apache/incubator-metron#1086
> 7 weeks ago Merge branch 'master' into feature/METRON-1416-upgrade-solr
> 7 weeks ago METRON-1634 Alerts UI add comment doesnt immediately show
> up. (merrimanr) closes apache/metron#1077
> 7 weeks ago METRON-1489 Retrofit UI tests to run reliably during nightly QE
> runs (sardell via nickwallen) closes apache/metron#1004
> 7 weeks ago METRON-1637 Wrong path to escalate alert REST endpoint
> (merrimanr) closes apache/metron#1078
> 8 weeks ago METRON-1624 Set Profiler and Enrichment batch parameters in
> 

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Nick Allen
+1 to a 0.6.0 release that includes the Pcap Panel and Solr work.

+1 to doing a 0.2.0 release for metron-bro-plugin-kafka.  I *think* we need
to do the plugin release first, so that the 0.6.0 Metron release will point
to plugin 0.2.0.

FWIW, here are the changes since the last release.

6 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
via mmiklavc) closes apache/metron#1152
2 weeks ago METRON-1701 Update General notes on the installation of Pycapa
on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
3 weeks ago METRON-1650 Packaging docker containers are too large
(jameslamb via merrimanr) closes apache/metron#1091
3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
management pack repo info closes apache/incubator-metron#1052
3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
apache/incubator-metron#1126
3 weeks ago METRON-1694: Clean up Metron REST docs closes
apache/incubator-metron#1131
4 weeks ago METRON-1606 Add a wrap to incoming messages in the
metron json parser (ottobackwards) closes apache/metron#1054
4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
build process (justinleet) closes apache/metron#1106
4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
(justinleet) closes apache/metron#1110
4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
apache/metron#1099
4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
merrimanr) closes apache/metron#1095
4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
apache/metron#1107
4 weeks ago METRON-1620: Fixes for forensic clustering use case example
(mmiklavc via mmiklavc) closes apache/metron#1065
4 weeks ago METRON-1659: The platform-info.sh should check for the vagrant
hostmanager plugin closes apache/incubator-metron#1100
4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
apache/incubator-metron#1101
4 weeks ago METRON-1236 Add start/stop/restart commands that execute
successfully, when ambari agents run as non-root user closes
apache/incubator-metron#1105
4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive
closes apache/incubator-metron#1104
5 weeks ago METRON-1660 On Solr, sorting by threat score fails (justinleet)
closes apache/metron#1102
5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes
apache/metron#1097
5 weeks ago METRON-1644: Support parser chaining closes
apache/incubator-metron#1084
5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the 2nd
arg (ottobackwards) closes apache/metron#1098
6 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation closes
apache/incubator-metron#1083
6 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen) closes
apache/metron#1092
6 weeks ago METRON-1649 Intermittent Test Failure
ProfileBuilderBoltTest#testFlushExpiredProfiles
(nickwallen) closes apache/metron#1090
6 weeks ago METRON-1635 Alerts UI status update doesnt immediately
show up (merrimanr) closes apache/metron#1080
6 weeks ago METRON-1642: KafkaWriter should be able choose the topic from a
field in addition to topology construction time closes
apache/incubator-metron#1082
6 weeks ago METRON-1636: Fix broken unit test setup in metron-alerts closes
apache/incubator-metron#1085
7 weeks ago METRON-1631 Alerts UI: Dash score does not show if only
filtering by one group (sardell via merrimanr) closes apache/metron#1079
7 weeks ago METRON-1647 Fix logging level score closes
apache/incubator-metron#1089
7 weeks ago METRON-1621: Sorting alerts table by score closes
apache/incubator-metron#1088
7 weeks ago METRON-1619: Stellar empty collections should be considered
false in boolean expressions closes apache/incubator-metron#1064
7 weeks ago METRON-1646 Sensor Stubs should work when kerberized
(nickwallen) closes apache/metron#1087
7 weeks ago METRON-1645: Check wether the Solr management pack is installed
before configuring the solr principal name. closes
apache/incubator-metron#1086
7 weeks ago Merge branch 'master' into feature/METRON-1416-upgrade-solr
7 weeks ago METRON-1634 Alerts UI add comment doesnt immediately show
up. (merrimanr) closes apache/metron#1077
7 weeks ago METRON-1489 Retrofit UI tests to run reliably during nightly QE
runs (sardell via nickwallen) closes apache/metron#1004
7 weeks ago METRON-1637 Wrong path to escalate alert REST endpoint
(merrimanr) closes apache/metron#1078
8 weeks ago METRON-1624 Set Profiler and Enrichment batch parameters in
Ambari (nickwallen) closes apache/metron#1069
8 weeks ago Merge remote-tracking branch 'origin/master' into
feature/METRON-1416-upgrade-solr
8 weeks ago Merge branch 'master' into feature/METRON-1416-upgrade-solr
(nickwallen) closes apache/metron#1075
8 weeks ago METRON-1629 Update Solr documentation (merrimanr via
justinleet) closes apache/metron#1072
8 weeks ago METRON-1633 Incorrect instructions when merging PR into feature
branch (nickwallen) closes 

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Justin Leet
I was actually going to kick out another thread in a little bit around our
release schedule, it should be out shortly.

Good point on the metron-bro-plugin-kafka.  I'm in favor of putting out a
0.2.0 release of it simultaneously.

On Wed, Aug 15, 2018 at 9:48 AM zeo...@gmail.com  wrote:

> I agree - I would love to see a release not long after the PCAP FB gets
> into master, and 0.6.0 makes sense to me.
>
> I'd also like to see a 0.2 release of metron-bro-plugin-kafka.  There is
> one new commit, and I have a PR open which is waiting on some tests before
> it's ready to be evaluated/merged.  I will try to get that work done asap.
> As of right now metron's dev ansible scripts pin to a specific release of
> metron-bro-plugin-kafka (0.1
> <0.1
> https://github.com/apache/metron/blob/master/metron-deployment/ansible/roles/bro/vars/main.yml
> >),
> and I'm fine leaving that as is until after the coming release, but we
> could also do a metron-bro-plugin-kafka release first and then update
> metron to point the dev environment to the new package prior to the
> upcoming RC.
>
> I would also like to discuss what the roadmap looks like for a 1.0 release
> and perhaps a more regular release schedule.  I have some thoughts but
> don't want to hijack this thread.
>
> Jon
>
> On Wed, Aug 15, 2018 at 9:11 AM Justin Leet  wrote:
>
> > Hi all,
> >
> > It's been a little while since the last release, and a couple major items
> > have gone in since then (or are hopefully close to going in!).  In
> > particular, I'd personally like to see a release with our Solr work
> >  and the
> > close-to-completion PCAP Query Panel
> > .  There is a thread
> > <
> >
> https://lists.apache.org/thread.html/94ebc9be23f6f2ec8c53f8f6b71e97d6919baf415caf534e2b25ba9b@%3Cdev.metron.apache.org%3E
> > >
> > around what's left before merging the PCAP feature branch, I encourage
> you
> > to take a look. There are also some nice-to-haves as well as some Apache
> > cleanup around the RAT tool and typescript files
> > .
> >
> > Version Number
> > I'm proposing bumping to 0.6.0, in particular because of the Solr and
> PCAP
> > efforts. We can adjust that as necessary.
> >
> > I'm proposing we release this from the Metron master branch, plus any
> > commits the community considers necessary.  Note that I'm proposing that
> > this release occur after the PCAP feature branch is merged into master.
> >
> > Proposed Timeframe
> > I would tentatively like to start work on the RC Wednesday, September
> 5th.
> > It's a little further out than usual, but I wanted to kick off the
> > discussion before Labor Day and to give ongoing  time to settle. And also
> > because I'll be unavailable around Labor Day.
> >
> > JIRA Status
> > There are 31 open PRs at https://github.com/apache/metron/pulls. We
> should
> > work on getting anything we feel merits inclusion closed out. Please
> > respond with any tickets we'd like included.
> >
> > A couple of these are for the PCAP feature branch, and there will be at
> > least one more for documentation.
> >
> > There will be updates necessary to get our Jira up to date.  I'll follow
> up
> > on that, and ask that everyone double check their tickets.
> >
> > There have been 106 commits since the 0.5.0 release (listed at the end of
> > message). There will be a few more when we pull in the PCAP feature
> branch.
> >
> > Completed PRs as of Aug 15 as generated by git log --pretty="%cr %s"
> > tags/apache-metron-0.5.0-release..HEAD.
> >
> > 5 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> > via mmiklavc) closes apache/metron#1152
> > 13 days ago METRON-1701 Update General notes on the installation of
> Pycapa
> > on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
> > 3 weeks ago METRON-1650 Packaging docker containers are too large
> > (jameslamb via merrimanr) closes apache/metron#1091
> > 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
> > management pack repo info closes apache/incubator-metron#1052
> > 3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
> > apache/incubator-metron#1126
> > 3 weeks ago METRON-1694: Clean up Metron REST docs closes
> > apache/incubator-metron#1131
> > 4 weeks ago METRON-1606 Add a wrap to incoming messages in
> the
> > metron json parser (ottobackwards) closes apache/metron#1054
> > 4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
> > build process (justinleet) closes apache/metron#1106
> > 4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
> > (justinleet) closes apache/metron#1110
> > 4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
> > apache/metron#1099
> > 4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
> > merrimanr) closes apache/metron#1095
> > 4 weeks ago METRON-1673 Fix 

Re: [DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread zeo...@gmail.com
I agree - I would love to see a release not long after the PCAP FB gets
into master, and 0.6.0 makes sense to me.

I'd also like to see a 0.2 release of metron-bro-plugin-kafka.  There is
one new commit, and I have a PR open which is waiting on some tests before
it's ready to be evaluated/merged.  I will try to get that work done asap.
As of right now metron's dev ansible scripts pin to a specific release of
metron-bro-plugin-kafka (0.1
<0.1https://github.com/apache/metron/blob/master/metron-deployment/ansible/roles/bro/vars/main.yml>),
and I'm fine leaving that as is until after the coming release, but we
could also do a metron-bro-plugin-kafka release first and then update
metron to point the dev environment to the new package prior to the
upcoming RC.

I would also like to discuss what the roadmap looks like for a 1.0 release
and perhaps a more regular release schedule.  I have some thoughts but
don't want to hijack this thread.

Jon

On Wed, Aug 15, 2018 at 9:11 AM Justin Leet  wrote:

> Hi all,
>
> It's been a little while since the last release, and a couple major items
> have gone in since then (or are hopefully close to going in!).  In
> particular, I'd personally like to see a release with our Solr work
>  and the
> close-to-completion PCAP Query Panel
> .  There is a thread
> <
> https://lists.apache.org/thread.html/94ebc9be23f6f2ec8c53f8f6b71e97d6919baf415caf534e2b25ba9b@%3Cdev.metron.apache.org%3E
> >
> around what's left before merging the PCAP feature branch, I encourage you
> to take a look. There are also some nice-to-haves as well as some Apache
> cleanup around the RAT tool and typescript files
> .
>
> Version Number
> I'm proposing bumping to 0.6.0, in particular because of the Solr and PCAP
> efforts. We can adjust that as necessary.
>
> I'm proposing we release this from the Metron master branch, plus any
> commits the community considers necessary.  Note that I'm proposing that
> this release occur after the PCAP feature branch is merged into master.
>
> Proposed Timeframe
> I would tentatively like to start work on the RC Wednesday, September 5th.
> It's a little further out than usual, but I wanted to kick off the
> discussion before Labor Day and to give ongoing  time to settle. And also
> because I'll be unavailable around Labor Day.
>
> JIRA Status
> There are 31 open PRs at https://github.com/apache/metron/pulls. We should
> work on getting anything we feel merits inclusion closed out. Please
> respond with any tickets we'd like included.
>
> A couple of these are for the PCAP feature branch, and there will be at
> least one more for documentation.
>
> There will be updates necessary to get our Jira up to date.  I'll follow up
> on that, and ask that everyone double check their tickets.
>
> There have been 106 commits since the 0.5.0 release (listed at the end of
> message). There will be a few more when we pull in the PCAP feature branch.
>
> Completed PRs as of Aug 15 as generated by git log --pretty="%cr %s"
> tags/apache-metron-0.5.0-release..HEAD.
>
> 5 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
> via mmiklavc) closes apache/metron#1152
> 13 days ago METRON-1701 Update General notes on the installation of Pycapa
> on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
> 3 weeks ago METRON-1650 Packaging docker containers are too large
> (jameslamb via merrimanr) closes apache/metron#1091
> 3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
> management pack repo info closes apache/incubator-metron#1052
> 3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
> apache/incubator-metron#1126
> 3 weeks ago METRON-1694: Clean up Metron REST docs closes
> apache/incubator-metron#1131
> 4 weeks ago METRON-1606 Add a wrap to incoming messages in the
> metron json parser (ottobackwards) closes apache/metron#1054
> 4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
> build process (justinleet) closes apache/metron#1106
> 4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
> (justinleet) closes apache/metron#1110
> 4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
> apache/metron#1099
> 4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
> merrimanr) closes apache/metron#1095
> 4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
> apache/metron#1107
> 4 weeks ago METRON-1620: Fixes for forensic clustering use case example
> (mmiklavc via mmiklavc) closes apache/metron#1065
> 4 weeks ago METRON-1659: The platform-info.sh should check for the vagrant
> hostmanager plugin closes apache/incubator-metron#1100
> 4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
> apache/incubator-metron#1101
> 4 weeks ago METRON-1236 Add start/stop/restart commands that execute
> successfully, 

[DISCUSS] Metron Release 0.6.0?

2018-08-15 Thread Justin Leet
Hi all,

It's been a little while since the last release, and a couple major items
have gone in since then (or are hopefully close to going in!).  In
particular, I'd personally like to see a release with our Solr work
 and the
close-to-completion PCAP Query Panel
.  There is a thread

around what's left before merging the PCAP feature branch, I encourage you
to take a look. There are also some nice-to-haves as well as some Apache
cleanup around the RAT tool and typescript files
.

Version Number
I'm proposing bumping to 0.6.0, in particular because of the Solr and PCAP
efforts. We can adjust that as necessary.

I'm proposing we release this from the Metron master branch, plus any
commits the community considers necessary.  Note that I'm proposing that
this release occur after the PCAP feature branch is merged into master.

Proposed Timeframe
I would tentatively like to start work on the RC Wednesday, September 5th.
It's a little further out than usual, but I wanted to kick off the
discussion before Labor Day and to give ongoing  time to settle. And also
because I'll be unavailable around Labor Day.

JIRA Status
There are 31 open PRs at https://github.com/apache/metron/pulls. We should
work on getting anything we feel merits inclusion closed out. Please
respond with any tickets we'd like included.

A couple of these are for the PCAP feature branch, and there will be at
least one more for documentation.

There will be updates necessary to get our Jira up to date.  I'll follow up
on that, and ask that everyone double check their tickets.

There have been 106 commits since the 0.5.0 release (listed at the end of
message). There will be a few more when we pull in the PCAP feature branch.

Completed PRs as of Aug 15 as generated by git log --pretty="%cr %s"
tags/apache-metron-0.5.0-release..HEAD.

5 days ago METRON-1730: Update steps to run pycapa on Centos 6 (mmiklavc
via mmiklavc) closes apache/metron#1152
13 days ago METRON-1701 Update General notes on the installation of Pycapa
on Kerberized cluster (MohanDV via nickwallen) closes apache/metron#1136
3 weeks ago METRON-1650 Packaging docker containers are too large
(jameslamb via merrimanr) closes apache/metron#1091
3 weeks ago METRON-1604 : Add RHEL 7 power pc to OS family for the HCP
management pack repo info closes apache/incubator-metron#1052
3 weeks ago METRON-1687: Upgrade the rat plugin to 0.13-SNAPSHOT closes
apache/incubator-metron#1126
3 weeks ago METRON-1694: Clean up Metron REST docs closes
apache/incubator-metron#1131
4 weeks ago METRON-1606 Add a wrap to incoming messages in the
metron json parser (ottobackwards) closes apache/metron#1054
4 weeks ago METRON-1672 Add metron-alertss UI unit tests to travis
build process (justinleet) closes apache/metron#1106
4 weeks ago METRON-1684 Fix Markdown problems in 3rdPartyParser.md
(justinleet) closes apache/metron#1110
4 weeks ago METRON-1657 Parser aggregation in storm (justinleet) closes
apache/metron#1099
4 weeks ago METRON-1651 Fixing failing protractor e2e test (tiborm via
merrimanr) closes apache/metron#1095
4 weeks ago METRON-1673 Fix Javadoc errors (justinleet) closes
apache/metron#1107
4 weeks ago METRON-1620: Fixes for forensic clustering use case example
(mmiklavc via mmiklavc) closes apache/metron#1065
4 weeks ago METRON-1659: The platform-info.sh should check for the vagrant
hostmanager plugin closes apache/incubator-metron#1100
4 weeks ago METRON-1658: Upgrade bro to 2.5.4 closes
apache/incubator-metron#1101
4 weeks ago METRON-1236 Add start/stop/restart commands that execute
successfully, when ambari agents run as non-root user closes
apache/incubator-metron#1105
4 weeks ago METRON-1670: Stellar WEEK_OF_YEAR test is locale sensitive
closes apache/incubator-metron#1104
5 weeks ago METRON-1660 On Solr, sorting by threat score fails (justinleet)
closes apache/metron#1102
5 weeks ago METRON-1656 Create KAKFA_SEEK function (nickwallen) closes
apache/metron#1097
5 weeks ago METRON-1644: Support parser chaining closes
apache/incubator-metron#1084
5 weeks ago METRON-1655 Make REGEXP_MATCH take multiple regexs in the 2nd
arg (ottobackwards) closes apache/metron#1098
6 weeks ago METRON-1643: Create a REGEX_ROUTING field transformation closes
apache/incubator-metron#1083
6 weeks ago METRON-1652 Document X-Pack Common Problem (nickwallen) closes
apache/metron#1092
6 weeks ago METRON-1649 Intermittent Test Failure
ProfileBuilderBoltTest#testFlushExpiredProfiles (nickwallen) closes
apache/metron#1090
6 weeks ago METRON-1635 Alerts UI status update doesnt immediately
show up (merrimanr) closes apache/metron#1080
6 weeks ago METRON-1642: KafkaWriter should be able choose the topic from a
field in addition to topology construction time