Re: [Discuss] Samza 0.13.1 release

[Fred Haifeng Ji]

Here is the following-up for the discussion.

We got 6 yes and 0 no. Based on the result, we are going to cut a release
for 0.13.1 and including all tickets in the list for 0.13.1 (
https://issues.apache.org/jira/issues/?jql=project%20%3D%2012314526%20AND%20fixVersion%20%3D%2012340845%20ORDER%20BY%20priority%20DESC%2C%20key%20ASC).


I am going to send out a release vote once it is ready.

Thanks,

Fred

On Mon, Aug 14, 2017 at 11:18 AM, xinyu liu <xinyuliu...@gmail.com> wrote:

> +1. Thanks for pushing the release.
>
> Xinyu
>
> On Mon, Aug 14, 2017 at 10:58 AM, Boris S <bor...@gmail.com> wrote:
>
> > +1 for the release.
> >
> > On Mon, Aug 14, 2017 at 10:38 AM, Yi Pan <nickpa...@gmail.com> wrote:
> >
> > > +1 for the list! Let's proceed!
> > >
> > > On Fri, Aug 11, 2017 at 6:13 PM, Ignacio Solis <iso...@igso.net>
> wrote:
> > >
> > > > +1
> > > >
> > > > On Fri, Aug 11, 2017 at 3:52 PM, Jacob Maes <jacob.m...@gmail.com>
> > > wrote:
> > > > > Looks good!
> > > > >
> > > > > +1
> > > > >
> > > > > On Thu, Aug 10, 2017 at 6:53 PM, Jagadish Venkatraman <
> > > > > jagadish1...@gmail.com> wrote:
> > > > >
> > > > >> +1 for the release. thanks for the summary and for driving this
> > Fred!
> > > > >>
> > > > >> On Thu, Aug 10, 2017 at 5:15 PM Fred Haifeng Ji <
> > haifeng...@gmail.com
> > > >
> > > > >> wrote:
> > > > >>
> > > > >> > The format was messed up when sent from my yahoo mail to
> > > > >> > dev@samza.apache.org. I am resending it from my gmail account.
> > > Sorry
> > > > for
> > > > >> > inconvenience!
> > > > >> >
> > > > >> > Hi all,
> > > > >> >
> > > > >> > There have been some new features and critical bug fixes added
> to
> > > > master
> > > > >> > since 0.13.0 release, which makes Samza Standalone features more
> > > > stable.
> > > > >> It
> > > > >> > is now good enough to warrant *a new minor release*. We will
> > > continue
> > > > to
> > > > >> > test for stability and performance in the next few weeks.
> > > > >> >
> > > > >> > Here are the main JIRA tickets that will be included in this
> > release
> > > > (but
> > > > >> > not limited to):
> > > > >> > SAMZA-1165: Cleanup data created by ZkStandalone in ZK;
> > > > >> > SAMZA-1324: Add a metricsreporter lifecycle for JobCoordinator
> > > > component
> > > > >> of
> > > > >> > StreamProcessor;
> > > > >> > SAMZA-1336: Standalone session expiration propagation;
> > > > >> > SAMZA-1337: LocalApplicationRunner needs to support StreamTask;
> > > > >> > SAMZA-1339: Add standalone integration tests;
> > > > >> > …
> > > > >> >
> > > > >> > There are also quite a few bug fixes in 0.13.1, *please check
> the
> > > > >> complete
> > > > >> > list of changes in 0.13.1 here
> > > > >> > <
> > > > >> > https://issues.apache.org/jira/browse/SAMZA-1165?jql=
> > > > >> project%20%3D%2012314526%20AND%20fixVersion%20%3D%
> > > > 2012340845%20ORDER%20BY%
> > > > >> 20priority%20DESC%2C%20key%20ASC
> > > > >> > >*
> > > > >> > .
> > > > >> >
> > > > >> > Most JIRAs in the list have been completed and merged, with the
> > > > following
> > > > >> > one remaining, but we should try to get it completed before
> 0.13.1
> > > is
> > > > >> > released.
> > > > >> > SAMZA-1385: Coordination utils in LocalApplicationRunner uses
> same
> > > Zk
> > > > >> node
> > > > >> > as ZkJobCoordinatorFactory for leader election
> > > > >> >
> > > > >> > Here's what I propose:
> > > > >> > 1. Cut an 0.13.1 release branch.
> > > > >> > 2. Work on getting the remaining open JIRA done.
> > > > >> > 3. Target a release vote by Aug 18.
> > > > >> >
> > > > >> > Thoughts?
> > > > >> >
> > > > >> > Fred
> > > > >> >
> > > > >> --
> > > > >> Sent from my iphone.
> > > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Nacho - Ignacio Solis - iso...@igso.net
> > > >
> > >
> >
>



-- 
Haifeng (Fred)  Ji

Re: [Discuss] Samza 0.13.1 release

[Fred Haifeng Ji]

The format was messed up when sent from my yahoo mail to
dev@samza.apache.org. I am resending it from my gmail account. Sorry for
inconvenience!

Hi all,

There have been some new features and critical bug fixes added to master
since 0.13.0 release, which makes Samza Standalone features more stable. It
is now good enough to warrant *a new minor release*. We will continue to
test for stability and performance in the next few weeks.

Here are the main JIRA tickets that will be included in this release (but
not limited to):
SAMZA-1165: Cleanup data created by ZkStandalone in ZK;
SAMZA-1324: Add a metricsreporter lifecycle for JobCoordinator component of
StreamProcessor;
SAMZA-1336: Standalone session expiration propagation;
SAMZA-1337: LocalApplicationRunner needs to support StreamTask;
SAMZA-1339: Add standalone integration tests;
…

There are also quite a few bug fixes in 0.13.1, *please check the complete
list of changes in 0.13.1 here
*
.

Most JIRAs in the list have been completed and merged, with the following
one remaining, but we should try to get it completed before 0.13.1 is
released.
SAMZA-1385: Coordination utils in LocalApplicationRunner uses same Zk node
as ZkJobCoordinatorFactory for leader election

Here's what I propose:
1. Cut an 0.13.1 release branch.
2. Work on getting the remaining open JIRA done.
3. Target a release vote by Aug 18.

Thoughts?

Fred

[VOTE] Apache Samza 0.13.1 RC0

[Fred Haifeng Ji]

This is a call for a vote on a release of Apache Samza 0.13.1. Thanks to
everyone who has contributed to this release.

The release candidate can be downloaded from here:
http://home.apache.org/~navina/samza-0.13.1-rc0/


The release candidate is signed with pgp key A211312E, which can be found
on keyservers:
http://pgp.mit.edu/pks/lookup?op=get=0xEDFD8F9AA211312E


The git tag is release-0.13.1-rc0 and signed with the same pgp key:
https://git-wip-us.apache.org/repos/asf?p=samza.git;a=tag;h=
refs/tags/release-0.13.1-rc0

Test binaries have been published to Maven's staging repository, and are
available here:
*https://repository.apache.org/content/repositories/orgapachesamza-1030/
*


29 issues were resolved for this release: https://issues.apache
.org/jira/issues/?jql=project%20%3D%2012314526%20AND%20fixVe
rsion%20%3D%2012340845%20ORDER%20BY%20priority%20DESC%2C%20key%20ASC


The vote will be open for 72 hours (ending at 1:00PM Monday, 08/21/2017).

Please download the release candidate, check the hashes/signature, build it
and test it, and then please vote:


[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove (and reason why)


-- 
Fred Ji

Re: [VOTE] Apache Samza 0.13.1 RC0

[Fred Haifeng Ji]

Thanks to those who already tested the RC and voted.

Due to the weekend and the eclipse day, we are extending the vote till 1pm
Wednesday 8/23.

Thanks,

Fred

On Tue, Aug 22, 2017 at 9:59 AM, Jagadish Venkatraman <
jagadish1...@gmail.com> wrote:

> Ran check-all.sh, and it succeeded!
>
> +1 (non binding)
>
> On Mon, Aug 21, 2017 at 4:34 PM, xinyu liu <xinyuliu...@gmail.com> wrote:
>
> > Built the src, and ran the tests using check-all.sh. Most of the tests
> ran
> > fine. There was an transient test failure (
> > https://issues.apache.org/jira/browse/SAMZA-1405), which seems to be
> > caused
> > by the testing env (further investigation needed). I reran the tests
> again
> > and it passed. Since this test doesn't affect the build itself, I am +1
> > (non-binding).
> >
> > Thanks,
> > Xinyu
> >
> > On Mon, Aug 21, 2017 at 2:24 PM, Yi Pan <nickpa...@gmail.com> wrote:
> >
> > > Downloaded the source, compiled and ran the integration tests. All
> > passed.
> > >
> > > +1 (binding) w/ the following minor comments:
> > > # Please make a note in the release note that this version requires JDK
> > > 1.8.0.112+ (I have test w/ JDK 1.8.0.121)
> > > # Please make sure that we publish artifacts compiled w/ Scala 2.10,
> > Scala
> > > 2.11, and Scala 2.12
> > >
> > > -Yi
> > >
> > > On Fri, Aug 18, 2017 at 11:59 AM, Fred Haifeng Ji <
> haifeng...@gmail.com>
> > > wrote:
> > >
> > > > This is a call for a vote on a release of Apache Samza 0.13.1. Thanks
> > to
> > > > everyone who has contributed to this release.
> > > >
> > > > The release candidate can be downloaded from here:
> > > > http://home.apache.org/~navina/samza-0.13.1-rc0/
> > > >
> > > >
> > > > The release candidate is signed with pgp key A211312E, which can be
> > found
> > > > on keyservers:
> > > > http://pgp.mit.edu/pks/lookup?op=get=0xEDFD8F9AA211312E
> > > >
> > > >
> > > > The git tag is release-0.13.1-rc0 and signed with the same pgp key:
> > > > https://git-wip-us.apache.org/repos/asf?p=samza.git;a=tag;h=
> > > > refs/tags/release-0.13.1-rc0
> > > >
> > > > Test binaries have been published to Maven's staging repository, and
> > are
> > > > available here:
> > > > *https://repository.apache.org/content/repositories/
> > orgapachesamza-1030/
> > > > <https://repository.apache.org/content/repositories/
> > orgapachesamza-1030/
> > > >*
> > > >
> > > >
> > > > 29 issues were resolved for this release: https://issues.apache
> > > > .org/jira/issues/?jql=project%20%3D%2012314526%20AND%20fixVe
> > > > rsion%20%3D%2012340845%20ORDER%20BY%20priority%20DESC%2C%20key%20ASC
> > > >
> > > >
> > > > The vote will be open for 72 hours (ending at 1:00PM Monday,
> > 08/21/2017).
> > > >
> > > > Please download the release candidate, check the hashes/signature,
> > build
> > > it
> > > > and test it, and then please vote:
> > > >
> > > >
> > > > [ ] +1 approve
> > > >
> > > > [ ] +0 no opinion
> > > >
> > > > [ ] -1 disapprove (and reason why)
> > > >
> > > >
> > > > --
> > > > Fred Ji
> > > >
> > >
> >
>
>
>
> --
> Jagadish V,
> Graduate Student,
> Department of Computer Science,
> Stanford University
>



-- 
Haifeng (Fred)  Ji

Re: [VOTE] Apache Samza 0.13.1 RC0

[Fred Haifeng Ji]

+cc nav...@apache.org

On Tue, Aug 22, 2017 at 11:19 AM, Fred Haifeng Ji <haifeng...@gmail.com>
wrote:

> Thanks to those who already tested the RC and voted.
>
> Due to the weekend and the eclipse day, we are extending the vote till 1pm
> Wednesday 8/23.
>
> Thanks,
>
> Fred
>
> On Tue, Aug 22, 2017 at 9:59 AM, Jagadish Venkatraman <
> jagadish1...@gmail.com> wrote:
>
>> Ran check-all.sh, and it succeeded!
>>
>> +1 (non binding)
>>
>> On Mon, Aug 21, 2017 at 4:34 PM, xinyu liu <xinyuliu...@gmail.com> wrote:
>>
>> > Built the src, and ran the tests using check-all.sh. Most of the tests
>> ran
>> > fine. There was an transient test failure (
>> > https://issues.apache.org/jira/browse/SAMZA-1405), which seems to be
>> > caused
>> > by the testing env (further investigation needed). I reran the tests
>> again
>> > and it passed. Since this test doesn't affect the build itself, I am +1
>> > (non-binding).
>> >
>> > Thanks,
>> > Xinyu
>> >
>> > On Mon, Aug 21, 2017 at 2:24 PM, Yi Pan <nickpa...@gmail.com> wrote:
>> >
>> > > Downloaded the source, compiled and ran the integration tests. All
>> > passed.
>> > >
>> > > +1 (binding) w/ the following minor comments:
>> > > # Please make a note in the release note that this version requires
>> JDK
>> > > 1.8.0.112+ (I have test w/ JDK 1.8.0.121)
>> > > # Please make sure that we publish artifacts compiled w/ Scala 2.10,
>> > Scala
>> > > 2.11, and Scala 2.12
>> > >
>> > > -Yi
>> > >
>> > > On Fri, Aug 18, 2017 at 11:59 AM, Fred Haifeng Ji <
>> haifeng...@gmail.com>
>> > > wrote:
>> > >
>> > > > This is a call for a vote on a release of Apache Samza 0.13.1.
>> Thanks
>> > to
>> > > > everyone who has contributed to this release.
>> > > >
>> > > > The release candidate can be downloaded from here:
>> > > > http://home.apache.org/~navina/samza-0.13.1-rc0/
>> > > >
>> > > >
>> > > > The release candidate is signed with pgp key A211312E, which can be
>> > found
>> > > > on keyservers:
>> > > > http://pgp.mit.edu/pks/lookup?op=get=0xEDFD8F9AA211312E
>> > > >
>> > > >
>> > > > The git tag is release-0.13.1-rc0 and signed with the same pgp key:
>> > > > https://git-wip-us.apache.org/repos/asf?p=samza.git;a=tag;h=
>> > > > refs/tags/release-0.13.1-rc0
>> > > >
>> > > > Test binaries have been published to Maven's staging repository, and
>> > are
>> > > > available here:
>> > > > *https://repository.apache.org/content/repositories/
>> > orgapachesamza-1030/
>> > > > <https://repository.apache.org/content/repositories/
>> > orgapachesamza-1030/
>> > > >*
>> > > >
>> > > >
>> > > > 29 issues were resolved for this release: https://issues.apache
>> > > > .org/jira/issues/?jql=project%20%3D%2012314526%20AND%20fixVe
>> > > > rsion%20%3D%2012340845%20ORDER%20BY%20priority%20DESC%2C%
>> 20key%20ASC
>> > > >
>> > > >
>> > > > The vote will be open for 72 hours (ending at 1:00PM Monday,
>> > 08/21/2017).
>> > > >
>> > > > Please download the release candidate, check the hashes/signature,
>> > build
>> > > it
>> > > > and test it, and then please vote:
>> > > >
>> > > >
>> > > > [ ] +1 approve
>> > > >
>> > > > [ ] +0 no opinion
>> > > >
>> > > > [ ] -1 disapprove (and reason why)
>> > > >
>> > > >
>> > > > --
>> > > > Fred Ji
>> > > >
>> > >
>> >
>>
>>
>>
>> --
>> Jagadish V,
>> Graduate Student,
>> Department of Computer Science,
>> Stanford University
>>
>
>
>
> --
> Haifeng (Fred)  Ji
>



-- 
Haifeng (Fred)  Ji

[RESULT][VOTE] Apache Samza 0.13.1 RC0

[Fred Haifeng Ji]

The vote of 0.13.1 RC0 has been more than 72 hours and we got +1 (binding)
x 3 and +1 (non-binding) x 3.

Samza 0.13.1 officially passed the VOTE!

Thanks!

Fred

Samza 0.13.1 officially released

[Fred Haifeng Ji]

Hi, all,

I am pleased to let you know that we have officially released Samza 0.13.1!

Huge thanks to everyone for working on the features and bugs in this
release, and cooperating in the release process.

Here is the announcement blog:
https://blogs.apache.org/samza/

Cheers!

Fred

Re: [DISCUSS] Samza 0.14.0 release

[Fred Haifeng Ji]

+1! Thanks Bharath!

Fred

On Mon, Nov 27, 2017 at 11:10 AM, Yi Pan  wrote:

> Thanks for driving this! +1
>
> A few minor things that are pending that I think we should pull in:
> 1) https://issues.apache.org/jira/browse/SAMZA-1459
> 2) https://github.com/apache/samza/pull/302
> 3) https://github.com/apache/samza/pull/301
> 4) https://github.com/apache/samza/pull/286
> 5) https://issues.apache.org/jira/browse/SAMZA-1406
> 6) https://issues.apache.org/jira/browse/SAMZA-1356
> 7) https://github.com/apache/samza/pull/10
> 8) https://github.com/apache/samza/pull/7
>
> Let's pull in the patches that are ready as well.
>
> Thanks!
>
> On Mon, Nov 27, 2017 at 10:45 AM, Debraj Manna 
> wrote:
>
> > +1
> >
> > On Mon, Nov 27, 2017 at 11:32 PM, xinyu liu 
> wrote:
> >
> > > +1.
> > >
> > > Very happy to see a lot of important features added in this release.
> > >
> > > Thanks,
> > > Xinyu
> > >
> > > On Mon, Nov 27, 2017 at 10:00 AM, Jagadish Venkatraman <
> > > jagad...@apache.org>
> > > wrote:
> > >
> > > > +1 from my side.
> > > >
> > > > Thank you Bharath for driving the release!
> > > >
> > > >
> > > >
> > > > On Mon, Nov 27, 2017 at 9:50 AM, Bharath Kumara Subramanian <
> > > > codin.mart...@gmail.com> wrote:
> > > >
> > > > > Hi all,
> > > > >
> > > > >
> > > > >
> > > > > We have added couple of major features to master since 0.13.1 that
> > > > warrants
> > > > > a major release.
> > > > >
> > > > > Within LinkedIn, some of these features have already been tested as
> > > part
> > > > of
> > > > > our test suites. We plan to continue our testing in coming weeks to
> > > > > validate the stability prior to release.
> > > > >
> > > > > We wanted to kick off the discussion in open source forum to keep
> the
> > > > > momentum flowing.
> > > > >
> > > > >
> > > > >
> > > > > Here is the list of features that are part of the new release
> > > > >
> > > > >- SAMZA-1510 
> -
> > > > Samza
> > > > >SQL
> > > > >- SAMZA-1417 
> -
> > > Add
> > > > >support for multistage batch to Samza on Hadoop
> > > > >- SAMZA-1438 
> -
> > > > > Event-hub
> > > > >connectors for Samza
> > > > >
> > > > >
> > > > >
> > > > > We have also worked on stabilizing our 0.13 features. Here are some
> > > > > highlights
> > > > >
> > > > >- SAMZA-1454  >,
> > > > >SAMZA-1493  -
> > Add
> > > > >support for durable state for high level API
> > > > >- SAMZA-1417 
> > > > >SAMZA-1330 
> > > > > SAMZA-1289
> > > > > -
> > Stabilization
> > > of
> > > > >ZooKeeper based deployment model
> > > > >- SAMZA-1471  >,
> > > > >SAMZA-1392 ,
> > > > > SAMZA-1465
> > > > > -
> Performance
> > > > >improvements
> > > > >
> > > > >
> > > > >
> > > > > You can find the concrete list of the features here
> > > > >  > > > > project%20%3D%20samza%20AND%20fixVersion%20%3D%200.14.0%
> > > > > 20AND%20resolution%20%3D%20fixed>
> > > > > .
> > > > >
> > > > >
> > > > >
> > > > > Here is my proposal on our release schedule and timelines.
> > > > >
> > > > >1. Create a release candidate with the current 0.14.0 HEAD
> > > > >2. Target a release vote on the week Dec 4st
> > > > >
> > > > >
> > > > >
> > > > > Thoughts?
> > > > >
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Bharath
> > > > >
> > > >
> > >
> >
>



-- 
Haifeng (Fred)  Ji

Re: [VOTE] SEP-12: Integration Test Framework

[Fred Haifeng Ji]

+1

On Thu, May 17, 2018 at 11:54 AM, santhosh venkat <
santhoshvenkat1...@gmail.com> wrote:

> +1.
>
> Thanks.
>
> On Thu, May 17, 2018 at 10:13 AM, Jacob Maes  wrote:
>
> > +1
> >
> > On Thu, May 17, 2018 at 9:56 AM, Jagadish Venkatraman <
> > jagadish1...@gmail.com> wrote:
> >
> > > Thanks Sanil for the proposal. This will go a long way in simplifying
> > > testing of Samza applications.
> > >
> > > +1 (binding)
> > >
> > >
> > >
> > > On Thu, May 17, 2018 at 9:45 AM, Daniel Nishimura <
> dnishim...@gmail.com>
> > > wrote:
> > >
> > > > +1
> > > >
> > > > Looks great!
> > > >
> > > > On Thu, May 17, 2018 at 9:08 AM, Xinyu Liu 
> > > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > The proposal looks great to me. Look forward to seeing the
> > > > implementation.
> > > > >
> > > > > Thanks,
> > > > > Xinyu
> > > > >
> > > > > On Wed, May 16, 2018 at 6:12 PM, Sanil Jain <
> sanil.jai...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > This is a call for a vote for Samza's Integration Test Framework
> as
> > > > > > described by:
> > > > > >
> > > > > > https://cwiki.apache.org/confluence/display/SAMZA/SEP-
> > > > > > 12%3A+Integration+Test+Framework
> > > > > >
> > > > > > The vote will be open for 3 days (ending at 6:00PM Monday,
> > > 05/21/2018).
> > > > > >
> > > > > > Link to the discuss mailing thread:
> > > > > >
> > > > > > http://mail-archives.apache.org/mod_mbox/samza-dev/201805.mbox/%
> > > > > > 3CDM5PR21MB02827A6FA9F47CB8EF99A339A2810%40DM5PR21MB0282.
> > > > > > namprd21.prod.outlook.com%3E
> > > > > >
> > > > > >
> > > > > > Please vote:
> > > > > >
> > > > > > [ ] +1 approve
> > > > > >
> > > > > > [ ] +0 no opinion
> > > > > >
> > > > > > [ ] -1 disapprove (and reason why)
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Jagadish V,
> > > Graduate Student,
> > > Department of Computer Science,
> > > Stanford University
> > >
> >
>



-- 
Haifeng (Fred)  Ji