[GitHub] samza pull request #525: SAMZA-1718: Simplify management of Zookeeper coordi...

2018-05-16 Thread vjagadish
GitHub user vjagadish opened a pull request:

https://github.com/apache/samza/pull/525

SAMZA-1718: Simplify management of Zookeeper coordination state

1. Currently coordination related state is spread across several Zookeeper 
classes. There are also back-and-forth flows that exist between the 
ZkJobCoordinator, ZkControllerImpl, ZkControllerListener and ZkLeaderElector. 
This PR nukes un-necessary interfaces (and their implementation classes), 
simplifies state management and unifies state in the ZkJobCoordinator class. 

2. Clearly defined life-cycle hooks on events: 
- Protocol validations happen once during the lifecycle of a 
StreamProcessor (instead of each new session)
- New subscriptions to listeners happen at each a new Zk session


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/vjagadish1989/samza zk-simplify

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/samza/pull/525.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #525


commit bc11712ad090e93b8dc767659fff628e8b9ccd8f
Author: Jagadish 
Date:   2018-05-04T20:59:01Z

Fix NPE in ClusterResourceManager

commit 6b05f8dd643d7b8c308412ea48bde80346b011e1
Author: Jagadish 
Date:   2018-05-07T20:42:44Z

Merge branch 'master' of https://github.com/apache/samza

commit 8269d0bfaf50491d4756a9a35501c4980d8450e6
Author: Jagadish 
Date:   2018-05-08T17:40:13Z

Merge branch 'master' of https://github.com/apache/samza

commit 1e8558aef3a145e20c15a9787726dfa312b61666
Author: Jagadish 
Date:   2018-05-17T04:08:22Z

Merge branch 'master' of https://github.com/apache/samza

commit b3754ead688bafdc70df813e69b947fe20605d73
Author: Jagadish 
Date:   2018-05-17T05:20:19Z

Merge branch 'master' of https://github.com/apache/samza

commit ef1d5bf6c432ebee135e5bc84032f8cf4e7314bf
Author: Jagadish 
Date:   2018-05-17T05:30:40Z

Simplify management of Zookeeper coordination state




---


[GitHub] samza pull request #523: SAMZA-1715: Unit test for Kafka admin deletedMessag...

2018-05-16 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/samza/pull/523


---


[VOTE] SEP-12: Integration Test Framework

2018-05-16 Thread Sanil Jain
Hi All,

This is a call for a vote for Samza's Integration Test Framework as
described by:

https://cwiki.apache.org/confluence/display/SAMZA/SEP-
12%3A+Integration+Test+Framework

The vote will be open for 3 days (ending at 6:00PM Monday, 05/21/2018).

Link to the discuss mailing thread:

http://mail-archives.apache.org/mod_mbox/samza-dev/201805.mbox/%
3CDM5PR21MB02827A6FA9F47CB8EF99A339A2810%40DM5PR21MB0282.
namprd21.prod.outlook.com%3E


Please vote:

[ ] +1 approve

[ ] +0 no opinion

[ ] -1 disapprove (and reason why)

Thanks


[GitHub] samza pull request #524: table-api: Add caching support

2018-05-16 Thread pdu-mn1
GitHub user pdu-mn1 opened a pull request:

https://github.com/apache/samza/pull/524

table-api: Add caching support

This change adds caching support for Samza tables. This is especially
useful for remote table where the accesses can have high latency for
applications that can tolerate staleness. Caching is added in the form
of a composite table that wraps the actual table and a cache. We reuse
the ReadWriteTable interface for the cache. A simple Guava cache-based
table is provided in this change.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/pdu-mn1/samza table-cache

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/samza/pull/524.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #524


commit 5d9384032df3068dbe8d28f59d627aa22d5572ed
Author: Peng Du 
Date:   2018-05-14T21:32:26Z

table-api: Add caching support

This change adds caching support for Samza tables. This is especially
useful for remote table where the accesses can have high latency for
applications that can tolerate staleness. Caching is added in the form
of a composite table that wraps the actual table and a cache. We reuse
the ReadWriteTable interface for the cache. A simple Guava cache-based
table is provided in this change.




---


Re: [VOTE] Apache Samza 0.14.1 RC1

2018-05-16 Thread Xinyu Liu
A reminder to download the build and vote for it. Since we are passing the
end date for the vote, let's extend to tomorrow 12pm.

For me, I ran the check-all.sh and integration tests on Linux REHL7 and all
tests passed. So +1 (binding) from my side.

Thanks,
Xinyu

On Thu, May 10, 2018 at 2:44 PM, Xinyu Liu  wrote:

> Hi, All,
>
> This is a call for a vote on a release of Apache Samza 0.14.1. Thanks to
> everyone who has contributed to this release.
>
> The release candidate can be downloaded from here:
> http://home.apache.org/~xinyu/samza-0.14.1-rc1/
>
> The release candidate is signed with pgp key C31D7061, which can be found
> on keyservers: http://pgp.mit.edu/pks/lookup?op=get&search=0xC31D7061
>
> The git tag is release-0.14.1-rc0 and signed with the same pgp key:
> https://git-wip-us.apache.org/repos/asf?p=samza.
> git;a=tag;h=refs/tags/release-0.14.1-rc1
>
> Test binaries have been published to Maven's staging repository, and are
> available here: https://repository.apache.org/content/
> repositories/orgapachesamza-1047/
>
> 46 issues were resolved for this release: https://issues.
> apache.org/jira/projects/SAMZA/versions/12343155
>
> The vote will be open for 72 hours (ending at 3:00PM Tuesday, 05/15/2018).
>
> Please download the release candidate, check the hashes/signature, build
> it and test it, and then please vote:
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove (and reason why)
>
> Thanks,
> Xinyu
>
>