[GitHub] samza pull request #525: SAMZA-1718: Simplify management of Zookeeper coordi...
GitHub user vjagadish opened a pull request: https://github.com/apache/samza/pull/525 SAMZA-1718: Simplify management of Zookeeper coordination state 1. Currently coordination related state is spread across several Zookeeper classes. There are also back-and-forth flows that exist between the ZkJobCoordinator, ZkControllerImpl, ZkControllerListener and ZkLeaderElector. This PR nukes un-necessary interfaces (and their implementation classes), simplifies state management and unifies state in the ZkJobCoordinator class. 2. Clearly defined life-cycle hooks on events: - Protocol validations happen once during the lifecycle of a StreamProcessor (instead of each new session) - New subscriptions to listeners happen at each a new Zk session You can merge this pull request into a Git repository by running: $ git pull https://github.com/vjagadish1989/samza zk-simplify Alternatively you can review and apply these changes as the patch at: https://github.com/apache/samza/pull/525.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #525 commit bc11712ad090e93b8dc767659fff628e8b9ccd8f Author: Jagadish Date: 2018-05-04T20:59:01Z Fix NPE in ClusterResourceManager commit 6b05f8dd643d7b8c308412ea48bde80346b011e1 Author: Jagadish Date: 2018-05-07T20:42:44Z Merge branch 'master' of https://github.com/apache/samza commit 8269d0bfaf50491d4756a9a35501c4980d8450e6 Author: Jagadish Date: 2018-05-08T17:40:13Z Merge branch 'master' of https://github.com/apache/samza commit 1e8558aef3a145e20c15a9787726dfa312b61666 Author: Jagadish Date: 2018-05-17T04:08:22Z Merge branch 'master' of https://github.com/apache/samza commit b3754ead688bafdc70df813e69b947fe20605d73 Author: Jagadish Date: 2018-05-17T05:20:19Z Merge branch 'master' of https://github.com/apache/samza commit ef1d5bf6c432ebee135e5bc84032f8cf4e7314bf Author: Jagadish Date: 2018-05-17T05:30:40Z Simplify management of Zookeeper coordination state ---
[GitHub] samza pull request #523: SAMZA-1715: Unit test for Kafka admin deletedMessag...
Github user asfgit closed the pull request at: https://github.com/apache/samza/pull/523 ---
[VOTE] SEP-12: Integration Test Framework
Hi All, This is a call for a vote for Samza's Integration Test Framework as described by: https://cwiki.apache.org/confluence/display/SAMZA/SEP- 12%3A+Integration+Test+Framework The vote will be open for 3 days (ending at 6:00PM Monday, 05/21/2018). Link to the discuss mailing thread: http://mail-archives.apache.org/mod_mbox/samza-dev/201805.mbox/% 3CDM5PR21MB02827A6FA9F47CB8EF99A339A2810%40DM5PR21MB0282. namprd21.prod.outlook.com%3E Please vote: [ ] +1 approve [ ] +0 no opinion [ ] -1 disapprove (and reason why) Thanks
[GitHub] samza pull request #524: table-api: Add caching support
GitHub user pdu-mn1 opened a pull request: https://github.com/apache/samza/pull/524 table-api: Add caching support This change adds caching support for Samza tables. This is especially useful for remote table where the accesses can have high latency for applications that can tolerate staleness. Caching is added in the form of a composite table that wraps the actual table and a cache. We reuse the ReadWriteTable interface for the cache. A simple Guava cache-based table is provided in this change. You can merge this pull request into a Git repository by running: $ git pull https://github.com/pdu-mn1/samza table-cache Alternatively you can review and apply these changes as the patch at: https://github.com/apache/samza/pull/524.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #524 commit 5d9384032df3068dbe8d28f59d627aa22d5572ed Author: Peng Du Date: 2018-05-14T21:32:26Z table-api: Add caching support This change adds caching support for Samza tables. This is especially useful for remote table where the accesses can have high latency for applications that can tolerate staleness. Caching is added in the form of a composite table that wraps the actual table and a cache. We reuse the ReadWriteTable interface for the cache. A simple Guava cache-based table is provided in this change. ---
Re: [VOTE] Apache Samza 0.14.1 RC1
A reminder to download the build and vote for it. Since we are passing the end date for the vote, let's extend to tomorrow 12pm. For me, I ran the check-all.sh and integration tests on Linux REHL7 and all tests passed. So +1 (binding) from my side. Thanks, Xinyu On Thu, May 10, 2018 at 2:44 PM, Xinyu Liu wrote: > Hi, All, > > This is a call for a vote on a release of Apache Samza 0.14.1. Thanks to > everyone who has contributed to this release. > > The release candidate can be downloaded from here: > http://home.apache.org/~xinyu/samza-0.14.1-rc1/ > > The release candidate is signed with pgp key C31D7061, which can be found > on keyservers: http://pgp.mit.edu/pks/lookup?op=get&search=0xC31D7061 > > The git tag is release-0.14.1-rc0 and signed with the same pgp key: > https://git-wip-us.apache.org/repos/asf?p=samza. > git;a=tag;h=refs/tags/release-0.14.1-rc1 > > Test binaries have been published to Maven's staging repository, and are > available here: https://repository.apache.org/content/ > repositories/orgapachesamza-1047/ > > 46 issues were resolved for this release: https://issues. > apache.org/jira/projects/SAMZA/versions/12343155 > > The vote will be open for 72 hours (ending at 3:00PM Tuesday, 05/15/2018). > > Please download the release candidate, check the hashes/signature, build > it and test it, and then please vote: > > [ ] +1 approve > > [ ] +0 no opinion > > [ ] -1 disapprove (and reason why) > > Thanks, > Xinyu > >