GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/2846
[WIP]: Exactly once transactional coordinator You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka exactly-once-transactional-coordinator Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/2846.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2846 ---- commit 40fa5f01866da411f1631c520ac6400a6ea9b6ba Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-02T01:42:49Z Transaction log message format (#134) * add transaction log message format * add transaction timeout to initPid request * collapse to one message type commit 1b2df91b19dacf2cd8a5548c86b227104e8bbc67 Author: hachikuji <ja...@confluent.io> Date: 2017-03-07T00:40:53Z Implement FindCoordinatorRequest for transaction coordinator (#140) commit 7a681649ec14e4b00df734fe584bd9dbb955e379 Author: hachikuji <ja...@confluent.io> Date: 2017-03-08T07:00:19Z Exactly once transactions request types (#141) commit a9c32758592112750569f7fd41b538e7500dc959 Author: Apurva Mehta <apu...@confluent.io> Date: 2017-03-15T20:47:25Z Fix build and test errors due to reabse onto idempotent-producer branch commit 20701f17c20e8121d125bdc11008fb9407f54d11 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-17T05:40:49Z Transaction log partition Immigration and Emigration (#142) * sub-package transaction and group classes within coordinator * add loading and cleaning up logic * add transaction configs commit 711657e3b3dead9c7612965def930d01daea6592 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-21T04:38:35Z Add transactions broker configs (#146) * add all broker-side configs * check for transaction timeout value * added one more exception type commit bb5c14fd2473abc1b340fcd6d3c5d0dbd787f4a4 Author: Apurva Mehta <apurva.1...@gmail.com> Date: 2017-03-30T22:13:11Z CPKAFKA-465 : Implement READ_COMMITTED mode in the KafkaConsumer (#145) commit 109ee0e4e7605f92885f6f1994c4efddb42bcc50 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-31T22:20:05Z Handle addPartitions and addOffsets on TC (#147) * handling add offsets to txn * add a pending state with prepareTransition / completeTransaction / abortTransition of state * refactor handling logic for multiple in-flight requests commit 846ea79a109e3cb9912832c2a9ed77700b066ef7 Author: Apurva Mehta <apu...@confluent.io> Date: 2017-04-03T21:17:25Z Fix test errors after rebase: 1. Notable conflicts are with the small API changes to DelayedOperation and the newly introduced purgeDataBefore PR. 2. Jason's update to support streaming decompression required a bit of an overhaul to the way we handle aborted transactions on the consumer. commit 8596871dd8794058fd124f8bbe722c99f0443cac Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-24T18:46:14Z change write txn request protocol commit a2995e1f449e297ff2fcd10ceb1f617e7a343f65 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-24T22:42:53Z fix unit tests commit a4765159028f920f7160e3617dcabee74a7e1981 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-24T22:52:37Z add sender thread commit 511d509069fb30f72d0ef394ab9ba23daf866d19 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-28T01:04:53Z rename TC Send Thread to general inter-broker send thread commit 135c0009db4df8d39a50a6e232b98aff3dbdf057 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-29T21:58:45Z add tc channel manager commit ca1ee8a701a6f353baa4fe0450ee1220f276baac Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-29T21:59:26Z missing files commit f98b6addeaf7f7aae11031700f920d8ab214c992 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-31T22:15:37Z add the txn marker channel manager commit fcc48e52a686418aef7573cf54167976aaea2018 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-05T16:09:27Z fix compilation errors commit 46c5ea238589eba58fab840d6025d95b9381c5e9 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-10T10:58:43Z integrate EndTxnRequest commit 7f53430e6febd5a8bc4ab479eb08b2df8d4d14fc Author: Damian Guy <damian....@gmail.com> Date: 2017-04-10T13:43:40Z add test fo InterBrokerSendThread. Refactor to use delegation rather than inheritance commit 76532ed936a8ca61af4a055d1fb5f65020e4e9b5 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-10T16:24:24Z refactor TransactionMarkerChannelManager. Add some test commit 62cdf3a47e3cf430fc18e093b7f91dfed71d9dd3 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-10T18:25:57Z more tests commit ec72f8cda2cbbd6c1887c7c427392e2387ae8c5a Author: Damian Guy <damian....@gmail.com> Date: 2017-04-11T09:23:36Z remove some answered TODOs commit b1981310e290501eeea05121ecd42f3a665a4675 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-11T15:46:37Z update to WriteTxnMarkersRequest/Response from Trunk commit 2e8d892dff21bfb74aa4edff971006d608ab73a5 Author: Damian Guy <damian....@gmail.com> Date: 2017-04-11T16:19:01Z add missing @Test annotation commit 4d17b7c96293ca8f9735049070512be9707aba27 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-02T01:42:49Z Transaction log message format (#134) * add transaction log message format * add transaction timeout to initPid request * collapse to one message type commit af926510d2fd455a0ea4e82da83e10cde65db4e9 Author: Apurva Mehta <apu...@confluent.io> Date: 2017-03-15T20:47:25Z Fix build and test errors due to reabse onto idempotent-producer branch commit fc3544bf6b55c48d487ef2b7877280d3ac90debb Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-17T05:40:49Z Transaction log partition Immigration and Emigration (#142) * sub-package transaction and group classes within coordinator * add loading and cleaning up logic * add transaction configs commit fc5fe9226dd4374018f6b5fe3c182158530af193 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-21T04:38:35Z Add transactions broker configs (#146) * add all broker-side configs * check for transaction timeout value * added one more exception type commit ef390df0eacc8d1f32f96b2db792326a053a5db1 Author: Guozhang Wang <wangg...@gmail.com> Date: 2017-03-31T22:20:05Z Handle addPartitions and addOffsets on TC (#147) * handling add offsets to txn * add a pending state with prepareTransition / completeTransaction / abortTransition of state * refactor handling logic for multiple in-flight requests commit 2a6526a861546eb4102b900d1da703fd2914bd43 Author: Apurva Mehta <apu...@confluent.io> Date: 2017-04-07T19:49:19Z Fix build errors after rebase onto trunk and dropping out the request stubs and client changes. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---