kafka git commit: MINOR: Fix error logged if not enough alive brokers for transactions state topic

2017-05-03 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk a7671c7f3 -> cfb238674 MINOR: Fix error logged if not enough alive brokers for transactions state topic Author: Ismael Juma Reviewers: Guozhang Wang Closes #2954 from ijuma/fix-error-message-if-transactions-topic-replication-factor-

kafka git commit: KAFKA-5144: renamed variables in MinTimestampTracker and added comments

2017-05-03 Thread guozhang
iewers: Matthias J. Sax, Guozhang Wang Closes #2948 from mihbor/patch-4 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/bc65c62e Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/bc65c62e Diff: http://git-wip-us.apache.o

kafka git commit: KAFKA-5055: Fix Kafka Streams skipped-records-rate sensor bug

2017-05-03 Thread guozhang
mp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15990086). mjsax guozhangwang take a look Author: dpoldrugo Reviewers: Matthias J. Sax, Guozhang Wang Closes #2949 from dpoldrugo/KAFKA-5055-skipped-records-rate-sensor-bug Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commi

[5/5] kafka git commit: KAFKA-5045: Clarify on KTable APIs for queryable stores

2017-05-03 Thread guozhang
(view). That tradeoff can be exploited by later query optimizers. Author: Eno Thereska Reviewers: Damian Guy, Matthias J. Sax, Guozhang Wang Closes #2832 from enothereska/KAFKA-5045-ktable Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf

[3/5] kafka git commit: KAFKA-5045: Clarify on KTable APIs for queryable stores

2017-05-03 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/ec9e4eaf/streams/src/main/java/org/apache/kafka/streams/kstream/KTable.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/kstream/KTable.java b/streams/src/main/ja

[1/5] kafka git commit: KAFKA-5045: Clarify on KTable APIs for queryable stores

2017-05-03 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk a3952aee4 -> ec9e4eafa http://git-wip-us.apache.org/repos/asf/kafka/blob/ec9e4eaf/streams/src/test/java/org/apache/kafka/streams/kstream/KStreamBuilderTest.java -- diff --git

[2/5] kafka git commit: KAFKA-5045: Clarify on KTable APIs for queryable stores

2017-05-03 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/ec9e4eaf/streams/src/main/java/org/apache/kafka/streams/kstream/internals/KGroupedStreamImpl.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/kstream/internals/K

[4/5] kafka git commit: KAFKA-5045: Clarify on KTable APIs for queryable stores

2017-05-03 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/ec9e4eaf/streams/src/main/java/org/apache/kafka/streams/kstream/KGroupedTable.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/kstream/KGroupedTable.java b/stre

kafka git commit: HOTFIX: fix potentially hanging test shouldAddStateStoreToRegexDefinedSource

2017-05-04 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk ec9e4eafa -> 24e642342 HOTFIX: fix potentially hanging test shouldAddStateStoreToRegexDefinedSource …dSource Author: bbejeck Reviewers: Matthias J. Sax, Guozhang Wang Closes #2783 from bbej

kafka git commit: KAFKA-4925: delay initial rebalance of consumer group

2017-05-04 Thread guozhang
p within the delay, complete the rebalance. Author: Damian Guy Reviewers: Ewen Cheslack-Postava, Guozhang Wang Closes #2758 from dguy/kafka-4925 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/ed59f742 Tree: http:/

kafka git commit: KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-05-04 Thread guozhang
tic Reviewers: Guozhang Wang Closes #2907 from amethystic/kafka-5118_improve_msg__for_failed_startup_with_nonKafka_data Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/a6728f6e Tree: http://git-wip-us.apache.org/repos/asf/kafka/t

kafka git commit: KAFKA-5104: DumpLogSegments should not open index files with `rw`

2017-05-04 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk a6728f6ee -> 41fead3ac KAFKA-5104: DumpLogSegments should not open index files with `rw` Add a parameter 'writable' for AbstractIndex and set its default value to true for its children classes. Author: amethystic Review

kafka git commit: KAFKA-5161: add code in reassign-partitions to check broker existence

2017-05-04 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 2448343ed -> 95b48b157 KAFKA-5161: add code in reassign-partitions to check broker existence Added code to check existence of the brokers in the proposed plan. Author: amethystic Reviewers: Guozhang Wang Closes #2962 from amethys

kafka git commit: KAFKA-5143: add kafka-broker-api-version.bat for Windows platform

2017-05-05 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 715eae6da -> 29994dd10 KAFKA-5143: add kafka-broker-api-version.bat for Windows platform Added kafka-broker-api-versions.bat for Windows platform Author: amethystic Reviewers: Vahid Hashemian, Ismael Juma, Guozhang Wang Closes #2

kafka git commit: KAFKA-5172: Fix fetchPrevious to find the correct session

2017-05-07 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk e71dce89c -> e472ee7b6 KAFKA-5172: Fix fetchPrevious to find the correct session Change fetchPrevious to use findSessions with the proper key and timestamps rather than using fetch. Author: Kyle Winkelman Reviewers: Damian Guy, Guozh

kafka git commit: KAFKA-5174: Have at least 2 threads for compaction and flushing in RocksDB

2017-05-08 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk e472ee7b6 -> 257ad524d KAFKA-5174: Have at least 2 threads for compaction and flushing in RocksDB This fix needs to be backported to 0.10.2 as well. Author: Eno Thereska Reviewers: Damian Guy, Ismael Juma, Guozhang Wang Closes #2

kafka git commit: KAFKA-5174: Have at least 2 threads for compaction and flushing in RocksDB

2017-05-08 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 d7850a400 -> 0e8b08477 KAFKA-5174: Have at least 2 threads for compaction and flushing in RocksDB This fix needs to be backported to 0.10.2 as well. Author: Eno Thereska Reviewers: Damian Guy, Ismael Juma, Guozhang Wang Closes #2

kafka git commit: KAFKA-4222: Adjust timeout in low resource environments

2017-05-09 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 78ace3725 -> 5b36adde4 KAFKA-4222: Adjust timeout in low resource environments Author: Eno Thereska Reviewers: Matthias J. Sax, Guozhang Wang Closes #2996 from enothereska/KAFKA-4222-queryOnRebalance Project: http://git-

kafka git commit: KAFKA-5126: Implement KIP-98 transactional methods in the MockProducer

2017-05-09 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 5b36adde4 -> c69842336 KAFKA-5126: Implement KIP-98 transactional methods in the MockProducer Author: Matthias J. Sax Reviewers: Damian Guy, Guozhang Wang Closes #2951 from mjsax/kafka-5126-add-transactions-to-mock-producer Proj

kafka git commit: KAFKA-4927: Fix KStreamsTestDriver to not throw NPE when KStream.to() sinks are used

2017-05-09 Thread guozhang
Van Leuven Reviewers: Eno Thereska, Matthias J. Sax, Guozhang Wang Closes #2716 from wimvanleuven/KAFKA-4927 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/b982eefd Tree: http://git-wip-us.apache.org/repos/asf/kafka/t

kafka git commit: KAFKA-5063: Fix flaky o.a.k.streams.integration.ResetIntegrationTest

2017-05-09 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk b982eefd3 -> 7371bf7f6 KAFKA-5063: Fix flaky o.a.k.streams.integration.ResetIntegrationTest Author: Matthias J. Sax Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Closes #2931 from mjsax/kafka-5140-flaky-reset-integration-t

kafka git commit: KAFKA-4317: Checkpoint state stores on commit interval

2017-05-11 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 bce189fa4 -> 9eb0cdb54 KAFKA-4317: Checkpoint state stores on commit interval This is a backport of https://github.com/apache/kafka/pull/2471 Author: Damian Guy Reviewers: Guozhang Wang Closes #3024 from dguy/k4881-bp Project: h

kafka git commit: KAFKA-4881: add internal.leave.group.config to consumer

2017-05-11 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 9eb0cdb54 -> 29214d336 KAFKA-4881: add internal.leave.group.config to consumer Backport from https://github.com/apache/kafka/pull/2650 Author: Damian Guy Reviewers: Guozhang Wang Closes #3025 from dguy/kafka-4881-bp Project: h

kafka git commit: KAFKA-5132: abort long running transactions

2017-05-12 Thread guozhang
ael Juma, Guozhang Wang Closes #2957 from dguy/kafka-5132 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/49518491 Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/49518491 Diff: http://git-wip-us.apache.org/repos/a

[1/3] kafka git commit: KAFKA-5130: Refactor transaction coordinator's in-memory cache; plus fixes on transaction metadata synchronization

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 7baa58d79 -> 794e6dbd1 http://git-wip-us.apache.org/repos/asf/kafka/blob/794e6dbd/core/src/test/scala/unit/kafka/coordinator/transaction/TransactionMarkerChannelManagerTest.scala ---

[2/3] kafka git commit: KAFKA-5130: Refactor transaction coordinator's in-memory cache; plus fixes on transaction metadata synchronization

2017-05-12 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/794e6dbd/core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala -- diff --git a/core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala b/

[3/3] kafka git commit: KAFKA-5130: Refactor transaction coordinator's in-memory cache; plus fixes on transaction metadata synchronization

2017-05-12 Thread guozhang
when initializing the pid for the first time, in which we will put a dummy into the cache but set its pendingState as `Empty` (so it will be valid to transit from `Empty` to `Empty`) so that it can be updated after the log append has completed. Author: Guozhang Wang Reviewers: Ismael Juma, D

kafka git commit: KAFKA-5216: Fix peekNextKey in cached window/session store iterators

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 794e6dbd1 -> da0b5b859 KAFKA-5216: Fix peekNextKey in cached window/session store iterators guozhangwang mjsax dguy Author: Xavier Léauté Reviewers: Damian Guy, Matthias J. Sax, Guozhang Wang Closes #3016 from xvrl/kafka-5

kafka git commit: KAFKA-5216: Fix peekNextKey in cached window/session store iterators

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 29214d336 -> 05c13552f KAFKA-5216: Fix peekNextKey in cached window/session store iterators guozhangwang mjsax dguy Author: Xavier Léauté Reviewers: Damian Guy, Matthias J. Sax, Guozhang Wang Closes #3016 from xvrl/kafka-5

kafka git commit: KAFKA-4965: set internal.leave.group.on.close to false in StreamsConfig

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 05c13552f -> 767cc31a8 KAFKA-4965: set internal.leave.group.on.close to false in StreamsConfig Backport from trunk Author: Damian Guy Reviewers: Guozhang Wang Closes #3032 from dguy/kafka-4965-bp Project: http://git-

kafka git commit: KAFKA-5198: Synchronize on RocksDbStore#openIterators

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 7258a5fdd -> b1cd3afc1 KAFKA-5198: Synchronize on RocksDbStore#openIterators …it is accessed from multiple threads Author: Colin P. Mccabe Reviewers: Guozhang Wang Closes #3000 from cmccabe/KAFKA-5198 Project: http://git-

kafka git commit: KAFKA-5198: Synchronize on RocksDbStore#openIterators since it is accessed from multiple threads

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.10.2 767cc31a8 -> b9fc41f04 KAFKA-5198: Synchronize on RocksDbStore#openIterators since it is accessed from multiple threads Author: Colin P. Mccabe Reviewers: Guozhang Wang Closes #3000 from cmccabe/KAFKA-5198 (cherry picked from com

kafka git commit: HOTFIX: convert Bytes back to byte[] in MergedSortedCacheWindowStoreIteratorTest

2017-05-12 Thread guozhang
ree: http://git-wip-us.apache.org/repos/asf/kafka/tree/8bf70610 Diff: http://git-wip-us.apache.org/repos/asf/kafka/diff/8bf70610 Branch: refs/heads/0.10.2 Commit: 8bf70610ba818f2d8e38fd285e553994d4e0d4b2 Parents: b9fc41f Author: Guozhang Wang Authored: Fri May 12 21:29:05 2017 -0700 Committer: Guozh

[1/3] kafka git commit: KAFKA-4144: Allow per stream/table timestamp extractor

2017-05-12 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk a1c8e7d94 -> 9198467eb http://git-wip-us.apache.org/repos/asf/kafka/blob/9198467e/streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamTaskTest.java -- di

[3/3] kafka git commit: KAFKA-4144: Allow per stream/table timestamp extractor

2017-05-12 Thread guozhang
KAFKA-4144: Allow per stream/table timestamp extractor Author: Jeyhun Karimov Reviewers: Damian Guy, Eno Thereska, Matthias J. Sax, Guozhang Wang Closes #2466 from jeyhunkarimov/KAFKA-4144 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos

[2/3] kafka git commit: KAFKA-4144: Allow per stream/table timestamp extractor

2017-05-12 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/9198467e/streams/src/main/java/org/apache/kafka/streams/processor/TopologyBuilder.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/processor/TopologyBuilder.java

kafka git commit: KAFKA-5167: fix unreleased state lock due to uncaught exception when closing a task

2017-05-12 Thread guozhang
an exception. Author: Matthias J. Sax Reviewers: Eno Thereska, Damian Guy, Guozhang Wang Closes #3001 from mjsax/kafka-5167-rebalance-lock-exception-0102 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/6ca71c06 Tree: http://

kafka git commit: KAFKA-5206: Use default aggSerde if no user-overridden is provided in RocksDBSessionStore

2017-05-15 Thread guozhang
eviewers: Damian Guy, Guozhang Wang Closes #2971 from KyleWinkelman/RocksDBSessionStore-fix-aggSerde-use Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/e40e27b4 Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/e40e2

kafka git commit: KAFKA-5206: Use default aggSerde if no user-overridden is provided in RocksDBSessionStore

2017-05-15 Thread guozhang
eviewers: Damian Guy, Guozhang Wang Closes #2971 from KyleWinkelman/RocksDBSessionStore-fix-aggSerde-use (cherry picked from commit e40e27b4eb99e8931488e86289453c5f14d5e886) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.ap

kafka git commit: KAFKA-5206: Use default values of keySerde if it is not specified by users in CachingSessionStore

2017-05-15 Thread guozhang
read.run(StreamThread.java:327) Author: Kyle Winkelman Reviewers: Damian Guy, Guozhang Wang Closes #2963 from KyleWinkelman/CachingSessionStore-fix-keySerde-use Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/475cc254 Tree: http:/

kafka git commit: KAFKA-5206: Use default values of keySerde if it is not specified by users in CachingSessionStore

2017-05-15 Thread guozhang
error in the logs for one of my test cases. Author: Kyle Winkelman Reviewers: Damian Guy, Guozhang Wang Closes #2963 from KyleWinkelman/CachingSessionStore-fix-keySerde-use (cherry picked from commit 475cc2544e18b6b321e716691648024cdbbafb16) Signed-off-by: Guozhang Wang Project: http:/

kafka git commit: KAFKA-5205: Use default values of keySerde if it is not specified by users in CachingSessionStore [Forced Update!]

2017-05-15 Thread guozhang
saw the below error in the logs for one of my test cases. Author: Kyle Winkelman Reviewers: Damian Guy, Guozhang Wang Closes #2963 from KyleWinkelman/CachingSessionStore-fix-keySerde-use (cherry picked from commit 475cc2544e18b6b321e716691648024cdbbafb16) Signed-off-by: Guozhang Wang Proje

kafka git commit: KAFKA-5205: Use default values of keySerde if it is not specified by users in CachingSessionStore [Forced Update!]

2017-05-15 Thread guozhang
saw the below error in the logs for one of my test cases. Author: Kyle Winkelman Reviewers: Damian Guy, Guozhang Wang Closes #2963 from KyleWinkelman/CachingSessionStore-fix-keySerde-use Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/a

kafka git commit: MINOR: Print offset and size in sendFetches

2017-05-15 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk cacbba651 -> 0e2c90bad MINOR: Print offset and size in sendFetches Author: Guozhang Wang Reviewers: Jason Gustafson Closes #3063 from guozhangwang/KMinor-more-logging-in-fetcher Project: http://git-wip-us.apache.org/repos/asf/ka

kafka git commit: KAFKA-5241: GlobalKTable should checkpoint offsets after restoring state

2017-05-16 Thread guozhang
ska, Guozhang Wang Closes #3054 from twbecker/KAFKA-5241 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/73703a15 Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/73703a15 Diff: http://git-wip-us.apache.org/repos/asf/kafka/d

kafka git commit: KAFKA-5241: GlobalKTable should checkpoint offsets after restoring state

2017-05-16 Thread guozhang
ska, Guozhang Wang Closes #3054 from twbecker/KAFKA-5241 (cherry picked from commit 73703a15c5006ddca166a458dcde72e17c91de4a) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/e06cd3e5 Tree: http://git-

kafka git commit: KAFKA-5166: Add option "dry run" to Streams application reset tool

2017-05-16 Thread guozhang
s would ensure that the main logic is used to "feed" into dry-run and we don't have code duplication. WDYT? Author: Bharat Viswanadham Reviewers: Matthias J. Sax, Damian Guy, Eno Thereska, Guozhang Wang Closes #3005 from bharatviswa504/KAFKA-5166 Project: http://git-wip-us.

[3/3] kafka git commit: KAFKA-4923: Add Exactly-Once Semantics to Streams

2017-05-16 Thread guozhang
KAFKA-4923: Add Exactly-Once Semantics to Streams Author: Matthias J. Sax Reviewers: Apurva Metha, Ismael Juma, Damian Guy, Eno Thereska, Guozhang Wang Closes #2945 from mjsax/kafka-4923-add-eos-to-streams Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip

[1/3] kafka git commit: KAFKA-4923: Add Exactly-Once Semantics to Streams

2017-05-16 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 670193f22 -> ebc7f7caa http://git-wip-us.apache.org/repos/asf/kafka/blob/ebc7f7ca/streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamThreadTest.java --

[2/3] kafka git commit: KAFKA-4923: Add Exactly-Once Semantics to Streams

2017-05-16 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/ebc7f7ca/streams/src/test/java/org/apache/kafka/streams/StreamsConfigTest.java -- diff --git a/streams/src/test/java/org/apache/kafka/streams/StreamsConfigTest.java b/streams/src/

kafka git commit: KAFKA-4772: Exploit #peek to implement #print() and other methods

2017-05-17 Thread guozhang
and `KStreamForeach` job. Author: jameschien Author: JamesChien Reviewers: Matthias J. Sax, Guozhang Wang Closes #2955 from jedichien/trunk Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/6910baf5 Tree: http://git-

kafka git commit: KAFKA-5231: Bump up producer epoch when sending abort txn markers on InitPid

2017-05-17 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk b3a33ce4b -> c64cfd2e2 KAFKA-5231: Bump up producer epoch when sending abort txn markers on InitPid Author: Guozhang Wang Reviewers: Jason Gustafson, Jun Rao Closes #3066 from guozhangwang/K5231-bump-up-epoch-when-abort-txn Proj

kafka git commit: KAFKA-5210: Application Reset Tool does not need to seek for internal topics

2017-05-17 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 972b75453 -> 9fa0d52ca KAFKA-5210: Application Reset Tool does not need to seek for internal topics mjsax dguy guozhangwang Could you please review the changes. Author: Bharat Viswanadham Reviewers: Matthias J. Sax, Damian Guy, Guozh

[2/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/e2875235/streams/src/main/java/org/apache/kafka/streams/state/internals/Segments.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/state/internals/Segments.java

[3/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
ordering in the underlying store for keys spread across multiple segments. This should also result in fewer cache keys getting scanned for queries spanning only some segments. Author: Xavier Léauté Reviewers: Damian Guy, Guozhang Wang Closes #3027 from xvrl/windowstore-range-scan Project: http

[1/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk b661d3b8a -> e28752357 http://git-wip-us.apache.org/repos/asf/kafka/blob/e2875235/streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBWindowStoreTest.java -

[3/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
ordering in the underlying store for keys spread across multiple segments. This should also result in fewer cache keys getting scanned for queries spanning only some segments. Author: Xavier Léauté Reviewers: Damian Guy, Guozhang Wang Closes #3027 from xvrl/windowstore-range-scan (cherry picked

[1/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 b661d3b8a -> 9170e87b2 http://git-wip-us.apache.org/repos/asf/kafka/blob/9170e87b/streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBWindowStoreTest.java

[2/3] kafka git commit: KAFKA-5192: add WindowStore range scan (KIP-155)

2017-05-18 Thread guozhang
http://git-wip-us.apache.org/repos/asf/kafka/blob/9170e87b/streams/src/main/java/org/apache/kafka/streams/state/internals/Segments.java -- diff --git a/streams/src/main/java/org/apache/kafka/streams/state/internals/Segments.java

kafka git commit: MINOR: improve descriptions of Streams reset tool options

2017-05-19 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 64e12d3c6 -> 037f63882 MINOR: improve descriptions of Streams reset tool options Author: Matthias J. Sax Reviewers: Bill Bejeck, Guozhang Wang Closes #3107 from mjsax/minor-reset-tool-options (cherry picked from com

kafka git commit: MINOR: improve descriptions of Streams reset tool options

2017-05-19 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 61bab2d87 -> 338857e1c MINOR: improve descriptions of Streams reset tool options Author: Matthias J. Sax Reviewers: Bill Bejeck, Guozhang Wang Closes #3107 from mjsax/minor-reset-tool-options Project: http://git-wip-us.apache.org/re

kafka git commit: KAFKA-4923: Modify compatibility test for Exaclty-Once Semantics in Streams

2017-05-21 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk dc10b0ea0 -> 495836a4a KAFKA-4923: Modify compatibility test for Exaclty-Once Semantics in Streams - add broker compatibility system tests Author: Matthias J. Sax Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Closes #2974 f

kafka git commit: KAFKA-4923: Modify compatibility test for Exaclty-Once Semantics in Streams

2017-05-21 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 c0e789bdc -> 6d04e412c KAFKA-4923: Modify compatibility test for Exaclty-Once Semantics in Streams - add broker compatibility system tests Author: Matthias J. Sax Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Closes #2974 f

kafka git commit: MINOR: remove TransactionCoordinatorIntegrationTest

2017-05-23 Thread guozhang
eviewers: Guozhang Wang Closes #3128 from dguy/minor-remove-test (cherry picked from commit 5a6676bfca9f56c467ff46aefffc6f344ff4bf65) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/9e0581df Tr

kafka git commit: MINOR: remove TransactionCoordinatorIntegrationTest

2017-05-23 Thread guozhang
eviewers: Guozhang Wang Closes #3128 from dguy/minor-remove-test Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/5a6676bf Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/5a6676bf Diff: http://git-wip-us.apache.org/r

kafka git commit: MINOR: improve EmbeddedKafkaCluster test utility for deleting topics

2017-05-23 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 fdbf2e5f7 -> 49a2482c2 MINOR: improve EmbeddedKafkaCluster test utility for deleting topics Author: Matthias J. Sax Reviewers: Bill Bejeck, Damian Guy, Eno Thereska, Guozhang Wang Closes #3104 from mjsax/minor-improve-embedded-ka

kafka git commit: MINOR: improve EmbeddedKafkaCluster test utility for deleting topics

2017-05-23 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 70ec4b1d9 -> 495877505 MINOR: improve EmbeddedKafkaCluster test utility for deleting topics Author: Matthias J. Sax Reviewers: Bill Bejeck, Damian Guy, Eno Thereska, Guozhang Wang Closes #3104 from mjsax/minor-improve-embedded-ka

[1/2] kafka git commit: KAFKA-5280: Protect txn metadata map with read-write lock

2017-05-23 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 495877505 -> 1bf648331 http://git-wip-us.apache.org/repos/asf/kafka/blob/1bf64833/core/src/test/scala/unit/kafka/coordinator/transaction/TransactionCoordinatorTest.scala -- d

[2/2] kafka git commit: KAFKA-5280: Protect txn metadata map with read-write lock

2017-05-23 Thread guozhang
rker queues. Author: Guozhang Wang Reviewers: Jason Gustafson, Jun Rao Closes #3082 from guozhangwang/K5231-read-write-lock Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/1bf64833 Tree: http://git-wip-us.apache.org/repos/asf/kafk

[2/2] kafka git commit: KAFKA-5280: Protect txn metadata map with read-write lock

2017-05-23 Thread guozhang
rker queues. Author: Guozhang Wang Reviewers: Jason Gustafson, Jun Rao Closes #3082 from guozhangwang/K5231-read-write-lock (cherry picked from commit 1bf64833168e81015e1f30a30c64eb6849c15422) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://g

[1/2] kafka git commit: KAFKA-5280: Protect txn metadata map with read-write lock

2017-05-23 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 49a2482c2 -> e6600a368 http://git-wip-us.apache.org/repos/asf/kafka/blob/e6600a36/core/src/test/scala/unit/kafka/coordinator/transaction/TransactionCoordinatorTest.scala --

kafka git commit: KAFKA-5273: Make KafkaConsumer.committed query the server for all partitions

2017-05-23 Thread guozhang
the `KafkaConsumer.committed` method to always lookup the server for the last committed offset to ensure it gets the correct information every time. Author: Apurva Mehta Reviewers: Jason Gustafson, Guozhang Wang Closes #3119 from apurvam/KAFKA-5273-kafkaconsumer-committed-should-always-hit-ser

kafka git commit: KAFKA-5273: Make KafkaConsumer.committed query the server for all partitions

2017-05-23 Thread guozhang
the `KafkaConsumer.committed` method to always lookup the server for the last committed offset to ensure it gets the correct information every time. Author: Apurva Mehta Reviewers: Jason Gustafson, Guozhang Wang Closes #3119 from apurvam/KAFKA-5273-kafkaconsumer-committed-should-always-

kafka git commit: KAFKA-4144 Follow-up: add one missing overload function to maintain backward compatibility

2017-05-24 Thread guozhang
b63#commitcomment-22200864) Author: Jeyhun Karimov Reviewers: Matthias J. Sax, Eno Thereska, Bill Bejeck, Guozhang Wang Closes #3109 from jeyhunkarimov/KAFKA-4144-follow-up Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/c5d44

kafka git commit: KAFKA-4144 Follow-up: add one missing overload function to maintain backward compatibility

2017-05-24 Thread guozhang
b63#commitcomment-22200864) Author: Jeyhun Karimov Reviewers: Matthias J. Sax, Eno Thereska, Bill Bejeck, Guozhang Wang Closes #3109 from jeyhunkarimov/KAFKA-4144-follow-up (cherry picked from commit c5d44af77473abb36cb9bf7ca3dead36490b8320) Signed-off-by: Guozhang Wang Project: http://git-

kafka git commit: KAFKA-5279: TransactionCoordinator must expire transactionalIds

2017-05-25 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 64fc1a7ca -> 20e200878 KAFKA-5279: TransactionCoordinator must expire transactionalIds remove transactions that have not been updated for at least `transactional.id.expiration.ms` Author: Damian Guy Reviewers: Apurva Mehta, Guozh

kafka git commit: KAFKA-5279: TransactionCoordinator must expire transactionalIds

2017-05-25 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 c3f806d02 -> a7bd4b3aa KAFKA-5279: TransactionCoordinator must expire transactionalIds remove transactions that have not been updated for at least `transactional.id.expiration.ms` Author: Damian Guy Reviewers: Apurva Mehta, Guozh

kafka git commit: KAFKA-5309: Stores not queryable after one thread died

2017-05-26 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 5dd2a49e6 -> 1b15adde1 KAFKA-5309: Stores not queryable after one thread died - introduces a new thread state DEAD - ignores DEAD threads when querying Author: Matthias J. Sax Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Clo

kafka git commit: KAFKA-5309: Stores not queryable after one thread died

2017-05-26 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 374336382 -> faa1803aa KAFKA-5309: Stores not queryable after one thread died - introduces a new thread state DEAD - ignores DEAD threads when querying Author: Matthias J. Sax Reviewers: Damian Guy, Eno Thereska, Guozhang Wang Clo

kafka git commit: KAFKA-4660; Improve test coverage KafkaStreams

2017-05-26 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 3066b2d88 -> eb49a5288 KAFKA-4660; Improve test coverage KafkaStreams dguy , mjsax Please review the PR and let me know your comments. Author: umesh chaudhary Reviewers: Bill Bejeck, Matthias J. Sax, Guozhang Wang Closes #3099 f

kafka git commit: KAFKA-4660; Improve test coverage KafkaStreams

2017-05-26 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 68eed84f2 -> ca8915d2e KAFKA-4660; Improve test coverage KafkaStreams dguy , mjsax Please review the PR and let me know your comments. Author: umesh chaudhary Reviewers: Bill Bejeck, Matthias J. Sax, Guozhang Wang Closes #3099 f

kafka git commit: KAFKA-5191: Autogenerate Consumer Fetcher metrics

2017-05-26 Thread guozhang
stopford hachikuji Author: James Cheng Reviewers: Ismael Juma , Guozhang Wang Closes #2993 from wushujames/fetcher_metrics_docs Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/0bc4f75e Tree: http://git-wip-us.apache.org/r

kafka git commit: KAFKA-5191: Autogenerate Consumer Fetcher metrics

2017-05-26 Thread guozhang
stopford hachikuji Author: James Cheng Reviewers: Ismael Juma , Guozhang Wang Closes #2993 from wushujames/fetcher_metrics_docs (cherry picked from commit 0bc4f75eedf14af6d0b2e3e9be62a460b1049d0b) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Comm

kafka git commit: KAFKA-5338: fix a miss-spell in ResetIntegrationTest

2017-05-29 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk dfa3c8a92 -> dc520d275 KAFKA-5338: fix a miss-spell in ResetIntegrationTest There is a Misspell in Annotations of ResetIntegrationTest. Author: hejiefang Reviewers: Matthias J. Sax, Guozhang Wang Closes #3159 from hejiefang/KAFKA-5

kafka git commit: KAFKA-5338: fix a miss-spell in ResetIntegrationTest

2017-05-29 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 569248f6f -> a1da4c534 KAFKA-5338: fix a miss-spell in ResetIntegrationTest There is a Misspell in Annotations of ResetIntegrationTest. Author: hejiefang Reviewers: Matthias J. Sax, Guozhang Wang Closes #3159 from hejiefang/KAFKA-5

kafka git commit: KAFKA-5278: ConsoleConsumer should honor `--value-deserializer`

2017-05-30 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk a8794d8a5 -> 6f5930d63 KAFKA-5278: ConsoleConsumer should honor `--value-deserializer` In the original implementation, console-consumer fails to honor `--value-deserializer` config. Author: amethystic Reviewers: Guozhang Wang Clo

kafka git commit: KAFKA-5278: ConsoleConsumer should honor `--value-deserializer`

2017-05-30 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 9dd7db2f5 -> 0521c65bc KAFKA-5278: ConsoleConsumer should honor `--value-deserializer` In the original implementation, console-consumer fails to honor `--value-deserializer` config. Author: amethystic Reviewers: Guozhang Wang Clo

kafka git commit: KAFKA-4603: Disallow abbreviations in OptionParser constructor

2017-05-30 Thread guozhang
fka into "new OptionParser(false)" Author: xinlihua Author: unknown <00067...@a23338408.zte.intra> Author: auroraxlh Author: xin Reviewers: Damian Guy, Guozhang Wang Closes #2349 from auroraxlh/fix_OptionParser_bug (cherry picked from commit f0745cd514a8af6ea22e1fddfef66f0e69ae

kafka git commit: KAFKA-4603: Disallow abbreviations in OptionParser constructor

2017-05-30 Thread guozhang
fka into "new OptionParser(false)" Author: xinlihua Author: unknown <00067...@a23338408.zte.intra> Author: auroraxlh Author: xin Reviewers: Damian Guy, Guozhang Wang Closes #2349 from auroraxlh/fix_OptionParser_bug Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit:

kafka git commit: KAKFA-5334: Allow rocksdb.config.setter to be specified as a String or Class instance

2017-05-30 Thread guozhang
ker Reviewers: Matthias J. Sax, Damian Guy, Guozhang Wang Closes #3155 from twbecker/KAFKA-5334 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/dd8cdb79 Tree: http://git-wip-us.apache.org/repos/asf/kafka/tree/dd8cdb79 Diff: http://git-

kafka git commit: KAKFA-5334: Allow rocksdb.config.setter to be specified as a String or Class instance

2017-05-30 Thread guozhang
ker Reviewers: Matthias J. Sax, Damian Guy, Guozhang Wang Closes #3155 from twbecker/KAFKA-5334 (cherry picked from commit dd8cdb79d356b3049c21bf00613b8144dff0882c) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/ka

kafka git commit: KAFKA-5308; TC should handle UNSUPPORTED_FOR_MESSAGE_FORMAT in WriteTxnMarker response

2017-05-30 Thread guozhang
any TopicPartitions that have same error from those waiting for markers Author: Damian Guy Reviewers: Jason Gustafson , Guozhang Wang Closes #3152 from dguy/kafka-5308 Project: http://git-wip-us.apache.org/repos/asf/kafka/repo Commit: http://git-wip-us.apache.org/repos/asf/kafka/commit/2cc8f48a Tree: h

kafka git commit: KAFKA-5308; TC should handle UNSUPPORTED_FOR_MESSAGE_FORMAT in WriteTxnMarker response

2017-05-30 Thread guozhang
any TopicPartitions that have same error from those waiting for markers Author: Damian Guy Reviewers: Jason Gustafson , Guozhang Wang Closes #3152 from dguy/kafka-5308 (cherry picked from commit 2cc8f48ae5358087381fa5f79233789499d6b939) Signed-off-by: Guozhang Wang Project: http://git-wip-us.apache.

kafka git commit: MINOR: Improve streams config parameters

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 81f0c1e8f -> d9479275f MINOR: Improve streams config parameters Adjust "importance level" and add explanation to the docs. Author: Matthias J. Sax Reviewers: Eno Thereska , Guozhang Wang Closes #2855 from mjsax/minor-im

kafka git commit: MINOR: Improve streams config parameters

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 1aad6b468 -> f4c29613f MINOR: Improve streams config parameters Adjust "importance level" and add explanation to the docs. Author: Matthias J. Sax Reviewers: Eno Thereska , Guozhang Wang Closes #2855 from mjsax/minor-im

kafka git commit: KAFKA-5218; New Short serializer, deserializer, serde

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk d9479275f -> dc5bf4bd4 KAFKA-5218; New Short serializer, deserializer, serde Author: Mario Molina Reviewers: Matthias J. Sax , Damian Guy , Michael G. Noll , Guozhang Wang Closes #3017 from mmolimar/KAFKA-5218 Project: http://

kafka git commit: KAFKA-5218; New Short serializer, deserializer, serde

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 f4c29613f -> 3bc173436 KAFKA-5218; New Short serializer, deserializer, serde Author: Mario Molina Reviewers: Matthias J. Sax , Damian Guy , Michael G. Noll , Guozhang Wang Closes #3017 from mmolimar/KAFKA-5218 (cherry picked f

kafka git commit: KAFKA-5350: Modify unstable annotations in Streams API

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 7311dcbc5 -> 681c6fc1f KAFKA-5350: Modify unstable annotations in Streams API Author: Guozhang Wang Reviewers: Matthias J. Sax , Jason Gustafson Closes #3172 from guozhangwang/K5350-compatibility-annotations Project: http://git-

kafka git commit: KAFKA-5350: Modify unstable annotations in Streams API

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/0.11.0 016e3b1a5 -> 5ae0adb2e KAFKA-5350: Modify unstable annotations in Streams API Author: Guozhang Wang Reviewers: Matthias J. Sax , Jason Gustafson Closes #3172 from guozhangwang/K5350-compatibility-annotations (cherry picked f

kafka git commit: KAFKA-5226; Fixes issue where adding topics matching a regex

2017-05-31 Thread guozhang
Repository: kafka Updated Branches: refs/heads/trunk 681c6fc1f -> 6360e04e7 KAFKA-5226; Fixes issue where adding topics matching a regex subscribed stream may not be detected by all followers until onJoinComplete returns. Author: Bill Bejeck Reviewers: Matthias J. Sax , Guozhang W

  1   2   3   4   5   6   7   8   9   10   >