This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch sharded_consumer_type_support_with_kinesis
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 063a06f fixing compilation
discard 4da5a2c Return message batch instead of list in the fetch result
discard 8d0248a Add isEndOfPartition check in checkpoints
discard 203aa08 Handle timeout exception in consumer and make shard iterator
type configurable
discard d922695 Add test code for kinesis
discard dbdcaf0 Change shard metadata logic
discard 47b1664 Refactor: get shard iterator methods
discard bb8e08f Handle closed connections
discard 00db7a2 Refactor code
discard b0a2468 Handle exceptions
discard 422688d Add license header
discard 900450d fetch records with timeout
discard b0eeec6 Add Kinesis config wrapper
discard ee95eeb Add license headers
discard 2463bd1 Reformat code
discard 9567c18 Move shardId out of checkpoint to partition group metadata
discard ba3d100 Fix consumer code
discard c9cd79c Refactor kinesis shard metadata interface and add shardId to
the metadata
discard 56efa08 Refactor PartitionGroupMetadataMap interface
discard 76cfcf1 Add kinesis code to handle offsets
discard 1a8a80a Add PartitionGroupMetdataMap interface
discard 60195b0 Add initial implementation of Kinesis consumer
discard abc6588 Add interfaces for V2 consumers
add 6f4336e default methods to avoid interface changes
new 87d0c26 Add interfaces for V2 consumers
new e094e49 Add initial implementation of Kinesis consumer
new 5b44917 Add PartitionGroupMetdataMap interface
new e7a5314 Add kinesis code to handle offsets
new 855e39d Refactor PartitionGroupMetadataMap interface
new 86fd014 Refactor kinesis shard metadata interface and add shardId to
the metadata
new f9c317d Fix consumer code
new d8b18cd Move shardId out of checkpoint to partition group metadata
new 9bdc27f Reformat code
new f3db54c Add license headers
new 2399cbb Add Kinesis config wrapper
new 4eb2aa6 fetch records with timeout
new b0f82c4 Add license header
new 2c1bb76 Handle exceptions
new bdbab1e Refactor code
new 173b3c4 Handle closed connections
new 6fcdf3e Refactor: get shard iterator methods
new 97d3ffc Change shard metadata logic
new 0af84b1 Add test code for kinesis
new bd7f673 Handle timeout exception in consumer and make shard iterator
type configurable
new abe6647 Add isEndOfPartition check in checkpoints
new eac6c90 Return message batch instead of list in the fetch result
new 6240808 fixing compilation
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (063a06f)
\
N -- N -- N
refs/heads/sharded_consumer_type_support_with_kinesis (6240808)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 23 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../realtime/LLRealtimeSegmentDataManager.java | 3 +-
.../impl/fakestream/FakeStreamConsumerFactory.java | 8 +---
.../fakestream/FakeStreamMetadataProvider.java | 11 -----
...lakyConsumerRealtimeClusterIntegrationTest.java | 5 ---
.../stream/kafka09/KafkaConsumerFactory.java | 7 ---
.../kafka09/KafkaStreamMetadataProvider.java | 46 +------------------
.../kafka09/KafkaPartitionLevelConsumerTest.java | 2 +-
.../stream/kafka20/KafkaConsumerFactory.java | 7 ---
.../kafka20/KafkaStreamMetadataProvider.java | 52 ----------------------
.../pinot/plugin/stream/kinesis/KinesisConfig.java | 10 ++---
.../plugin/stream/kinesis/KinesisConsumerTest.java | 29 ++++++------
.../spi/stream/PartitionGroupInfoFetcher.java | 4 +-
.../pinot/spi/stream/StreamConsumerFactory.java | 4 +-
.../pinot/spi/stream/StreamMetadataProvider.java | 36 ++++++++++++---
14 files changed, 63 insertions(+), 161 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
