This is an automated email from the ASF dual-hosted git repository.
jjkoshy pushed a change to branch jjkoshy-corruptlogissue
in repository https://gitbox.apache.org/repos/asf/kafka.git.
at 1711fb1 log message format version should be 0.10.0
This branch includes the following new commits:
new 7a812c1 [LI-HOTFIX] LIKAFKA-4425 and LIKAFKA-4424 - add quota metrics
log TICKET = LI_DESCRIPTION =
new 4902305 [LI-HOTFIX] LIKAFKA-4424: Add a metric to track the total
number of requests that have been throttled and rename the delay queue size
metric TICKET = LI_DESCRIPTION =
new d302fa2 [LI-HOTFIX] LIKAFKA-8529: avoid duplicate app-info
registrations TICKET = LI_DESCRIPTION =
new e77fd34 [LI-HOTFIX] add metadata.topic.expiry.ms config to
KafkaProducer TICKET = LI_DESCRIPTION =
new bad1cc8 [LI-HOTFIX] Add kafka-jbod-reassignment.sh to generate
reassignment json file for conversion from one-broker-per-disk to
one-broker-per-node TICKET = LI_DESCRIPTION =
new abbfbd3 [LI-HOTFIX] LIKAFKA-12852: mirror maker with new consumer
should make progress after committing to a deleted topic TICKET =
LI_DESCRIPTION =
new 0b8aa43 [LI-HOTFIX] LIKAFKA-12852, attempt #2. Clear the offset map
after receiving offset commit exception. TICKET = LI_DESCRIPTION =
new 8571fa0 [LI-HOTFIX] Adding metrics for log compaction threads alive
TICKET = KAFKA-6588 LI_DESCRIPTION = Introduces a new metric that is useful to
monitor log compaction threads in the broker. Too much overhead in open-source
to introduce this metric. Hence, the hotfix.
new 5646748 [LI-HOTFIX] Clear the offset map even when the offset commit
failed. We need to do this to avoid committing old offsets. TICKET =
LI_DESCRIPTION =
new d481e08 [LI-HOTFIX] Consumer should fetch metadata from the same
broker until it is disconnected from that broker TICKET = LI_DESCRIPTION = -
HOTFIX LIKAFKA-13869; Prevent MetadataRequest starvation by trying to send
MetadataRequest before the end of networkClient.poll()
new 1f73cdf [LI-HOTFIX] LIKAFKA-12720 : Buffer the fetched data for
paused partitions TICKET = KAFKA-7548 LI_DESCRIPTION = "KafkaConsumer should
not throw away already fetched data for paused partitions"
new 6c21f11 [LI-HOTFIX] LIKAFKA-14632 - add more heartbeat and poll
timing sensors to new consumer TICKET = LIKAFKA-14632 LI_DESCRIPTION = adds
"poll-interval", "last-poll-seconds-ago" and
"last-heartbeat-received-seconds-ago" sensors to consumer
new ebb6508 [LI-HOTFIX] Do not let callers of BufferPool.dellocate
deallocate more memory than total memory. TICKET = LI_DESCRIPTION =
new 7a67b81 [LI-HOTFIX] LIKAFKA-8072: Kafka should shutdown if it
couldn't make progress in processing request TICKET = LI_DESCRIPTION = This
patch adds a new config called request.processing.max.time.ms. By default its
value is Long.MaxValue to be backward compatible. Network threads will log
error message and call Runtime.getRuntime.halt(1) if one of the following is
true: - New request can not be inserted into requestChannel after
request.processing.max.time.ms - requestChannel.l [...]
new bb46d3a [LI-HOTFIX] Only read the high watermark checkpointfile
(replication-offset-checkpoint) once TICKET = KAFKA-6468 LI_DESCRIPTION =
new ee3a597 [LI-HOTFIX] KAFKA-6469 Batch ISR change notifications TICKET
= KAFKA-6469 LI_DESCRIPTION =
new 2a28d61 [LI-HOTFIX] LIKAFKA-11492: capture heap dump on healthcheck
suicide TICKET = LIKAFKA-11492 LI_DESCRIPTION = captures a heap dump and dies
if kafka broker fails to do any IO activity for a configurable amount of time
new 2ec273f [LI-HOTFIX] Allow poison pill methods to take an exit status
code to use on halt RB=1340022 TICKET = LI_DESCRIPTION = Allows failing process
(in this case, KafkaServer.scala) to generate heap dump and exit status code,
before exiting. I think this codepath is also used by KMM (venice).
new c79483b [LI-HOTFIX] LIKAFKA-9486 followup; Initialize
lastDequeueTimeMs to be Long.MaxValue TICKET = LI_DESCRIPTION =
new fcde80d [LI-HOTFIX] StopReplicaRequest should remove partitions from
ReplicaManager TICKET = LI_DESCRIPTION = Due to one of our existing hotfix
patch, after a broker starts, the broker may receive LeaderAndIsrRequest to
become a follower for a partition, receive StopReplicaRequest for this
partition, and then receive LeaderAndIsrRequest to become follower for this
partition again. If we don't remove this partition from the ReplicaManager on
receiving the StopReplicaRequest, then [...]
new 13372f0 [LI-HOTFIX] Add bounded flush to KafkaProducer. TICKET =
KAFKA-7711 LI_DESCRIPTION = Add a bounded flush() API and timeout if producer
is unable to flush all the batch records in a limited time.
new f529cd7 [LI-HOTFIX] Added controller sensors to measure queue and
remote time for LeaderAndIsr, Update_metadata, Stop_replica requests TICKET =
LI_DESCRIPTION = Add controller sensors for requests queue and remote times.
Added kafka sensors to display LeaderAndIsr, Stop_replica, and Update_metadata
request times (queue time, remote time) on InGraph. Displaying time for 999,
99, 75, 50, Avg, Max percentiles.
new 6a904fb [LI-HOTFIX] Add multiple config defaults for
__consumer_offsets topic creation TICKET = LI_DESCRIPTION =
new a9d9428 [LI-HOTFIX] Log request quota metrics to
kafka-quota-metrics.log TICKET = LI_DESCRIPTION =
new 320b70a [LI-HOTFIX] LIKAFKA-18568 : Adding new offset reset strategy
- LICLOSEST (LI only) TICKET = LI_DESCRIPTION = New reset policy for consumers
of topics affected by ULEs. Provides a trade-off between message loss and time
to bootstrap the partition (aka availability).
new 32b1b3e [LI-HOTFIX] Add topic deletion hook in zookeeper to trigger
in-memory topic deletion flag changes: TICKET = LI_DESCRIPTION =
new 5b99a6b [LI-HOTFIX] LIKAFKA-18349 - Reuse the same
UpdateMetadataRequest object and struct to reduce controller memory usage
TICKET = KAFKA-7186 LI_DESCRIPTION =
new 9b91b30 [LI-HOTFIX] Allow deleteRecordsBefore() to handle topics with
only [compacted] in clean.up.policy TICKET = LI_DESCRIPTION =
new ac7ae81 [LI-HOTFIX] LIKAFKA-18966: do not expire quota sensors TICKET
= LI_DESCRIPTION = The Kafka sensor for throttle time is recorded only when
there is throttling and thus if a client is not throttled for a while, the
sensor expires. And when it expires, it is not registered as an attribute of
the corresponding mbean sensor. However, healthcheck expects this attribute to
exist in the mbean sensor all the time and hence raising the attribute not
found exception and polluting a [...]
new c3f4f21 [LI-HOTFIX] Showing the provided urls in the exception when
no resolvable url can be found TICKET = LI_DESCRIPTION = Add url information to
exception message to help debugging RB=1405576 BUG=TOOLS-194012
G=Kafka-Code-Reviews R=dolin,mgharat,rrosenbl A=rrosenbl,mgharat
new bc4791a [LI-HOTFIX] Added
org.apache.kafka.common.protocol.SecurityProtocol, which is a duplicate of
org.apache.kafka.common.security.auth.SecurityProtocol, to break circular
dependency TICKET = LI_DESCRIPTION =
new d8a8ccf [LI-HOTFIX] KAFKA-6604; ReplicaManager should not remove
partitions on the log dirctory from high watermark checkpoint file TICKET =
KAFKA-6604 LI_DESCRIPTION =
new d3e3a0a [LI-HOTFIX] Log FindCoordinatorRequest send and failure to
info in AbstractCoordinator TICKET = LI_DESCRIPTION = No logging for
FindCooridnatorRequest send and failure makes it hard to investigate issues.
Since there are no metrics for this having logging here makes investigation
easier.
new feed875 [LI-HOTFIX] Reduce lock retention and improve broker shutdown
time: TICKET = [KAFKA-8667, KAFKA-8668] LI_DESCRIPTION = - Avoid acquiring
partitionMap lock in shutdownIdleFetcherThread - Avoid appending to the time
index during shutdown if the time index has not yet be initialized
new 8aa5bd9 [LI-HOTFIX] Update fetcher thread idle flag in addPartitions
TICKET = KAFKA-8667 LI_DESCRIPTION =
new 87ddb6d [LI-HOTFIX] Removing the PreferredReplicaImbalanceCount
metric to make the controller performant TICKET = LI_DESCRIPTION = Avoid
expensive update of PreferredReplicaImbalanceCount metric
new e302f88 [LI-HOTFIX] Mirror maker passthrough mode, including shallow
iterator over record batches and producer compression config and enable
passthrough for mirror maker TICKET = LI_DESCRIPTION =
new 28c6247 [LI-HOTFIX] Fix integ tests with added passthrough
compression codec TICKET = LI_DESCRIPTION =
new cfe5130 [LI-HOTFIX] LIKAFKA-18913: fix bytebuffer size miscalculation
when deallocating expanded buffer TICKET = LI_DESCRIPTION = When returning
allocated memory buffer to available memory pool, do not return more than
allocated size.
new 1bf1a8e [LI-HOTFIX] Protect UpdateMetadataRequest struct cache with a
lock TICKET = LI_DESCRIPTION =
new baca2fc [LI-HOTFIX] Enforce minimum replication factor on topic
creation via CreateTopicPolicy TICKET = LI_DESCRIPTION = On new topic creation,
the controller will use a custom policy called LiCreateTopicPolicy to determine
if new topic partition assignment satisfies minimum replication factor. If
fails the check, will override the user assignment by generating new assignment
with sufficient RF and write back to ZooKeeper. The same policy will also be
used by each broker to vali [...]
new ca4a695 [LI-HOTFIX] LIKAFKA-20010 Disable/Enable auto-topic-creation
at runtime TICKET = KAFKA-7650 LI_DESCRIPTION = enable dynamic broker config
for auto-topic-creation.
new 7f3f41f [LI-HOTFIX] Add dynamic maintenance broker config TICKET =
KAFKA-8527 LI_DESCRIPTION = When a broker is masked as maintenance broker,
Kafka will not assign partitions of new topics to the broker if partition
assignment is done by kafka brokers. 1) add dynamic broker config to support
maintenance brokers 2) add logic to update maintenance broker info in
controller 3) support maintenance broker in Kafka API 4) support maintenance
broker in AdminZkClient 5) add logic to rea [...]
new 4a9cac6 [LI-HOTFIX] Add Apache License text to the begining of files.
TICKET = LI_DESCRIPTION =
new 0f63123 [LI-HOTFIX] Add note on LinkedIn Kafka Branch to README
TICKET = LI_DESCRIPTION =
new a177dbe [LI-HOTFIX] Fix NPE in KafkaConsumer Fetcher TICKET =
LI_DESCRIPTION =
new 537749c [LI-HOTFIX] Rename the heap dump files to contain .hprof
extension. TICKET = LI_DESCRIPTION =
new 748c377 [LI-HOTFIX] Fixed NPE in LiCreateTopicPolicy, setup test in
AdminClientIntegrationTest. TICKET = LI_DESCRIPTION =
new a741190 [LI-HOTFIX] Cancel partition reassignment after topic
deletion (#14) TICKET = KAFKA-8249 LI_DESCRIPTION =
new 8b26dce [LI-HOTFIX] Increase limits on non-commenting source
statements (NCSS) style checks (#21) TICKET = LI_DESCRIPTION =
new d6a0365 [LI-HOTFIX] Avoid decompressing a batch under certain
conditions to improve performance (reduce CPU usage). TICKET = LI_DESCRIPTION =
Avoid decompressing a batch sent in ProduceRequest under the following
conditions: - Batch sent by producer is greater than V1 - Version of batch sent
by producer matches the boker message format version
new 30f2f3a [LI-HOTFIX] LIKAFKA-19419: Do not delete snapshot files
during log recovery offset checkpoint when called for truncation TICKET =
KAFKA-7452 LI_DESCRIPTION = In upstream, it is fixed by KAFKA-7557. However, we
decide to keep this hotfix to provide further optimization since we are not
using transactional producer in Linkedin currently. EXIT_CRITERIA = MANUAL
["when transactional producer is used"]
new 6bcbc39 [LI-HOTFIX] Create a
KafkaZkClient#setOrCreatePartitionReassignment method with a single argument.
TICKET = LI_DESCRIPTION = This change ensures that the API consistency is
maintained with the upstream Kafka for the
KafkaZkClient#setOrCreatePartitionReassignment method in Kafka 2.0. Originally
this API exists in Kafka 2.0, but internal Kafka-server has removed this API
when migrating from 0.11 -> 2.0, and cherry-picking this change from 2.1.
new 9dcfd84 [LI-HOTFIX] Add deletePartitionReassignment() in
KafkaZkClient TICKET = LI_DESCRIPTION =
new 8f254b9 [LI-HOTFIX] Revert PR-4143: PartitionReassignmentHandler
should only generate event when znode is created TICKET = LI_DESCRIPTION =
new 7431935 [LI-HOTFIX] Add logging when automatic topic creation happens
in order to track which application might be relying on
auto.topic.create.enable being true (#12) TICKET = LI_DESCRIPTION =
new a378c89 [LI-HOTFIX] LIKAFKA-21968: Add broker-side observer interface
and NoOpObserver implementation (#6) TICKET = LI_DESCRIPTION = The observer
interface lets us provide implementation which provides the usage accounting
data unit for the C2S V3 service.
new 2a9a7d3 [LI-HOTFIX] add Bintray support to LinkedIn Kafka Github
TICKET = LI_DESCRIPTION = This contains changes for CI builds and publishing
artifacts to the maven repo under the LinkedIn Bintray account. Travis will
kick off a build and publish artifacts to bintray upon creating a tag in the
"x.y.z.w" format.
new de4ea93 [LI-HOTFIX] Duplicate metrics should not lead to failure
(#24) TICKET = LI_DESCRIPTION =
new 7c69f9a [LI-HOTFIX] LIKAFKA-16384: brokers should suggest the max
ProduceRequest ApiVersion that supports the broker default configured message
format version instead of always suggesting the maximum ApiVersion. TICKET =
LI_DESCRIPTION =
new 27fbe3a [LI-HOTFIX] [ScalaConsumer] Added back the old Scala consumer
code, which was removed by "KAFKA-2983: Remove Scala consumers and related code
(#5230)" (commit cc4dce94af8b19a796eeb7a9be78640739cb1a48) in upstream. TICKET
= LI_DESCRIPTION = This patch included fix by Jon Lee from 2.0-li branch and a
follow up fix by Xiongqi Welsey Wu for 2.3-li branch. EXIT_CRITERIA = MANUAL
["When old Scala consumer is no longer needed"]
new 36436a0 [LI-HOTFIX] LIKAFKA-5686: Add error logging for topic,
partition and offset information for invalid message. TICKET = LI_DESCRIPTION =
new 16789e2 [LI-HOTFIX] LIKAFKA-8207: Changed the old consumer
TopicPartitionChangeListner to listen on child changes of the topic path TICKET
= LI_DESCRIPTION =
new 0289a95 [LI-HOTFIX] Implement metrics to detect inactive
MirrorMakerThread and AbstractFetcherThread TICKET = LI_DESCRIPTION = Add
MaxFetcherThreadInactiveTimeMs and
MirrorMaker-maxMirrorMakerThreadNoCommitTimeMs metrics Part of this fix has
been moved to "Added back the old scala consumer code" patch
new 219c90f [LI-HOTFIX] Avoid NPE if two topics are created back to back.
See LIKAFKA-10614 TICKET = LI_DESCRIPTION =
new 37acae8 [LI-HOTFIX] Support old consumer SSL TICKET = LI_DESCRIPTION =
new f334137 [LI-HOTFIX] relex method length checkstyle requirements since
hotfix makes some method longer TICKET = LI_DESCRIPTION = EXIT_CRITERIA =
MANUAL ["when the method length doesn't go beyond the upstream defined 150 line
maximum "]
new 660839d [LI-HOTFIX] About supporting old consumer SSL, changes the
ConsumerFetcherManager to get bootstrap server values from ZK instead of cfg2
TICKET = LI_DESCRIPTION = obtain bootstrap servers from zookeeper for old
consumers
new 1855ccb [LI-HOTFIX] fix selector leak in ZookeeperConsumerConnector
LI_DESCRIPTION = fix selector leak in ZookeeperConsumerConnector TICKET =
new d0c006b [LI-HOTFIX] Old consumer client should not trigger topic
re-creation for deleted topics, when auto.create.topics.enable=true on broker
TICKET = LI_DESCRIPTION = Metadata request can trigger topic re-creation of a
deleted topic, if cluster has auto topic creation enabled
new 4c95a53 [LI-HOTFIX] Expose last committed offsets in
ZookeeperConsumerConnector (old consumer) to facilitate old consumer migration
in kafka-rest TICKET = LI_DESCRIPTION =
new f7835f6 [LI-HOTFIX] Make lastCommittedPartitionsAndOffsets volatile
in ZookeeperConsumerConnector TICKET = LI_DESCRIPTION =
new 2024c6d [LI-HOTFIX] LIKAFKA-19608 Refresh bootstrap server in
ConsumerFetcherManager when TopicMetadata request fails TICKET = LI_DESCRIPTION
= As part of GDPR, the bootstrap server were fetched from the ZK for updating
TopicMetadata. This list of bootstrap servers was never refreshed after reboot.
Recently all the broker in Kafka cluster were swapped out resulting in all
TopicMetadata fetch request to fail because the request was being set to
decommissioned brokers.
new dc8a49a [LI-HOTFIX] passthrough performance improvement in Log.append
TICKET = LI_DESCRIPTION = Broker-side changes for pass-through solution
new 44ed09d [LI-HOTFIX] Add recompressionRate sensor TICKET =
LI_DESCRIPTION =
new d977af4 [LI-HOTFIX] Exclude topics being deleted from the
offlinePartitionCount metric and clean up partitionState in
PartitionStateMachine after topic deletion is done (#13) TICKET =
LI_DESCRIPTION =
new 83be700 [LI-HOTFIX] Always set lastCommittedPartitionsAndOffsets in
scala consumer (#26) TICKET = LI_DESCRIPTION =
new e0c7183 [LI-HOTFIX] Fix flush behavior
new 2eb5359 [LI-HOTFIX] LIKAFKA-24478: Reduce UpdateMetadataRequest
toString() result (#27) TICKET = LI_DESCRIPTION = In large clusters with large
metadata size the UpdateMetadataRequest::toString can generate really large
strings. If there are n/w issue these strings are logged resulting in lots of
these string to be generated and cause high memory usage.
new 5d9de17 [LI-HOTFIX] Clean up purgatory when leader replica is kicked
out of replica list. TICKET = KAFKA-8571
new 2a928d5 [LI-CHERRY-PICK] [4fdfe2b2] KAFKA-8591;
WorkerConfigTransformer NPE on connector configuration reloading (#6991) TICKET
= KAFKA-8591 LI_DESCRIPTION = EXIT_CRITERIA = HASH
[4fdfe2b2c4f744b0e9a8ac1c36f68c3fa58c48e3] ORIGINAL_DESCRIPTION =
new 39d0b85 [LI-CHERRY-PICK] [b725b3cb] KAFKA-8653; Default rebalance
timeout to session timeout for JoinGroup v0 (#7072) TICKET = KAFKA-8653
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[b725b3cb2e18278669023edc90ab4585c6624b9a] ORIGINAL_DESCRIPTION =
new 13090cb [LI-CHERRY-PICK] [1052d87d] KAFKA-5998: fix
checkpointableOffsets handling (#7030) TICKET = KAFKA-5998 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [1052d87d37bdc0bab085de2bcf8f49a344dfcdd5]
ORIGINAL_DESCRIPTION =
new 4f982aa [LI-CHERRY-PICK] [62617b93] Fixes #8198 KStreams testing docs
use non-existent method pipe (#6678) TICKET = LI_DESCRIPTION = EXIT_CRITERIA =
HASH [62617b93d13215716600aa498f6806978be07c30] ORIGINAL_DESCRIPTION =
new 1bbcfbe [LI-CHERRY-PICK] [2400f729] KAFKA-6605: Fix NPE in Flatten
when optional Struct is null (#5705) TICKET = KAFKA-6605 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [2400f729a1069393503b8657cb69ed524c466ff4]
ORIGINAL_DESCRIPTION =
new c3f7bc0 [LI-CHERRY-PICK] [813bf6c3] KAFKA-7157: Fix handling of nulls
in TimestampConverter (#7070) TICKET = KAFKA-7157 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [813bf6c31ee84f66f517cfb6f44ca8abce37dcb9]
ORIGINAL_DESCRIPTION =
new b115540 [LI-CHERRY-PICK] [5942700a] HOT FIX: close RocksDB objects in
correct order (#7076) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[5942700a45363170c914f5a450bba0d9b3ca05d8] ORIGINAL_DESCRIPTION =
new 48e6981 [LI-CHERRY-PICK] [0f0093c1] KAFKA-8620: fix NPE due to race
condition during shutdown while rebalancing (#7021) TICKET = KAFKA-8620
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[0f0093c1693d6ea4091228cd3a87db0219d028a2] ORIGINAL_DESCRIPTION =
new 4712752 [LI-CHERRY-PICK] [a32918b1] KAFKA-8637: WriteBatch objects
leak off-heap memory (#7050) TICKET = KAFKA-8637 LI_DESCRIPTION = EXIT_CRITERIA
= HASH [a32918b17766e24196e0af30daa19703986d3ee0] ORIGINAL_DESCRIPTION =
new 0e24ddf [LI-CHERRY-PICK] [27eba249] KAFKA-8662; Fix producer metadata
error handling and consumer manual assignment (#7086) TICKET = KAFKA-8662
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[27eba2494b698ba48c6fbf3851ed36b5a287db22] ORIGINAL_DESCRIPTION =
new f25708c [LI-CHERRY-PICK] [426f4c7a] KAFKA-8530; Check for topic
authorization errors in OffsetFetch response (#6928) TICKET = KAFKA-8530
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[426f4c7ac7fb46b0bf61541f84fca01ddbf72458] ORIGINAL_DESCRIPTION =
new 5a2d6c5 [LI-CHERRY-PICK] [011ec517] KAFKA-8602: Separate PR for 2.3
branch (#7092) TICKET = KAFKA-8602 LI_DESCRIPTION = EXIT_CRITERIA = HASH
[011ec517f15cbcec4c7499980202a9f5485dabbf] ORIGINAL_DESCRIPTION =
new bf2735d [LI-CHERRY-PICK] [6f189d96] KAFKA-8670; Fix exception for
kafka-topics.sh --describe without --topic mentioned (#7094) TICKET =
KAFKA-8670 LI_DESCRIPTION = EXIT_CRITERIA = HASH
[6f189d9609d513054ea31d2e997432a8a7635344] ORIGINAL_DESCRIPTION =
new 1f2d32b [LI-CHERRY-PICK] [3d7b989c] KAFKA-8615: Change to track
partition time breaks TimestampExtractor (#7054) TICKET = KAFKA-8615
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[3d7b989cb7b6d48acefbb748b0927be2505c8da8] ORIGINAL_DESCRIPTION =
new e3e29d0 [LI-CHERRY-PICK] [23714574] KAFKA-8635; Skip client poll in
Sender loop when no request is sent (#7085) TICKET = KAFKA-8635 LI_DESCRIPTION
= EXIT_CRITERIA = HASH [23714574ae440654c23cc790af8d925ba85d7e40]
ORIGINAL_DESCRIPTION =
new 90dd97e [LI-CHERRY-PICK] [aa1a285e] MINOR: Remove stale streams
producer retry default docs. (#6844) TICKET = LI_DESCRIPTION = EXIT_CRITERIA =
HASH [aa1a285ed8babf1f39571440378162144c1453bf] ORIGINAL_DESCRIPTION =
new 1b1b6a8 [LI-CHERRY-PICK] [6916e861] MINOR: Update documentation for
enabling optimizations (#7099) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[6916e8618c609a018df405b79e62fa550289e475] ORIGINAL_DESCRIPTION =
new 9b8230e [LI-CHERRY-PICK] [f94ec1c3] KAFKA-8678; Fix leave group
protocol bug in throttling and error response (#7101) TICKET = KAFKA-8678
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[f94ec1c37088569931df706fd09fb1d1808f9be3] ORIGINAL_DESCRIPTION =
new d50e53c [LI-CHERRY-PICK] [c29380f4] KAFKA-8715; Fix buggy reliance on
state timestamp in static member.id generation (#7116) TICKET = KAFKA-8715
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[c29380f40d0db6d0c4a549117ba910f915a5053a] ORIGINAL_DESCRIPTION =
new d2d71e0 [LI-CHERRY-PICK] [f86f7e21] KAFKA-8731: InMemorySessionStore
throws NullPointerException on startup (#7132) TICKET = KAFKA-8731
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[f86f7e21d986b7cda3cf8c2e53b8500625846fa2] ORIGINAL_DESCRIPTION =
new 93adb6c [LI-CHERRY-PICK] [7b52feb8] MINOR: Avoid dividing by zero
(#7143) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[7b52feb8deeeaf9af480161445be03ce979651ef] ORIGINAL_DESCRIPTION =
new 7fd0832 [LI-CHERRY-PICK] [0826d6e9] KAFKA-8736: Streams performance
improvement, use isEmpty() rather than size() == 0 (#7164) TICKET = KAFKA-8736
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[0826d6e90d4ff9648f512cdd9bc00307d4ef3b3e] ORIGINAL_DESCRIPTION =
new 932a4be [LI-CHERRY-PICK] [8e870416] MINOR: Upgrade jackson-databind
to 2.9.9.3 (#7125) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[8e870416e7929101679c66cbc0f3730f9d5bd003] ORIGINAL_DESCRIPTION =
new 995b533 [LI-CHERRY-PICK] [04cf8fb2] KAFKA-8550: Fix plugin loading of
aliased converters in Connect (#6959) TICKET = KAFKA-8550 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [04cf8fb2c116812abaa1b348d5e30536b4a1061c]
ORIGINAL_DESCRIPTION =
new a674b56 [LI-CHERRY-PICK] [b85707c0] KAFKA-8774: Regex can be found
anywhere in config value (#7197) TICKET = KAFKA-8774 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [b85707c0fdb4c11448cdb5a1938e0488ddc91102]
ORIGINAL_DESCRIPTION =
new 4bd037b [LI-CHERRY-PICK] [24269269] KAFKA-7941: Catch
TimeoutException in KafkaBasedLog worker thread (#6283) TICKET = KAFKA-7941
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[24269269b58cba9a826d0ab507e1fcf89f814666] ORIGINAL_DESCRIPTION =
new 4e1ccbe [LI-CHERRY-PICK] [8d70218d] KAFKA-8391; Improved the Connect
integration tests to make them less flaky TICKET = KAFKA-8391 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [8d70218de2ab8637f922a43993020216e57404c8]
ORIGINAL_DESCRIPTION =
new ba41910 [LI-CHERRY-PICK] [f81189cd] KAFKA-8736: Track size in
InMemoryKeyValueStore (#7177) TICKET = KAFKA-8736 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [f81189cd3915f0876f8e2ed440269c9c0ecea1e9]
ORIGINAL_DESCRIPTION =
new f807018 [LI-CHERRY-PICK] [d5eda1ea] KAFKA-8791:
RocksDBTimestampedStore should open in regular mode by default (#7201) TICKET =
KAFKA-8791 LI_DESCRIPTION = EXIT_CRITERIA = HASH
[d5eda1eac8314cc3107208c1098e1f89d41c2ed5] ORIGINAL_DESCRIPTION =
new e14fb47 [LI-CHERRY-PICK] [90386e89] MINOR: Correct typo in test name
`TimetampedSegmentsTest` (#7210) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[90386e89be4d294baf63911af9012493a3faa35a] ORIGINAL_DESCRIPTION =
new 32fc264 [LI-CHERRY-PICK] [4d0cc439] KAFKA-8788: Optimize client
metadata handling with a large number of partitions (#7192) TICKET = KAFKA-8788
LI_DESCRIPTION = EXIT_CRITERIA = HASH
[4d0cc439eea0c57aba508fae257c366edfd39028] ORIGINAL_DESCRIPTION =
new b5f003a [LI-CHERRY-PICK] [9cb27f5f] MINOR: Fix bugs in handling
zero-length ImplicitLinkedHashCollections (#7163) TICKET = LI_DESCRIPTION =
EXIT_CRITERIA = HASH [9cb27f5f80b82aca65ccb89f3b9ba4d07222c9df]
ORIGINAL_DESCRIPTION =
new a1732a7 [LI-CHERRY-PICK] [051d2909] KAFKA-8802: ConcurrentSkipListMap
shows performance regression in cache and in-memory store (#7212) TICKET =
KAFKA-8802 LI_DESCRIPTION = EXIT_CRITERIA = HASH
[051d29098ac7529f54475899c3441ed918a6882c] ORIGINAL_DESCRIPTION =
new a89170a [LI-CHERRY-PICK] [71e20193] KAFKA-8800: Increase poll timeout
in poll[Records]UntilTrue (#7211) TICKET = KAFKA-8800 LI_DESCRIPTION =
EXIT_CRITERIA = HASH [71e20193e1fe70e10e4c6961a6db14768f6e0c88]
ORIGINAL_DESCRIPTION =
new 1a4492d [LI-CHERRY-PICK] [e323f4be] MINOR: Fixing log format typo
(#7219) TICKET = LI_DESCRIPTION = EXIT_CRITERIA = HASH
[e323f4be5deceb1e6f48a7f179e0447000e8e6a4] ORIGINAL_DESCRIPTION =
new e194c85 [LI-HOTFIX] include gradle wrapper and ignore a failed unit
test due to port binding error for travis build (#37)
new da8d07a [LI-CHERRY-PICK] [db8cb96a] KAFKA-8325; Remove batch from
in-flight requests on MESSAGE_TOO_LARGE errors (#7176) TICKET = KAFKA-8325
LI_DESCRIPTION =
new 52e2cd5 [LI-CHERRY-PICK] [91000095] KAFKA-8824: bypass value serde on
null (#7235) TICKET = KAFKA-8824 LI_DESCRIPTION =
new afe27b4 [LI-CHERRY-PICK] [1a5062cc] KAFKA-8586: Fail source tasks
when producers fail to send records (#6993) TICKET = KAFKA-8586 LI_DESCRIPTION =
new 7eb9b2a [LI-CHERRY-PICK] [5b4e749d] KAFKA-8391; Temporarily ignore
flaky Connect rebalance integration tests TICKET = KAFKA-8391 LI_DESCRIPTION =
new d902f8d [LI-HOTFIX] add prepare-commit-msg hook to help format commit
message (#38)
new 851a0f9 [LI-HOTFIX] add back old parseAndValidateAddresses API for
backward compatibility (#39)
new 5ffb0db [LI-HOTFIX] embed versioning information in jars (#45)
new 33c52ea [LI-HOTFIX] embed versioning information in jars (v2) (#46)
new c2a69f3 [HOTFIX] Allocate correct size for ArrayList when parsing
UpdateMetadataRequest (#51)
new 223587f [LI-HOTFIX] Log the partition being made online due to
unclean leader election. (#52)
new d6b30ae Implementation of memory pool based on weak references. (#49)
new 15ee7e2 Preallocate maps with exact size instead of the default(which
is 16) (#50)
new 85ebb3a [LI-HOTFIX] Make client-side auto.topic.creation configurable
and def… (#54)
new 89d1672 [LI-HOTFIX] Separate Kafka Controller Node from
Non-Controller Node (#42)
new b55f699 [LI-HOTFIX] exclude stream artifacts and connect artifacts
from travis ci publication (#56)
new 3f78c42 [LI-HOTFIX] fix hard coded travis tag (#57)
new c8f3afc [LI-HOTFIX] Do not throw exceptions when internal headers are
set and the coordinated channel with the broker is using Message_v1(magic = 1)
(#58)
new aef87f918 Add counters for the following: (#59)
new 7c06d74 [LI-HOTFIX] Add sensor to collect statistics of KafkaChannel
memory allocation size.
new 83b4112 [LI-HOTFIX] Change default value of config
delivery.timeout.ms to MAX_INT.
new 1a4c6fd [LI-HOTFIX] Add support to use BoringSSL for SSL/TLS.
new c432d86 [LI-HOTFIX] Rollback KAFKA-7440 as a workaround for
KAFKA-9212. (#61)
new 16dfeec [LI-HOTFIX] Remove
KafkaZkClient#setOrCreatePartitionReassignment and add
AdminZkClient#addPartitions (#60)
new 49d8318 [LI-HOTFIX] Rollback hotfix to pick up fix for KAFKA-9212
and KAFKA-9261. (#63)
new f5a78f4 [LI-HOTFIX] Guard costly trace- and debug-level logging to
avoid unnecessary resource use during index operations. (#64)
new 23b1453 [LI-HOTFIX] Fix typo in docString of UpdateMetadataRequest.
(#55)
new 12417cc [LI-HOTFIX] Improve shutdown performance via lazy accessing
the offset and time indices. (#65)
new db8ecf6 [LI-HOTFIX] pick up KAFKA-8104 with modification (#66)
new 40065ac [LI-CHERRY-PICK][dca1bf1] Fix LazyTimeIndex & LazyOffsetIndex
concurrency (#67)
new da84506 [LI-HOTFIX] Be ultra lazy in loading lazy indices during
index deletion. (#68)
new 58acea2 [LI-HOTFIX] kafka-run-class.sh SCALA_VERSION should match
gradle.properties TICKET = LI_DESCRIPTION = This is a follow-up to an earlier
hotfix 2a9a7d3d2992f11f05ff4c147abd7f8d46935336 which added bintray support to
LinkedIn Kafka Github. The Scala version in the run script needs to be updated.
new b345165 basic stress tool
new 281a036 add sample log configuration
new 4adc50fa props should be in kafkaconfig style
new c53a41a apply the right configs
new b62bc50 add tailing reader threads
new 1711fb1 log message format version should be 0.10.0
The 153 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
