Satish Duggana created KAFKA-16161:
--
Summary: Avoid creating remote log metadata snapshot file in
partition data directory.
Key: KAFKA-16161
URL: https://issues.apache.org/jira/browse/KAFKA-16161
Satish Duggana created KAFKA-15864:
--
Summary: Add more tests asserting the log-start-offset,
local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered
storage.
Key: KAFKA-15864
URL:
Satish Duggana created KAFKA-15857:
--
Summary: Introduce LocalLogStartOffset and TieredOffset in
OffsetSpec.
Key: KAFKA-15857
URL: https://issues.apache.org/jira/browse/KAFKA-15857
Project: Kafka
Satish Duggana created KAFKA-15612:
--
Summary: Followup on whether the indexes need to be materialized
before they are passed to RSM for writing them to tiered storage.
Key: KAFKA-15612
URL:
Satish Duggana created KAFKA-15594:
--
Summary: Add 3.6.0 to streams upgrade/compatibility tests
Key: KAFKA-15594
URL: https://issues.apache.org/jira/browse/KAFKA-15594
Project: Kafka
Issue
Satish Duggana created KAFKA-15593:
--
Summary: Add 3.6.0 to broker/client upgrade/compatibility tests
Key: KAFKA-15593
URL: https://issues.apache.org/jira/browse/KAFKA-15593
Project: Kafka
Satish Duggana created KAFKA-15576:
--
Summary: Add 3.2.0 to broker/client and streams
upgrade/compatibility tests
Key: KAFKA-15576
URL: https://issues.apache.org/jira/browse/KAFKA-15576
Project:
[
https://issues.apache.org/jira/browse/KAFKA-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15535.
Resolution: Fixed
> Add documentation of "remote.log.index.file.cache.total.size.bytes"
Satish Duggana created KAFKA-15535:
--
Summary: Add documentation of
"remote.log.index.file.cache.total.size.bytes" configuration property.
Key: KAFKA-15535
URL: https://issues.apache.org/jira/browse/KAFKA-15535
Satish Duggana created KAFKA-15530:
--
Summary: Add missing documentation of metrics introduced as part
of KAFKA-15196
Key: KAFKA-15530
URL: https://issues.apache.org/jira/browse/KAFKA-15530
Project:
Satish Duggana created KAFKA-15503:
--
Summary: CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52,
10.0.16, 11.0.16, 12.0.1
Key: KAFKA-15503
URL: https://issues.apache.org/jira/browse/KAFKA-15503
Satish Duggana created KAFKA-15483:
--
Summary: Update metrics documentation for the new metrics
implemented as part of KIP-938
Key: KAFKA-15483
URL: https://issues.apache.org/jira/browse/KAFKA-15483
[
https://issues.apache.org/jira/browse/KAFKA-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15092.
Resolution: Invalid
> KafkaClusterTestKit in test jar depends on MockFaultHandler
>
[
https://issues.apache.org/jira/browse/KAFKA-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15482.
Resolution: Invalid
> kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar
>
[
https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-7739.
---
Resolution: Fixed
> Kafka Tiered Storage
>
>
> Key:
[
https://issues.apache.org/jira/browse/KAFKA-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-14993.
Resolution: Fixed
> Improve TransactionIndex instance handling while copying to and
Satish Duggana created KAFKA-15453:
--
Summary: Enable `testFencingOnTransactionExpiration` in
TransactionsWithTieredStoreTest
Key: KAFKA-15453
URL: https://issues.apache.org/jira/browse/KAFKA-15453
[
https://issues.apache.org/jira/browse/KAFKA-15352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15352.
Resolution: Fixed
> Ensure consistency while deleting the remote log segments
>
[
https://issues.apache.org/jira/browse/KAFKA-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15245.
Resolution: Fixed
> Improve Tiered Storage Metrics
> --
>
>
Satish Duggana created KAFKA-15439:
--
Summary: Add transaction tests enabled with tiered storage
Key: KAFKA-15439
URL: https://issues.apache.org/jira/browse/KAFKA-15439
Project: Kafka
Issue
[
https://issues.apache.org/jira/browse/KAFKA-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15293.
Resolution: Fixed
> Update metrics doc to add tiered storage metrics
>
Satish Duggana created KAFKA-15434:
--
Summary: Tiered Storage Quotas
Key: KAFKA-15434
URL: https://issues.apache.org/jira/browse/KAFKA-15434
Project: Kafka
Issue Type: Improvement
Satish Duggana created KAFKA-15433:
--
Summary: Follower fetch from tiered offset
Key: KAFKA-15433
URL: https://issues.apache.org/jira/browse/KAFKA-15433
Project: Kafka
Issue Type:
[
https://issues.apache.org/jira/browse/KAFKA-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15260.
Resolution: Fixed
> RLM Task should wait until RLMM is initialized before copying
[
https://issues.apache.org/jira/browse/KAFKA-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-9564.
---
Resolution: Fixed
> Integration Test framework for Tiered Storage
>
[
https://issues.apache.org/jira/browse/KAFKA-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-9565.
---
Resolution: Won't Fix
> Implementation of Tiered Storage SPI to integrate with S3
>
[
https://issues.apache.org/jira/browse/KAFKA-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-12458.
Resolution: Won't Do
> Implementation of Tiered Storage Integration with Azure Storage
Satish Duggana created KAFKA-15420:
--
Summary: Kafka Tiered Storage V1
Key: KAFKA-15420
URL: https://issues.apache.org/jira/browse/KAFKA-15420
Project: Kafka
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/KAFKA-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-13097.
Resolution: Invalid
> Handle the requests gracefully to publish the events in
>
Satish Duggana created KAFKA-15388:
--
Summary: Handle topics that were having compaction as retention
earlier are changed to delete only retention policy and onboarded to tiered
storage.
Key: KAFKA-15388
URL:
[
https://issues.apache.org/jira/browse/KAFKA-15386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-15386.
Resolution: Duplicate
> Update log-start-offset in RLM task for a leader partition for
Satish Duggana created KAFKA-15386:
--
Summary: Update log-start-offset in RLM task for a leader
partition for the earliest leader epoch of the current leader's leader epoch
lineage available in the remote storage.
Key:
Satish Duggana created KAFKA-15376:
--
Summary: Revisit removing data earlier to the current leader for
topics enabled with tiered storage.
Key: KAFKA-15376
URL: https://issues.apache.org/jira/browse/KAFKA-15376
Satish Duggana created KAFKA-15313:
--
Summary: Delete remote log segments partition asynchronously when
a partition is deleted.
Key: KAFKA-15313
URL: https://issues.apache.org/jira/browse/KAFKA-15313
Satish Duggana created KAFKA-15300:
--
Summary: Include remotelog size in complete log size and also add
local log size and remote log size separately in kafka-log-dirs tool.
Key: KAFKA-15300
URL:
Satish Duggana created KAFKA-15285:
--
Summary:
https://github.com/apache/kafka/pull/13990#issuecomment-1659256150
Key: KAFKA-15285
URL: https://issues.apache.org/jira/browse/KAFKA-15285
Project:
Satish Duggana created KAFKA-15265:
--
Summary: Remote copy/fetch quotas for tiered storage.
Key: KAFKA-15265
URL: https://issues.apache.org/jira/browse/KAFKA-15265
Project: Kafka
Issue Type:
Satish Duggana created KAFKA-15241:
--
Summary: Compute tiered offset by keeping the respective epochs in
scope.
Key: KAFKA-15241
URL: https://issues.apache.org/jira/browse/KAFKA-15241
Project: Kafka
Satish Duggana created KAFKA-15169:
--
Summary: Add a test to make sure the remote index file is
overwritten for the earlier existing(corrupted) files.
Key: KAFKA-15169
URL:
Satish Duggana created KAFKA-15094:
--
Summary: Add RemoteIndexCache metrics like
misses/evictions/load-failures.
Key: KAFKA-15094
URL: https://issues.apache.org/jira/browse/KAFKA-15094
Project: Kafka
Satish Duggana created KAFKA-15047:
--
Summary: Handle rolling segments when the active segment's
retention is breached incase of tiered storage is enabled.
Key: KAFKA-15047
URL:
[
https://issues.apache.org/jira/browse/KAFKA-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana reopened KAFKA-12384:
> Flaky Test ListOffsetsRequestTest.testResponseIncludesLeaderEpoch
>
Satish Duggana created KAFKA-14993:
--
Summary: Improve TransactionIndex instance handling while copying
to and fetching from RSM.
Key: KAFKA-14993
URL: https://issues.apache.org/jira/browse/KAFKA-14993
Satish Duggana created KAFKA-14915:
--
Summary: Option to consume multiple partitions that have their
data in remote storage for the target offsets.
Key: KAFKA-14915
URL:
Satish Duggana created KAFKA-14912:
--
Summary: Introduce a configuration for remote index cache size,
preferably a dynamic config.
Key: KAFKA-14912
URL: https://issues.apache.org/jira/browse/KAFKA-14912
Satish Duggana created KAFKA-14726:
--
Summary: Move/rewrite LogReadInfo, LogOffsetSnapshot, and
LogStartOffsetIncrementReason to storage module.
Key: KAFKA-14726
URL:
Satish Duggana created KAFKA-14714:
--
Summary: Move/Rewrite RollParams, LogAppendInfo, and
LeaderHwChange to storage module.
Key: KAFKA-14714
URL: https://issues.apache.org/jira/browse/KAFKA-14714
Satish Duggana created KAFKA-14708:
--
Summary: Remove kafka.examples.Consumer dependancy on
ShutdownableThread
Key: KAFKA-14708
URL: https://issues.apache.org/jira/browse/KAFKA-14708
Project: Kafka
Satish Duggana created KAFKA-14706:
--
Summary: Move ShutdownableThread to server-commons module.
Key: KAFKA-14706
URL: https://issues.apache.org/jira/browse/KAFKA-14706
Project: Kafka
Issue
Satish Duggana created KAFKA-14688:
--
Summary: Move org.apache.kafka.server.log.internals to
org.apache.kafka.storage.internals.log
Key: KAFKA-14688
URL: https://issues.apache.org/jira/browse/KAFKA-14688
Satish Duggana created KAFKA-14625:
--
Summary: CheckpointFile read and write API consistency
Key: KAFKA-14625
URL: https://issues.apache.org/jira/browse/KAFKA-14625
Project: Kafka
Issue
[
https://issues.apache.org/jira/browse/KAFKA-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-14613.
Resolution: Won't Do
> Move BrokerReconfigurable/KafkaConfig to server-common module.
>
Satish Duggana created KAFKA-14613:
--
Summary: Move BrokerReconfigurable/KafkaConfig to server-common
module.
Key: KAFKA-14613
URL: https://issues.apache.org/jira/browse/KAFKA-14613
Project: Kafka
Satish Duggana created KAFKA-14603:
--
Summary: Move KafkaMetricsGroup to server-common module.
Key: KAFKA-14603
URL: https://issues.apache.org/jira/browse/KAFKA-14603
Project: Kafka
Issue
Satish Duggana created KAFKA-14602:
--
Summary: offsetDelta in BatchMetadata is an int but the values are
computed as difference of offsets which are longs.
Key: KAFKA-14602
URL:
Satish Duggana created KAFKA-14574:
--
Summary: Add doc generation as part of the CI build process
Key: KAFKA-14574
URL: https://issues.apache.org/jira/browse/KAFKA-14574
Project: Kafka
Issue
Satish Duggana created KAFKA-14558:
--
Summary: Move LastRecord, TxnMetadata, BatchMetadata,
ProducerStateEntry, and ProducerAppendInfo to the storage module.
Key: KAFKA-14558
URL:
Satish Duggana created KAFKA-14551:
--
Summary: Move LeaderEpochFileCache to storage module
Key: KAFKA-14551
URL: https://issues.apache.org/jira/browse/KAFKA-14551
Project: Kafka
Issue Type:
Satish Duggana created KAFKA-14550:
--
Summary: MoveSnapshotFile and CorruptSnapshotException to storage
module
Key: KAFKA-14550
URL: https://issues.apache.org/jira/browse/KAFKA-14550
Project: Kafka
[
https://issues.apache.org/jira/browse/KAFKA-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-9990.
---
Resolution: Fixed
> Supporting transactions in tiered storage
>
Satish Duggana created KAFKA-14467:
--
Summary: Add a test to validate the replica state after processing
the OFFSET_MOVED_TO_TIERED_STORAGE error, especially for the transactional state
Key: KAFKA-14467
URL:
Satish Duggana created KAFKA-14466:
--
Summary: Refactor ClassLoaderAwareRemoteStorageManager.scala to
ClassLoaderAwareRemoteStorageManager.java and move it to storage module.
Key: KAFKA-14466
URL:
Satish Duggana created KAFKA-13560:
--
Summary: Load indexes and data in async manner in the critical
path of replica fetcher threads.
Key: KAFKA-13560
URL: https://issues.apache.org/jira/browse/KAFKA-13560
Satish Duggana created KAFKA-13369:
--
Summary: Follower fetch protocol enhancements for tiered storage.
Key: KAFKA-13369
URL: https://issues.apache.org/jira/browse/KAFKA-13369
Project: Kafka
Satish Duggana created KAFKA-13355:
--
Summary: Shutdown broker eventually when unrecoverable exceptions
like IOException encountered in RLMM.
Key: KAFKA-13355
URL:
[
https://issues.apache.org/jira/browse/KAFKA-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-9569.
---
Resolution: Fixed
> RemoteStorageManager implementation for HDFS storage.
>
Satish Duggana created KAFKA-13097:
--
Summary: Handle the requests gracefully to publish the events in
TopicBasedRemoteLogMetadataManager when it is not yet initialized.
Key: KAFKA-13097
URL:
[
https://issues.apache.org/jira/browse/KAFKA-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-12970.
Resolution: Fixed
This is already addressed as mentioned in the comment:
Satish Duggana created KAFKA-12988:
--
Summary: RLMM add/updateRemoteLogSegmentMetadata and
putRemotePartitionDeleteMetadata to be changed with asynchronous APIs.
Key: KAFKA-12988
URL:
Satish Duggana created KAFKA-12970:
--
Summary: Make tiered storage related schemas adopt flexible
versions feature.
Key: KAFKA-12970
URL: https://issues.apache.org/jira/browse/KAFKA-12970
Project:
Satish Duggana created KAFKA-12969:
--
Summary: Add cluster or broker level config for topic level
tiered storage confgs.
Key: KAFKA-12969
URL: https://issues.apache.org/jira/browse/KAFKA-12969
Satish Duggana created KAFKA-12816:
--
Summary: Add tier storage configs.
Key: KAFKA-12816
URL: https://issues.apache.org/jira/browse/KAFKA-12816
Project: Kafka
Issue Type: Sub-task
Satish Duggana created KAFKA-12802:
--
Summary: Add a file based cache for consumed remote log metadata
for each partition to avoid consuming again incase of broker restarts.
Key: KAFKA-12802
URL:
Satish Duggana created KAFKA-12758:
--
Summary: Create a new `server-common` module and move
ApiMessageAndVersion, RecordSerde, AbstractApiMessageSerde, and
BytesApiMessageSerde to that module.
Key: KAFKA-12758
Satish Duggana created KAFKA-12757:
--
Summary: Move server related common classes into a separate
`server-common` module.
Key: KAFKA-12757
URL: https://issues.apache.org/jira/browse/KAFKA-12757
Satish Duggana created KAFKA-12641:
--
Summary: Clear RemoteLogLeaderEpochState entry when it become
empty.
Key: KAFKA-12641
URL: https://issues.apache.org/jira/browse/KAFKA-12641
Project: Kafka
Satish Duggana created KAFKA-12429:
--
Summary: Serdes for all message types in internal topic which is
used in default implementation for RLMM.
Key: KAFKA-12429
URL:
Satish Duggana created KAFKA-12368:
--
Summary: Inmemory implementation of RSM and RLMM.
Key: KAFKA-12368
URL: https://issues.apache.org/jira/browse/KAFKA-12368
Project: Kafka
Issue Type:
Satish Duggana created KAFKA-9990:
-
Summary: Supporting transactions in tiered storage
Key: KAFKA-9990
URL: https://issues.apache.org/jira/browse/KAFKA-9990
Project: Kafka
Issue Type:
Satish Duggana created KAFKA-9579:
-
Summary: RLM fetch implementation by adding respective purgatory
Key: KAFKA-9579
URL: https://issues.apache.org/jira/browse/KAFKA-9579
Project: Kafka
Satish Duggana created KAFKA-9569:
-
Summary: RSM implementation for HDFS storage.
Key: KAFKA-9569
URL: https://issues.apache.org/jira/browse/KAFKA-9569
Project: Kafka
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/KAFKA-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana resolved KAFKA-9554.
---
Resolution: Duplicate
Duplicate of https://issues.apache.org/jira/browse/KAFKA-9548
>
Satish Duggana created KAFKA-9550:
-
Summary: RemoteLogManager implementation
Key: KAFKA-9550
URL: https://issues.apache.org/jira/browse/KAFKA-9550
Project: Kafka
Issue Type: Sub-task
Satish Duggana created KAFKA-9549:
-
Summary: Local storage implementations for RSM and RLMM which can
be used in tests.
Key: KAFKA-9549
URL: https://issues.apache.org/jira/browse/KAFKA-9549
Project:
Satish Duggana created KAFKA-9548:
-
Summary: RemoteStorageManager and RemoteLogMetadataManager
interfaces.
Key: KAFKA-9548
URL: https://issues.apache.org/jira/browse/KAFKA-9548
Project: Kafka
Satish Duggana created KAFKA-8733:
-
Summary: Offline partitions occur when leader's disk is slow in
reads while responding to follower fetch requests.
Key: KAFKA-8733
URL:
Satish Duggana created KAFKA-7742:
-
Summary: DelegationTokenCache#hmacIdCache entry is not cleared
when a token is removed using removeToken(String tokenId) API.
Key: KAFKA-7742
URL:
Satish Duggana created KAFKA-7219:
-
Summary: Add topic/partition level metrics.
Key: KAFKA-7219
URL: https://issues.apache.org/jira/browse/KAFKA-7219
Project: Kafka
Issue Type: Improvement
Satish Duggana created KAFKA-7216:
-
Summary: Exception while running kafka-acls.sh from 1.0 env on
target Kafka env with 1.1.1
Key: KAFKA-7216
URL: https://issues.apache.org/jira/browse/KAFKA-7216
[
https://issues.apache.org/jira/browse/KAFKA-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858059#comment-15858059
]
Satish Duggana commented on KAFKA-4741:
---
[~ijuma] Thanks for merging the PR. Can you set me as
Satish Duggana created KAFKA-4741:
-
Summary: Memory leak in RecordAccumulator#append
Key: KAFKA-4741
URL: https://issues.apache.org/jira/browse/KAFKA-4741
Project: Kafka
Issue Type: Bug
[
https://issues.apache.org/jira/browse/KAFKA-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana updated KAFKA-4741:
--
Summary: Memory leak in RecordAccumulator.append (was: Memory leak in
[
https://issues.apache.org/jira/browse/KAFKA-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486424#comment-15486424
]
Satish Duggana commented on KAFKA-4156:
---
It works fine when classifier with value as test is used
[
https://issues.apache.org/jira/browse/KAFKA-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana updated KAFKA-4156:
--
Priority: Major (was: Blocker)
> Not able to download tests jar of kafka and kafka-streams
[
https://issues.apache.org/jira/browse/KAFKA-4156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Satish Duggana updated KAFKA-4156:
--
Description:
Below dependency is added in one of our repos to use EmbeddedKafkaCluster but
Satish Duggana created KAFKA-4156:
-
Summary: Not able to download tests jar of kafka and kafka-streams
from maven repo.
Key: KAFKA-4156
URL: https://issues.apache.org/jira/browse/KAFKA-4156
Project:
96 matches
Mail list logo
