[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-21 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1601136417 Unrelated test failures: ``` [Build / JDK 17 and Scala 2.13 /

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-21 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1600387314 > @divijvaidya , sorry, which commits should I check? I merged together new changes in one commit. It's this one:

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-20 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1599308163 Thank you @showuon @satishd for your review so far. I have added another commit to de-flake some tests, improved thread safety for `Entry`, added new unit tests and added log

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-19 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1597273967 Rebasing from trunk to fix flaky CI test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-16 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1594369804 Thank you for looking into this @satishd > But we observed an impact when there is a degradation in our remote storage(HDFS) clusters. Yes, you are right, the impact

[GitHub] [kafka] divijvaidya commented on pull request #13850: KAFKA-15084: Remove lock contention from RemoteIndexCache

2023-06-15 Thread via GitHub
divijvaidya commented on PR #13850: URL: https://github.com/apache/kafka/pull/13850#issuecomment-1592791383 @satishd @showuon please take a look at this when you get a chance. We have identified this as a major problem while running Tiered Storage in production. -- This is an automated