[jira] [Resolved] (KAFKA-10387) Cannot include SMT configs with source connector that uses topic.creation.* properties

2020-08-16 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-10387. Resolution: Fixed > Cannot include SMT configs with source connector that

[jira] [Commented] (KAFKA-10387) Cannot include SMT configs with source connector that uses topic.creation.* properties

2020-08-16 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178747#comment-17178747 ] Konstantine Karantasis commented on KAFKA-10387: Addition of configs for

[jira] [Updated] (KAFKA-10387) Cannot include SMT configs with source connector that uses topic.creation.* properties

2020-08-16 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-10387: --- Fix Version/s: 2.6.1 2.7.0 > Cannot include SMT configs w

[GitHub] [kafka] carlos-verdes commented on pull request #9176: Allow replace all for RegexRouter

2020-08-16 Thread GitBox
carlos-verdes commented on pull request #9176: URL: https://github.com/apache/kafka/pull/9176#issuecomment-674684857 @kkonstantine can you help me with this PR or point to me to someone who can help? I really would appreciate :) -

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-16 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10401: Fix Version/s: 2.6.1 2.7.0 > GroupMetadataManager ignores current_state_timesta

[jira] [Updated] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-16 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10401: Priority: Critical (was: Major) > GroupMetadataManager ignores current_state_timestamp field for

[GitHub] [kafka] kkonstantine merged pull request #9172: KAFKA-10387: Fix inclusion of transformation configs when topic creation is enabled in Connect

2020-08-16 Thread GitBox
kkonstantine merged pull request #9172: URL: https://github.com/apache/kafka/pull/9172 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] kkonstantine edited a comment on pull request #9172: KAFKA-10387: Fix inclusion of transformation configs when topic creation is enabled in Connect

2020-08-16 Thread GitBox
kkonstantine edited a comment on pull request #9172: URL: https://github.com/apache/kafka/pull/9172#issuecomment-674644885 Thanks @rhauch ! Tested manually with transforms from the `plugin.path` as well. Merging on `trunk` and backporting to `2.6`. (2/3 builds were green) ---

[GitHub] [kafka] kkonstantine commented on pull request #9172: KAFKA-10387: Fix inclusion of transformation configs when topic creation is enabled in Connect

2020-08-16 Thread GitBox
kkonstantine commented on pull request #9172: URL: https://github.com/apache/kafka/pull/9172#issuecomment-674644885 Thanks @rhauch ! Tested manually with transforms from the `plugin.path` as well. Merging on `trunk` and backporting to `2.6`. -

[GitHub] [kafka] apovzner commented on pull request #8768: KAFKA-10023: Enforce broker-wide and per-listener connection creation…

2020-08-16 Thread GitBox
apovzner commented on pull request #8768: URL: https://github.com/apache/kafka/pull/8768#issuecomment-674639202 Hi @rajinisivaram, the test failure turned out to be a bug where I did not remove connection rate sensors on listener removal. I fixed the code and tests now pass.

[jira] [Assigned] (KAFKA-10401) GroupMetadataManager ignores current_state_timestamp field for GROUP_METADATA_VALUE_SCHEMA_V3

2020-08-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reassigned KAFKA-10401: - Assignee: Luke Chen > GroupMetadataManager ignores current_state_timestamp field for > GROUP_M

[GitHub] [kafka] huxihx opened a new pull request #9189: Kafka 10407: Have KafkaLog4jAppender support `linger.ms` and `batch.size`

2020-08-16 Thread GitBox
huxihx opened a new pull request #9189: URL: https://github.com/apache/kafka/pull/9189 https://issues.apache.org/jira/browse/KAFKA-10407 Currently, KafkaLog4jAppender does not support `linger.ms` or `batch.size`. In some situations, those two parameters are good to tune the performan

[jira] [Comment Edited] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2020-08-16 Thread Alena Messmer (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178678#comment-17178678 ] Alena Messmer edited comment on KAFKA-8154 at 8/17/20, 2:00 AM: ---

[jira] [Comment Edited] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2020-08-16 Thread Alena Messmer (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178678#comment-17178678 ] Alena Messmer edited comment on KAFKA-8154 at 8/17/20, 1:59 AM: ---

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2020-08-16 Thread Alena Messmer (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178678#comment-17178678 ] Alena Messmer commented on KAFKA-8154: -- [~pwebb.itrs] [~rnataraja] I've opened a [pu

[jira] [Assigned] (KAFKA-10407) add linger.ms parameter support to KafkaLog4jAppender

2020-08-16 Thread huxihx (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxihx reassigned KAFKA-10407: -- Assignee: huxihx > add linger.ms parameter support to KafkaLog4jAppender > --

[GitHub] [kafka] Spatterjaaay opened a new pull request #9188: break when dst is full so that unwrap isn't called when appreadbuffer…

2020-08-16 Thread GitBox
Spatterjaaay opened a new pull request #9188: URL: https://github.com/apache/kafka/pull/9188 … may have data There are a couple of different situations which can result in BUFFER_OVERFLOW on read with the current implementation, due to the while loop structure (such as TLS compr

[GitHub] [kafka] huxihx commented on pull request #7711: KAFKA-9157: Avoid generating empty segments if all records are deleted after cleaning

2020-08-16 Thread GitBox
huxihx commented on pull request #7711: URL: https://github.com/apache/kafka/pull/7711#issuecomment-674612527 @junrao Could you take some time to review this patch? Thanks :) This is an automated message from the Apache Git S

[jira] [Commented] (KAFKA-10363) Broker try to connect to a new cluster when there are changes in zookeeper.connect properties

2020-08-16 Thread Rens Groothuijsen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178634#comment-17178634 ] Rens Groothuijsen commented on KAFKA-10363: --- One possible workaround is to upd

[jira] [Created] (KAFKA-10407) add linger.ms parameter support to KafkaLog4jAppender

2020-08-16 Thread Yu Yang (Jira)
Yu Yang created KAFKA-10407: --- Summary: add linger.ms parameter support to KafkaLog4jAppender Key: KAFKA-10407 URL: https://issues.apache.org/jira/browse/KAFKA-10407 Project: Kafka Issue Type: Impro

[GitHub] [kafka] rajinisivaram commented on pull request #8768: KAFKA-10023: Enforce broker-wide and per-listener connection creation…

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #8768: URL: https://github.com/apache/kafka/pull/8768#issuecomment-674554549 @apovzner DynamicBrokerReconfigurationTest.testAddRemoveSaslListeners failed in all three PR builds, so probably related? ``` 15:55:45 kafka.server.DynamicBrokerReconfi

[GitHub] [kafka] lbradstreet commented on pull request #9187: MINOR: bump mockito to 3.5.0

2020-08-16 Thread GitBox
lbradstreet commented on pull request #9187: URL: https://github.com/apache/kafka/pull/9187#issuecomment-674551252 I thought this might be useful for jmh benchmarks as reflection can often throw us off. I'm not sure we use the inline mock maker anywhere though. ---

[GitHub] [kafka] lbradstreet opened a new pull request #9187: MINOR: bump mockito to 3.5.0

2020-08-16 Thread GitBox
lbradstreet opened a new pull request #9187: URL: https://github.com/apache/kafka/pull/9187 3.5.0 no longer uses any reflection and is backwards compatible. The lack of reflection could be helpful when writing jmh benchmark tests as often these mocks can completely throw off benchmark resu

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-16 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17178519#comment-17178519 ] Vagesh Mathapati commented on KAFKA-10396: -- I mean to say if my topic going to

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-16 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vagesh Mathapati updated KAFKA-10396: - Attachment: (was: MyStreamProcessor.java) > Overall memory of container keep on grow

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-16 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vagesh Mathapati updated KAFKA-10396: - Attachment: MyStreamProcessor.java > Overall memory of container keep on growing due to

[GitHub] [kafka] vamossagar12 commented on pull request #6669: KAFKA-8238: Adding Number of messages/bytes read

2020-08-16 Thread GitBox
vamossagar12 commented on pull request #6669: URL: https://github.com/apache/kafka/pull/6669#issuecomment-674534010 > Hey there @vamossagar12, are you still working on this PR? hey @stanislavkozlovski I think I had made some final changes but couldn't get past the final review(I sho

[GitHub] [kafka] rajinisivaram commented on pull request #8768: KAFKA-10023: Enforce broker-wide and per-listener connection creation…

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #8768: URL: https://github.com/apache/kafka/pull/8768#issuecomment-674533627 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Resolved] (KAFKA-10404) Flaky Test kafka.api.SaslSslConsumerTest.testCoordinatorFailover

2020-08-16 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-10404. Fix Version/s: 2.6.1 2.5.2 2.7.0 Reviewer: M

[GitHub] [kafka] rajinisivaram commented on pull request #9183: KAFKA-10404; Use higher poll timeout to avoid rebalance in testCoordinatorFailover

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #9183: URL: https://github.com/apache/kafka/pull/9183#issuecomment-674528245 @omkreddy Thanks for the review, merging to trunk, 2.6 and 2.5. This is an automated message from the Apache

[GitHub] [kafka] rajinisivaram merged pull request #9183: KAFKA-10404; Use higher poll timeout to avoid rebalance in testCoordinatorFailover

2020-08-16 Thread GitBox
rajinisivaram merged pull request #9183: URL: https://github.com/apache/kafka/pull/9183 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] rajinisivaram commented on a change in pull request #9142: MINOR: Fix delete_topic for system tests

2020-08-16 Thread GitBox
rajinisivaram commented on a change in pull request #9142: URL: https://github.com/apache/kafka/pull/9142#discussion_r471094493 ## File path: tests/kafkatest/services/kafka/kafka.py ## @@ -503,7 +503,7 @@ def create_topic(self, topic_cfg, node=None, use_zk_to_create_topic=True

[GitHub] [kafka] rajinisivaram merged pull request #9143: MINOR: Fix the way total consumed is calculated for verifiable consumer

2020-08-16 Thread GitBox
rajinisivaram merged pull request #9143: URL: https://github.com/apache/kafka/pull/9143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] rajinisivaram commented on pull request #9143: MINOR: Fix the way total consumed is calculated for verifiable consumer

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #9143: URL: https://github.com/apache/kafka/pull/9143#issuecomment-674507951 @skaundinya15 Thanks for running the tests, merging to trunk. This is an automated message from the Apache G

[jira] [Resolved] (KAFKA-9516) Flaky Test PlaintextProducerSendTest#testNonBlockingProducer

2020-08-16 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9516. --- Fix Version/s: 2.6.1 2.5.2 2.7.0 Reviewer: Isma

[jira] [Resolved] (KAFKA-8033) Flaky Test PlaintextConsumerTest#testFetchInvalidOffset

2020-08-16 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8033. --- Fix Version/s: 2.5.2 Reviewer: Ismael Juma Resolution: Fixed > Flaky Test Pla

[GitHub] [kafka] rajinisivaram commented on pull request #9184: KAFKA-8033; Wait for NoOffsetForPartitionException in testFetchInvalidOffset

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #9184: URL: https://github.com/apache/kafka/pull/9184#issuecomment-674505814 @ijuma Thanks for the review. Yes, NoOffsetForPartitionException continues to be thrown as soon as possible, typically less than 50ms. Merging to trunk, 2.6 and 2.5. -

[GitHub] [kafka] rajinisivaram merged pull request #9184: KAFKA-8033; Wait for NoOffsetForPartitionException in testFetchInvalidOffset

2020-08-16 Thread GitBox
rajinisivaram merged pull request #9184: URL: https://github.com/apache/kafka/pull/9184 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] rajinisivaram merged pull request #9181: KAFKA-9516; Increase timeout in testNonBlockingProducer to make it more reliable

2020-08-16 Thread GitBox
rajinisivaram merged pull request #9181: URL: https://github.com/apache/kafka/pull/9181 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] rajinisivaram commented on pull request #9181: KAFKA-9516; Increase timeout in testNonBlockingProducer to make it more reliable

2020-08-16 Thread GitBox
rajinisivaram commented on pull request #9181: URL: https://github.com/apache/kafka/pull/9181#issuecomment-674503723 @ijuma Thanks for the review, merging to trunk, 2.6 and 2.5. This is an automated message from the Apache Gi

[GitHub] [kafka] JoelWee commented on pull request #9186: KAFKA-10277: Allow null keys with non-null mappedKey in KStreamKGlobalTable join

2020-08-16 Thread GitBox
JoelWee commented on pull request #9186: URL: https://github.com/apache/kafka/pull/9186#issuecomment-674500361 [KAFKA-10277](https://issues.apache.org/jira/browse/KAFKA-10277?jql=project%20%3D%20KAFKA%20AND%20labels%20%3D%20newbie%20AND%20status%20%3D%20Open%20ORDER%20BY%20updated%20DESC)

[GitHub] [kafka] JoelWee opened a new pull request #9186: KAFKA-10277: Allow null keys with non-null mappedKey in KStreamKGlobalTable join

2020-08-16 Thread GitBox
JoelWee opened a new pull request #9186: URL: https://github.com/apache/kafka/pull/9186 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade notes)

[GitHub] [kafka] stanislavkozlovski commented on pull request #6669: KAFKA-8238: Adding Number of messages/bytes read

2020-08-16 Thread GitBox
stanislavkozlovski commented on pull request #6669: URL: https://github.com/apache/kafka/pull/6669#issuecomment-674497333 Hey there @vamossagar12, are you still working on this PR? This is an automated message from the Apache