[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503113#comment-16503113 ] Ashish Surana commented on KAFKA-6976: -- One more broker side error: 2018-06-06 07:41:28,522

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503112#comment-16503112 ] Ashish Surana commented on KAFKA-6976: -- Observed some errors on broker side: (a) 2018-06-06

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509296#comment-16509296 ] Ashish Surana commented on KAFKA-6976: -- The issue is resolved after making some changes to broker

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 10:07 AM:

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 10:07 AM:

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 7:47 AM: --- The issue

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 7:48 AM: --- {code:java}

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 7:47 AM: --- The issue

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 7:48 AM: --- {code:java}

[jira] [Commented] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509297#comment-16509297 ] Ashish Surana commented on KAFKA-6631: -- The issue is resolved after making some changes to broker

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361515#comment-16361515 ] Ashish Surana commented on KAFKA-6555: -- Hi Matthias,   Thanks for pointing to KAFKA-6144. As I go

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in

[jira] [Created] (KAFKA-6555) Making state store queryable during restoration

Ashish Surana created KAFKA-6555: Summary: Making state store queryable during restoration Key: KAFKA-6555 URL: https://issues.apache.org/jira/browse/KAFKA-6555 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Flags: Important > Making state store queryable during restoration >

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361613#comment-16361613 ] Ashish Surana edited comment on KAFKA-6555 at 2/13/18 12:04 AM: Ok,

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367822#comment-16367822 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 8:10 PM: --- First let's

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367822#comment-16367822 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 8:10 PM: --- First let's

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367822#comment-16367822 ] Ashish Surana commented on KAFKA-6555: -- First let's see when a task can go to restoration state: *

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366398#comment-16366398 ] Ashish Surana commented on KAFKA-6555: -- Raised PR @[https://github.com/apache/kafka/pull/4575]

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361515#comment-16361515 ] Ashish Surana edited comment on KAFKA-6555 at 2/15/18 11:42 PM: Hi

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:44 AM: Sure.

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:44 AM: Sure.

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366471#comment-16366471 ] Ashish Surana commented on KAFKA-6555: -- Sure. This approach: Basically here we are allowing to query

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:45 AM: Sure.

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606957#comment-16606957 ] Ashish Surana edited comment on KAFKA-7149 at 9/7/18 10:29 AM: --- [~guozhang] 

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606957#comment-16606957 ] Ashish Surana commented on KAFKA-7149: -- [~guozhang] As you suggested, below changes can reduce the

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Description: We observed that when we have high number of partitions, instances or

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Description: We observed that when we have high number of partitions, instances or

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Attachment: (was: AssignmentInfo.java) > Reduce assignment data size to improve kafka

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539596#comment-16539596 ] Ashish Surana edited comment on KAFKA-7149 at 7/11/18 6:33 AM: --- Made the

[jira] [Created] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

Ashish Surana created KAFKA-7149: Summary: Reduce assignment data size to improve kafka streams scalability Key: KAFKA-7149 URL: https://issues.apache.org/jira/browse/KAFKA-7149 Project: Kafka

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539565#comment-16539565 ] Ashish Surana commented on KAFKA-6976: -- Created below ticket to address this issue the right way:

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539596#comment-16539596 ] Ashish Surana edited comment on KAFKA-7149 at 7/11/18 6:34 AM: --- Made the

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396531#comment-16396531 ] Ashish Surana commented on KAFKA-6555: -- +1. Let me capture all the approaches in KIP, and we can have

[jira] [Created] (KAFKA-6642) Rack aware replica assignment in kafka streams

Ashish Surana created KAFKA-6642: Summary: Rack aware replica assignment in kafka streams Key: KAFKA-6642 URL: https://issues.apache.org/jira/browse/KAFKA-6642 Project: Kafka Issue Type: New

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:18 AM: --- Current task

[jira] [Commented] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416778#comment-16416778 ] Ashish Surana commented on KAFKA-6642: -- Current task assignor is sticky, and it can be made

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:13 AM: --- Current task

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:12 AM: --- Current task

[jira] [Updated] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6642: - Summary: Rack aware task assignment in kafka streams (was: Rack aware replica assignment in

[jira] [Updated] (KAFKA-6718) Rack Aware Replica Task Assignment for Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6718: - Description: |Machines in data centre are sometimes grouped in racks. Racks provide isolation as

[jira] [Commented] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420345#comment-16420345 ] Ashish Surana commented on KAFKA-6642: -- Hi Wang, Sure, I am working with Deepak on this. PR is very

[jira] [Comment Edited] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/30/18 10:05 AM: Current

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631333#comment-16631333 ] Ashish Surana edited comment on KAFKA-7149 at 9/28/18 4:18 AM: --- Navinder 

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740052#comment-16740052 ] Ashish Surana commented on KAFKA-7149: -- Is this change on track for 2.2.0 release. I believe this is

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962541#comment-16962541 ] Ashish Surana commented on KAFKA-6555: -- [~vinoth] I worked on it earlier like an year back and since

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948413#comment-16948413 ] Ashish Surana commented on KAFKA-7149: -- I think along with these encoding changes we are also

[jira] [Created] (KAFKA-10608) Add support for rolling upgrade with topology changes

Ashish Surana created KAFKA-10608: - Summary: Add support for rolling upgrade with topology changes Key: KAFKA-10608 URL: https://issues.apache.org/jira/browse/KAFKA-10608 Project: Kafka

[jira] [Commented] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212112#comment-17212112 ] Ashish Surana commented on KAFKA-6642: -- Since the other ticket is abandoned, should I create KIP for