[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-12 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905430#comment-16905430 ] Vinoth Chandar commented on KAFKA-7149: --- While looking at changes to detect topology changes,

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-12 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905430#comment-16905430 ] Vinoth Chandar edited comment on KAFKA-7149 at 8/12/19 5:47 PM: While

[jira] [Commented] (KAFKA-8799) Support ability to pass global user data to consumers during Assignment

2019-08-13 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906627#comment-16906627 ] Vinoth Chandar commented on KAFKA-8799: --- [~guozhang] filed this for the longer term fix. >

[jira] [Created] (KAFKA-8799) Support ability to pass global user data to consumers during Assignment

2019-08-13 Thread Vinoth Chandar (JIRA)
Vinoth Chandar created KAFKA-8799: - Summary: Support ability to pass global user data to consumers during Assignment Key: KAFKA-8799 URL: https://issues.apache.org/jira/browse/KAFKA-8799 Project:

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-02 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899224#comment-16899224 ] Vinoth Chandar commented on KAFKA-7149: --- [~guozhang] [~NaviBrar] Do you mind if I claim this issue,

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-16 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909140#comment-16909140 ] Vinoth Chandar commented on KAFKA-7149: --- [~guozhang] Ping ping :) > Reduce assignment data size

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-16 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909314#comment-16909314 ] Vinoth Chandar commented on KAFKA-7149: --- To close the loop on turning on compression on the backing

[jira] [Created] (KAFKA-8810) Add mechanism to detect topology mismatch between streams instances

2019-08-16 Thread Vinoth Chandar (JIRA)
Vinoth Chandar created KAFKA-8810: - Summary: Add mechanism to detect topology mismatch between streams instances Key: KAFKA-8810 URL: https://issues.apache.org/jira/browse/KAFKA-8810 Project: Kafka

[jira] [Commented] (KAFKA-8810) Add mechanism to detect topology mismatch between streams instances

2019-08-20 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911528#comment-16911528 ] Vinoth Chandar commented on KAFKA-8810: --- [~pkleindl] Interesting. I was thinking of just generating

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916005#comment-16916005 ] Vinoth Chandar commented on KAFKA-8831: --- With this log statement _log.info("Active : " +

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916154#comment-16916154 ] Vinoth Chandar commented on KAFKA-8831: --- Elaborating on the topology for context. There are two

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916174#comment-16916174 ] Vinoth Chandar commented on KAFKA-8831: --- [~ableegoldman] yes to your statement above.  > Joining a

[jira] [Resolved] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8831. --- Resolution: Not A Problem I will think about better logging and put up a patch. Closing this

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916173#comment-16916173 ] Vinoth Chandar commented on KAFKA-8831: --- Turns out its a LockException that’s in trace mode in

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916192#comment-16916192 ] Vinoth Chandar commented on KAFKA-8831: --- Sorry.. keep forgetting to refresh the page before

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916234#comment-16916234 ] Vinoth Chandar commented on KAFKA-8831: --- >>Maybe I'm missing your point, but it doesn't seem like

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915954#comment-16915954 ] Vinoth Chandar commented on KAFKA-8831: --- [~cpettitt-confluent] I am not seeing it recover after 30

[jira] [Comment Edited] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915954#comment-16915954 ] Vinoth Chandar edited comment on KAFKA-8831 at 8/26/19 5:12 PM:

[jira] [Assigned] (KAFKA-8839) Improve logging in Kafka Streams around debugging task lifecycle

2019-08-27 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-8839: - Assignee: Vinoth Chandar > Improve logging in Kafka Streams around debugging task

[jira] [Created] (KAFKA-8839) Improve logging in Kafka Streams around debugging task lifecycle

2019-08-27 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-8839: - Summary: Improve logging in Kafka Streams around debugging task lifecycle Key: KAFKA-8839 URL: https://issues.apache.org/jira/browse/KAFKA-8839 Project: Kafka

[jira] [Commented] (KAFKA-8831) Joining a new instance sometimes does not cause rebalancing

2019-08-23 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914704#comment-16914704 ] Vinoth Chandar commented on KAFKA-8831: --- I am also facing this, on a similar setup. Feel free to

[jira] [Commented] (KAFKA-8810) Add mechanism to detect topology mismatch between streams instances

2019-08-27 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916881#comment-16916881 ] Vinoth Chandar commented on KAFKA-8810: --- Great points [~vvcephei] . I have not considered EOS

[jira] [Comment Edited] (KAFKA-8870) Prevent dirty reads of Streams state store from Interactive queries

2019-09-04 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922705#comment-16922705 ] Vinoth Chandar edited comment on KAFKA-8870 at 9/4/19 5:40 PM: --- Initial

[jira] [Created] (KAFKA-8913) Document topic based configs & ISR settings for Streams apps

2019-09-16 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-8913: - Summary: Document topic based configs & ISR settings for Streams apps Key: KAFKA-8913 URL: https://issues.apache.org/jira/browse/KAFKA-8913 Project: Kafka

[jira] [Assigned] (KAFKA-8870) Prevent dirty reads of Streams state store from Interactive queries

2019-09-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-8870: - Assignee: Vinoth Chandar > Prevent dirty reads of Streams state store from Interactive

[jira] [Commented] (KAFKA-8870) Prevent dirty reads of Streams state store from Interactive queries

2019-09-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16926066#comment-16926066 ] Vinoth Chandar commented on KAFKA-8870: --- Picking it up, since I have not heard objections >

[jira] [Resolved] (KAFKA-8913) Document topic based configs & ISR settings for Streams apps

2019-09-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8913. --- Resolution: Fixed > Document topic based configs & ISR settings for Streams apps >

[jira] [Assigned] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-06 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-7149: - Assignee: Vinoth Chandar (was: Navinder Brar) > Reduce assignment data size to improve

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-09 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904106#comment-16904106 ] Vinoth Chandar commented on KAFKA-7149: --- I changed the approach from the original PR. Noticed few

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-09 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904245#comment-16904245 ] Vinoth Chandar edited comment on KAFKA-7149 at 8/9/19 11:30 PM: Pasting

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-09 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904245#comment-16904245 ] Vinoth Chandar edited comment on KAFKA-7149 at 8/9/19 11:31 PM: Pasting

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-09 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904245#comment-16904245 ] Vinoth Chandar commented on KAFKA-7149: --- Pasting some size tests for old and new assignment

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

2019-08-09 Thread Vinoth Chandar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904252#comment-16904252 ] Vinoth Chandar commented on KAFKA-7149: --- [~guozhang] We can squeeze another 20% by simply writing

[jira] [Commented] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954789#comment-16954789 ] Vinoth Chandar commented on KAFKA-8994: --- Closing this, and merging this scope into KAFKA-6144 >

[jira] [Resolved] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8994. --- Resolution: Fixed > Streams should expose standby replication information & allow stale

[jira] [Assigned] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-6144: - Assignee: Navinder Brar > Allow state stores to serve stale reads during rebalance >

[jira] [Commented] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954791#comment-16954791 ] Vinoth Chandar commented on KAFKA-6144: --- yes please. Also consider merging the scope KAFKA-8994 and

[jira] [Resolved] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8994. --- Resolution: Duplicate > Streams should expose standby replication information & allow stale

[jira] [Reopened] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened KAFKA-8994: --- > Streams should expose standby replication information & allow stale reads of > state store >

[jira] [Commented] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954995#comment-16954995 ] Vinoth Chandar commented on KAFKA-8994: --- yes tbf, I actually tried to change this field after I

[jira] [Resolved] (KAFKA-8839) Improve logging in Kafka Streams around debugging task lifecycle

2019-10-07 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-8839. --- Resolution: Fixed Closing since the PR has been merged > Improve logging in Kafka Streams

[jira] [Updated] (KAFKA-8839) Improve logging in Kafka Streams around debugging task lifecycle

2019-10-07 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-8839: -- Fix Version/s: 2.4.0 > Improve logging in Kafka Streams around debugging task lifecycle >

[jira] [Assigned] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-07 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-8994: - Assignee: Vinoth Chandar > Streams should expose standby replication information &

[jira] [Created] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-07 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-8994: - Summary: Streams should expose standby replication information & allow stale reads of state store Key: KAFKA-8994 URL: https://issues.apache.org/jira/browse/KAFKA-8994

[jira] [Commented] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948135#comment-16948135 ] Vinoth Chandar commented on KAFKA-6144: --- yes. ideally the KIP should cover that as well. I am

[jira] [Commented] (KAFKA-4696) Streams standby task assignment should be state-store aware

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947200#comment-16947200 ] Vinoth Chandar commented on KAFKA-4696: --- My bad. you are right. and seems like this is tracked as a

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947204#comment-16947204 ] Vinoth Chandar edited comment on KAFKA-6555 at 10/8/19 10:18 PM: -

[jira] [Updated] (KAFKA-8994) Streams should expose standby replication information & allow stale reads of state store

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-8994: -- Description: Currently Streams interactive queries (IQ) fail during the time period where

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947204#comment-16947204 ] Vinoth Chandar commented on KAFKA-6555: --- [~asurana] wondering if you worked on the KIP. I am

[jira] [Commented] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947205#comment-16947205 ] Vinoth Chandar commented on KAFKA-6144: --- [~NaviBrar] curious to know if you got around to the KIP.

[jira] [Commented] (KAFKA-4696) Streams standby task assignment should be state-store aware

2019-10-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947183#comment-16947183 ] Vinoth Chandar commented on KAFKA-4696: --- Looks like the linked PRs have merged? Close this?  >

[jira] [Comment Edited] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947757#comment-16947757 ] Vinoth Chandar edited comment on KAFKA-6144 at 10/9/19 2:41 PM:

[jira] [Commented] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947757#comment-16947757 ] Vinoth Chandar commented on KAFKA-6144: --- [~NaviBrar] sg. Would you have cycles to drive the

[jira] [Commented] (KAFKA-6144) Allow state stores to serve stale reads during rebalance

2019-10-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951312#comment-16951312 ] Vinoth Chandar commented on KAFKA-6144: --- [~NaviBrar] Thnx again,. responded on the mailing list.

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-04 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030170#comment-17030170 ] Vinoth Chandar commented on KAFKA-9430: --- The right way to compute the endOffsets would be following

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031156#comment-17031156 ] Vinoth Chandar commented on KAFKA-9512: --- {code:java}

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031157#comment-17031157 ] Vinoth Chandar commented on KAFKA-9512: --- I will try to reproduce this locally and investigate.. 

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031169#comment-17031169 ] Vinoth Chandar commented on KAFKA-9512: --- I have run this locally over 15 times.. without luck.. 

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031166#comment-17031166 ] Vinoth Chandar commented on KAFKA-9430: --- [~guozhang] IIUC that change you point out, has simplified

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031873#comment-17031873 ] Vinoth Chandar commented on KAFKA-9430: --- >If it becomes straightforward to tighten up the estimate,

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031778#comment-17031778 ] Vinoth Chandar commented on KAFKA-9512: --- IIUC [~mjsax] saw this couple times and since this one is

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031779#comment-17031779 ] Vinoth Chandar commented on KAFKA-9430: --- >we can expose this from the changelogReader as well which

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032054#comment-17032054 ] Vinoth Chandar commented on KAFKA-9512: --- Repro-ed with some tips from guozhang.. Appears as though

[jira] [Comment Edited] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031778#comment-17031778 ] Vinoth Chandar edited comment on KAFKA-9512 at 2/7/20 2:00 AM: --- IIUC

[jira] [Comment Edited] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-06 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032054#comment-17032054 ] Vinoth Chandar edited comment on KAFKA-9512 at 2/7/20 1:59 AM: --- Repro-ed

[jira] [Resolved] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-18 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved KAFKA-9512. --- Resolution: Fixed Closing since the PR is now landed > Flaky Test

[jira] [Created] (KAFKA-9428) Expose standby information in KafkaStreams via queryMetadataForKey API

2020-01-14 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-9428: - Summary: Expose standby information in KafkaStreams via queryMetadataForKey API Key: KAFKA-9428 URL: https://issues.apache.org/jira/browse/KAFKA-9428 Project:

[jira] [Created] (KAFKA-9429) Allow ability to control whether stale reads out of state stores are desirable

2020-01-14 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-9429: - Summary: Allow ability to control whether stale reads out of state stores are desirable Key: KAFKA-9429 URL: https://issues.apache.org/jira/browse/KAFKA-9429

[jira] [Updated] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-9430: -- Fix Version/s: 2.5.0 > Tighten up lag estimates when source topic optimization is on >

[jira] [Created] (KAFKA-9431) Expose API in KafkaStreams to fetch all local offset lags

2020-01-14 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-9431: - Summary: Expose API in KafkaStreams to fetch all local offset lags Key: KAFKA-9431 URL: https://issues.apache.org/jira/browse/KAFKA-9431 Project: Kafka

[jira] [Created] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-01-14 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-9430: - Summary: Tighten up lag estimates when source topic optimization is on Key: KAFKA-9430 URL: https://issues.apache.org/jira/browse/KAFKA-9430 Project: Kafka

[jira] [Updated] (KAFKA-9429) Allow ability to control whether stale reads out of state stores are desirable

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-9429: -- Component/s: streams > Allow ability to control whether stale reads out of state stores are

[jira] [Updated] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-9430: -- Component/s: streams > Tighten up lag estimates when source topic optimization is on >

[jira] [Updated] (KAFKA-9428) Expose standby information in KafkaStreams via queryMetadataForKey API

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-9428: -- Component/s: streams > Expose standby information in KafkaStreams via queryMetadataForKey API

[jira] [Commented] (KAFKA-6144) Allow serving interactive queries from in-sync Standbys

2020-01-14 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015248#comment-17015248 ] Vinoth Chandar commented on KAFKA-6144: --- [~vvcephei] [~NaviBrar]  Added subtasks here..  > Allow

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-01-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017570#comment-17017570 ] Vinoth Chandar commented on KAFKA-9430: --- [~vvcephei] , is there a Jira for the refactor? we can

[jira] [Assigned] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-01-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-9430: - Assignee: Vinoth Chandar > Tighten up lag estimates when source topic optimization is

[jira] [Commented] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-04-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080010#comment-17080010 ] Vinoth Chandar commented on KAFKA-9846: --- First of all, thanks for flagging this issue

[jira] [Commented] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-04-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080063#comment-17080063 ] Vinoth Chandar commented on KAFKA-9846: --- >>During transfer of ownership of the task between

[jira] [Commented] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080554#comment-17080554 ] Vinoth Chandar commented on KAFKA-9846: --- hi [~ableegoldman], if you were talking about Task.State,

[jira] [Commented] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-04-10 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080989#comment-17080989 ] Vinoth Chandar commented on KAFKA-9846: --- Understood, I was always wary of grabbing those maps at

[jira] [Commented] (KAFKA-9757) Add documentation change for KIP-535

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071325#comment-17071325 ] Vinoth Chandar commented on KAFKA-9757: --- [~NaviBrar] Feel free to take it up.. Definitely helps

[jira] [Assigned] (KAFKA-9757) Add documentation change for KIP-535

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-9757: - Assignee: Navinder Brar (was: Vinoth Chandar) > Add documentation change for KIP-535 >

[jira] [Commented] (KAFKA-9759) Add documentation change for KIP-562

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071049#comment-17071049 ] Vinoth Chandar commented on KAFKA-9759: --- [~bchen225242] this KIP author is [~NaviBrar] , not me..

[jira] [Commented] (KAFKA-9757) Add documentation change for KIP-535

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071050#comment-17071050 ] Vinoth Chandar commented on KAFKA-9757: --- when is this due by? some guidance of timeline would be

[jira] [Commented] (KAFKA-9757) Add documentation change for KIP-535

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071108#comment-17071108 ] Vinoth Chandar commented on KAFKA-9757: --- That's a bit short for me. Will try by wednesday > Add

[jira] [Assigned] (KAFKA-8870) Prevent dirty reads of Streams state store from Interactive queries

2020-03-30 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-8870: - Assignee: (was: Vinoth Chandar) > Prevent dirty reads of Streams state store from

[jira] [Created] (KAFKA-10071) TopicCommand tool should make more efficient metadata calls to Kafka Servers

2020-05-29 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-10071: -- Summary: TopicCommand tool should make more efficient metadata calls to Kafka Servers Key: KAFKA-10071 URL: https://issues.apache.org/jira/browse/KAFKA-10071

[jira] [Assigned] (KAFKA-9945) TopicCommand should support --if-exists and --if-not-exists when --bootstrap-server is used

2020-05-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-9945: - Assignee: Vinoth Chandar > TopicCommand should support --if-exists and --if-not-exists

[jira] [Commented] (KAFKA-10174) Prefer --bootstrap-server ducktape tests using kafka_configs.sh

2020-07-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154741#comment-17154741 ] Vinoth Chandar commented on KAFKA-10174: [https://github.com/apache/kafka/pull/8948]   >

[jira] [Assigned] (KAFKA-10213) Prefer --bootstrap-server in ducktape tests for Kafka clients

2020-07-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-10213: -- Assignee: Ron Dagostino (was: Vinoth Chandar) > Prefer --bootstrap-server in

[jira] [Created] (KAFKA-10258) Get rid of use_zk_connection flag in kafka.py public methods

2020-07-09 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-10258: -- Summary: Get rid of use_zk_connection flag in kafka.py public methods Key: KAFKA-10258 URL: https://issues.apache.org/jira/browse/KAFKA-10258 Project: Kafka

[jira] [Updated] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

2020-06-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-10131: --- Description: Get the ducktape tests working without the --zookeeper flag (except for

[jira] [Updated] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

2020-06-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-10131: --- Description: Get the ducktape tests working without the --zookeeper flag (except for

[jira] [Updated] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

2020-06-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-10131: --- Description: Get the ducktape tests working without the --zookeeper flag (except for

[jira] [Commented] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-06-23 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143158#comment-17143158 ] Vinoth Chandar commented on KAFKA-9846: --- Probably don't have time this week.. But if y'all can take

[jira] [Assigned] (KAFKA-9846) Race condition can lead to severe lag underestimate for active tasks

2020-06-24 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned KAFKA-9846: - Assignee: (was: Vinoth Chandar) > Race condition can lead to severe lag

[jira] [Created] (KAFKA-10213) Prefer --bootstrap-server in ducktape tests for Kafka clients

2020-06-29 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-10213: -- Summary: Prefer --bootstrap-server in ducktape tests for Kafka clients Key: KAFKA-10213 URL: https://issues.apache.org/jira/browse/KAFKA-10213 Project: Kafka

[jira] [Created] (KAFKA-10174) Prefer --bootstrap-server ducktape tests using kafka_configs.sh

2020-06-16 Thread Vinoth Chandar (Jira)
Vinoth Chandar created KAFKA-10174: -- Summary: Prefer --bootstrap-server ducktape tests using kafka_configs.sh Key: KAFKA-10174 URL: https://issues.apache.org/jira/browse/KAFKA-10174 Project: Kafka

[jira] [Updated] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

2020-06-16 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated KAFKA-10131: --- Description: Get the ducktape tests working without the --zookeeper flag (except for

  1   2   >