[jira] [Created] (KAFKA-6581) ConsumerGroupCommand hangs if even one of the partition is unavailable

2018-02-22 Thread Sahil Aggarwal (JIRA)
Sahil Aggarwal created KAFKA-6581: - Summary: ConsumerGroupCommand hangs if even one of the partition is unavailable Key: KAFKA-6581 URL: https://issues.apache.org/jira/browse/KAFKA-6581 Project:

[jira] [Comment Edited] (KAFKA-5157) Options for handling corrupt data during deserialization

2018-02-22 Thread childNo͡.de
[ https://issues.apache.org/jira/browse/KAFKA-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372564#comment-16372564 ] Marcel "childNo͡.de" Trautwein edited comment on KAFKA-5157 at 2/22/18 9:08 AM:

[jira] [Commented] (KAFKA-5157) Options for handling corrupt data during deserialization

2018-02-22 Thread childNo͡.de
[ https://issues.apache.org/jira/browse/KAFKA-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372564#comment-16372564 ] Marcel "childNo͡.de" Trautwein commented on KAFKA-5157: --- Just a question ... What I

[jira] [Commented] (KAFKA-6572) kafka-consumer-groups does not reset offsets to specified datetime correctly

2018-02-22 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372618#comment-16372618 ] huxihx commented on KAFKA-6572: --- [~slucas] Currently, the partition's offset will be set to the LEO (log end

[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2018-02-22 Thread AMOUSSOU DJANGBAN Baruch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372665#comment-16372665 ] AMOUSSOU DJANGBAN Baruch commented on KAFKA-4477: - Thanks [~hawk_aa] Are you know if in

[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2018-02-22 Thread AMOUSSOU DJANGBAN Baruch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372689#comment-16372689 ] AMOUSSOU DJANGBAN Baruch commented on KAFKA-4477: - Ok Thanks    > Node reduces its ISR

[jira] [Commented] (KAFKA-6581) ConsumerGroupCommand hangs if even one of the partition is unavailable

2018-02-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372688#comment-16372688 ] ASF GitHub Bot commented on KAFKA-6581: --- SahilAggarwal opened a new pull request #4612: KAFKA-6581:

[jira] [Updated] (KAFKA-6581) ConsumerGroupCommand hangs if even one of the partition is unavailable

2018-02-22 Thread Sahil Aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Aggarwal updated KAFKA-6581: -- Priority: Minor (was: Major) > ConsumerGroupCommand hangs if even one of the partition is

[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2018-02-22 Thread AMOUSSOU DJANGBAN Baruch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372629#comment-16372629 ] AMOUSSOU DJANGBAN Baruch commented on KAFKA-4477: - Hi All, I have same issue actually

[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2018-02-22 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372644#comment-16372644 ] Håkon Åmdal commented on KAFKA-4477: We ended up running our own build of Kafka 0.11.0 where we cherry

[jira] [Commented] (KAFKA-4477) Node reduces its ISR to itself, and doesn't recover. Other nodes do not take leadership, cluster remains sick until node is restarted.

2018-02-22 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372683#comment-16372683 ] Håkon Åmdal commented on KAFKA-4477: Not sure, but if they use Kafka 1.0.0, all those commits seems to

[jira] [Resolved] (KAFKA-6577) Connect standalone SASL file source and sink test fails without explanation

2018-02-22 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-6577. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 4610

[jira] [Commented] (KAFKA-6577) Connect standalone SASL file source and sink test fails without explanation

2018-02-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372606#comment-16372606 ] ASF GitHub Bot commented on KAFKA-6577: --- dguy closed pull request #4610: KAFKA-6577: Fix Connect

[jira] [Commented] (KAFKA-6572) kafka-consumer-groups does not reset offsets to specified datetime correctly

2018-02-22 Thread Sharon Lucas (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372986#comment-16372986 ] Sharon Lucas commented on KAFKA-6572: - No.  There were tons of messages whose timestamp was greater

[jira] [Updated] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-6583: -- Affects Version/s: 0.10.2.0 0.11.0.0 > Metadata should include number of state

[jira] [Updated] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-6583: -- Component/s: streams > Metadata should include number of state stores for task >

[jira] [Created] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
Richard Yu created KAFKA-6583: - Summary: Metadata should include number of state stores for task Key: KAFKA-6583 URL: https://issues.apache.org/jira/browse/KAFKA-6583 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373124#comment-16373124 ] Richard Yu commented on KAFKA-6583: --- This issue will block

[jira] [Updated] (KAFKA-4696) Streams standby task assignment should be state-store aware

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-4696: -- External issue URL: https://issues.apache.org/jira/browse/KAFKA-6583 > Streams standby task assignment

[jira] [Comment Edited] (KAFKA-6572) kafka-consumer-groups does not reset offsets to specified datetime correctly

2018-02-22 Thread Sharon Lucas (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372986#comment-16372986 ] Sharon Lucas edited comment on KAFKA-6572 at 2/22/18 4:03 PM: -- [~huxi_2b] 

[jira] [Created] (KAFKA-6584) Session expiration concurrent with ZooKeeper leadership failover may lead to broker registration failure

2018-02-22 Thread Chris Thunes (JIRA)
Chris Thunes created KAFKA-6584: --- Summary: Session expiration concurrent with ZooKeeper leadership failover may lead to broker registration failure Key: KAFKA-6584 URL:

[jira] [Updated] (KAFKA-4696) Streams standby task assignment should be state-store aware

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-4696: -- External issue URL: (was: https://issues.apache.org/jira/browse/KAFKA-6583) > Streams standby task

[jira] [Created] (KAFKA-6585) Sonsolidate duplicated logic on reset tools

2018-02-22 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-6585: Summary: Sonsolidate duplicated logic on reset tools Key: KAFKA-6585 URL: https://issues.apache.org/jira/browse/KAFKA-6585 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-6586) Refactor Connect executables

2018-02-22 Thread Randall Hauch (JIRA)
Randall Hauch created KAFKA-6586: Summary: Refactor Connect executables Key: KAFKA-6586 URL: https://issues.apache.org/jira/browse/KAFKA-6586 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-6585) Consolidate duplicated logic on reset tools

2018-02-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-6585: --- Summary: Consolidate duplicated logic on reset tools (was: Sonsolidate duplicated logic on

[jira] [Commented] (KAFKA-5157) Options for handling corrupt data during deserialization

2018-02-22 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373432#comment-16373432 ] Matthias J. Sax commented on KAFKA-5157: It is by design. It's of course something different

[jira] [Updated] (KAFKA-5157) Options for handling corrupt data during deserialization

2018-02-22 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-5157: --- Description: When there is a bad formatted data in the source topics, deserialization will

[jira] [Updated] (KAFKA-5157) Options for handling corrupt data during deserialization

2018-02-22 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-5157: --- Labels: kip user-experience (was: user-experience) > Options for handling corrupt data

[jira] [Updated] (KAFKA-6586) Refactor Connect executables

2018-02-22 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch updated KAFKA-6586: - Description: The main methods in {{ConnectDistributed}} and {{ConnectStandalone}} have a lot of

[jira] [Commented] (KAFKA-6585) Consolidate duplicated logic on reset tools

2018-02-22 Thread Aditya Vivek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373401#comment-16373401 ] Aditya Vivek commented on KAFKA-6585: - [~guozhang] Can I pick this up? > Consolidate duplicated logic

[jira] [Commented] (KAFKA-6585) Consolidate duplicated logic on reset tools

2018-02-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373546#comment-16373546 ] Jason Gustafson commented on KAFKA-6585: [~adityavivek94] I went ahead and assigned to you. Of

[jira] [Commented] (KAFKA-6002) Kafka Connect Transform transforming JSON string into actual object

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373755#comment-16373755 ] Ewen Cheslack-Postava commented on KAFKA-6002: -- [~edvard.poliakov] Not sure if you made

[jira] [Assigned] (KAFKA-4696) Streams standby task assignment should be state-store aware

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu reassigned KAFKA-4696: - Assignee: Richard Yu > Streams standby task assignment should be state-store aware >

[jira] [Updated] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-6583: -- Issue Type: New Feature (was: Improvement) > Metadata should include number of state stores for task >

[jira] [Comment Edited] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373124#comment-16373124 ] Richard Yu edited comment on KAFKA-6583 at 2/23/18 12:52 AM: - This issue will

[jira] [Commented] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373759#comment-16373759 ] Matthias J. Sax commented on KAFKA-6583: Thanks for putting the comment. It's better to "Link"

[jira] [Assigned] (KAFKA-6585) Consolidate duplicated logic on reset tools

2018-02-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-6585: -- Assignee: Aditya Vivek > Consolidate duplicated logic on reset tools >

[jira] [Commented] (KAFKA-4696) Streams standby task assignment should be state-store aware

2018-02-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373589#comment-16373589 ] ASF GitHub Bot commented on KAFKA-4696: --- ConcurrencyPractitioner opened a new pull request #4615:

[jira] [Commented] (KAFKA-6551) Unbounded queues in WorkerSourceTask cause OutOfMemoryError

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373906#comment-16373906 ] Ewen Cheslack-Postava commented on KAFKA-6551: -- Seems reasonable – this should only be an

[jira] [Commented] (KAFKA-5575) SchemaBuilder should have a method to clone an existing Schema.

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373925#comment-16373925 ] Ewen Cheslack-Postava commented on KAFKA-5575: -- [~rhauch] I think I didn't trigger a vote on

[jira] [Commented] (KAFKA-5828) Allow explicitly setting polling interval for Kafka connectors

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373773#comment-16373773 ] Ewen Cheslack-Postava commented on KAFKA-5828: -- I don't think this is best solved at the

[jira] [Updated] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-6583: -- Labels: needs-kip (was: ) > Metadata should include number of state stores for task >

[jira] [Commented] (KAFKA-6578) Connect distributed and standalone worker 'main()' methods should catch and log all exceptions

2018-02-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373981#comment-16373981 ] ASF GitHub Bot commented on KAFKA-6578: --- hachikuji closed pull request #4609: KAFKA-6578: Changed

[jira] [Commented] (KAFKA-5740) Use separate file for HTTP logs

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373949#comment-16373949 ] Ewen Cheslack-Postava commented on KAFKA-5740: -- Isn't this something that can be handled via

[jira] [Commented] (KAFKA-6585) Consolidate duplicated logic on reset tools

2018-02-22 Thread Aditya Vivek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373951#comment-16373951 ] Aditya Vivek commented on KAFKA-6585: - Thanks Jason :) > Consolidate duplicated logic on reset tools

[jira] [Commented] (KAFKA-6433) Connect distributed workers should fail if their config is "incompatible" with leader's

2018-02-22 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373961#comment-16373961 ] Ewen Cheslack-Postava commented on KAFKA-6433: -- This needs a lot of thought around upgrades,

[jira] [Resolved] (KAFKA-6578) Connect distributed and standalone worker 'main()' methods should catch and log all exceptions

2018-02-22 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6578. Resolution: Fixed Fix Version/s: 1.1.0 > Connect distributed and standalone worker

[jira] [Commented] (KAFKA-6572) kafka-consumer-groups does not reset offsets to specified datetime correctly

2018-02-22 Thread huxihx (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374023#comment-16374023 ] huxihx commented on KAFKA-6572: --- [~slucas] Could it be possible that some records in those segments have no

[jira] [Issue Comment Deleted] (KAFKA-6583) Metadata should include number of state stores for task

2018-02-22 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated KAFKA-6583: -- Comment: was deleted (was: This issue will block KAFKA-4696 until resolved.) > Metadata should include

[jira] [Created] (KAFKA-6582) Partitions get underreplicated, with a single ISR, and doesn't recover. Other brokers do not take over and we need to manually restart the broker.

2018-02-22 Thread Jurriaan Pruis (JIRA)
Jurriaan Pruis created KAFKA-6582: - Summary: Partitions get underreplicated, with a single ISR, and doesn't recover. Other brokers do not take over and we need to manually restart the broker. Key: KAFKA-6582

[jira] [Commented] (KAFKA-3450) Producer blocks on send to topic that doesn't exist if auto create is disabled

2018-02-22 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372875#comment-16372875 ] Josef Ludvíček commented on KAFKA-3450: --- Same problem with 0.11.0.1 Is there any plan to resolve