[jira] [Updated] (KAFKA-1850) Failed reassignment leads to additional replica

[ https://issues.apache.org/jira/browse/KAFKA-1850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1850: - Assignee: (was: Neha Narkhede) > Failed reassignment leads to additional replica >

[jira] [Commented] (KAFKA-3835) Streams is creating two ProducerRecords for each send via RecordCollector

[ https://issues.apache.org/jira/browse/KAFKA-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833786#comment-15833786 ] Guozhang Wang commented on KAFKA-3835: -- [~ankushpuri] Sorry for the late reply as I was not pinged

[jira] [Commented] (KAFKA-1354) Failed to load class "org.slf4j.impl.StaticLoggerBinder"

[ https://issues.apache.org/jira/browse/KAFKA-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833784#comment-15833784 ] Maniyoor, RakeshAcharya (Rakesh) commented on KAFKA-1354: - HI I am currently OOO

[jira] [Updated] (KAFKA-4327) Move Reset Tool from core to streams

[ https://issues.apache.org/jira/browse/KAFKA-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4327: --- Description: This is a follow up on https://issues.apache.org/jira/browse/KAFKA-4008

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833906#comment-15833906 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833907#comment-15833907 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833913#comment-15833913 ] Elias Levy commented on KAFKA-4144: --- Jeyhun, sorry if I was not clear. My comment about not being able

Re: [DISCUSS] KIP-114: KTable materialization and improved semantics

Thanks for the KIP Eno, I have a few meta comments and a few detailed comments: 1. I like the materialize() function in general, but I would like to see how other KTable functions should be updated accordingly. For example, 1) KStreamBuilder.table(..) has a state store name parameter, and we will

[jira] [Updated] (KAFKA-3124) Update protocol wiki page to reflect latest request/response formats

[ https://issues.apache.org/jira/browse/KAFKA-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3124: - Assignee: (was: Liquan Pei) > Update protocol wiki page to reflect latest request/response

[jira] [Commented] (KAFKA-2363) ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread Transient Failure

[ https://issues.apache.org/jira/browse/KAFKA-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833785#comment-15833785 ] Guozhang Wang commented on KAFKA-2363: -- I have not seen this failure recently, how about you

[jira] [Commented] (KAFKA-3124) Update protocol wiki page to reflect latest request/response formats

[ https://issues.apache.org/jira/browse/KAFKA-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833783#comment-15833783 ] Guozhang Wang commented on KAFKA-3124: -- [~liquanpei] I'm un-assigning you from this task for now,

[jira] [Updated] (KAFKA-1354) Failed to load class "org.slf4j.impl.StaticLoggerBinder"

[ https://issues.apache.org/jira/browse/KAFKA-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1354: - Assignee: (was: Jay Kreps) > Failed to load class "org.slf4j.impl.StaticLoggerBinder" >

[jira] [Updated] (KAFKA-1676) Ability to cancel replica reassignment in progress

[ https://issues.apache.org/jira/browse/KAFKA-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1676: - Assignee: (was: Neha Narkhede) > Ability to cancel replica reassignment in progress >

Re: [VOTE] KIP-107 Add purgeDataBefore() API in AdminClient

To me the distinction between recovery-checkpoint and replication-checkpoint are different from the distinction between these two hw checkpoint values: when broker starts up and act as the leader for a partition, it can live without seeing the recovery checkpoint, but just cannot rely on the

[jira] [Updated] (KAFKA-4676) Kafka consumers gets stuck for some partitions

[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Shukla updated KAFKA-4676: - Attachment: stuck-consumer-node-1.log stuck-consumer-node-2.log

Re: [DISCUSS] KIP-114: KTable materialization and improved semantics

Hi, thanks for the KIP Eno! Here are my 2 cents: 1) I like Guozhang's proposal about removing store name from all KTable methods and generate internal names (however, I would do this as overloads). Furthermore, I would not force users to call .materialize() if they want to query a store, but add

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833891#comment-15833891 ] Matthias J. Sax commented on KAFKA-4113: [~mitch-seymour] see

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833899#comment-15833899 ] Matthias J. Sax commented on KAFKA-4144: Some of my thoughts: 1. I don't think, we should have a

[jira] [Commented] (KAFKA-4304) Extend Interactive Queries for return latest update timestamp per key

[ https://issues.apache.org/jira/browse/KAFKA-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833900#comment-15833900 ] Matthias J. Sax commented on KAFKA-4304: [~jeyhunkarimov] I am not sure what you mean by {{top-k}}

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833708#comment-15833708 ] Jeyhun Karimov commented on KAFKA-4144: --- [~elevy] I am not sure I got your point. Please correct me

[jira] [Commented] (KAFKA-4676) Kafka consumers gets stuck for some partitions

[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833747#comment-15833747 ] Jason Gustafson commented on KAFKA-4676: Can you provide full consumer logs please? It is also

[GitHub] kafka pull request #2407: logDirs empty error added

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2407 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833762#comment-15833762 ] Guozhang Wang commented on KAFKA-4113: -- Hello [~mitch-seymour], sorry for the late reply. In a recent

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

Hey Guozhang, Thanks for the review! Yes we have considered this approach and briefly explained why we don't do it in the rejected alternative section. Here is my concern with this approach in more detail: - This approach introduces tight coupling between kafka's logical leader election with

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833776#comment-15833776 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833775#comment-15833775 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Updated] (KAFKA-4613) Treat null-key records the same way for joins and aggreations

[ https://issues.apache.org/jira/browse/KAFKA-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4613: --- Status: Patch Available (was: Open) > Treat null-key records the same way for joins and

[jira] [Commented] (KAFKA-4676) Kafka consumers gets stuck for some partitions

[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833869#comment-15833869 ] Vishal Shukla commented on KAFKA-4676: -- Hi Jason, Thank you very much for immediate actions on

Re: [VOTE] KIP-107 Add purgeDataBefore() API in AdminClient

Yeah, your solution of adding new APIs certainly works and I don't think that is an issue. On the other hand I don't think it is an issue to add a new checkpoint file as well since we already have multiple checkpoint files. The benefit of the new approach you mentioned is probably not an issue in

Re: [Suggestion] Issues on StreamConfig Builder

Sounds good, thanks! On Thu, Jan 19, 2017 at 9:21 PM, Dongjin Lee wrote: > 1. Then, I will submit the KIP as soon as KAFKA-2898 is completed. > 2. Into following three sub-tasks: > a. Provide ProducerConfig#builder > b. Provide ConsumerConfig#builder > c. Provide

Re: [VOTE] KIP-107 Add purgeDataBefore() API in AdminClient

Thanks for the comment Guozhang. Please don't worry about being late. I would like to update the KIP if there is clear benefit of the new approach. I am wondering if there is any use-case or operation aspects that would benefit from the new approach. I am not saying that these checkpoint files

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

Hello Dong, Thanks for the very well written KIP. I had a general thought on the ZK path management, wondering if the following alternative would work: 1. Bump up versions in "brokers/topics/[topic]" and "/brokers/topics/[topic]/partitions/[partitionId]/state" to 2, in which the replica id is no

[jira] [Commented] (KAFKA-4613) Treat null-key records the same way for joins and aggreations

[ https://issues.apache.org/jira/browse/KAFKA-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833586#comment-15833586 ] ASF GitHub Bot commented on KAFKA-4613: --- GitHub user jeyhunkarimov opened a pull request:

[jira] [Assigned] (KAFKA-4613) Treat null-key records the same way for joins and aggreations

[ https://issues.apache.org/jira/browse/KAFKA-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeyhun Karimov reassigned KAFKA-4613: - Assignee: Jeyhun Karimov > Treat null-key records the same way for joins and aggreations

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833649#comment-15833649 ] Elias Levy commented on KAFKA-4144: --- That's fine. I am less concerned about the implementation details

Re: [DISCUSS] KIP-112: Handle disk failure for JBOD

I think it also affects KIP-113 design but just leave it as a single comment here. On Sun, Jan 22, 2017 at 10:50 AM, Guozhang Wang wrote: > Hello Dong, > > Thanks for the very well written KIP. I had a general thought on the ZK > path management, wondering if the following

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833597#comment-15833597 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833596#comment-15833596 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

Re: [VOTE] KIP-107 Add purgeDataBefore() API in AdminClient

I think this is less of an issue: we can use the same patterns as in the request protocol, i.e.: write(Map[TP, Long]) // write the checkout point in v0 format write(Map[TP, Pair[Long, Long]]) // write the checkout point in v1 format CheckpointedOffsets read() // read the file relying on its

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833686#comment-15833686 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833687#comment-15833687 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[GitHub] kafka pull request #2420: KAFKA-4613: Treat null-key records the same way fo...

GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/2420 KAFKA-4613: Treat null-key records the same way for joins and aggreations You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4304) Extend Interactive Queries for return latest update timestamp per key

[ https://issues.apache.org/jira/browse/KAFKA-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833607#comment-15833607 ] Jeyhun Karimov commented on KAFKA-4304: --- [~mjsax] Can we generalize this feature to {{top-k}}

[jira] [Commented] (KAFKA-3628) Native Schema Registry in Kafka

[ https://issues.apache.org/jira/browse/KAFKA-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833640#comment-15833640 ] Sushant Sood commented on KAFKA-3628: - Hi [~sriharsha] can you please share the updates on this

[jira] [Commented] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833933#comment-15833933 ] Matthias J. Sax commented on KAFKA-4144: About #2: I guess, the question is what "dynamic" means.

[jira] [Updated] (KAFKA-2000) Delete consumer offsets from kafka once the topic is deleted

[ https://issues.apache.org/jira/browse/KAFKA-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2000: --- Reviewer: Jason Gustafson (was: Joel Koshy) > Delete consumer offsets from kafka once the topic is

[jira] [Comment Edited] (KAFKA-4676) Kafka consumers gets stuck for some partitions

[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833429#comment-15833429 ] Bhavesh Shah edited comment on KAFKA-4676 at 1/22/17 3:04 PM: -- Hi

[jira] [Comment Edited] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833131#comment-15833131 ] Jeyhun Karimov edited comment on KAFKA-4144 at 1/22/17 3:05 PM: [~elevy]

[jira] [Comment Edited] (KAFKA-4144) Allow per stream/table timestamp extractor

[ https://issues.apache.org/jira/browse/KAFKA-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833131#comment-15833131 ] Jeyhun Karimov edited comment on KAFKA-4144 at 1/22/17 3:06 PM: [~elevy]

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833356#comment-15833356 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833355#comment-15833355 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

Re: [VOTE] KIP-107 Add purgeDataBefore() API in AdminClient

Hey Guozhang, Thanks for the review:) Yes it is possible to combine them. Both solution will have the same performance. But I think the current solution will give us simpler Java class design. Note that we will have to change Java API (e.g. read() and write()) of OffsetCheckpoint class in order

[jira] [Commented] (KAFKA-4676) Kafka consumers gets stuck for some partitions

[ https://issues.apache.org/jira/browse/KAFKA-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833429#comment-15833429 ] Bhavesh Shah commented on KAFKA-4676: - Hi [~hachikuji]/[~ijuma], Event after upgrading kafka to

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833492#comment-15833492 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups:

[jira] [Commented] (KAFKA-1207) Launch Kafka from within Apache Mesos

[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833491#comment-15833491 ] postmas...@inn.ru commented on KAFKA-1207: -- Delivery is delayed to these recipients or groups: