Re: [VOTE] KIP-479 Add Materialized to Join

+1 (binding) On 7/25/19 1:05 PM, Bill Bejeck wrote: > All, > > After a great discussion on KIP-479 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP-479%3A+Add+Materialized+to+Join) > I'd > like to start a vote. > > Thanks, > Bill > signature.asc Description: OpenPGP digital signatur

Re: [VOTE] KIP-467: Augment ProduceResponse error messaging

Hi Guozhang, The proposal looks good. A couple minor questions. 1. InvalidRecordException is currently located in `org.apache.kafka.common.record`, which is not a public package. Shall we move it to `org.apache.kafka.common.errors`? 2. I'm not sure I understand the point about UnknownServerExcept

[jira] [Created] (KAFKA-8717) Use cached hw/lso offset metadata when reading from log

Jason Gustafson created KAFKA-8717: -- Summary: Use cached hw/lso offset metadata when reading from log Key: KAFKA-8717 URL: https://issues.apache.org/jira/browse/KAFKA-8717 Project: Kafka Iss

Re: [DISCUSS] KIP-496: Administrative API to delete consumer offsets

1. Fixed, thanks! 2. Yes, that is what I was thinking. Do you see any problems? 3. Good point. Do you think a meter for expired and deleted offsets would be sufficient? 4. I considered it. I thought that might be a little dangerous for dynamic groups which have subscriptions changing. If the fir

Build failed in Jenkins: kafka-trunk-jdk11 #714

See Changes: [wangguoz] KAFKA-8179: add public ConsumerPartitionAssignor interface (#7108) -- Started by an SCM change Started by an SCM change [EnvInject] - Loading node

Build failed in Jenkins: kafka-trunk-jdk8 #3811

See Changes: [wangguoz] KAFKA-8179: add public ConsumerPartitionAssignor interface (#7108) -- Started by an SCM change Started by an SCM change [EnvInject] - Loading node

Re: [DISCUSS] KIP-496: Administrative API to delete consumer offsets

Hi Jason, Thanks for the KIP! I've made a pass on it and here are few comments: 1. " before the clients which ." --> incomplete sentence? 2. " Any committed offset for a partition which is not currently subscribed to is subject to expiration." --> this may be an implementation detail, but are we

[jira] [Resolved] (KAFKA-8703) Move PartitionAssignor to public API

[ https://issues.apache.org/jira/browse/KAFKA-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-8703. Resolution: Fixed > Move PartitionAssignor to public API >

[VOTE] KIP-479 Add Materialized to Join

All, After a great discussion on KIP-479 ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-479%3A+Add+Materialized+to+Join) I'd like to start a vote. Thanks, Bill

[jira] [Created] (KAFKA-8716) broker cannot join the cluster after upgrading the binary from 2.1 to 2.2.1 or 2.3.0

Yu Yang created KAFKA-8716: -- Summary: broker cannot join the cluster after upgrading the binary from 2.1 to 2.2.1 or 2.3.0 Key: KAFKA-8716 URL: https://issues.apache.org/jira/browse/KAFKA-8716 Project: Kafka

[jira] [Resolved] (KAFKA-8712) Build Kafka Streams against Scala 2.13

[ https://issues.apache.org/jira/browse/KAFKA-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8712. Resolution: Duplicate Fix Version/s: (was: 2.4.0) > Build Kafka Streams against

Re: Fwd: [DISCUSS] KIP-492 Add java security providers in Kafka Security config

Thanks Rajini . > 4) The main difference between SSL and SASL is that for SSL, you register a > provider with your own algorithm name and you specify your algorithm name > in a separate config. This algorithm name can be anything you choose. For > SASL, we register providers for standard SASL mech

Re: [DISCUSS] KIP-481: SerDe Improvements for Connect Decimal type in JSON

Thanks for the replies Andy and Andrew (2x Andy?)! > Is the text decimal a base16 encoded number, or is it base16 encoded binary > form of the number? The conversion happens as decimal.unscaledValue().toByteArray() and then the byte array is converted to a hex string, so it's definitely the binar

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Habib, Yes. Our approach is to have retention as you see it to day i.e delete the local log segments after configured amount of time or size is reached. We will be shipping logs to remote storage such as HDFS or S3 as soon as a log segment is rotated in a topic-partition. This wil

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

>>Under the proposed definition of RemoteTier, would it be possible to have an implementation that transfers older log segments to a slower storage tier, but one that is still local? Examples of slower local(ie mounted locally) tiers being HDDs vs SSDs, or NFS volumes. No, it does not allow moving

Re: [DISCUSS] KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)

We still want to give the "blacklisted" broker the leadership if nobody else is available. Therefore, isn't putting a broker on the blacklist pretty much the same as moving it to the last entry in the replicas list and then triggering a preferred leader election? If we want this to be undone a

Re: Check the version of kafka information for MDT Mirror information

What is an MDT mirror server? best, Colin On Thu, Jul 18, 2019, at 18:29, Harry k wrote: > Hi, > How to check version information for Kafka that is being used on the MDT > Mirror servers? Is their any command to check that.I have any only access > to Kafka and zookeeper servers through putty.Any

Re: [DISCUSS] KIP-481: SerDe Improvements for Connect Decimal type in JSON

This is a bit orthogonal, but in JsonSchemaConverter I use JSONSchemas to indicate whether a JSON number should be deserialized as an integer or a decimal

Re: [DISCUSS] KIP-481: SerDe Improvements for Connect Decimal type in JSON

Hi Almog, Like the KIP - I think being able to support decimals in JSON in the same way most other systems do is a great improvement. It's not 100% clear to me from the KIP what the current format is. Is the text decimal a base16 encoded number, or is it base16 encoded binary form of the number?

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi, Under the proposed definition of RemoteTier, would it be possible to have an implementation that transfers older log segments to a slower storage tier, but one that is still local? Examples of slower local(ie mounted locally) tiers being HDDs vs SSDs, or NFS volumes. Let me know if I"m mi

Re: Fwd: [DISCUSS] KIP-492 Add java security providers in Kafka Security config

Hi Sandeep/Harsha, I don't have any major concerns about this KIP since it solves a specific issue and is a relatively minor change. I am unconvinced about the SASL case, but it probably is better to add as a config that can be used with SASL as well in future anyway. Just to complete the convers

Build failed in Jenkins: kafka-trunk-jdk8 #3810

See Changes: [junrao] MINOR: Ensure in-memory metadata is removed before physical deletion of -- [...truncated 2.56 MB...] org.apache.kafka.connect.transforms.TimestampCon

[jira] [Created] (KAFKA-8715) Static consumer cannot join group due to ERROR in broker

Raman Gupta created KAFKA-8715: -- Summary: Static consumer cannot join group due to ERROR in broker Key: KAFKA-8715 URL: https://issues.apache.org/jira/browse/KAFKA-8715 Project: Kafka Issue Type

[jira] [Created] (KAFKA-8714) CLOSE_WAIT connections piling up on the broker

Rajdeep Mukherjee created KAFKA-8714: Summary: CLOSE_WAIT connections piling up on the broker Key: KAFKA-8714 URL: https://issues.apache.org/jira/browse/KAFKA-8714 Project: Kafka Issue Ty