Yanfei, You caught a mistake on my part. I referenced the wrong KIP. That one is for Kafka Streams, KIP-36 is the one for the regular client. I'll update the referenced FLIP and its JIRA. This feature is already available in our client, my team at work implemented it against the old Kafka Consumer API earlier this year. We'd like to donate the implementation on the new API.
KIP-36 https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=61321028#content/view/61321028 On Fri, Nov 11, 2022, 2:55 AM Martijn Visser <martijnvis...@apache.org> wrote: > Hi Yanfei, > > The version for Kafka Clients has been upgraded to 3.2.3 since 1.16 via > FLINK-29513 [1] > > Best regards, > > Martijn > > [1] https://issues.apache.org/jira/browse/FLINK-29513 > > On Fri, Nov 11, 2022 at 4:11 AM Yanfei Lei <fredia...@gmail.com> wrote: > > > Hi Jeremy, > > > > Thanks for the proposal. > > I'm curious if this feature can adapt to the current kafka-client version > > in the connector. The rack awareness feature requires a version>=3.2.0 to > > use, while the kafka-client version of Kafka connector is 2.8.1. Will we > > upgrade the Kafka-client version first? > > > > Best, > > Yanfei > > > > Jeremy DeGroot <jeremy.degr...@gmail.com> 于2022年11月11日周五 05:35写道： > > > > > Kafak has a rack awareness feature that allows brokers and consumers to > > > communicate about the rack (or AWS Availability Zone) they're located > in. > > > Reading from a local broker can save money in bandwidth and improve > > latency > > > for your consumers. > > > > > > This improvement proposes that a Kafka Consumer could be configured > with > > a > > > callback that could be run when it's being configured on the task > > manager, > > > that will set the appropriate value at runtime if a value is provided. > > > > > > More detail about this proposal can be found at > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-268%3A+Kafka+Rack+Awareness > > > > > > > > > More information about the Kafka rack awareness feature is at > > > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-708%3A+Rack+awareness+for+Kafka+Streams > > > > > > > > > Best, > > > > > > Jeremy > > > > > >
