Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Raghu Angadi
gt; > > > *From: *Mich Talebzadeh > *Date: *Friday, January 26, 2024 at 09:19 > *To: *"Schwager, Randall" > *Cc: *"dev@spark.apache.org" > *Subject: *Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer > > > > *CAUTION:* The e-mail below

Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Schwager, Randall
@spark.apache.org<mailto:dev@spark.apache.org>" mailto:dev@spark.apache.org>> Subject: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer CAUTION: The e-mail below is from an external source. Please exercise caution before opening attachments, clicking links, or following guidance. Your des

Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Mich Talebzadeh
dall > > > > *From: *Mich Talebzadeh > *Date: *Friday, January 26, 2024 at 04:30 > *To: *"Schwager, Randall" > *Cc: *"dev@spark.apache.org" > *Subject: *[EXTERNAL] Re: Spark Kafka Rack Aware Consumer > > > > *CAUTION:* The e-mail below is

Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Schwager, Randall
the description to make that distinction more clear. Sincerely, Randall From: Mich Talebzadeh Date: Friday, January 26, 2024 at 04:30 To: "Schwager, Randall" Cc: "dev@spark.apache.org" Subject: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer CAUTION: The e-mail below is from an ext

Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Mich Talebzadeh
om: *"Schwager, Randall" > *Date: *Monday, January 22, 2024 at 17:02 > *To: *"dev@spark.apache.org" > *Subject: *Re: Spark Kafka Rack Aware Consumer > > > > Hello Spark Devs! > > > > After doing some detective work, I’d like to revisit this idea

Re: Spark Kafka Rack Aware Consumer

2024-01-25 Thread Schwager, Randall
Bump. Am I asking these questions in the wrong place? Or should I forego design input and just write the PR? From: "Schwager, Randall" Date: Monday, January 22, 2024 at 17:02 To: "dev@spark.apache.org" Subject: Re: Spark Kafka Rack Aware Consumer Hello Spark Devs! After

Re: Spark Kafka Rack Aware Consumer

2024-01-22 Thread Schwager, Randall
ot;Schwager, Randall" Date: Wednesday, January 10, 2024 at 19:39 To: "dev@spark.apache.org" Subject: Spark Kafka Rack Aware Consumer Hello Spark Devs! Has there been discussion around adding the ability to dynamically set the ‘client.rack’ Kafka parameter at the executor? The Kafka SQ

Spark Kafka Rack Aware Consumer

2024-01-10 Thread Schwager, Randall
Hello Spark Devs! Has there been discussion around adding the ability to dynamically set the ‘client.rack’ Kafka parameter at the executor? The Kafka SQL connector code on master doesn’t seem to support this feature. One can easily set the ‘client.rack’ parameter at the driver, but that just