Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Schwager, Randall
Granted. Thanks for bearing with me. I’ve also opened up permissions to allow anyone with the link to edit the document. Thank you! From: Mich Talebzadeh Date: Friday, January 26, 2024 at 09:19 To: "Schwager, Randall" Cc: "dev@spark.apache.org" Subject: Re: [EXTERNAL]

Re: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer

2024-01-26 Thread Schwager, Randall
the description to make that distinction more clear. Sincerely, Randall From: Mich Talebzadeh Date: Friday, January 26, 2024 at 04:30 To: "Schwager, Randall" Cc: "dev@spark.apache.org" Subject: [EXTERNAL] Re: Spark Kafka Rack Aware Consumer CAUTION: The e-mail below is from an ext

Re: Spark Kafka Rack Aware Consumer

2024-01-25 Thread Schwager, Randall
Bump. Am I asking these questions in the wrong place? Or should I forego design input and just write the PR? From: "Schwager, Randall" Date: Monday, January 22, 2024 at 17:02 To: "dev@spark.apache.org" Subject: Re: Spark Kafka Rack Aware Consumer Hello Spark Devs! After

Re: Spark Kafka Rack Aware Consumer

2024-01-22 Thread Schwager, Randall
awareness and other location assignment patterns more generally in SPARK-46798<https://issues.apache.org/jira/browse/SPARK-46798>. Since this is my first go at contributing to Spark, could I ask for a committer to help shepherd this JIRA issue along? Sincerely, Randall From: &qu

Spark Kafka Rack Aware Consumer

2024-01-10 Thread Schwager, Randall
Hello Spark Devs! Has there been discussion around adding the ability to dynamically set the ‘client.rack’ Kafka parameter at the executor? The Kafka SQL connector code on master doesn’t seem to support this feature. One can easily set the ‘client.rack’ parameter at the driver, but that just