Hi Spark experts, I met 2 problems when using Spark Connect on 3.5.5. And I am sure they are not fixed on 4.0.0. Hope you can take a look when you have time:
1. No way to do health check on Spark connect service. Spark doesn’t provide a way to enable k8s liveness and readiness probes on Spark connect: https://issues.apache.org/jira/browse/SPARK-52344 2. Compatibility issues when enable both Spark thrift server and Spark connect server on one Spark app on K8s : https://issues.apache.org/jira/browse/SPARK-52081 Thanks, Remzi Get Outlook for Mac <https://aka.ms/GetOutlookForMac>