John Leuner created SPARK-60504:
-----------------------------------
Summary: spark-shell ignores --remote and connects to localhost
instead, when spark.api.mode=connect is set
Key: SPARK-60504
URL: https://issues.apache.org/jira/browse/SPARK-60504
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: 4.1.1, 4.2.0, 4.0.1, 4.0.0, 4.1.0
Environment: amazon linux 2023
Reporter: John Leuner
withLocalConnectServer() in SparkSession.scala decides whether to autostart a
local Spark Connect server
the logic ignores a supplied --remote and always starts a local server
the same bug was in pyspark and was fixed in SPARK-51212
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
