Autumn2OO5 commented on issue #59426: URL: https://github.com/apache/spark/issues/59426#issuecomment-6148977133
Hi, I’d like to work on this if it’s still open. Before I start, I wanted to check which direction maintainers prefer: Code fix: pass --master (and related options like --deploy-mode) through to the Spark Connect server that SDP launches, so the pipeline actually runs on the chosen cluster manager. Docs fix: update the pipelines docs to say which spark-submit arguments are and aren’t supported right now, and how to target a specific cluster (for example, pointing at an existing Connect server). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
