gengliangwang commented on code in PR #54035: URL: https://github.com/apache/spark/pull/54035#discussion_r2748240283
########## docs/declarative-pipelines-programming-guide.md: ########## @@ -117,10 +117,47 @@ The `spark-pipelines` command line interface (CLI) is the primary way to manage `spark-pipelines run` launches an execution of a pipeline and monitors its progress until it completes. -The `--spec` parameter allows selecting the pipeline spec file. If not provided, the CLI will look in the current directory and parent directories for one of the files: +Since `spark-pipelines` is built on top of `spark-submit`, it supports all `spark-submit` arguments except for `--class`. For the complete list of available parameters, see the [Spark Submit documentation](https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit). Review Comment: ```suggestion Since `spark-pipelines` is built on top of `spark-submit`, `spark-pipelines run` supports all `spark-submit` arguments except for `--class`. For the complete list of available parameters, see the [Spark Submit documentation](https://spark.apache.org/docs/latest/submitting-applications.html#launching-applications-with-spark-submit). ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
