Hi All, I have raised an improvement jira for passing a python file as an command line argument for Pyspark. The alternative is to use spark-submit but if there can be a uniform way to pass files as arguments like it is done in case of spark-shell and spark-sql (like -i or -f option).
I have created SPARK-41119 <https://issues.apache.org/jira/browse/SPARK-41119> as a placeholder, please suggest. Thanks and regards, Lingaraj