[ https://issues.apache.org/jira/browse/SPARK-21325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
guoxiaolongzte closed SPARK-21325. ---------------------------------- duplicate > The shell of 'spark-submit' about '--jars' and '--fils', jars and files can > be placed on local and hdfs. > -------------------------------------------------------------------------------------------------------- > > Key: SPARK-21325 > URL: https://issues.apache.org/jira/browse/SPARK-21325 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.3.0 > Reporter: guoxiaolongzte > Priority: Minor > > 1.My submit way: > spark-submit --class cn.gxl.TestSql{color:red} --jars > hdfs://nameservice:/gxl/spark-core_2.11-2.3.0-SNAPSHOT.jar,hdfs://nameservice:/gxl/zookeeper-3.4.6.jar > --files > hdfs://nameservice:/gxl/value1.txt,hdfs://nameservice:/gxl/value2.txt{color} > hdfs://nameservice:/gxl/spark_2.0.2_project.jar > 2.spark-submit description: > --jars {color:red}JARS Comma-separated list of local jars{color} to include > on the driver and executor classpaths. > --files{color:red} FILES Comma-separated list of files{color} to be placed in > the working directory of each executor. File paths of these files in > executors can be accessed via SparkFiles.get(fileName). > 3.Problem Description: > {color:red} jars and files Not only can be placed on local but also can be > placed on hdfs. > The description of '' - jars '', that can only be placed on local.This is > wrong > The description of '--files' is not clear that can be placed locally or > hdfs.This is blurry. Not conducive to the developer to understand and > use.*{color} > So, this is an optimization feature that deserves to be modified. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org