RE: submit spark job with spcified file for driver
Here is the description for the --file option that you can specify to spark-submit: --files FILES Comma-separated list of files to be placed in the working directory of each executor. Mohammed Author: Big Data Analytics with Spark -Original Message- From: alexeyy3 [mailto:alexey.yakubov...@searshc.com] Sent: Thursday, February 4, 2016 2:18 PM To: user@spark.apache.org Subject: submit spark job with spcified file for driver Is it possible to specify a file (with key-value properties) when submitting spark app with spark-submit? Some mails refers to the key --file, but docs. does not mention it. If you can specify a file, how to access it from spark job driver? Thank you, Alexey -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: submit spark job with spcified file for driver
Please take a look at: core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala You would see '--files' argument On Thu, Feb 4, 2016 at 2:17 PM, alexeyy3 <alexey.yakubov...@searshc.com> wrote: > Is it possible to specify a file (with key-value properties) when > submitting > spark app with spark-submit? Some mails refers to the key --file, but docs. > does not mention it. > If you can specify a file, how to access it from spark job driver? > > Thank you, Alexey > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
submit spark job with spcified file for driver
Is it possible to specify a file (with key-value properties) when submitting spark app with spark-submit? Some mails refers to the key --file, but docs. does not mention it. If you can specify a file, how to access it from spark job driver? Thank you, Alexey -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org