[jira] [Assigned] (SPARK-17577) SparkR support add files to Spark job and get by executors
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17577: Assignee: (was: Apache Spark) > SparkR support add files to Spark job and get by executors > -- > > Key: SPARK-17577 > URL: https://issues.apache.org/jira/browse/SPARK-17577 > Project: Spark > Issue Type: Improvement > Components: SparkR >Reporter: Yanbo Liang > > Scala/Python users can add files to Spark job by submit options {{--files}} > or {{SparkContext.addFile()}}. Meanwhile, users can get the added file by > {{SparkFiles.get(filename)}}. > We should also support this function for SparkR users, since SparkR users may > install third party R packages on each executors. For examples, SparkR users > can download third party R packages to driver firstly, add these files to the > Spark job by this API and each executor can install these packages by > {{install.packages}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-17577) SparkR support add files to Spark job and get by executors
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17577: Assignee: Apache Spark > SparkR support add files to Spark job and get by executors > -- > > Key: SPARK-17577 > URL: https://issues.apache.org/jira/browse/SPARK-17577 > Project: Spark > Issue Type: Improvement > Components: SparkR >Reporter: Yanbo Liang >Assignee: Apache Spark > > Scala/Python users can add files to Spark job by submit options {{--files}} > or {{SparkContext.addFile()}}. Meanwhile, users can get the added file by > {{SparkFiles.get(filename)}}. > We should also support this function for SparkR users, since SparkR users may > install third party R packages on each executors. For examples, SparkR users > can download third party R packages to driver firstly, add these files to the > Spark job by this API and each executor can install these packages by > {{install.packages}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org