[
https://issues.apache.org/jira/browse/SPARK-8506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14594854#comment-14594854
]
Shivaram Venkataraman commented on SPARK-8506:
----------------------------------------------
Thats a good point - I just ran into this yesterday and created a PR that
improves documentation at https://github.com/apache/spark/pull/6916
Do you think adding a new argument to sparkR.init will be good enough ? i.e.
something like sparkR.init(master="local",
packages="com.databricks.spark-csv_2.10:1.0.3")
> SparkR does not provide an easy way to depend on Spark Packages when
> performing init from inside of R
> -----------------------------------------------------------------------------------------------------
>
> Key: SPARK-8506
> URL: https://issues.apache.org/jira/browse/SPARK-8506
> Project: Spark
> Issue Type: Bug
> Components: SparkR
> Affects Versions: 1.4.0
> Reporter: holdenk
> Priority: Minor
>
> While packages can be specified when using the sparkR or sparkSubmit scripts,
> the programming guide tells people to create their spark context using the R
> shell + init. The init does have a parameter for jars but no parameter for
> packages. Setting the SPARKR_SUBMIT_ARGS overwrites some necessary
> information. I think a good solution would just be adding another field to
> the init function to allow people to specify packages in the same way as jars.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
