[
https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615523#comment-14615523
]
Vincent Warmerdam commented on SPARK-8596:
------------------------------------------
1. true. made commit:
https://github.com/koaning/spark-ec2/blob/rstudio-install/rstudio/init.sh#L35-37.
do we wan this code here, or somewhere else? seems like this is something
system wide and not rstudio specific... what about /spark/init.sh instead of
/rstudio/init.sh?
2. it gives you a breaking error.
```
> sc <- sparkR.init(spark_link)
Launching java with spark-submit command /root/spark/bin/spark-submit
sparkr-shell /tmp/RtmpSaSV2q/backend_port53744f8e9f59
/root/spark/conf/spark-env.sh: line 30: ulimit: open files: cannot modify
limit: Operation not permitted
```
ulimit is a command that can only be run by root, while the rstudio user isn't.
3. can i remove this line:
https://github.com/koaning/spark-ec2/blob/branch-1.4/templates/root/spark/conf/spark-env.sh#L30
not all users will want to use rstudio and im not sure how this might break
things (im assuming pyspark might use this script as well?) perhaps we can move
the new `/etc/security/limits.conf` paremeters in here?
> Install and configure RStudio server on Spark EC2
> -------------------------------------------------
>
> Key: SPARK-8596
> URL: https://issues.apache.org/jira/browse/SPARK-8596
> Project: Spark
> Issue Type: Improvement
> Components: EC2, SparkR
> Reporter: Shivaram Venkataraman
>
> This will make it convenient for R users to use SparkR from their browsers
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]