[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138586#comment-15138586 ] Sean Owen commented on SPARK-8684: -- I'm bulk closing some EC2 issues as the ones that are still live can be 'ported' to the new amplab repo > Update R version in Spark EC2 AMI > - > > Key: SPARK-8684 > URL: https://issues.apache.org/jira/browse/SPARK-8684 > Project: Spark > Issue Type: Improvement > Components: EC2, SparkR >Reporter: Shivaram Venkataraman >Priority: Minor > > Right now the R version in the AMI is 3.1 -- However a number of R libraries > need R version 3.2 and it will be good to update the R version on the AMI > while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945470#comment-14945470 ] Vincent Warmerdam commented on SPARK-8684: -- It seems that the most recent AMI from amazon now ships with the most recent R version. http://stackoverflow.com/questions/31180061/r-3-2-on-aws-ami > Update R version in Spark EC2 AMI > - > > Key: SPARK-8684 > URL: https://issues.apache.org/jira/browse/SPARK-8684 > Project: Spark > Issue Type: Improvement > Components: EC2, SparkR >Reporter: Shivaram Venkataraman >Priority: Minor > > Right now the R version in the AMI is 3.1 -- However a number of R libraries > need R version 3.2 and it will be good to update the R version on the AMI > while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721566#comment-14721566 ] Vincent Warmerdam commented on SPARK-8684: -- upgrading the spark ec2 ami would take significant work and might not be something for the upcoming spark release. this is (to my knowledge) still something that is unresolved. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Fix For: 1.5.0 Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721585#comment-14721585 ] Yin Huai commented on SPARK-8684: - ah, I see. I thought the jira of this task had been all done because the fix version is set. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Fix For: 1.5.0 Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721324#comment-14721324 ] Yin Huai commented on SPARK-8684: - Should we resolve it? Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Fix For: 1.5.0 Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624331#comment-14624331 ] Apache Spark commented on SPARK-8684: - User 'koaning' has created a pull request for this issue: https://github.com/apache/spark/pull/7366 Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614990#comment-14614990 ] Vincent Warmerdam commented on SPARK-8684: -- just tried it all, and it just seems to work on my current branch of `rstudio-install`. http://i.imgur.com/QkKq4Sj.png no clue why we had an 3.1 error before. it might be because of how some parts are automated now and that we don't run the sparkR.sh command first. can't say exactly what may have caused it in the past though. the only annoying thing at the moment seems that if you want to use Rmarkdown, it will start another sparkR instance because it starts a seperate R-shell to run code in it. this is solved by stopping spark first before generating the rmarkdown html file. besides that it seems like a very nice automated install that will help the R community to get started. http://i.imgur.com/Ah88K9T.png Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615249#comment-14615249 ] Shivaram Venkataraman commented on SPARK-8684: -- Thanks ! this looks good. I'll leave this issue open in case we ever come back to upgrade the R version on the AMI Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614288#comment-14614288 ] Vincent Warmerdam commented on SPARK-8684: -- Mhm. It am noticing that it reminds me that Spark was made for R 3.1 whenever I load the `sparkR` script. Even if we want R 3.2 for ggplot, we may also need to ensure R 3.2 for other packages. Which implies that all slaves also need R 3.2 and that SparkR needs to allow this. Has SparkR been tested for that? If that's not the case, we may just want to delay this task for when SparkR is ready for 3.2 Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614348#comment-14614348 ] Shivaram Venkataraman commented on SPARK-8684: -- Hmm - the SparkR being built for 3.1 is a minor warning. It should work on 3.2 as well (I've tested it). That said if we can get ggplot2, magrittr etc. to work on 3.1 that will be a better solution. Any ideas why they don't work well with 3.1 ? It doesn't seem like that old a release to me Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613277#comment-14613277 ] Shivaram Venkataraman commented on SPARK-8684: -- Yeah I tried to hack on this a bit yesterday as well and ran into the same problem with tk-devel. Lets see in Amazon has a better answer for this. One thing we can do right now is add a build-r-3-2.sh script in rstudio/ in the spark-ec2 tree. That way in the tutorial you can include instructions for users to run this script if they want to build R 3.2 from source. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612964#comment-14612964 ] Vincent Warmerdam commented on SPARK-8684: -- I've tried a different approach, which involves downloading the rpm's by hand. Unfortunately, this leads to a lot of jumping through bunnyholes. Namely, a long script that does things like: ``` wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-3.2.1-1.el7.x86_64.rpm wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-core-3.2.1-1.el7.x86_64.rpm wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-core-devel-3.2.1-1.el7.x86_64.rpm wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-devel-3.2.1-1.el7.x86_64.rpm wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-java-3.2.1-1.el7.x86_64.rpm wget http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-java-devel-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-core-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-core-devel-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-devel-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-java-3.2.1-1.el7.x86_64.rpm yum localinstall ./R-java-devel-3.2.1-1.el7.x86_64.rpm ``` And even this way I need other dependencies which AWS AMI doesnt have. ``` root@ip-172-31-44-83 ~]$ yum install tk-devel tre-devel Loaded plugins: priorities, update-motd, upgrade-helper No package tk-devel available. No package tre-devel available. Error: Nothing to do ``` It seems like too much effort to manually try do all this. I opened up a package request at amazon for them to support R-3.2 as well. Hopefully a response will come. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611680#comment-14611680 ] Vincent Warmerdam commented on SPARK-8684: -- Mhm... I've tried multiple approaches. My collegue even had a look at it and left him without a clue. Make a stackoverflow question for advice. http://stackoverflow.com/questions/31180061/r-3-2-on-aws-ami I get the impression that the amazon AMI forces you to use the amazon repos if the package you need is also available in the amazon package system... which only have the old versions. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612193#comment-14612193 ] Shivaram Venkataraman commented on SPARK-8684: -- Its unfortunate that the AWS AMI prevents installing a newer version from the EPEL repo. Building R takes too long though, so I'm not sure whats a good solution here. Lets see if we hear back on the StackOverflow post about any workarounds. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609013#comment-14609013 ] Vincent Warmerdam commented on SPARK-8684: -- mhm. the aws ami packager doesn't seem to recognize R-3.2.1. even when I add a rpm repo, it doesnt work: yum-config-manager --add-repo https://dl.fedoraproject.org/pub/epel/7/x86_64/ Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609054#comment-14609054 ] Shivaram Venkataraman commented on SPARK-8684: -- Building from source might take a while and it wouldn't be a good idea to do it by default. We could put it behind a flat (--r-version=3.2) and then only build from source if the user specifies the flag. But the yum option could be made default if we could get it to work. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606293#comment-14606293 ] Shivaram Venkataraman commented on SPARK-8684: -- The create_image.sh script is only used for generating new AMIs and we don't generate new AMIs very often as its a pretty expensive process to do this on all zones, regions etc. Instead you could try to add a new directory named rstudio and in the init.sh file there you could try to upgrade the R package using yum. This would look somewhat like the ganglia file at https://github.com/mesos/spark-ec2/blob/branch-1.4/ganglia/init.sh BTW the best way to test this is to try out the yum upgrade on a running spark-ec2 cluster and then put the commands into a script. Also you can point spark-ec2 to a custom repository with the flag --spark-ec2-git-repo https://github.com/apache/spark/blob/c6ba2ea341ad23de265d870669b25e6a41f461e5/ec2/spark_ec2.py#L206 (the default is github.com/mesos/spark-ec2). So for example you could point it to your fork kaoning/spark-ec2. Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604642#comment-14604642 ] Vincent Warmerdam commented on SPARK-8684: -- I have an initial commit that I would like to try out that does the yum approach: https://github.com/koaning/spark-ec2/blob/rstudio-install/create_image.sh#L22-23 [~shivaram] what's the easiest way to test this? Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604600#comment-14604600 ] Vincent Warmerdam commented on SPARK-8684: -- I'll double check. I've done this before but I recall it was always a bit messy. Do we prefer using yum or is installing from source also a possbility? Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604449#comment-14604449 ] Shivaram Venkataraman commented on SPARK-8684: -- [~cantdutchthis] Continuing the conversation from the other JIRA, the EC2 AMI we use is based on CentOS. What is the best way to install R 3.2 on this AMI ? Is there a standard yum repository we can use for this ? Update R version in Spark EC2 AMI - Key: SPARK-8684 URL: https://issues.apache.org/jira/browse/SPARK-8684 Project: Spark Issue Type: Improvement Components: EC2, SparkR Reporter: Shivaram Venkataraman Priority: Minor Right now the R version in the AMI is 3.1 -- However a number of R libraries need R version 3.2 and it will be good to update the R version on the AMI while launching a EC2 cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org