[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2016-02-09 Thread Sean Owen (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138586#comment-15138586
 ] 

Sean Owen commented on SPARK-8684:
--

I'm bulk closing some EC2 issues as the ones that are still live can be 
'ported' to the new amplab repo

> Update R version in Spark EC2 AMI
> -
>
> Key: SPARK-8684
> URL: https://issues.apache.org/jira/browse/SPARK-8684
> Project: Spark
>  Issue Type: Improvement
>  Components: EC2, SparkR
>Reporter: Shivaram Venkataraman
>Priority: Minor
>
> Right now the R version in the AMI is 3.1 -- However a number of R libraries 
> need R version 3.2 and it will be good to update the R version on the AMI 
> while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-10-06 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945470#comment-14945470
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

It seems that the most recent AMI from amazon now ships with the most recent R 
version. 
http://stackoverflow.com/questions/31180061/r-3-2-on-aws-ami

> Update R version in Spark EC2 AMI
> -
>
> Key: SPARK-8684
> URL: https://issues.apache.org/jira/browse/SPARK-8684
> Project: Spark
>  Issue Type: Improvement
>  Components: EC2, SparkR
>Reporter: Shivaram Venkataraman
>Priority: Minor
>
> Right now the R version in the AMI is 3.1 -- However a number of R libraries 
> need R version 3.2 and it will be good to update the R version on the AMI 
> while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-30 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721566#comment-14721566
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

upgrading the spark ec2 ami would take significant work and might not be 
something for the upcoming spark release. this is (to my knowledge) still 
something that is unresolved. 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor
 Fix For: 1.5.0


 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-30 Thread Yin Huai (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721585#comment-14721585
 ] 

Yin Huai commented on SPARK-8684:
-

ah, I see. I thought the jira of this task had been all done because the fix 
version is set. 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor
 Fix For: 1.5.0


 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-29 Thread Yin Huai (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721324#comment-14721324
 ] 

Yin Huai commented on SPARK-8684:
-

Should we resolve it?


 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor
 Fix For: 1.5.0


 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-13 Thread Apache Spark (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14624331#comment-14624331
 ] 

Apache Spark commented on SPARK-8684:
-

User 'koaning' has created a pull request for this issue:
https://github.com/apache/spark/pull/7366

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-06 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614990#comment-14614990
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

just tried it all, and it just seems to work on my current branch of 
`rstudio-install`.

http://i.imgur.com/QkKq4Sj.png

no clue why we had an 3.1 error before. it might be because of how some parts 
are automated now and that we don't run the sparkR.sh command first. can't say 
exactly what may have caused it in the past though. 

the only annoying thing at the moment seems that if you want to use Rmarkdown, 
it will start another sparkR instance because it starts a seperate R-shell to 
run code in it. this is solved by stopping spark first before generating the 
rmarkdown html file. besides that it seems like a very nice automated install 
that will help the R community to get started. 

http://i.imgur.com/Ah88K9T.png

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-06 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615249#comment-14615249
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

Thanks ! this looks good. I'll leave this issue open in case we ever come back 
to upgrade the R version on the AMI

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-05 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614288#comment-14614288
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

Mhm. It am noticing that it reminds me that Spark was made for R 3.1 whenever I 
load the `sparkR` script. 

Even if we want R 3.2 for ggplot, we may also need to ensure R 3.2 for other 
packages. Which implies that all slaves also need R 3.2 and that SparkR needs 
to allow this. Has SparkR been tested for that? If that's not the case, we may 
just want to delay this task for when SparkR is ready for 3.2 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-05 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614348#comment-14614348
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

Hmm - the SparkR being built for 3.1 is a minor warning. It should work on 3.2 
as well (I've tested it). That said if we can get ggplot2, magrittr etc. to 
work on 3.1 that will be a better solution. Any ideas why they don't work well 
with 3.1 ? It doesn't seem like that old a release to me

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-03 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14613277#comment-14613277
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

Yeah I tried to hack on this a bit yesterday as well and ran into the same 
problem with tk-devel. Lets see in Amazon has a better answer for this. One 
thing we can do right now is add a build-r-3-2.sh script in rstudio/ in the 
spark-ec2 tree. That way in the tutorial you can include instructions for users 
to run this script if they want to build R 3.2 from source.

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-03 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612964#comment-14612964
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

I've tried a different approach, which involves downloading the rpm's by hand. 
Unfortunately, this leads to a lot of jumping through bunnyholes. Namely, a 
long script that does things like: 

```
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-3.2.1-1.el7.x86_64.rpm
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-core-3.2.1-1.el7.x86_64.rpm
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-core-devel-3.2.1-1.el7.x86_64.rpm
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-devel-3.2.1-1.el7.x86_64.rpm
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-java-3.2.1-1.el7.x86_64.rpm
wget 
http://dl.fedoraproject.org/pub/epel/testing/7/x86_64/r/R-java-devel-3.2.1-1.el7.x86_64.rpm
 

yum localinstall ./R-3.2.1-1.el7.x86_64.rpm
yum localinstall ./R-core-3.2.1-1.el7.x86_64.rpm
yum localinstall ./R-core-devel-3.2.1-1.el7.x86_64.rpm
yum localinstall ./R-devel-3.2.1-1.el7.x86_64.rpm
yum localinstall ./R-java-3.2.1-1.el7.x86_64.rpm
yum localinstall ./R-java-devel-3.2.1-1.el7.x86_64.rpm 
```

And even this way I need other dependencies which AWS AMI doesnt have. 

```
root@ip-172-31-44-83 ~]$ yum install tk-devel tre-devel
Loaded plugins: priorities, update-motd, upgrade-helper
No package tk-devel available.
No package tre-devel available.
Error: Nothing to do
```

It seems like too much effort to manually try do all this. I opened up a 
package request at amazon for them to support R-3.2 as well. Hopefully a 
response will come. 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-02 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611680#comment-14611680
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

Mhm... I've tried multiple approaches. My collegue even had a look at it and 
left him without a clue. 

Make a stackoverflow question for advice. 

http://stackoverflow.com/questions/31180061/r-3-2-on-aws-ami

I get the impression that the amazon AMI forces you to use the amazon repos if 
the package you need is also available in the amazon package system... which 
only have the old versions. 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-07-02 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612193#comment-14612193
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

Its unfortunate that the AWS AMI prevents installing a newer version from the 
EPEL repo. Building R takes too long though, so I'm not sure whats a good 
solution here. Lets see if we hear back on the StackOverflow post about any 
workarounds.

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-30 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609013#comment-14609013
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

mhm. the aws ami packager doesn't seem to recognize R-3.2.1. even when I add a 
rpm repo, it doesnt work:

yum-config-manager --add-repo https://dl.fedoraproject.org/pub/epel/7/x86_64/

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-30 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609054#comment-14609054
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

Building from source might take a while and it wouldn't be a good idea to do it 
by default. We could put it behind a flat (--r-version=3.2) and then only build 
from source if the user specifies the flag. But the yum option could be made 
default if we could get it to work.

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-29 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606293#comment-14606293
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

The create_image.sh script is only used for generating new AMIs and we don't 
generate new AMIs very often as its a pretty expensive process to do this on 
all zones, regions etc.

Instead you could try to add a new directory named rstudio and in the init.sh 
file there you could try to upgrade the R package using yum. This would look 
somewhat like the ganglia file at 
https://github.com/mesos/spark-ec2/blob/branch-1.4/ganglia/init.sh

BTW the best way to test this is to try out the yum upgrade on a running 
spark-ec2 cluster and then put the commands into a script. Also you can point 
spark-ec2 to a custom repository with the flag --spark-ec2-git-repo 
https://github.com/apache/spark/blob/c6ba2ea341ad23de265d870669b25e6a41f461e5/ec2/spark_ec2.py#L206
 (the default is github.com/mesos/spark-ec2). So for example you could point it 
to your fork kaoning/spark-ec2.

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604642#comment-14604642
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

I have an initial commit that I would like to try out that does the yum 
approach: 
https://github.com/koaning/spark-ec2/blob/rstudio-install/create_image.sh#L22-23

[~shivaram] what's the easiest way to test this? 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-28 Thread Vincent Warmerdam (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604600#comment-14604600
 ] 

Vincent Warmerdam commented on SPARK-8684:
--

I'll double check. I've done this before but I recall it was always a bit 
messy. Do we prefer using yum or is installing from source also a possbility? 

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-06-27 Thread Shivaram Venkataraman (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604449#comment-14604449
 ] 

Shivaram Venkataraman commented on SPARK-8684:
--

[~cantdutchthis] Continuing the conversation from the other JIRA, the EC2 AMI 
we use is based on CentOS. What is the best way to install R 3.2 on this AMI ? 
Is there a standard yum repository we can use for this ?

 Update R version in Spark EC2 AMI
 -

 Key: SPARK-8684
 URL: https://issues.apache.org/jira/browse/SPARK-8684
 Project: Spark
  Issue Type: Improvement
  Components: EC2, SparkR
Reporter: Shivaram Venkataraman
Priority: Minor

 Right now the R version in the AMI is 3.1 -- However a number of R libraries 
 need R version 3.2 and it will be good to update the R version on the AMI 
 while launching a EC2 cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org