I use spark on EC2 but it's a CDH 5.3.3 distribution (starving developer
version) installed thru Cloudera Manager. Spark is configured to run on Yarn.
Regards
Sanjay
Sent from my iPhone
> On May 29, 2015, at 6:16 PM, roni wrote:
>
> Hi ,
> Any update on this?
> I am not sure if the issue I
Hi ,
Any update on this?
I am not sure if the issue I am seeing is related ..
I have 8 slaves and when I created the cluster I specified ebs volume with
100G.
I see on Ec2 8 volumes created and each attached to the corresponding slave.
But when I try to copy data on it , it complains that
/root/ep
I used Spark on EC2 a while ago, but recent revisions seem to have broken
the functionality.
Is anyone actually using Spark on EC2 at the moment?
The bug in question is:
https://issues.apache.org/jira/browse/SPARK-5008
It makes it impossible to use persistent HDFS without a workround on each
sl