Re: Spark and Hadoop

x27;m confused which one do I need to download. I need to try just the hello > world kind of program which has nothing to do with Hadoop. Or is it that I > can only use Spark with Hadoop? > > Thanks. > > > > -- > View this message in context: > http://apache-spark-user

Re: Spark and Hadoop

anks. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-and-Hadoop-tp6113.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Spark and Hadoop

eed to try just the hello world kind of program which has nothing to do with Hadoop. Or is it that I can only use Spark with Hadoop? Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-and-Hadoop-tp6113.html Sent from the Apache Spark User List ma

Re: Setting properties in core-site.xml for Spark and Hadoop to access

l file. The > moment I remove my AWS credentials from the ephemeral-hdfs config file, > pyspark cannot open files in S3 without me providing the credentials > in-line. > > I also guessed that the config file under /root/mapreduce might be a kind > of base config file that both Spar

RE: Spark and Hadoop cluster

Thanks, Mayur. Sent via the Samsung GALAXY S®4, an AT&T 4G LTE smartphone Original message From: Mayur Rustagi Date:03/21/2014 11:32 AM (GMT-08:00) To: user@spark.apache.org Subject: Re: Spark and Hadoop cluster Both are quite stable. Yarn is in beta though so woul

Re: Spark and Hadoop cluster

Both are quite stable. Yarn is in beta though so would be good to test on Standalone till Spark 1.0.0. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Fri, Mar 21, 2014 at 2:19 PM, Sameer Tilak wrote: > Hi

Spark and Hadoop cluster

Hi everyone,We are planning to set up Spark. The documentation mentions that it is possible to run Spark in standalone mode on a Hadoop cluster. Does anyone have any comments on stability and performance of this mode?

Re: Setting properties in core-site.xml for Spark and Hadoop to access

file that both Spark and Hadoop would read from first, and then override with configs from the other files. The path to the config suggests that, but it doesn't appear to be the case. Adding my AWS keys to that file seemed to affect neither Spark nor ephemeral-hdfs/bin/hadoop. Nick On Fri, Ma

Re: Setting properties in core-site.xml for Spark and Hadoop to access

e of my AWS keys. When I set those properties using conf.set() in > pyspark, distcp didn't appear to be aware of them. > > Nick > > > ---------- > View this message in context: Setting properties in core-site.xml for > Spark and Hadoop to > access&

Setting properties in core-site.xml for Spark and Hadoop to access

properties using conf.set() in pyspark, distcp didn't appear to be aware of them. Nick -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Setting-properties-in-core-site-xml-for-Spark-and-Hadoop-to-access-tp2402.html Sent from the Apache Spark User List ma