RE: Question on Spark architecture and DAG

2016-02-12 Thread Mich Talebzadeh
ndy Davidson [mailto:a...@santacruzintegration.com] Sent: 12 February 2016 21:17 To: Mich Talebzadeh ; user@spark.apache.org Subject: Re: Question on Spark architecture and DAG From: Mich Talebzadeh mailto:m...@peridale.co.uk> > Date: Thursday, February 11, 2016 at 2:30 PM To: "u

Re: Question on Spark architecture and DAG

2016-02-12 Thread Andy Davidson
From: Mich Talebzadeh Date: Thursday, February 11, 2016 at 2:30 PM To: "user @spark" Subject: Question on Spark architecture and DAG > Hi, > > I have used Hive on Spark engine and of course Hive tables and its pretty > impressive comparing Hive using MR engine. >

Question on Spark architecture and DAG

2016-02-11 Thread Mich Talebzadeh
Hi, I have used Hive on Spark engine and of course Hive tables and its pretty impressive comparing Hive using MR engine. Let us assume that I use spark shell. Spark shell is a client that connects to spark master running on a host and port like below spark-shell --master spark://50.140.197.21