master is managing the resources in the cluster, e.g. ensuring all components can work together, master/worker/driver
e.g. you have to submit your application with the path: driver -> master -> worker then the driver take most of the responsibility of running your application, e.g. scheduling jobs/tasks the driver is more like a user-facing component, while master is more transparent to the user Best, -- Nan Zhu On Monday, March 31, 2014 at 10:48 AM, Dan wrote: > Hi, > > I've been recently reading spark code and confused about driver and > master. What's the difference between them? > > When I run spark in standalone cluster, from the log it seems that the > driver has not been launched. > > Thanks, > Dan > > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/The-difference-between-driver-and-master-in-Spark-tp6158.html > Sent from the Apache Spark Developers List mailing list archive at Nabble.com > (http://Nabble.com). > >
