Where is the SparkContext object created then? On my local machine or on the master node in the cluster?
On Mon, Feb 17, 2014 at 4:17 AM, Nhan Vu Lam Chi <[email protected]>wrote: > Your local app will be called "driver program", which creates jobs and > submits them to the cluster for running. > > > On Mon, Feb 17, 2014 at 9:19 AM, David Thomas <[email protected]> wrote: > >> From >> docs<https://spark.incubator.apache.org/docs/latest/spark-standalone.html> >> : >> >> >> *Connecting an Application to the ClusterTo run an application on the >> Spark cluster, simply pass the spark://IP:PORT URL of the master as to the >> SparkContext constructor.* >> >> Could someone enlighten me on what happens if I run the app, from say, >> Eclipse on my local machine, but use the url of the master node which is on >> cloud. What role does my local JVM play then? >> > >
