Re: Edge Node in Spark

2017-06-07 Thread Mich Talebzadeh
Agreed with Ayan. Essentially an Edge node is a physical host or VM that is used by the application to run the job. The users or service users start the process from the Edge node. Edge nodes are added to the cluster for example DEV/TEST/UAT etc. Edge node normally has all compatible binaries in

Re: Edge Node in Spark

2017-06-06 Thread ayan guha
They are all same thing. Essentially it means a machine which is not part of the cluster butHas all clients. On Wed, 7 Jun 2017 at 5:48 am, Irving Duran wrote: > Where in the documentation did you find "edge node"? Spark would call it > worker or executor, but not "edge node". Her is some i

Re: Edge Node in Spark

2017-06-06 Thread Irving Duran
Where in the documentation did you find "edge node"? Spark would call it worker or executor, but not "edge node". Her is some info about yarn logs -> https://spark.apache.org/docs/latest/running-on-yarn.html. Thank You, Irving Duran On Tue, Jun 6, 2017 at 11:48 AM, Ashok Kumar wrote: > Just

Re: Edge Node in Spark

2017-06-06 Thread Ashok Kumar
Just Straight Spark please. Also if I run a spark job using Python or Scala using Yarn where the log files are kept in the edge node?  Are these under logs directory for yarn? thanks On Tuesday, 6 June 2017, 14:11, Irving Duran wrote: Ashok,Are you working with straight spark or referri

Re: Edge Node in Spark

2017-06-06 Thread Irving Duran
Ashok, Are you working with straight spark or referring to GraphX? Thank You, Irving Duran On Mon, Jun 5, 2017 at 3:45 PM, Ashok Kumar wrote: > Hi, > > I am a bit confused between Edge node, Edge server and gateway node in > Spark. > > Do these mean the same thing? > > How does one set up an

Edge Node in Spark

2017-06-05 Thread Ashok Kumar
Hi, I am a bit confused between Edge node, Edge server and gateway node in Spark. Do these mean the same thing? How does one set up an Edge node to be used in Spark? Is this different from Edge node for Hadoop please? Thanks ---