Reynold
thanks for the reply. It's true, this is more to Yarn communication
than Spark.
But this is a general enough problem for all the YARN_CLUSTER mode
application. I thought
just to reach out to the community.
If we choose to using Akka solution, then this is related to Spark, as
there i
This isn't exactly about Spark itself, more about how an application on
YARN/Mesos can communicate with another one.
How about your application launch program just takes in a parameter (or env
variable or command line argument) for the IP address of your client
application, and just send updates?
Hi Spark dev community:
I have several questions regarding Application and Spark communication
1) Application Level Progress Monitoring
Currently, our application using in YARN_CLUSTER model running Spark Jobs.
This works well so far, but we would like to monitoring the application
level progres
