Hi, I'm not very familiar with "High Availability/DR operations". Could you explain what it is? My very limited understanding of the phrase allows me to think that with YARN and cluster deploy mode you've failure recovery for free so when your drivers dies YARN will attempt to resurrect it a few times. The other "components", i.e. map shuffle stages, partitions/tasks, are handled by Spark itself.
Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 https://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Sun, Feb 5, 2017 at 10:11 AM, Ashok Kumar <ashok34...@yahoo.com.invalid> wrote: > Hello, > > What are the practiced High Availability/DR operations for Spark cluster at > the moment. I am specially interested if YARN is used as the resource > manager. > > Thanks --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
