I think I might find the root cause, YARN-1931 addressed the incompatible issue. The solution for my case might be either take related Spark patches or do an upgrade.
On Wed, Jul 30, 2014 at 2:11 PM, yao <yaosheng...@gmail.com> wrote: > Hi Everyone, > > We got some yarn related errors when running spark 0.9.0 on hadoop 2.4 > (but it was okay on hadoop 2.2). I didn't find any comments said spark > 0.9.0 could support hadoop 2.4, so could I assume that we have to upgrade > spark to the latest release version at this point to solve this issue ? > > Best > Shengzhe >