Re: Can't assembly YARN project with SBT

Hi! It seems that the problem of "unable to load YARN support" present only when I run my job from code and by not using the spark-submit script. IMO this is related to SPARK-5144 . I'm running QueueStream example with a single change: sparkConf.se

Can't assembly YARN project with SBT

Hi! I'm using the latest IntelliJ and I can't compile the yarn project into the Spark assembly fat JAR. That is why I'm getting a SparkException with message "Unable to load YARN support". The yarn project is also missing from SBT tasks and I can't add it. How can I force sbt to include? Thanks!