Re: Is there any good Docker container / compose with spark 2.4+ and YARN 2.8.2+

Ivan, Although this is kubernetes-related docs it might apply to your use case: https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images There is a script that can create the image for you in spark distribution, it was added in 2.3. So if you downloaded a spark 2.3+ distribu

Is there any good Docker container / compose with spark 2.4+ and YARN 2.8.2+

Hi, looking for a ready to use docker-container that has inside: - spark 2.4 or higher - yarn 2.8.2 or higher I'm looking for a way to submit spark jobs on yarn.