Ivan,

Although this is kubernetes-related docs it might apply to your use case:

https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images

There is a script that can create the image for you in spark distribution,
it was added in 2.3. So if you downloaded a spark 2.3+ distribution then
you will find this script.

On Wed, Sep 16, 2020 at 7:55 AM Ivan Petrov <capacyt...@gmail.com> wrote:

> Hi,
> looking for a ready to use docker-container that has inside:
> - spark 2.4 or higher
> - yarn 2.8.2 or higher
> I'm looking for a way to submit spark jobs on yarn.
>


-- 

Ricardo Martinelli De Oliveira

Data Engineer, AI CoE

Red Hat Brazil <https://www.redhat.com/>

Av. Brigadeiro Faria Lima, 3900

8th floor

rmart...@redhat.com    T: +551135426125
M: +5511970696531
@redhatjobs <https://twitter.com/redhatjobs>   redhatjobs
<https://www.facebook.com/redhatjobs> @redhatjobs
<https://instagram.com/redhatjobs>
<https://www.redhat.com/>

Reply via email to