Just want to clarify. I want to run a single node spark cluster in a docker container. I want to use Spark 2.0+ and scala. Looking for a docker image from docker hub. I want this setup for development and testing purpose.
Please let me know if you know of any docker image that can help me get started. Thanks On Sun, Jan 8, 2017 at 1:52 PM, shyla deshpande <deshpandesh...@gmail.com> wrote: > Thanks really appreciate. > > On Sun, Jan 8, 2017 at 1:02 PM, vvshvv <vvs...@gmail.com> wrote: > >> Hi, >> >> I am running spark streaming job using spark jobserver via this image: >> >> https://hub.docker.com/r/depend/spark-jobserver/. >> >> It works well in standalone (using mesos job does not make progress). >> Spark jobserver that supports Spark 2.0 has new API that is only suitable >> for non-streaming jobs as for streaming you have to specify >> StreamingContextFactory that still uses old API, so you can just use old >> API for now. >> >> >> >> Sent from my Mi phone >> On shyla deshpande <deshpandesh...@gmail.com>, Jan 8, 2017 11:51 PM >> wrote: >> >> I looking for a docker image that I can use from docker hub for running a >> spark streaming app with scala and spark 2.0 +. >> >> I am new to docker and unable to find one image from docker hub that >> suits my needs. Please let me know if anyone is using a docker for spark >> streaming app and share your experience. >> >> Thanks >> >> >
