Hi,
I am running spark streaming job using spark jobserver via this image:
It works well in standalone (using mesos job does not make progress). Spark jobserver that supports Spark 2.0 has new API that is only suitable for non-streaming jobs as for streaming you have to specify StreamingContextFactory that still uses old API, so you can just use old API for now.
Sent from my Mi phone
On shyla deshpande <deshpandesh...@gmail.com>, Jan 8, 2017 11:51 PM wrote:
I looking for a docker image that I can use from docker hub for running a spark streaming app with scala and spark 2.0 +.I am new to docker and unable to find one image from docker hub that suits my needs. Please let me know if anyone is using a docker for spark streaming app and share your experience.Thanks
