Re: Upgrade the scala code using the most updated Spark version

2017-03-27 Thread vvshvv
it yo On Jörn Franke , Mar 28, 2017 12:11 AM wrote:Usually you define the dependencies to the Spark library as provided. You also seem to mix different Spark versions which should be avoided.The Hadoop library seems to be outdated and should also only be provided.The other dependencies you could

Re:RE: Fast write datastore...

2017-03-15 Thread vvshvv
me know your thoughts.   Thanks, Muthu     On Wed, Mar 15, 2017 at 10:55 AM, vvshvv <vvs...@gmail.com> wrote: Hi muthu,   I agree with Shiva, Cassandra also supports SASI indexes, which can partially replace Elasticsearch functionality.  

Re:Docker image for Spark streaming app

2017-01-08 Thread vvshvv
Hi, I am running spark streaming job using spark jobserver via this image: https://hub.docker.com/r/depend/spark-jobserver/. It works well in standalone (using mesos job does not make progress). Spark jobserver that supports Spark 2.0 has new API that is only suitable for non-streaming jobs as f