Re: Spark Streaming and Shark | Streaming Taking All CPUs

Thanks Mayur, it is working :) -- Anish Sneh http://in.linkedin.com/in/anishsneh

Re: Spark Streaming and Shark | Streaming Taking All CPUs

Simply configure spark.cores.max variable in your application in spark context. Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Mon, May 19, 2014 at 11:13 PM, anishs...@yahoo.co.in < anishs...@yahoo.co.in> wrote: > Hi Al

Spark Streaming and Shark | Streaming Taking All CPUs

Hi All I am new to Spark, I was trying to use Spark Streaming and Shark at the same time. I was recieiving messages from Kafka and pushing them to HDFS after minor processing. It was workin fine, but it was taking all the CPUs and at the same time on other terminal i tried to access shark but