Re: Integrating D3 with Spark

2015-04-12 Thread anshu shukla
Hey Ousterhout , I found its amazing .Before this i used to use my own D3.js files that subscribes to the redis pub-shub database where output tuples are being published to the DB . So it was already including latency to push data to redis ,although it was very less. Once again

Re: Parquet File Binary column statistics error when reuse byte[] among rows

2015-04-12 Thread Cheng Lian
Thanks for reporting this! Would you mind to open JIRA tickets for both Spark and Parquet? I'm not sure whether Parquet declares somewhere the user mustn't reuse byte arrays when using binary type. If it does, then it's a Spark bug. Anyway, this should be fixed. Cheng On 4/12/15 1:50 PM,

Re: wait time between start master and start slaves

2015-04-12 Thread Nicholas Chammas
Oh, good point. So I guess I should be able to query the master via code like this before any slaves are started. On Sat, Apr 11, 2015 at 7:52 PM Ted Yu yuzhih...@gmail.com wrote: From SparkUI.scala : def getUIPort(conf: SparkConf): Int = { conf.getInt(spark.ui.port,

Re: [VOTE] Release Apache Spark 1.3.1 (RC3)

2015-04-12 Thread Mark Hamstra
+1 On Fri, Apr 10, 2015 at 11:05 PM, Patrick Wendell pwend...@gmail.com wrote: Please vote on releasing the following candidate as Apache Spark version 1.3.1! The tag to be voted on is v1.3.1-rc2 (commit 3e83913):