How to use Window Operations with kafka Direct-API?

2015-06-12 Thread ZIGEN
Hi, I'm using Spark Streaming(1.3.1). I want to get exactly-once messaging from Kafka and use Window operations of DStraem, When Window operations(eg DStream#reduceByKeyAndWindow) with kafka Direct-API java.lang.ClassCastException occurs as follows. --- stacktrace --

Re: How to use Window Operations with kafka Direct-API?

2015-06-12 Thread zigen
Hi Shao, Thank you for your quick prompt. I was disappointed. I will try window operations with Receiver-based Approach(KafkaUtils.createStream). Thank you again, ZIGEN 2015/06/12 17:18、Saisai Shao sai.sai.s...@gmail.com のメッセージ: I think you could not use offsetRange in such way, when you

Re: Compile error from Spark 1.2.0

2015-01-01 Thread zigen
of arbitrary decimal support. Can you open a JIRA? On Sun, Dec 28, 2014 at 12:23 AM, Akhil Das ak...@sigmoidanalytics.com wrote: Hi Zigen, Looks like they missed it. Thanks Best Regards On Sat, Dec 27, 2014 at 12:43 PM, Zigen Zigen dbviewer.zi...@gmail.com wrote: Hello , I am zigen

Compile error since Spark 1.2.0

2014-12-27 Thread zigen
Compile error from Spark 1.2.0 Hello , I am zigen. I am using the Spark SQL 1.1.0. I want to use the Spark SQL 1.2.0. but my Spark application is a compile error. Spark 1.1.0 had a DataType.DecimalType. but Spark1.2.0 had not DataType.DecimalType. Why ? JavaDoc (Spark 1.1.0) http

Compile error from Spark 1.2.0

2014-12-26 Thread Zigen Zigen
Hello , I am zigen. I am using the Spark SQL 1.1.0. I want to use the Spark SQL 1.2.0. but my Spark application is a compile error. Spark 1.1.0 had a DataType.DecimalType. but Spark1.2.0 had not DataType.DecimalType. Why ? JavaDoc (Spark 1.1.0) http://people.apache.org/~pwendell/spark