Re: Spark Task is not created

2016-06-25 Thread Akhil Das
Would be good if you can paste the piece of code that you are executing. On Sun, Jun 26, 2016 at 11:21 AM, Ravindra wrote: > Hi All, > > May be I need to just set some property or its a known issue. My spark > application hangs in test environment whenever I see

Spark Task is not created

2016-06-25 Thread Ravindra
Hi All, May be I need to just set some property or its a known issue. My spark application hangs in test environment whenever I see following message - 16/06/26 11:13:34 INFO DAGScheduler: *Submitting 2 missing tasks from ShuffleMapStage* 145 (MapPartitionsRDD[590] at rdd at

Streaming and Batch code sharing

2016-06-25 Thread Nikhil Goyal
Hi, Does anyone has a good example where realtime and batch are able to share same code. (Other than this one https://github.com/databricks/reference-apps/blob/master/logs_analyzer/chapter1/reuse.md ) Thanks Nikhil

Re: Running JavaBased Implementation of StreamingKmeans Spark

2016-06-25 Thread Biplob Biswas
Hi, I tried doing that but even then I couldn't see any results. I started the program and added the files later. Thanks & Regards Biplob Biswas On Sat, Jun 25, 2016 at 2:19 AM, Jayant Shekhar wrote: > Hi Biplop, > > Can you try adding new files to the training/test

Unsubscribe

2016-06-25 Thread Y!-RK
- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org

Unsubscribe

2016-06-25 Thread milad bourhani
Unsubscribe

Re: spark-sql jdbc dataframe mysql data type issue

2016-06-25 Thread Mich Talebzadeh
select 10 sample rows for columns id, ctime from each (MySQL and spark) tables and post the output please. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

spark-sql jdbc dataframe mysql data type issue

2016-06-25 Thread 刘虓
Hi, I came across this strange behavior of Apache Spark 1.6.1: when I was reading mysql table into spark dataframe ,a column of data type float got mapped into double. dataframe schema: root |-- id: long (nullable = true) |-- ctime: double (nullable = true) |-- atime: double (nullable =

Unsubscribe

2016-06-25 Thread Shivpriya Tamboskar
Unsubscribe Sent from my iPhone - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org