Re: Parquet without hadoop: Possible?

2015-08-12 Thread Cheng Lian
st 11, 2015 12:01 PM *To:* Ellafi, Saif A.; deanwamp...@gmail.com *Cc:* user@spark.apache.org *Subject:* RE: Parquet without hadoop: Possible? Sorry, I provided bad information. This example worked fine with reduced parallelism. It seems my problem have to do with something specific with the

Re: Parquet without hadoop: Possible?

2015-08-11 Thread Jerry Lam
> From: Ellafi, Saif A. > Sent: Tuesday, August 11, 2015 12:01 PM > To: Ellafi, Saif A.; deanwamp...@gmail.com > Cc: user@spark.apache.org > Subject: RE: Parquet without hadoop: Possible? > > Sorry, I provided bad information. This example worked fine with reduced > parall

RE: Parquet without hadoop: Possible?

2015-08-11 Thread Saif.A.Ellafi
I confirm that it works, I was just having this issue: https://issues.apache.org/jira/browse/SPARK-8450 Saif From: Ellafi, Saif A. Sent: Tuesday, August 11, 2015 12:01 PM To: Ellafi, Saif A.; deanwamp...@gmail.com Cc: user@spark.apache.org Subject: RE: Parquet without hadoop: Possible? Sorry

RE: Parquet without hadoop: Possible?

2015-08-11 Thread Saif.A.Ellafi
11:49 AM To: deanwamp...@gmail.com Cc: user@spark.apache.org Subject: RE: Parquet without hadoop: Possible? I am launching my spark-shell spark-1.4.1-bin-hadoop2.6/bin/spark-shell 15/08/11 09:43:32 INFO SparkILoop: Created sql context (with Hive support).. SQL context available as sqlContext

RE: Parquet without hadoop: Possible?

2015-08-11 Thread Saif.A.Ellafi
August 11, 2015 11:39 AM To: Ellafi, Saif A. Cc: user@spark.apache.org Subject: Re: Parquet without hadoop: Possible? It should work fine. I have an example script here: https://github.com/deanwampler/spark-workshop/blob/master/src/main/scala/sparkworkshop/SparkSQLParquet10-script.scala (Spark 1

Re: Parquet without hadoop: Possible?

2015-08-11 Thread Dean Wampler
It should work fine. I have an example script here: https://github.com/deanwampler/spark-workshop/blob/master/src/main/scala/sparkworkshop/SparkSQLParquet10-script.scala (Spark 1.4.X) What does "I am failing to do so" mean? Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition