I try with the spark 1.3 command mentioned in spark-csv website
val df = sqlContext.load("com.databricks.spark.csv", Map("path" ->
"fileName.csv", "header" -> "true"))
and I get the following error
java.lang.NoClassDefFoundError: org/apache/commons/csv/CSVFormat
at com.databricks.spark.csv.CsvRelation.inferSchema(CsvRelation.scala:90)
at com.databricks.spark.csv.CsvRelation.<init>(CsvRelation.scala:53) at
com.databricks.spark.csv.DefaultSource.createRelation(DefaultSource.scala:89)
at
com.databricks.spark.csv.DefaultSource.createRelation(DefaultSource.scala:39)
at
com.databricks.spark.csv.DefaultSource.createRelation(DefaultSource.scala:27)
at org.apache.spark.sql.sources.ResolvedDataSource$.apply(ddl.scala:219) at
org.apache.spark.sql.SQLContext.load(SQLContext.scala:697)
And in my previous mail it should have been
%dep
z.load(com.databricks:spark-csv_2.11:1.0.3)
On Tue, Jun 23, 2015 at 7:51 PM, George Koshy <gkos...@gmail.com> wrote:
> Please help,
> I get this error
> error: value read is not a member of org.apache.spark.sql.SQLContext
> val df =
> sqlContext.read.format("com.databricks.spark.csv").option("header",
> "true").load("filename.csv")
>
>
> My code is as follows:
> import org.apache.spark.SparkContext
>
> %dep
> com.databricks:spark-csv_2.11:1.0.3
>
> import org.apache.spark.sql.SQLContext val sqlContext = new SQLContext(sc)
> val df =
> sqlContext.read.format("com.databricks.spark.csv").option("header",
> "true").load("fileName.csv")
>
> --
> Sincerely!
> George Koshy,
> Richardson,
> in.linkedin.com/in/gkoshyk/
>
--
Sincerely!
George Koshy,
Richardson,
in.linkedin.com/in/gkoshyk/
