I think this is fixed in https://github.com/apache/spark/pull/15767
This should be fixed in 2.1.0.
2017-03-17 3:28 GMT+09:00 George Obama :
> Hello,
>
>
>
> I am using spark 2.0.2 to read the CSV file with empty columns and is
> hitting the issue:
>
> scala>val df = sqlContext.read.option("head
Hello,
I am using spark 2.0.2 to read the CSV file with empty columns and is hitting
the issue:
scala>val df = sqlContext.read.option("header", true).option("inferSchema",
true).csv("file location")
17/03/13 07:26:26 WARN DataSource: Error while looking for metadata directory.
scala> df.show(