[
https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408362#comment-15408362
]
Arsen Vladimirskiy commented on SPARK-15899:
--------------------------------------------
Are you using the pre-compiled binaries? The applied fix is probably not there
yet. I tried with spark-2.0.0-bin-without-hadoop.tgz distro and got the same
error. To workaround the issue for now, I tried adding
"spark.sql.warehouse.dir=file:///C:/Experiment/spark-2.0.0-bin-without-hadoop/spark-warehouse"
config setting to the conf/spark-defaults.conf file with the "file:///" scheme
and it seems to let me read files via the SparkSession (e.g val data =
spark.read.format("csv").option("header","false").load("C:/Temp/test.csv"))
> file scheme should be used correctly
> ------------------------------------
>
> Key: SPARK-15899
> URL: https://issues.apache.org/jira/browse/SPARK-15899
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Kazuaki Ishizaki
> Priority: Minor
>
> [A RFC|https://www.ietf.org/rfc/rfc1738.txt] defines file scheme as
> {{file://host/}} or {{file:///}}.
> [Wikipedia|https://en.wikipedia.org/wiki/File_URI_scheme]
> [Some code
> stuffs|https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L58]
> use different prefix such as {{file:}}.
> It would be good to prepare a utility method to correctly add {{file://host}}
> or {{file://} prefix.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
