[
https://issues.apache.org/jira/browse/SPARK-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345611#comment-15345611
]
Alexander Ulanov commented on SPARK-15899:
------------------------------------------
`user.dir` on Windows starts with a letter:
scala> System.getProperty("user.dir")
res0: String = C:\Program Files (x86)\scala\bin
On Linux it starts with a slash:
scala> System.getProperty("user.dir")
res0: String = /home/hduser
It seems that java.io.File could convert it to a proper URI:
Windows:
scala> new File("c:/myfile").toURI
res6: java.net.URI = file:/c:/myfile
Linux:
scala> new File("/home/myfile").toURI
res3: java.net.URI = file:/home/myfile
We can remove "file:" from
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L58
and add toURI conversion in
https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L694
> file scheme should be used correctly
> ------------------------------------
>
> Key: SPARK-15899
> URL: https://issues.apache.org/jira/browse/SPARK-15899
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Reporter: Kazuaki Ishizaki
> Priority: Minor
>
> [A RFC|https://www.ietf.org/rfc/rfc1738.txt] defines file scheme as
> {{file://host/}} or {{file:///}}.
> [Wikipedia|https://en.wikipedia.org/wiki/File_URI_scheme]
> [Some code
> stuffs|https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala#L58]
> use different prefix such as {{file:}}.
> It would be good to prepare a utility method to correctly add {{file://host}}
> or {{file://} prefix.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
