[
https://issues.apache.org/jira/browse/SPARK-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15415994#comment-15415994
]
Davies Liu commented on SPARK-16227:
------------------------------------
Can reproduce this by change `jsont` to `jsont:1`
> Json schema inference fails when `:` exists in file path
> --------------------------------------------------------
>
> Key: SPARK-16227
> URL: https://issues.apache.org/jira/browse/SPARK-16227
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.6.1, 2.0.0
> Reporter: Burak Yavuz
>
> While Hadoop handles `:` in file paths since
> https://issues.apache.org/jira/browse/HDFS-13, the json schema inference
> doesn't behave as nicely.
> If the filename has a timestamp which contains a colon, if this file is in
> parquet, everything works, but when it is in json, it fails. Json should be
> able to also handle these cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
