[
https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257291#comment-15257291
]
Chris Nauroth commented on HDFS-10327:
--------------------------------------
As originally described, it was an ask for WebHDFS to handle these "Spark
directories", but HDFS doesn't handle knowledge of specific applications.
Likewise, I'm not sure a SPARK JIRA would be useful, because the Spark
community probably doesn't easily have a way to alter the behavior of WebHDFS.
> Open files in WEBHDFS which are stored in folders by Spark
> ----------------------------------------------------------
>
> Key: HDFS-10327
> URL: https://issues.apache.org/jira/browse/HDFS-10327
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: webhdfs
> Reporter: Thomas Hille
> Labels: features
>
> When Spark saves a file in HDFS it creates a directory which includes many
> parts of the file. When you read it with spark programmatically, you can read
> this directory as it is a normal file.
> If you try to read this directory-style file in webhdfs, it returns
> {"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"Path
> is not a file: [...]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
