[
https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077314#comment-17077314
]
Bhavani Sudha commented on HUDI-69:
-----------------------------------
[~garyli1019] Yes the InputPathHandler will be able to provide MOR snapshot
paths. However I think the FileInputFormat filters out hidden files by default.
The log files start with a `.` and hence are treated as hidden files by the
FileInputFormat class. Given this context, when we do super.listStatus from
HoodieParquetInputFormat -
[https://github.com/apache/incubator-hudi/blob/b5d093a21bbb19f164fbc549277188f2151232a8/hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieParquetInputFormat.java#L107]
the log files are not listed.
> Support realtime view in Spark datasource #136
> ----------------------------------------------
>
> Key: HUDI-69
> URL: https://issues.apache.org/jira/browse/HUDI-69
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: Spark Integration
> Reporter: Vinoth Chandar
> Assignee: Yanjia Gary Li
> Priority: Major
> Fix For: 0.6.0
>
>
> https://github.com/uber/hudi/issues/136
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
