sivabalan narayanan created HUDI-3189:
-----------------------------------------
Summary: Follow up for fallback to full table scan with
incremental query when files are cleaned up or achived
Key: HUDI-3189
URL: https://issues.apache.org/jira/browse/HUDI-3189
Project: Apache Hudi
Issue Type: Task
Components: Incremental Pull
Reporter: sivabalan narayanan
[https://github.com/apache/hudi/pull/3946]
was added to fallback to full table scan with incremental query on 2 occasions:
# files are cleaned up, but active timeline still returns the commits.
# commits are archived.
There are two follow ups from the original PR.
a. fs.isExists() call should be routed to metadata table.
b. Add similar support to MOR table.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)