Jintao created HUDI-2754:
----------------------------
Summary: Performance improvement for IncrementalRelation
Key: HUDI-2754
URL: https://issues.apache.org/jira/browse/HUDI-2754
Project: Apache Hudi
Issue Type: Bug
Components: Incremental Pull
Reporter: Jintao
When HoodieIncrSource is used to fetch the update from another Hudi table, the
IncrementalRelation will be used to read the data. But it has a performance
issue because the column pruning and predicate pushdown don't happen. As the
result, Hudi reads too much useless data.
By enabling the column pruning and predicate pushdown, the data to read is
reduced dramatically.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
