Rahil Chertara created HUDI-9739:
------------------------------------
Summary: Avoid using meta client in FGReader to avoid performance
degradation
Key: HUDI-9739
URL: https://issues.apache.org/jira/browse/HUDI-9739
Project: Apache Hudi
Issue Type: Improvement
Reporter: Rahil Chertara
{*}Goal{*}: FGReader should take necessary information from the
constructor/builder without having to do additional FS calls and scanning on
the executor (e.g., loading table config, scanning timeline, reading schema,
etc.) before reading the records.
Constructing meta client incurs loading table config, scanning timeline,
reading schema, etc., which are very expensive operations, which must not
happen per file group.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
