Manoj Govindassamy created HUDI-3300:
----------------------------------------

             Summary: Timeline server FSViewManager should avoid inline reading 
for metadata file partition
                 Key: HUDI-3300
                 URL: https://issues.apache.org/jira/browse/HUDI-3300
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Manoj Govindassamy
            Assignee: Ethan Guo
             Fix For: 0.11.0


When inline reading is enabled, that is 
hoodie.metadata.enable.full.scan.log.files = false, 
MetadataMergedLogRecordReader doesn't cache the file listings records via the 
ExternalSpillableMap. So, every file listing will lead to re-reading of 
metadata files partition log and base files. Since files partition is less in 
size, even when inline reading is enabled, the TimelineServer should construct 
the FSViewManager with inline reading disabled for metadata files partition. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to