Sagar Sumit created HUDI-8540:
---------------------------------
Summary: Fix nested column projection in hudi connector
Key: HUDI-8540
URL: https://issues.apache.org/jira/browse/HUDI-8540
Project: Apache Hudi
Issue Type: Task
Reporter: Sagar Sumit
Fix For: 1.1.0
Quoting from [Slack thread
-|https://trinodb.slack.com/archives/CGB0QHWSW/p1731697476660179]
{code:java}
Hudi connector is not great at reading values from the deeply nested objects.
Historically we've got a table where one field has around 5000 nested fields,
so the user that only tries to read a few fields quickly runs out of RAM
because apparently the whole object is being read into memory. {code}
Hudi connector needs to implement `HiveMetadata#applyProjection` to support
projection for nested fields.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
