David Li created ARROW-17914:
--------------------------------

             Summary: [Java] Support reading a subset of fields from an IPC 
file or stream
                 Key: ARROW-17914
                 URL: https://issues.apache.org/jira/browse/ARROW-17914
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Java
            Reporter: David Li


C++ supports {{IpcReadOptions.included_fields}} which lets you load a subset of 
(top-level) fields from an IPC file or stream, potentially saving on I/O costs. 
It would be useful to support this in Java as well. Some refactoring would be 
required since MessageSerializer currently reads record batch messages in as a 
whole, and it would be good to quantify how much of a benefit this provides in 
different scenarios.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to