David Li created ARROW-17914:
--------------------------------
Summary: [Java] Support reading a subset of fields from an IPC
file or stream
Key: ARROW-17914
URL: https://issues.apache.org/jira/browse/ARROW-17914
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Reporter: David Li
C++ supports {{IpcReadOptions.included_fields}} which lets you load a subset of
(top-level) fields from an IPC file or stream, potentially saving on I/O costs.
It would be useful to support this in Java as well. Some refactoring would be
required since MessageSerializer currently reads record batch messages in as a
whole, and it would be good to quantify how much of a benefit this provides in
different scenarios.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)