[
https://issues.apache.org/jira/browse/ARROW-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17605446#comment-17605446
]
David Dali Susanibar Arce commented on ARROW-17705:
---------------------------------------------------
The Adapter/ORC and Dataset ORC handling different level of abstractions:
* The Adapter/ORC: Adapter this moment is a specialized reader for single ORC
files
* The Dataset ORC: Dataset is a more generic implementation for reader ORC
files, and also support reading multiple files
Then this two modules are already needed and need to continue working for
improvements.
Also, https://issues.apache.org/jira/browse/ARROW-17561 is needed
[~kou]
> [Java][Dataset][Adapter/ORC] Compare features for ORC reader between Dataset
> and Adapter/ORC
> ---------------------------------------------------------------------------------------------
>
> Key: ARROW-17705
> URL: https://issues.apache.org/jira/browse/ARROW-17705
> Project: Apache Arrow
> Issue Type: Sub-task
> Reporter: David Dali Susanibar Arce
> Assignee: David Dali Susanibar Arce
> Priority: Major
>
> Compare new Dataset ORC reader versus Adapter ORC reader:
> Dataset ORC: High level interface to a dataset abstraction
> {code:java}
> FileSystemDatasetFactory(rootAllocator(),
> NativeMemoryPool.getDefault(),FileFormat.ORC, orcDatasetUri) {code}
>
> Adapter ORC: Direct bindings to the file reader
> {code:java}
> new OrcReader(testFile.getAbsolutePath(), allocator); {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
