[
https://issues.apache.org/jira/browse/IMPALA-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108591#comment-17108591
]
Tim Armstrong commented on IMPALA-9741:
---------------------------------------
[~skyyws] the HdfsScanNode implementation in the backend can handle
mixed-format files. E.g. see how per_type_files_ is constructed and used in
be/src/exec/hdfs-scan-node-base.cc. For Hive-style tables, each partition can
have a different file format, so the file format is a property of
HdfsPartitionDescriptor. But there's no reason the scan node can't be modified
to determine the file format in a different way.
I think there will be a lot of code shared between IcebergScanNode.java and
HdfsScanNode.java. I'm not sure the best way to achieve that code-sharing,
maybe a common base class or by factoring out logic into a separate class.
> Support query iceberg table by impala
> -------------------------------------
>
> Key: IMPALA-9741
> URL: https://issues.apache.org/jira/browse/IMPALA-9741
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: WangSheng
> Assignee: WangSheng
> Priority: Major
> Attachments: select-iceberg.jpg
>
>
> Since we have submit an patch of supporting create iceberg table by impala in
> IMPALA-9688, we are preparing to implement iceberg table query by impala. But
> we need to read the impala and iceberg code deeply to determine how to do
> this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
