Yong Yang created IMPALA-10780:
----------------------------------
Summary: Iceberg in Impala should support combination storage
Key: IMPALA-10780
URL: https://issues.apache.org/jira/browse/IMPALA-10780
Project: IMPALA
Issue Type: Improvement
Reporter: Yong Yang
Currently, the filesystem of the metadata path is used to check the data file,
that is blocking the following scenario:
# metadata is on hdfs
# data is on s3a or other object store.
Following code in FeIcebergTable.Utils fails this combination:
private static HdfsPartition.FileDescriptor getFileDescriptor(Path fileLoc,
Path tableLoc, ListMap<TNetworkAddress> hostIndex) throws IOException {
FileSystem fs = FileSystemUtil.getFileSystemForPath(tableLoc);
FileStatus fileStatus = fs.getFileStatus(fileLoc);
return getFileDescriptor(fs, tableLoc, fileStatus, hostIndex);
}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
