Hello Anonymous Coward (572), Tim Armstrong, Joe McDonnell, Impala Public
Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/15334
to look at the new patch set (#2).
Change subject: IMPALA-9400: Initial Ozone support
......................................................................
IMPALA-9400: Initial Ozone support
Ozone is a block-based filesystem store and is similar to HDFS in
many aspects. This patch adds initial support for reading data stored
on Ozone and writing data to Ozone. It adds Ozone to the whitelist of
Impala writable filesystems and adds the necessary Ozone client jars
to the Impala classpath.
Initially, Ozone will be treated as a remote storage service, similar to
how Impala treats S3 and ABFS. Ozone will typically be deployed on a
separate storage cluster, so all reads will be remote.
Rather than updating to a new CDP GBN with the added Ozone client jars,
I just modified the existing GBN to include the new jars in the Maven
repo.
Testing:
* Manually tested that connecting to an external Ozone cluster works and
that Impala can create an Ozone-backed table, write to the
table, read from the table, and drop the table
* Ran core tests with and without USE_CDP_HIVE=true
Change-Id: I2544ff61e8767f061253a62a01ce2b7dfc384a99
---
M be/src/exec/hdfs-table-sink.cc
M be/src/runtime/io/disk-io-mgr.cc
M be/src/runtime/io/disk-io-mgr.h
M be/src/util/hdfs-util.cc
M be/src/util/hdfs-util.h
M bin/impala-config.sh
M fe/pom.xml
M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java
M impala-parent/pom.xml
9 files changed, 72 insertions(+), 4 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/34/15334/2
--
To view, visit http://gerrit.cloudera.org:8080/15334
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I2544ff61e8767f061253a62a01ce2b7dfc384a99
Gerrit-Change-Number: 15334
Gerrit-PatchSet: 2
Gerrit-Owner: Sahil Takiar <[email protected]>
Gerrit-Reviewer: Anonymous Coward (572)
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Sahil Takiar <[email protected]>
Gerrit-Reviewer: Tim Armstrong <[email protected]>
