Yanjia Gary Li has uploaded a new patch set (#7). ( http://gerrit.cloudera.org:8080/14711 )
Change subject: [WIP]IMPALA-8778: Support Apache Hudi Read Optimized Table ...................................................................... [WIP]IMPALA-8778: Support Apache Hudi Read Optimized Table Hudi Read Optimized Table contains multiple versions of parquet files, in order to load the correct table, Impala needs to recognize Hudi Read Optimized Table as a HdfsTable and load the latest version of the file using HoodieROTablePathFilte. Change-Id: I65e146b347714df32fe968409ef2dde1f6a25cdf --- M bin/rat_exclude_files.txt M fe/pom.xml M fe/src/main/java/org/apache/impala/catalog/FileMetadataLoader.java M fe/src/main/java/org/apache/impala/catalog/HdfsFileFormat.java M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java A fe/src/main/java/org/apache/impala/util/HudiUtil.java M fe/src/test/java/org/apache/impala/catalog/FileMetadataLoaderTest.java M testdata/bin/create-load-data.sh A testdata/data/hudicow/.hoodie/20191218160747.clean A testdata/data/hudicow/.hoodie/20191218160747.clean.inflight A testdata/data/hudicow/.hoodie/20191218160747.clean.requested A testdata/data/hudicow/.hoodie/20191218160747.commit A testdata/data/hudicow/.hoodie/20191218160747.commit.requested A testdata/data/hudicow/.hoodie/20191218160747.inflight A testdata/data/hudicow/.hoodie/20191218160804.clean A testdata/data/hudicow/.hoodie/20191218160804.clean.inflight A testdata/data/hudicow/.hoodie/20191218160804.clean.requested A testdata/data/hudicow/.hoodie/20191218160804.commit A testdata/data/hudicow/.hoodie/20191218160804.commit.requested A testdata/data/hudicow/.hoodie/20191218160804.inflight A testdata/data/hudicow/.hoodie/hoodie.properties A testdata/data/hudicow/2015/03/16/.hoodie_partition_metadata A testdata/data/hudicow/2015/03/16/75ca3e88-0a2c-4592-b1c5-4d4812c80388-0_0-38-281_20191218160804.parquet A testdata/data/hudicow/2015/03/16/75ca3e88-0a2c-4592-b1c5-4d4812c80388-0_1-5-10_20191218160747.parquet A testdata/data/hudicow/2015/03/17/.hoodie_partition_metadata A testdata/data/hudicow/2015/03/17/ea972399-ebd0-4447-a01b-6356fd76e43f-0_2-38-283_20191218160804.parquet A testdata/data/hudicow/2015/03/17/ea972399-ebd0-4447-a01b-6356fd76e43f-0_2-5-11_20191218160747.parquet A testdata/data/hudicow/2016/03/15/.hoodie_partition_metadata A testdata/data/hudicow/2016/03/15/e867a156-5330-4a05-a188-ec39f131b1d0-0_0-5-9_20191218160747.parquet A testdata/data/hudicow/2016/03/15/e867a156-5330-4a05-a188-ec39f131b1d0-0_1-38-282_20191218160804.parquet 30 files changed, 424 insertions(+), 20 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/11/14711/7 -- To view, visit http://gerrit.cloudera.org:8080/14711 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I65e146b347714df32fe968409ef2dde1f6a25cdf Gerrit-Change-Number: 14711 Gerrit-PatchSet: 7 Gerrit-Owner: Yanjia Gary Li <yanjia.gary...@gmail.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Yanjia Gary Li <yanjia.gary...@gmail.com> Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com>
