This is an automated email from the ASF dual-hosted git repository.
zhangyue19921010 pushed a change to branch stream-binary-copy
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 40d3cbc23a2 take care of more conner cases and add uts
add 0d96b1c7f39 add more check before binary copy
No new revisions were added by this update.
Summary of changes:
...SparkBinaryCopyClusteringExecutionStrategy.java | 35 +--
.../org/apache/hudi/common/util/ParquetUtils.java | 25 --
.../hudi/parquet/io/ParquetBinaryCopyChecker.java | 195 ++++++++++++++
.../io/TestHoodieParquetFileBinaryCopier.java | 8 +-
.../parquet/io/TestParquetBinaryCopyChecker.java | 295 +++++++++++++++++++++
...SparkBinaryCopyClusteringAndValidationMeta.java | 138 ++++++++++
6 files changed, 642 insertions(+), 54 deletions(-)
create mode 100644
hudi-hadoop-common/src/main/java/org/apache/hudi/parquet/io/ParquetBinaryCopyChecker.java
create mode 100644
hudi-hadoop-common/src/test/java/org/apache/hudi/parquet/io/TestParquetBinaryCopyChecker.java