This is an automated email from the ASF dual-hosted git repository.
changchen pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from d3e6bdea16 Configure Log4j2 to print logs of org.apache.iceberg for
tracing ClickHouseIcebergSuite aborted issues.I also remove threadLog in
CHBroadcastBuildSideCache, since Log4j2 supports printing thread name and id
(#8361)
add 8a5d7fb3b3 [GLUTEN-7028][CH][Part-14] Refactor Case Sensitive Support
for MergeTree (#8346)
No new revisions were added by this update.
Summary of changes:
.../sql/delta/catalog/ClickHouseTableV2.scala | 14 +-
.../commands/OptimizeTableCommandOverwrites.scala | 39 +++---
.../sql/delta/catalog/ClickHouseTableV2.scala | 14 +-
.../commands/OptimizeTableCommandOverwrites.scala | 39 +++---
.../sql/delta/catalog/ClickHouseTableV2.scala | 17 +--
.../commands/OptimizeTableCommandOverwrites.scala | 39 +++---
.../clickhouse/ExtensionTableBuilder.java | 5 +-
.../backendsapi/clickhouse/CHIteratorApi.scala | 2 +-
.../execution/GlutenMergeTreePartition.scala | 10 +-
.../sql/delta/catalog/ClickHouseTableV2Base.scala | 16 +--
.../commands/GlutenCHCacheDataCommand.scala | 2 +-
.../utils/MergeTreePartsPartitionsUtil.scala | 81 ++++++------
.../datasources/mergetree/DeltaMetaReader.scala | 26 ++--
.../datasources/mergetree/MetaSerializer.scala | 86 +++++--------
.../datasources/mergetree/StorageMeta.scala | 141 ++++++++++-----------
.../datasources/v1/CHFormatWriterInjects.scala | 2 +-
.../datasources/v1/CHMergeTreeWriterInjects.scala | 33 ++---
.../hive/GlutenClickHouseTableAfterRestart.scala | 4 +-
.../GlutenClickHouseMergeTreeCacheDataSuite.scala | 2 +-
...tenClickHouseMergeTreePathBasedWriteSuite.scala | 62 ++++-----
...GlutenClickHouseMergeTreeWriteOnHDFSSuite.scala | 44 +++----
...eMergeTreeWriteOnHDFSWithRocksDBMetaSuite.scala | 41 +++---
.../GlutenClickHouseMergeTreeWriteOnS3Suite.scala | 45 +++----
.../GlutenClickHouseMergeTreeWriteSuite.scala | 58 ++++-----
...lutenClickhouseMergetreeSoftAffinitySuite.scala | 3 +-
.../apache/spark/affinity/MixedAffinitySuite.scala | 3 +-
cpp-ch/local-engine/Common/BlockTypeUtils.h | 27 ++++
cpp-ch/local-engine/Common/CHUtil.cpp | 83 ------------
cpp-ch/local-engine/Common/CHUtil.h | 8 --
cpp-ch/local-engine/Common/DebugUtils.cpp | 3 +-
cpp-ch/local-engine/Common/GlutenConfig.cpp | 9 ++
cpp-ch/local-engine/Common/GlutenConfig.h | 11 ++
cpp-ch/local-engine/Common/PlanUtil.cpp | 124 ++++++++++++++++++
.../Common/{ArrayJoinHelper.h => PlanUtil.h} | 27 ++--
.../Parser/RelParsers/FilterRelParser.cpp | 4 +-
.../Parser/RelParsers/GroupLimitRelParser.cpp | 2 +-
.../Parser/RelParsers/MergeTreeRelParser.cpp | 91 ++++++++-----
.../Parser/RelParsers/MergeTreeRelParser.h | 2 +-
.../Parser/RelParsers/ProjectRelParser.cpp | 4 +-
.../Parser/RelParsers/ProjectRelParser.h | 4 +-
.../Parser/RelParsers/WriteRelParser.cpp | 34 ++---
.../local-engine/Parser/SerializedPlanParser.cpp | 28 ++--
.../Storages/MergeTree/StorageMergeTreeFactory.cpp | 3 +-
.../Storages/MergeTree/StorageMergeTreeFactory.h | 2 +-
.../local-engine/tests/data/upper_case_col.parquet | Bin 0 -> 459 bytes
cpp-ch/local-engine/tests/gtest_parquet_read.cpp | 17 ++-
...tion_schema.csv.json => upper_col_parquet.json} | 34 +----
.../apache/gluten/expression/ConverterUtils.scala | 25 +---
48 files changed, 660 insertions(+), 710 deletions(-)
create mode 100644 cpp-ch/local-engine/Common/PlanUtil.cpp
copy cpp-ch/local-engine/Common/{ArrayJoinHelper.h => PlanUtil.h} (53%)
create mode 100644 cpp-ch/local-engine/tests/data/upper_case_col.parquet
copy cpp-ch/local-engine/tests/json/{read_student_option_schema.csv.json =>
upper_col_parquet.json} (55%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
