This is an automated email from the ASF dual-hosted git repository.
lgbo-ustc pushed a change to branch feature/idle-source-handling
in repository https://gitbox.apache.org/repos/asf/gluten.git
discard 5d08f10fb3 fix: Add shouldCallNoMoreSplits option to
GlutenSourceFunction for unbounded test scenarios
discard 4b55f61333 fix: Update velox4j reference to
feature/idle-source-handling branch
discard c0133bbd0a test: Add integration test for idle watermark status in
WatermarkAssigner
discard 7ab1cb8a64 test: Add unit tests for GlutenSourceFunction
WatermarkStatus handling
discard 8aa92c97e2 fix: Handle WatermarkStatus elements in GlutenSourceFunction
add 0a16d3272c [MINOR][CORE] Fail fast in InsertTransitions when a child
has no recognizable Convention (#12442)
add 8a987f8b81 rewrite multi-children Count in window expressions
add 9f9c2482a0 [MINOR][VL] Fix arrow 18 build errors on Power (#12408)
add bd2c1ce6be [VL] Support cudf.allowCpuFallback config for Velox cuDF
backend (#12451)
add cfef50944a [GLUTEN][CORE] Add TaskContext JNI callback for reading
Spark task attempt id from native (#12435)
add ef309d210e [GLUTEN][CORE] Add backend hooks for native config
forwarding (#12437)
add 4017ec94d3 [GLUTEN][CORE] Expose
ColumnarBatches.isLightBatch/ensureOffloaded as public (#12431)
add cd994505b0 [GLUTEN-12465][CORE] Support optional stage InputStats
plumbing in scan/input-iterator transformers (#12433)
add 9baa47c424 [GLUTEN-12303][VL] Support async multipart upload for S3
writes (#12305)
add a6202db285 [VL] Fix GlutenSubquerySuite in Spark 4.x (#12473)
add 630d5ace8a [CORE] optimize driver heap memory by lazily store metadata
columns and fix mismatch result when input_file_name is only in filter
condition (#11899)
add 6f179f5814 [MINOR] Remove stale complex type scan fallback config from
tests (#12476)
add 8aeff651e5 [VL] Support test/debug/benchmark native builds on macOS
(follow-up to #12331) (#12470)
add 065d2e30de [MINOR][CORE] Avoid O(n^2) stack walk in
CallerInfo.inBloomFilterStatFunctionCall (#12477)
add 75d6d1f0d0 [VL] Fix SPARK-53322 in GlutenKeyGroupedPartitioningSuite
for Spark 4.1 (#12469)
add ef647cac78 [CORE] Limit SparkSessionExtension suite to Gluten test
(#12475)
add 5d9bced5d4 [GLUTEN-12157][VL] Fix silently-skipped math/scalar test
suites and add Velox native tests for sin, tan, tanh, radians, ln (#12158)
add 31adaf8756 [GLUTEN-4730][CH] feat: Support date_from_unix_date
function: Add ClickHouse backend implementation (#12410)
add a1caefecb4 [MINOR][VL] Fix explain with ColumnarPartialGenerateExec
(#12478)
add 0f8074c8fd [VL]Use Velox's HashTableCache to cache the BHJ's HashTable
(#12163)
add 85d3ca109e [GLUTEN-12280][VL] Fix Spark 4 Arrow Python UDF stream
writer (#12345)
add 268ae68667 [GLUTEN-12449] Remove unsupported functions in
ArrowWritableColumnVector (#12450)
add 2479a6f168 [GLUTEN-12439] [FLINK] Add CONCAT / CONCAT_WS expression
registration (#12452)
add c5cb134c79 [GLUTEN][VL] Optimize Delta Lake DV materialization and
plan rule performance (#12390)
add fc756ffae8 [VL] Support GPU async native shuffle read (#12370)
add c357f6b811 [VL] Fix GlutenVariantInferShreddingSuite in Spark 4.1
(#12481)
add fadf00629d [VL] Fix SPARK-54439 in GlutenKeyGroupedPartitioningSuite
for Spark 4.1 (#12482)
add 26c2954f6b [GLUTEN-11622][VL] Enable minute/second(timestamp_ntz)
native execution (#12295)
add 7f5ff0def7 [VL] Disable useHashTableCache if the hash table is not
pre-built during HashJoinNode creation (#12487)
add 5ecef3c0e1 [VL] Refactor Velox metrics transport to use JSON payloads
(#12126)
add b57060effb [MINOR] Fix Scala test cache invalidation for suffixed
source roots (#12498)
add 022bc4b379 [VL] Adjust Spark 4.x inherited suite coverage (#12484)
add cd37d7aef9 [VL] Fall back to vanilla Delta write for unsupported
schemas (#12444)
add 9685185b94 [GLUTEN-12206][FLINK] Support native checkpoint snapshot
and restore for source operator (#12490)
add abce609f8a fix: Handle WatermarkStatus elements in GlutenSourceFunction
add 3bcf527e74 test: Add unit tests for GlutenSourceFunction
WatermarkStatus handling
add 53d7c08417 test: Add integration test for idle watermark status in
WatermarkAssigner
add 15c246dcca fix: Update velox4j reference to
feature/idle-source-handling branch
add ec01991b7a fix: Add shouldCallNoMoreSplits option to
GlutenSourceFunction for unbounded test scenarios
add bf1aa13c9a feat: E2E test for idle WatermarkStatus detection with
Kafka + MiniCluster
add a2ab1ae622 chore: remove obsolete
GlutenSourceFunctionWatermarkStatusTest
add c8d9460f78 test: verify idle inputs are excluded from combined
min-watermark
add 9cd1b66fcb fix: upgrade surefire in gluten-flink-ut from 3.0.0-M5 to
3.3.0
new 8e9685a1e1 fix: revert gluten-flink surefire upgrade
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5d08f10fb3)
\
N -- N -- N refs/heads/feature/idle-source-handling (8e9685a1e1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/flink.yml | 2 +-
.gitignore | 4 +
.../backendsapi/clickhouse/CHIteratorApi.scala | 18 +-
.../VeloxCelebornColumnarBatchSerializer.scala | 7 +-
.../perf/GlutenDeltaOptimizedWriterExec.scala | 70 +-
.../benchmark/DeltaPlanningBenchmark.scala | 238 +++
.../sql/delta/GlutenOptimisticTransaction.scala | 15 +-
.../spark/sql/delta/DeltaVariantWriteSuite.scala | 94 ++
.../java/org/apache/gluten/metrics/Metrics.java | 200 +--
.../org/apache/gluten/metrics/OperatorMetrics.java | 3 +
.../apache/gluten/vectorized/HashJoinBuilder.java | 6 +-
.../gluten/backendsapi/velox/VeloxBackend.scala | 19 +-
.../backendsapi/velox/VeloxIteratorApi.scala | 21 +-
.../org/apache/gluten/config/VeloxConfig.scala | 58 +
.../execution/ColumnarPartialGenerateExec.scala | 4 +-
.../gluten/execution/HashJoinExecTransformer.scala | 2 +-
.../execution/SerializedBroadcastHashTable.scala | 6 +-
.../execution/VeloxBroadcastBuildSideCache.scala | 5 +-
.../metrics/HashAggregateMetricsUpdater.scala | 2 +-
.../apache/gluten/metrics/JoinMetricsUpdater.scala | 2 +-
.../org/apache/gluten/metrics/MetricsUtil.scala | 137 +-
.../metrics/NestedLoopJoinMetricsUpdater.scala | 2 +-
.../gluten/metrics/UnionMetricsUpdater.scala | 2 +-
.../vectorized/ColumnarBatchSerializer.scala | 52 +-
.../ColumnarBatchSerializerInstance.scala | 11 +-
.../api/python/ColumnarArrowEvalPythonExec.scala | 77 +-
.../spark/shuffle/ColumnarShuffleReader.scala | 74 +-
.../sql/execution/ColumnarBuildSideRelation.scala | 11 +-
.../unsafe/UnsafeColumnarBuildSideRelation.scala | 11 +-
.../VeloxOrcDataTypeValidationSuite.scala | 172 +--
.../VeloxParquetDataTypeValidationSuite.scala | 172 +--
.../apache/gluten/execution/VeloxScanSuite.scala | 6 +-
.../python/ArrowEvalPythonExecSuite.scala | 71 +
.../functions/DateFunctionsValidateSuite.scala | 8 +
.../functions/MathFunctionsValidateSuite.scala | 35 +
.../functions/ScalarFunctionsValidateSuite.scala | 99 +-
.../functions/WindowFunctionsValidateSuite.scala | 39 +
.../spark/sql/execution/GlutenHiveUDFSuite.scala | 17 +
...ilter.cpp => SparkFunctionDateFromUnixDate.cpp} | 9 +-
...Timestamp.h => SparkFunctionDateFromUnixDate.h} | 61 +-
.../CommonScalarFunctionParser.cpp | 1 +
cpp/CMakeLists.txt | 13 +
cpp/core/CMakeLists.txt | 28 +-
cpp/core/compute/Runtime.h | 2 +-
cpp/core/config/GlutenConfig.h | 2 +
cpp/core/jni/JniCommon.h | 4 +
cpp/core/jni/JniWrapper.cc | 125 +-
.../jni/TaskContextJniWrapper.cc} | 22 +-
.../TaskContextJniWrapper.h} | 24 +-
cpp/core/shuffle/Options.h | 5 +
cpp/core/shuffle/ShuffleReader.h | 2 +
cpp/core/utils/Metrics.h | 89 +-
cpp/velox/CMakeLists.txt | 57 +-
cpp/velox/benchmarks/CMakeLists.txt | 4 +
cpp/velox/benchmarks/GenericBenchmark.cc | 6 +-
cpp/velox/benchmarks/S3AsyncUploadBenchmark.cc | 245 +++
cpp/velox/compute/VeloxBackend.cc | 14 +-
cpp/velox/compute/VeloxBackend.h | 5 +
cpp/velox/compute/VeloxRuntime.cc | 20 +-
cpp/velox/compute/VeloxRuntime.h | 6 +-
cpp/velox/compute/WholeStageResultIterator.cc | 174 +--
cpp/velox/compute/WholeStageResultIterator.h | 6 -
cpp/velox/config/VeloxConfig.h | 5 +
cpp/velox/filesystem/GlutenS3FileSystem.cc | 609 +++++++-
cpp/velox/filesystem/GlutenS3FileSystem.h | 25 +-
cpp/velox/jni/VeloxJniWrapper.cc | 40 +-
cpp/velox/shuffle/ReaderThreadPool.cc | 99 ++
cpp/velox/shuffle/ReaderThreadPool.h | 93 ++
cpp/velox/shuffle/VeloxGpuAsyncShuffleReader.cc | 205 +++
...huffleReader.h => VeloxGpuAsyncShuffleReader.h} | 51 +-
cpp/velox/shuffle/VeloxGpuShuffleReader.cc | 9 +-
cpp/velox/shuffle/VeloxGpuShuffleReader.h | 9 +-
cpp/velox/shuffle/VeloxShuffleReader.cc | 174 ++-
cpp/velox/shuffle/VeloxShuffleReader.h | 94 +-
cpp/velox/substrait/SubstraitToVeloxPlan.cc | 47 +-
cpp/velox/tests/CMakeLists.txt | 10 +-
cpp/velox/tests/FilePathGenerator.cc | 5 +-
cpp/velox/tests/GlutenS3FileSystemTest.cc | 14 +
cpp/velox/tests/RuntimeTest.cc | 4 +-
cpp/velox/tests/VeloxGpuShuffleWriterTest.cc | 45 +-
cpp/velox/tests/VeloxShuffleWriterTest.cc | 84 +-
cpp/velox/tests/VeloxShuffleWriterTestBase.h | 4 +-
cpp/velox/utils/CachedBatchQueue.h | 125 ++
cpp/velox/utils/ConfigExtractor.cc | 19 +
dev/build-arrow-18.sh | 5 +-
dev/build-helper-functions.sh | 13 +-
dev/builddeps-veloxbe.sh | 11 +-
dev/run-scala-test.sh | 2 +-
docs/developers/MetricsFramework.md | 340 +++++
docs/get-started/VeloxS3.md | 11 +
docs/velox-configuration.md | 7 +
ep/build-velox/src/build-velox.sh | 18 +-
ep/build-velox/src/get-velox.sh | 15 +-
...power.patch => support_ibm_power_spark40.patch} | 8 +-
.../gluten/columnarbatch/ColumnarBatches.java | 5 +-
.../apache/gluten/task/TaskContextJniWrapper.java | 42 +
.../vectorized/ArrowWritableColumnVector.java | 37 -
.../gluten/vectorized/JniByteInputStreams.java | 5 +
.../gluten/vectorized/ShuffleReaderJniWrapper.java | 32 +-
.../gluten/vectorized/ShuffleStreamReader.scala | 26 +-
.../vectorized/ArrowWritableColumnVectorTest.java | 29 +-
.../gluten/extension/caller/CallerInfo.scala | 12 +-
.../extension/columnar/transition/Transition.scala | 20 +
.../columnar/transition/Transitions.scala | 25 +-
.../execution/adaptive/ShuffleStageWrapper.scala | 83 +
.../gluten/delta/DeltaDeletionVectorScanInfo.scala | 119 +-
.../gluten/delta/DeltaDeletionVectorScanInfo.scala | 141 +-
.../gluten/execution/DeltaScanTransformer.scala | 2 +-
.../gluten/extension/DeltaPostTransformRules.scala | 76 +-
.../org/apache/gluten/execution/DeltaSuite.scala | 58 +
gluten-flink/docs/Flink.md | 2 +-
.../rexnode/functions/RexCallConverterFactory.java | 4 +-
.../gluten/client/OffloadedJobGraphGenerator.java | 18 +-
.../api/operators/GlutenStreamSource.java | 4 +
...TaskMetrics.java => SourceOperatorMetrics.java} | 4 +-
.../runtime/operators/GlutenOneInputOperator.java | 3 +-
.../runtime/operators/GlutenSourceFunction.java | 40 +-
.../org/apache/gluten/util/VectorOutputBridge.java | 10 +-
.../GlutenStreamTwoInputWatermarkStatusTest.java | 26 +
...GlutenSourceFunctionWatermarkStatusE2ETest.java | 207 ++-
.../GlutenSourceFunctionWatermarkStatusTest.java | 196 ---
.../runtime/stream/custom/ConcatFunctionsTest.java | 86 ++
.../extensions/AdvancedExtensionNode.java | 8 +
.../org/apache/gluten/substrait/plan/PlanNode.java | 4 +
.../gluten/substrait/rel/AggregateRelNode.java | 6 +
.../apache/gluten/substrait/rel/CrossRelNode.java | 10 +
.../gluten/substrait/rel/DeltaLocalFilesNode.java | 5 +-
.../apache/gluten/substrait/rel/ExpandRelNode.java | 6 +
.../apache/gluten/substrait/rel/FetchRelNode.java | 7 +
.../apache/gluten/substrait/rel/FilterRelNode.java | 7 +
.../gluten/substrait/rel/GenerateRelNode.java | 6 +
.../gluten/substrait/rel/InputIteratorRelNode.java | 41 +
.../apache/gluten/substrait/rel/JoinRelNode.java | 10 +
.../gluten/substrait/rel/LocalFilesNode.java | 3 +
.../gluten/substrait/rel/ProjectRelNode.java | 6 +
.../apache/gluten/substrait/rel/ReadRelNode.java | 59 +-
.../org/apache/gluten/substrait/rel/RelNode.java | 3 +
.../apache/gluten/substrait/rel/SetRelNode.java | 5 +
.../apache/gluten/substrait/rel/SortRelNode.java | 6 +
.../org/apache/gluten/substrait/rel/TopNNode.java | 6 +
.../substrait/rel/WindowGroupLimitRelNode.java | 6 +
.../apache/gluten/substrait/rel/WindowRelNode.java | 6 +
.../apache/gluten/substrait/rel/WriteRelNode.java | 6 +
.../gluten/backendsapi/BackendSettingsApi.scala | 12 +
.../apache/gluten/backendsapi/IteratorApi.scala | 3 +-
.../org/apache/gluten/config/GlutenConfig.scala | 27 +-
.../execution/BasicScanExecTransformer.scala | 24 +-
.../execution/FileSourceScanExecTransformer.scala | 11 +-
.../execution/GlutenWholeStageColumnarRDD.scala | 14 +-
.../gluten/execution/WholeStageTransformer.scala | 6 +-
.../execution/WholeStageZippedPartitionsRDD.scala | 11 +-
.../extension/ApplyStageInputStatsRule.scala | 148 ++
.../columnar/PushDownInputFileExpression.scala | 8 +-
.../rewrite/RewriteMultiChildrenCount.scala | 81 +-
.../extension/columnar/validator/Validators.scala | 8 +-
.../ColumnarCollapseTransformStages.scala | 35 +-
.../execution/GlutenQueryComparisonTest.scala | 3 -
.../columnar/transition/TransitionSuite.scala | 50 +
.../columnar/transition/TransitionSuiteBase.scala | 15 +
.../utils/clickhouse/ClickHouseTestSettings.scala | 3 +-
.../gluten/utils/velox/VeloxTestSettings.scala | 2 +
.../spark/sql/GlutenColumnExpressionSuite.scala | 15 +
.../spark/sql/GlutenDateFunctionsSuite.scala | 17 +
.../hive/execution/GlutenHiveSQLQueryCHSuite.scala | 41 +-
.../hive/execution/GlutenHiveSQLQuerySuite.scala | 3 +-
.../utils/clickhouse/ClickHouseTestSettings.scala | 3 +-
.../gluten/utils/velox/VeloxTestSettings.scala | 2 +
.../hive/execution/GlutenHiveSQLQueryCHSuite.scala | 41 +-
.../spark/sql/sources/GlutenInsertSuite.scala | 334 ++--
.../utils/clickhouse/ClickHouseTestSettings.scala | 2 +
.../gluten/utils/velox/VeloxTestSettings.scala | 2 +
.../spark/sql/GlutenColumnExpressionSuite.scala | 15 +
.../velox/VeloxAdaptiveQueryExecSuite.scala | 4 +-
.../hive/execution/GlutenHiveSQLQueryCHSuite.scala | 41 +-
.../spark/sql/sources/GlutenInsertSuite.scala | 334 ++--
.../utils/clickhouse/ClickHouseTestSettings.scala | 2 +
.../gluten/utils/velox/VeloxTestSettings.scala | 21 +-
.../spark/sql/GlutenColumnExpressionSuite.scala | 15 +
.../sql/GlutenSparkSessionExtensionSuite.scala | 4 +-
.../org/apache/spark/sql/GlutenSubquerySuite.scala | 86 +-
.../hive/execution/GlutenHiveSQLQueryCHSuite.scala | 41 +-
.../spark/sql/sources/GlutenInsertSuite.scala | 334 ++--
.../utils/clickhouse/ClickHouseTestSettings.scala | 2 +
.../gluten/utils/velox/VeloxTestSettings.scala | 40 +-
.../spark/sql/GlutenColumnExpressionSuite.scala | 15 +
.../sql/GlutenSparkSessionExtensionSuite.scala | 6 +-
.../org/apache/spark/sql/GlutenSubquerySuite.scala | 86 +-
.../GlutenKeyGroupedPartitioningSuite.scala | 211 +++
.../hive/execution/GlutenHiveSQLQueryCHSuite.scala | 41 +-
.../spark/sql/sources/GlutenInsertSuite.scala | 334 ++--
mkdocs.yml | 1 +
.../org/apache/gluten/sql/shims/SparkShims.scala | 9 +-
.../GlutenShuffleBlockFetcherIteratorBase.scala | 11 +-
.../ShuffleBlockFetcherIteratorParams.scala | 33 +-
.../gluten/sql/shims/spark33/Spark33Shims.scala | 24 +
.../spark/storage/GlutenPushBasedFetchHelper.scala | 384 +++++
.../GlutenShuffleBlockFetcherIterator.scala | 1509 ++++++++++++++++++
.../gluten/sql/shims/spark34/Spark34Shims.scala | 25 +
.../spark/storage/GlutenPushBasedFetchHelper.scala | 399 +++++
.../GlutenShuffleBlockFetcherIterator.scala | 1578 +++++++++++++++++++
.../gluten/sql/shims/spark35/Spark35Shims.scala | 25 +
.../spark/storage/GlutenPushBasedFetchHelper.scala | 399 +++++
.../GlutenShuffleBlockFetcherIterator.scala | 1580 +++++++++++++++++++
.../gluten/sql/shims/spark40/Spark40Shims.scala | 25 +
.../spark/storage/GlutenPushBasedFetchHelper.scala | 399 +++++
.../GlutenShuffleBlockFetcherIterator.scala | 1597 +++++++++++++++++++
.../gluten/sql/shims/spark41/Spark41Shims.scala | 25 +
.../spark/storage/GlutenPushBasedFetchHelper.scala | 399 +++++
.../GlutenShuffleBlockFetcherIterator.scala | 1601 ++++++++++++++++++++
209 files changed, 16440 insertions(+), 2560 deletions(-)
create mode 100644
backends-velox/src-delta33/test/scala/org/apache/spark/sql/execution/benchmark/DeltaPlanningBenchmark.scala
create mode 100644
backends-velox/src-delta40/test/scala/org/apache/spark/sql/delta/DeltaVariantWriteSuite.scala
copy cpp-ch/local-engine/Functions/{FunctionsBloomFilter.cpp =>
SparkFunctionDateFromUnixDate.cpp} (82%)
copy cpp-ch/local-engine/Functions/{SparkFunctionDateToUnixTimestamp.h =>
SparkFunctionDateFromUnixDate.h} (55%)
copy cpp/{velox/substrait/VariantToVectorConverter.h =>
core/jni/TaskContextJniWrapper.cc} (58%)
mode change 100644 => 100755
copy cpp/core/{operators/r2c/RowToColumnar.h => jni/TaskContextJniWrapper.h}
(65%)
mode change 100644 => 100755
create mode 100644 cpp/velox/benchmarks/S3AsyncUploadBenchmark.cc
create mode 100644 cpp/velox/shuffle/ReaderThreadPool.cc
create mode 100644 cpp/velox/shuffle/ReaderThreadPool.h
create mode 100644 cpp/velox/shuffle/VeloxGpuAsyncShuffleReader.cc
copy cpp/velox/shuffle/{VeloxGpuShuffleReader.h =>
VeloxGpuAsyncShuffleReader.h} (57%)
create mode 100644 cpp/velox/utils/CachedBatchQueue.h
create mode 100644 docs/developers/MetricsFramework.md
copy ep/build-velox/src/{support_ibm_power.patch =>
support_ibm_power_spark40.patch} (84%)
create mode 100755
gluten-arrow/src/main/java/org/apache/gluten/task/TaskContextJniWrapper.java
copy
backends-clickhouse/src/main/java/org/apache/gluten/vectorized/IteratorWrapper.java
=>
gluten-arrow/src/test/java/org/apache/gluten/vectorized/ArrowWritableColumnVectorTest.java
(57%)
create mode 100644
gluten-core/src/main/scala/org/apache/spark/sql/execution/adaptive/ShuffleStageWrapper.scala
rename
gluten-flink/runtime/src/main/java/org/apache/gluten/table/runtime/metrics/{SourceTaskMetrics.java
=> SourceOperatorMetrics.java} (96%)
delete mode 100644
gluten-flink/ut/src/test/java/org/apache/gluten/table/runtime/operators/GlutenSourceFunctionWatermarkStatusTest.java
create mode 100644
gluten-flink/ut/src/test/java/org/apache/gluten/table/runtime/stream/custom/ConcatFunctionsTest.java
create mode 100644
gluten-substrait/src/main/scala/org/apache/gluten/extension/ApplyStageInputStatsRule.scala
copy
gluten-arrow/src/main/scala/org/apache/spark/storage/SparkInputStreamUtil.scala
=>
shims/common/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIteratorBase.scala
(63%)
copy
gluten-substrait/src/main/scala/org/apache/spark/shuffle/GlutenShuffleReaderWrapper.scala
=>
shims/common/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorParams.scala
(50%)
create mode 100644
shims/spark33/src/main/scala/org/apache/spark/storage/GlutenPushBasedFetchHelper.scala
create mode 100644
shims/spark33/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIterator.scala
create mode 100644
shims/spark34/src/main/scala/org/apache/spark/storage/GlutenPushBasedFetchHelper.scala
create mode 100644
shims/spark34/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIterator.scala
create mode 100644
shims/spark35/src/main/scala/org/apache/spark/storage/GlutenPushBasedFetchHelper.scala
create mode 100644
shims/spark35/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIterator.scala
create mode 100644
shims/spark40/src/main/scala/org/apache/spark/storage/GlutenPushBasedFetchHelper.scala
create mode 100644
shims/spark40/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIterator.scala
create mode 100644
shims/spark41/src/main/scala/org/apache/spark/storage/GlutenPushBasedFetchHelper.scala
create mode 100644
shims/spark41/src/main/scala/org/apache/spark/storage/GlutenShuffleBlockFetcherIterator.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
