This is an automated email from the ASF dual-hosted git repository.
kazuyukitanimura pushed a change to branch optimize-null-count
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
from a903b415 fix ci
add 81af72fb fix: Check sort order of SortExec instead of child output
(#821)
add 2370f6ae fix: Fix panic in `avg` aggregate and disable `stddev` by
default (#819)
add 9d4afc16 fix: Supported nested types in HashJoin (#735)
add a0734dcc Make it possible to run 'make benchmark-%' using jvm 17+
(#823)
add acb78280 perf: Remove some redundant copying of batches (#816)
add a7a5f895 chore: Add more unsupported cases to supportedSortType (#825)
add 5e816503 feat: `CreateArray` support (#793)
add 380f03d0 feat: Add native thread configs (#828)
add 6051232a feat: Add specific configs for converting Spark Parquet and
JSON data to Arrow (#832)
add 3f826a3e perf: Remove redundant copying of batches after FilterExec
(#835)
add bc7136e4 Merge remote-tracking branch 'upstream/main' into
optimize-null-count
No new revisions were added by this update.
Summary of changes:
Makefile | 8 +-
.../main/scala/org/apache/comet/CometConf.scala | 70 +++-
dev/diffs/3.4.3.diff | 30 +-
dev/diffs/3.5.1.diff | 26 +-
dev/diffs/4.0.0-preview1.diff | 26 +-
docs/source/index.rst | 5 +-
docs/source/user-guide/configs.md | 7 +-
.../user-guide/{datatypes.md => datasources.md} | 29 +-
docs/source/user-guide/expressions.md | 2 +-
docs/source/user-guide/operators.md | 27 +-
native/Cargo.lock | 25 +-
native/Cargo.toml | 2 +
native/core/Cargo.toml | 6 +
native/core/benches/filter.rs | 111 +++++
.../src/execution/datafusion/expressions/avg.rs | 4 -
.../datafusion/expressions/avg_decimal.rs | 5 -
native/core/src/execution/datafusion/planner.rs | 29 +-
native/core/src/execution/jni_api.rs | 22 +-
native/core/src/execution/operators/copy.rs | 88 +++-
native/core/src/execution/operators/filter.rs | 452 +++++++++++++++++++++
native/core/src/execution/operators/mod.rs | 65 +--
.../scala/org/apache/comet/CometExecIterator.scala | 4 +-
.../apache/comet/CometSparkSessionExtensions.scala | 39 +-
.../org/apache/comet/serde/QueryPlanSerde.scala | 87 +++-
.../sql/comet/CometTakeOrderedAndProjectExec.scala | 3 +-
.../test/resources/test-data/json-test-1.ndjson | 4 +
...sum_integers_no_grouping.sql => agg_stddev.sql} | 24 +-
.../org/apache/comet/CometExpressionSuite.scala | 57 ++-
.../comet/exec/CometColumnarShuffleSuite.scala | 2 +-
.../org/apache/comet/exec/CometExecSuite.scala | 33 +-
.../org/apache/comet/exec/CometJoinSuite.scala | 61 +++
.../scala/org/apache/spark/sql/CometTestBase.scala | 2 +-
.../sql/benchmark/CometTPCDSMicroBenchmark.scala | 1 +
33 files changed, 1125 insertions(+), 231 deletions(-)
copy docs/source/user-guide/{datatypes.md => datasources.md} (54%)
create mode 100644 native/core/benches/filter.rs
create mode 100644 native/core/src/execution/operators/filter.rs
create mode 100644 spark/src/test/resources/test-data/json-test-1.ndjson
copy
spark/src/test/resources/tpcds-micro-benchmarks/{agg_sum_integers_no_grouping.sql
=> agg_stddev.sql} (70%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
