(datafusion-comet) branch main updated: chore: Use in_list func directly (#559)

2024-06-12 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 558a5930 chore: Use in_list func directly

(datafusion-comet) branch main updated: fix: Input batch to ShuffleRepartitioner.insert_batch should not be larger than configured batch size (#523)

2024-06-06 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new c1cdf46b fix: Input batch

(datafusion-comet) branch main updated: chore: Add UnboundColumn to carry datatype for unbound reference (#518)

2024-06-05 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 6143e7a9 chore: Add UnboundColumn

(datafusion-comet) branch main updated (c819bc0b -> 23e0801b)

2024-06-05 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git from c819bc0b Small changes in docs (#512) add 23e0801b chore: Upgrade spark to 4.0.0-preview1 (#526) No new

(datafusion-comet) branch main updated: fix: Incorrect input schema when preparing result expressions for HashAggregation (#501)

2024-06-01 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 24781fb7 fix: Incorrect input schema when

(datafusion-comet) branch main updated: chore: Removing copying data from dictionary values into CometDictionary (#490)

2024-05-29 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 8c532be3 chore: Removing copying data

(datafusion-comet) branch main updated: fix: Reuse previous CometDictionary Java arrays (#489)

2024-05-28 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new ee154606 fix: Reuse previous

(datafusion-comet) branch main updated: fix: CometReader.loadVector should not overwrite dictionary ids (#476)

2024-05-27 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 479a97a7 fix: CometReader.loadVector

(datafusion-comet) branch main updated: fix: substring with negative indices should produce correct result (#470)

2024-05-26 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 7ba56935 fix: substring with negative

(datafusion-comet) branch main updated: fix: `ColumnReader.loadVector` should initiate `CometDictionary` after re-import arrays (#473)

2024-05-25 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 5bfe46d4 fix: `ColumnReader.loadVector

(datafusion) branch main updated: Minor: add runtime asserts to RowGroup (#10641)

2024-05-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion.git The following commit(s) were added to refs/heads/main by this push: new 4b7b5ab11a Minor: add runtime asserts

(datafusion-comet) branch main updated: feat: Add COMET_SHUFFLE_MODE config to control Comet shuffle mode (#460)

2024-05-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 507e475b feat: Add COMET_SHUFFLE_MODE

(datafusion-comet) branch main updated: feat: correlation support (#456)

2024-05-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 6d23e284 feat: correlation support (#456

(datafusion-comet) branch main updated: feat: Supports UUID column (#395)

2024-05-21 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 7b0a7e07 feat: Supports UUID column (#395

(datafusion-comet) branch main updated: chore: improve fallback message when comet native shuffle is not enabled (#445)

2024-05-20 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 383ae919 chore: improve fallback message

(datafusion-comet) branch main updated: fix: fix CometNativeExec.doCanonicalize for ReusedExchangeExec (#447)

2024-05-18 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new b4c2dc23 fix: fix

(datafusion-comet) branch main updated: fix: newFileScanRDD should not take constructor from custom Spark versions (#412)

2024-05-18 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 1f23c188 fix: newFileScanRDD should

(datafusion-comet) branch main updated: fix: Reuse CometBroadcastExchangeExec with Spark ReuseExchangeAndSubquery rule (#441)

2024-05-18 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new ec8da307 fix: Reuse

(datafusion-comet) branch main updated: test: Fix explain with exteded info comet test (#436)

2024-05-16 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 7fe20b13 test: Fix explain with exteded

(datafusion) branch test_hash_join_build_right deleted (was 5a8348f711)

2024-05-15 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch test_hash_join_build_right in repository https://gitbox.apache.org/repos/asf/datafusion.git was 5a8348f711 UDAF: Extend more args to `state_fields` and `groups_accumulator_supported

(datafusion) branch test_hash_join_build_right created (now 5a8348f711)

2024-05-15 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch test_hash_join_build_right in repository https://gitbox.apache.org/repos/asf/datafusion.git at 5a8348f711 UDAF: Extend more args to `state_fields` and `groups_accumulator_supported

(datafusion-comet) branch main updated: tests: Move random data generation methods from CometCastSuite to new DataGenerator class (#426)

2024-05-15 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new fcf7d5b4 tests: Move random data

(datafusion-comet) branch main updated: doc: Add Plan Stability Testing to development guide (#432)

2024-05-14 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 1a04805b doc: Add Plan Stability Testing

(datafusion-comet) branch main updated (32b73188 -> 2bf7d121)

2024-05-14 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git from 32b73188 docs: fix various sphinx warnings (#428) add 2bf7d121 chore: Remove an unused config (#430

(datafusion-comet) branch main updated: chore: Rename some columnar shuffle configs for code consistently (#418)

2024-05-13 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 5430f632 chore: Rename some columnar

(datafusion-comet) branch main updated: feat: Enable columnar shuffle by default (#250)

2024-05-08 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 14494d3a feat: Enable columnar shuffle

(datafusion-comet) branch main updated: build: Add scala-version to matrix (#396)

2024-05-07 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new ee86b0e0 build: Add scala-version

(datafusion-comet) branch main updated: docs: fix the docs url of installation instructions (#393)

2024-05-06 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 8bba58e4 docs: fix the docs url

(datafusion-comet) branch main updated: feat: Supports Stddev (#348)

2024-05-06 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new c40bc7c2 feat: Supports Stddev (#348

(datafusion-comet) branch main updated: doc: add contributing in README.md (#382)

2024-05-05 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 76330e9f doc: add contributing

(datafusion-comet) branch main updated: build: Add Spark SQL test pipeline with ANSI mode enabled (#321)

2024-05-03 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new e48b12ea build: Add Spark SQL test

(datafusion-comet) branch main updated: fix: limit with offset should return correct results (#359)

2024-04-30 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new c9008199 fix: limit with offset should

(datafusion-comet) branch main updated: fix: SortMergeJoin with unsupported key type should fall back to Spark (#355)

2024-04-30 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 7067606 fix: SortMergeJoin

(datafusion-comet) branch main updated: fix: CometShuffleExchangeExec logical link should be correct (#324)

2024-04-30 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new b326637 fix: CometShuffleExchangeExec

(datafusion-comet) branch main updated: docs: Generate configuration guide in mvn build (#349)

2024-04-29 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 1865284 docs: Generate configuration

(datafusion-comet) branch main updated: feat: Improve CometBroadcastHashJoin statistics (#339)

2024-04-29 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new e49a796 feat: Improve

(datafusion-comet) branch main updated: chore: Add allocation source to StreamReader (#332)

2024-04-26 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 897dde7 chore: Add allocation source

(datafusion-comet) branch main updated: feat: Support murmur3_hash and sha2 family hash functions (#226)

2024-04-25 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 8485558 feat: Support murmur3_hash

(datafusion-comet) branch main updated: feat: Support Variance (#297)

2024-04-25 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 49bf503 feat: Support Variance (#297

(datafusion-comet) branch main updated: test: Suppress decimal random number tests for 3.2 and 3.3 (#319)

2024-04-25 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new d6d8620 test: Suppress decimal random

(datafusion-comet) branch main updated: build: Move shim directories (#318)

2024-04-25 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new ef94c55 build: Move shim directories

(datafusion-comet) branch main updated: feat: Improve CometHashJoin statistics (#309)

2024-04-24 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 869da2d feat: Improve CometHashJoin

(datafusion-comet) branch main updated: chore: Ignore unused variables (#306)

2024-04-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 47526ae chore: Ignore unused variables

(datafusion-comet) branch main updated: fix: CometExec's outputPartitioning might not be same as Spark expects after AQE interferes (#299)

2024-04-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new f789c21 fix: CometExec's

(datafusion-comet) branch main updated: fix: Iceberg scan transition should be in front of other data source v2 (#302)

2024-04-23 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 21717eb fix: Iceberg scan transition

(datafusion-comet) branch main updated: doc: Update DataFusion project name and url (#300)

2024-04-22 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new de42975 doc: Update DataFusion project

(datafusion-comet) branch main updated: feat: Add extended explain info to Comet plan (#255)

2024-04-22 Thread viirya
This is an automated email from the ASF dual-hosted git repository. viirya pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git The following commit(s) were added to refs/heads/main by this push: new 6d01f6a feat: Add extended explain info