github

Messages by Date

2026/04/27 Re: [PR] fix(proto): correctly serialize `FilterExec` empty projection [datafusion] via GitHub
2026/04/27 Re: [PR] feat: suport spark compatible floor function [datafusion] via GitHub
2026/04/27 Re: [PR] perf(spark): use 256-entry byte-pair table in hex encoding [datafusion] via GitHub
2026/04/27 Re: [PR] build: Enable Spark SQL tests for Spark 4.1.1 [datafusion-comet] via GitHub
2026/04/27 [PR] chore(deps): bump reqwest from 0.13.2 to 0.13.3 [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: suport spark compatible floor function [datafusion] via GitHub
2026/04/27 [PR] Fix GH action permissions in `rust.yml` and `docs.yaml` workflows [datafusion] via GitHub
2026/04/27 Re: [PR] refactor `array_remove` benchmarks & add nested benches [datafusion] via GitHub
2026/04/27 Re: [PR] Fix some GH action permission issues identified by CodeQL [datafusion] via GitHub
2026/04/27 Re: [PR] Fix some GH action permission issues identified by CodeQL [datafusion] via GitHub
2026/04/27 Re: [PR] feat: default to sort-based shuffle writer [WIP] [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: default to sort-based shuffle writer [WIP] [datafusion-ballista] via GitHub
2026/04/27 Re: [I] Add vector distance, array math, and array aggregate functions [datafusion] via GitHub
2026/04/27 [PR] build: add spark-4.2 Maven profile targeting 4.2.0-preview4 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] refactor: consolidate identical spark-4.0 and spark-4.1 shims into spark-4.x [datafusion-comet] via GitHub
2026/04/27 [PR] refactor: consolidate identical spark-4.0 and spark-4.1 shims into spark-4.x [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: InterleaveExec fallback to UnionExec when children partitioning diverges [datafusion] via GitHub
2026/04/27 Re: [PR] fix: InterleaveExec fallback to UnionExec when children partitioning diverges [datafusion] via GitHub
2026/04/27 Re: [PR] build: add spark-4.1 Maven profile and shim sources [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: split disk_write_time from write_time in sort shuffle writer [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: default to sort-based shuffle writer [WIP] [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] Do not merge - Test df binding python [datafusion] via GitHub
2026/04/27 Re: [PR] feat: default to sort-based shuffle writer [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] build: add spark-4.1 Maven profile and shim sources [datafusion-comet] via GitHub
2026/04/27 Re: [PR] build: add spark-4.1 Maven profile and shim sources [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: [iceberg] Pass table master key ID to native scan [datafusion-comet] via GitHub
2026/04/27 Re: [PR] Run core benchmarks with CodSpeed [datafusion] via GitHub
2026/04/27 Re: [PR] Fix:c Median() truncates integers by returning Float64 for integer inputs [datafusion] via GitHub
2026/04/27 Re: [PR] feat: Prune complex/nested predicates via statistics propagation [datafusion] via GitHub
2026/04/27 Re: [PR] feat: Add Spark-compatible `xxhash64` and `murmur3` hash functions [datafusion] via GitHub
2026/04/27 Re: [PR] Refactor(optimizer): Simplify Stable ScalarUDFs using physical execution [datafusion] via GitHub
2026/04/27 Re: [PR] perf: reduce read amplification for partitioned JSON file scanning [datafusion] via GitHub
2026/04/27 Re: [PR] Fix: External sort OOM for single oversized batches by chunked spill fallback [datafusion] via GitHub
2026/04/27 Re: [PR] [TEST] Filter pushdown dynamic [datafusion] via GitHub
2026/04/27 Re: [PR] AggregateExec: incremental memory release before streaming merge [datafusion] via GitHub
2026/04/27 Re: [PR] fix(explain): render aggregate expressions correctly when CSE is applied [datafusion] via GitHub
2026/04/27 Re: [PR] Simplify case when all result expressions are identical [datafusion] via GitHub
2026/04/27 Re: [PR] Remove from string column [datafusion] via GitHub
2026/04/27 Re: [PR] feat: add coerce_arguments flag to UDTFs to allow skipping automatic … [datafusion] via GitHub
2026/04/27 Re: [PR] refactor: Consolidate async UDF handling in physical planner [datafusion] via GitHub
2026/04/27 Re: [PR] feat: add LazyPartitioned mode for hash join to reduce RepartitionExec overhead [datafusion] via GitHub
2026/04/27 Re: [PR] Preserve input field nullability in ArrayAgg return field [datafusion] via GitHub
2026/04/27 Re: [PR] Changed clippy.toml and added std hashmap and hashset to disallowed t… [datafusion] via GitHub
2026/04/27 Re: [PR] Gene.bordegaray/2026/02/partition index dynamic filters [datafusion] via GitHub
2026/04/27 Re: [PR] [BENCH] Benchmark upgrade coalesce improvements [datafusion] via GitHub
2026/04/27 Re: [PR] docs: add Docker-based workflow for building documentation [datafusion] via GitHub
2026/04/27 Re: [PR] Support reverse page ordering in sort pushdown phase 1 [datafusion] via GitHub
2026/04/27 Re: [PR] Add preimage optimization for `ceil` to rewrite predicates into range filters [datafusion] via GitHub
2026/04/27 Re: [PR] [datafusion-spark] Implement map function [datafusion] via GitHub
2026/04/27 Re: [PR] WIP: FFI query planner [datafusion] via GitHub
2026/04/27 Re: [I] Use interleave_record_batch to avoid tiny batches in sort-based shuffle [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: Add standalone shuffle writer benchmark that shuffles real Parquet input [datafusion-ballista] via GitHub
2026/04/27 Re: [I] Add support for Spark 4.1 `OneRowRelationExec` [datafusion-comet] via GitHub
2026/04/27 [PR] feat: default to sort-based shuffle writer [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: Add standalone shuffle writer benchmark that shuffles real Parquet input [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: Add standalone shuffle writer benchmark that shuffles real Parquet input [datafusion-ballista] via GitHub
2026/04/27 Re: [I] Replace shuffle implementation with version based on Comet [datafusion-ballista] via GitHub
2026/04/27 [PR] fix: throw SchemaColumnConvertNotSupportedException from native_datafusion schema mismatch [datafusion-comet] via GitHub
2026/04/27 [PR] feat: split disk_write_time from write_time in sort shuffle writer [datafusion-ballista] via GitHub
2026/04/27 Re: [I] Dictionary coercion on min/max [datafusion] via GitHub
2026/04/27 Re: [PR] Support Dictionary Arrays in MIN/MAX Aggregates [datafusion] via GitHub
2026/04/27 Re: [PR] Support Dictionary Arrays in MIN/MAX Aggregates [datafusion] via GitHub
2026/04/27 [I] Replace shuffle implementation with version based on Comet [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: support `PartialMerge` aggregation mode [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: support regular BuildRight+LeftAnti hash join [datafusion-comet] via GitHub
2026/04/27 Re: [I] Release DataFusion `54.0.0` (Apr 2026 / May 2026) [datafusion] via GitHub
2026/04/27 [PR] feat: Utf8View and BinaryView support [datafusion-comet] via GitHub
2026/04/27 [PR] feat(aqe): support executor failure in AdaptiveExecutionGraph [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] ci: add Spark 4.0 / JDK 21 profile [datafusion-comet] via GitHub
2026/04/27 Re: [I] Create new Comet logo that is consistent with other DataFusion Projects [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [I] Improve documentation for configs related to explain/fallback [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: support `PartialMerge` aggregation mode [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: reject incompatible decimal precision/scale in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: reject incompatible decimal precision/scale in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [I] native_datafusion: incompatible decimal precision/scale read silently succeeds without value validation [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: Cache remote shuffle reader clients on executor [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: Cache remote shuffle reader clients on executor [datafusion-ballista] via GitHub
2026/04/27 [PR] feat: rewrite standalone shuffle_bench to drive real Parquet input [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] docs: document hash-based and sort-based shuffle implementations [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] docs: document hash-based and sort-based shuffle implementations [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: Scheduler config update [datafusion-ballista] via GitHub
2026/04/27 [I] Configuration guide should be generated from code [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] feat: support `PartialMerge` aggregation mode [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: support `PartialMerge` aggregation mode [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: Scheduler config update [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] Support different scales for decimal binary math functions [datafusion] via GitHub
2026/04/27 [PR] feat: defer sort-shuffle materialization with interleave_record_batch [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] fix: reject string/binary read as numeric in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [I] native_datafusion: STRING column read as INT silently returns garbage values [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: reject string/binary read as numeric in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [D] DISCUSSION: Seattle DataFusion Meetup (April 23, 2026) [datafusion] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] perf: Use bulk-NULL builder in `replace` [datafusion] via GitHub
2026/04/27 [PR] feat: support binary arguments for StringConcat operator [datafusion] via GitHub
2026/04/27 Re: [PR] feat: Scheduler config update [datafusion-ballista] via GitHub
2026/04/27 [PR] feat: Scheduler config update [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] docs: add Understanding Comet Plans user guide page [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: fall back to Spark for hash join and sort-merge join on non-default collated string keys [Spark 4] [datafusion-comet] via GitHub
2026/04/27 Re: [I] Broadcast hash join and sort-merge join can produce incorrect results on non-default collated keys [Spark 4] [datafusion-comet] via GitHub
2026/04/27 Re: [I] Use `NullBuffer::union_many` when appropriate [datafusion] via GitHub
2026/04/27 Re: [I] Migrate 4.0.1 support to 4.0.2 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] chore: Bump Spark 4.0.1 to 4.0.2 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: InterleaveExec fallback to UnionExec when children partitioning diverges [datafusion] via GitHub
2026/04/27 Re: [PR] feat: add inner_product scalar function [datafusion] via GitHub
2026/04/27 Re: [I] Add vector distance, array math, and array aggregate functions [datafusion] via GitHub
2026/04/27 Re: [PR] feat: change Expr OuterReferenceColumn and Alias to Box type for reducing expr struct size [datafusion] via GitHub
2026/04/27 [I] Unable to use Ballista at scale (e.g. TPC-H @ 1TB) [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] Update documentation for PhysicalExpr::evaluate_bounds [datafusion] via GitHub
2026/04/27 Re: [PR] Add protobuf serialization/deserialization support for `EmptyTable` scans [datafusion] via GitHub
2026/04/27 Re: [PR] Add protobuf serialization/deserialization support for `EmptyTable` scans [datafusion] via GitHub
2026/04/27 Re: [I] Upgrade `rand` to `0.10`, `rand_distr` to `0.6` [datafusion] via GitHub
2026/04/27 Re: [PR] docs: document hash-based and sort-based shuffle implementations [datafusion-ballista] via GitHub
2026/04/27 Re: [I] Create new Comet logo that is consistent with other DataFusion Projects [datafusion-comet] via GitHub
2026/04/27 Re: [I] Remove `generational-arena` from project [datafusion] via GitHub
2026/04/27 Re: [PR] feat : ABI upgrade from abi_stabby to stabby since abi_stable is no longer maintained [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Optimize `substr_index` to use bulk-NULL string builder [datafusion] via GitHub
2026/04/27 Re: [PR] chore: Remove unnecessary optimizer rules due to datafusion upgrade to v53 [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] chore: Remove unnecessary optimizer rules due to datafusion upgrade to v53 [datafusion-ballista] via GitHub
2026/04/27 Re: [I] [Feature] Support external Remote Shuffle Service (e.g., Apache Celeborn / Apache Uniffle) [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] fix: prevent hash join deadlock when dynamic filtering is enabled [datafusion] via GitHub
2026/04/27 Re: [I] [Feature] Support external Remote Shuffle Service (e.g., Apache Celeborn / Apache Uniffle) [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] perf: optimise `first_value`, `last_value` aggregate function [datafusion] via GitHub
2026/04/27 Re: [PR] perf: optimise `first_value`, `last_value` aggregate function [datafusion] via GitHub
2026/04/27 Re: [PR] Add protobuf serialization/deserialization support for `EmptyTable` scans [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [PR] perf: optimise `first_value`, `last_value` aggregate function [datafusion] via GitHub
2026/04/27 Re: [I] Use interleave_record_batch to avoid tiny batches in sort-based shuffle [datafusion-ballista] via GitHub
2026/04/27 Re: [PR] perf: Optimize `substr_index` to use bulk-NULL string builder [datafusion] via GitHub
2026/04/27 Re: [PR] perf: optimise `first_value`, `last_value` aggregate function [datafusion] via GitHub
2026/04/27 Re: [PR] perf: optimise `first_value`, `last_value` aggregate function [datafusion] via GitHub
2026/04/27 [PR] chore: Bump Spark 4.0.1 to 4.0.2 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: introduce pluggable SpillFile trait and TempFileFactory for custom spill backends [datafusion] via GitHub
2026/04/27 [PR] docs: document hash-based and sort-based shuffle implementations [datafusion-ballista] via GitHub
2026/04/27 [PR] feat: introduce pluggable SpillFile trait and TempFileFactory for custom spill backends [datafusion] via GitHub
2026/04/27 Re: [PR] fix: reject string/binary read as numeric in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [PR] fix: reject string/binary read as numeric in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [I] Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [I] Improve performance of `array_has` [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Add bulk NULL-aware string builders, use in `lower` and `upper` [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Optimize `substr_index` to use bulk-NULL string builder [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Optimize `substr_index` to use bulk-NULL string builder [datafusion] via GitHub
2026/04/27 Re: [PR] fix: reject incompatible decimal precision/scale in native_datafusion scan [datafusion-comet] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Implement physical execution of uncorrelated scalar subqueries [datafusion] via GitHub
2026/04/27 [I] Comet should fallback to Spark for streaming queries [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat : ABI upgrade from abi_stabby to stabby since abi_stable is no longer maintained [datafusion] via GitHub
2026/04/27 Re: [PR] ci: add Spark 4.0 / JDK 21 profile [datafusion-comet] via GitHub
2026/04/27 Re: [PR] ci: add Spark 4.0 / JDK 21 profile [datafusion-comet] via GitHub
2026/04/27 [I] Add support for Spark 4.2.0-preview4 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] Refactor InListExpr into static-filter modules [datafusion] via GitHub
2026/04/27 Re: [PR] feat: support 2-argument ceil(value, scale) for Spark compatibility [datafusion] via GitHub
2026/04/27 Re: [PR] feat: support 2-argument ceil(value, scale) for Spark compatibility [datafusion] via GitHub
2026/04/27 Re: [I] Epic: CometNativeScan improvements (per-partition serde, cleanup, DPP, AQE DPP, V2 operator) [datafusion-comet] via GitHub
2026/04/27 [PR] feat: AQE DPP for native Parquet scans with broadcast reuse [datafusion-comet] via GitHub
2026/04/27 Re: [I] Add support for Spark 4.1 `OneRowRelationExec` [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: add bug-triage Claude skill [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: add bug-triage Claude skill [datafusion-comet] via GitHub
2026/04/27 Re: [I] Remove `__unnest_placeholder` from result projection on queries with struct unnest. [datafusion] via GitHub
2026/04/27 Re: [PR] perf: implement convert_to_state for SparkAvg [datafusion] via GitHub
2026/04/27 Re: [PR] feat: remove `__unnest_placeholder` from struct unnest projection [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Use bulk-NULL builder in `chr` [datafusion] via GitHub
2026/04/27 Re: [PR] feat: Support Spark expression `str_to_map` [datafusion-comet] via GitHub
2026/04/27 Re: [I] Optimize `chr` to use bulk-NULL string builder [datafusion] via GitHub
2026/04/27 Re: [I] Reduce Iceberg CI matrix: pin JDK per Spark version [datafusion-comet] via GitHub
2026/04/27 Re: [I] Fix issues found when documenting current expression incompatibilities [datafusion-comet] via GitHub
2026/04/27 [PR] chore: fix spark ansi sum incompatibility message [datafusion-comet] via GitHub
2026/04/27 Re: [I] Add Java 21 to the supported version matrix (particularly for Spark 4.0) [datafusion-comet] via GitHub
2026/04/27 Re: [I] Tracking: remaining Spark 4.1 CI failures on #4093 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: add initial support for `array_exists` with lambda expression support [datafusion-comet] via GitHub
2026/04/27 Re: [PR] Add lambda support and array_transform udf [datafusion] via GitHub
2026/04/27 [PR] WIP: test Spark `array_exists` with lambdas [datafusion] via GitHub
2026/04/27 Re: [I] Blog post about 1000 distinct committers / history of the project [datafusion] via GitHub
2026/04/27 Re: [PR] feat : ABI upgrade from abi_stabby to stabby since abi_stable is no longer maintained [datafusion] via GitHub
2026/04/27 Re: [PR] perf: implement convert_to_state for SparkAvg [datafusion] via GitHub
2026/04/27 Re: [PR] feat(unparser): Keep inner join `Filter → TableScan` predicates to `WHERE` instead of moving to `JOIN ON` [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Use bulk-NULL builder in `replace` [datafusion] via GitHub
2026/04/27 Re: [I] Use `NullBuffer::union_many` when appropriate [datafusion] via GitHub
2026/04/27 Re: [I] Use `NullBuffer::union_many` when appropriate [datafusion] via GitHub
2026/04/27 [I] Use `NullBuffer::union_many` when appropriate [datafusion] via GitHub
2026/04/27 Re: [PR] perf: Use bulk-NULL builder in `replace` [datafusion] via GitHub
2026/04/27 Re: [PR] feat: support TimestampType join keys in SortMergeJoin [datafusion-comet] via GitHub
2026/04/27 [I] Bug triage results: 2026-04-27 [datafusion-comet] via GitHub
2026/04/27 [PR] feat: add bug-triage Claude skill [datafusion-comet] via GitHub
2026/04/27 Re: [I] chore: DataFusion 54.0.0 [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat : ABI upgrade from abi_stabby to stabby since abi_stable is no longer maintained [datafusion] via GitHub
2026/04/27 Re: [PR] feat: support regular BuildRight+LeftAnti hash join [datafusion-comet] via GitHub
2026/04/27 Re: [PR] docs: rename SQL File Tests to Comet SQL Tests [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: Support Spark levenshtein expression in native execution [datafusion-comet] via GitHub
2026/04/27 Re: [PR] feat: Support Spark levenshtein expression in native execution [datafusion-comet] via GitHub
2026/04/27 Re: [I] chore: Create CI action that validates links in md files [datafusion] via GitHub
2026/04/27 Re: [PR] chore: add internal markdown link check [datafusion] via GitHub
2026/04/27 Re: [PR] Resolve MIN/MAX from Parquet metadata for Single-mode aggregates and CAST projections [datafusion] via GitHub