github

Messages by Date

2026/08/28 Re: [PR] perf: replace PiecewiseMergeJoin's visited bitmap with a suffix watermark (~1.8x faster Left join) [datafusion] via GitHub
2026/08/27 Re: [PR] fix: make CometDiskBlockWriter spill registry per-task instead of executor-global [datafusion-comet] via GitHub
2026/08/27 Re: [PR] docs: add contributing guide link [datafusion-comet] via GitHub
2026/08/27 Re: [PR] refactor: thread PhysicalOptimizerContext through join_selection stats helpers [datafusion] via GitHub
2026/08/27 Re: [I] bug: `SparkCollectList`/`SparkCollectSet` declare nullable list elements, diverging from Spark's `containsNull = false` [datafusion] via GitHub
2026/08/27 [PR] doc: fix benchmark examples for MacOS [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: project Spark 4 VARIANT columns in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: widen percentile input to use larger precision [datafusion] via GitHub
2026/08/27 Re: [PR] feat: serialize ASOF join plans [datafusion] via GitHub
2026/08/27 [PR] docs: add contributing guide link [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support ASOF joins [datafusion] via GitHub
2026/08/27 Re: [PR] fix: reject inconsistent parameterized ScalarValues [datafusion] via GitHub
2026/08/27 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/08/27 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add ASOF join logical semantics [datafusion] via GitHub
2026/08/27 Re: [PR] feat: support ASOF joins [datafusion] via GitHub
2026/08/27 Re: [PR] fix: emit deferred unmatched rows when memory-limited NestedLoopJoin exhausts its left side [datafusion] via GitHub
2026/08/27 Re: [PR] fix: make wide date-to-timestamp casts safe [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix(physical-plan): fix aggregation_time metric inflation on multi-aggregate GROUP BY [datafusion] via GitHub
2026/08/27 Re: [I] Add `CONTRIBUTING.md` with link to the contributor guide [datafusion-comet] via GitHub
2026/08/27 [PR] bench_additional_math_functios [datafusion-comet] via GitHub
2026/08/27 Re: [PR] Update SQLite expression display expectations [datafusion-testing] via GitHub
2026/08/27 Re: [PR] fix(physical-plan): fix aggregation_time metric inflation on multi-aggregate GROUP BY [datafusion] via GitHub
2026/08/27 Re: [PR] fix(physical-plan): fix aggregation_time metric inflation on multi-aggregate GROUP BY [datafusion] via GitHub
2026/08/27 Re: [PR] fix: Avoid casting unreachable nested List values [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: add spark.comet.explain.planOnly.enabled, reported per query [datafusion-comet] via GitHub
2026/08/27 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/08/27 Re: [PR] fix: support empty struct types [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support floating-point ASOF equality keys [datafusion] via GitHub
2026/08/27 Re: [PR] fix: preserve Spark AVG buffer and overflow semantics [datafusion-comet] via GitHub
2026/08/27 [PR] fix: emit deferred unmatched rows when memory-limited NestedLoopJoin exhausts its left side [datafusion] via GitHub
2026/08/27 [I] Memory-limited NestedLoopJoin silently drops unmatched rows when it spills [datafusion] via GitHub
2026/08/27 Re: [PR] bench: add simplify_function_over_case benchmark [datafusion] via GitHub
2026/08/27 Re: [PR] bench: add simplify_function_over_case benchmark [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add experimental native support for in-memory cache, disabled by default [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix(ffi): prevent recursive session physical planning [datafusion] via GitHub
2026/08/27 Re: [PR] fix: exclude child compute from NestedLoopJoinExec metrics [datafusion] via GitHub
2026/08/27 Re: [PR] Fix OneSideHashJoiner memory size accounting [datafusion] via GitHub
2026/08/27 Re: [PR] docs: update stale interval multiplication note in expressions.md [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: preserve external sort workspace across spilling [datafusion] via GitHub
2026/08/27 [PR] Fix OneSideHashJoiner memory size accounting [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add experimental native support for in-memory cache, disabled by default [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: gc StringView/BinaryView arrays before spilling to prevent write amplification [datafusion] via GitHub
2026/08/27 Re: [PR] feat: support string to numeric coercion for arithmetic operators [datafusion] via GitHub
2026/08/27 Re: [PR] feat: Create dynamic filters in SortMergeJoin [datafusion] via GitHub
2026/08/27 Re: [PR] docs: update stale interval multiplication note in expressions.md [datafusion-comet] via GitHub
2026/08/27 [PR] fix(physical-plan): fix aggregation_time metric inflation on multi-aggregate GROUP BY [datafusion] via GitHub
2026/08/27 Re: [PR] fix(ffi): prevent recursive session physical planning [datafusion] via GitHub
2026/08/27 Re: [PR] fix: exclude child compute from NestedLoopJoinExec metrics [datafusion] via GitHub
2026/08/27 Re: [PR] fix: stop treating arithmetic negation as bitwise NOT [datafusion] via GitHub
2026/08/27 Re: [PR] bench: add simplify_function_over_case benchmark [datafusion] via GitHub
2026/08/27 Re: [PR] feat: widen output decimal type for decimal ceil/floor [datafusion] via GitHub
2026/08/27 Re: [I] Correctness guard: disable memory-limited NestedLoopJoin fallback for LEFT-family joins with multi-partition right side [datafusion] via GitHub
2026/08/27 Re: [PR] Refresh statistics parser settings between query files [datafusion] via GitHub
2026/08/27 Re: [PR] perf(spark): reduce map deduplication allocations [datafusion] via GitHub
2026/08/27 Re: [PR] fix: refuse memory-limited NestedLoopJoin fallback for left-emission joins with a multi-partition probe side [datafusion] via GitHub
2026/08/27 Re: [PR] fix: report bounded shuffle allocator memory usage [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: report bounded shuffle allocator memory usage [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf(spark): reduce map deduplication allocations [datafusion] via GitHub
2026/08/27 [I] Nested-value first_value / last_value state allocates per winning row [datafusion] via GitHub
2026/08/27 Re: [PR] perf(spark): reduce map deduplication allocations [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add Hudi read integration [datafusion-ballista] via GitHub
2026/08/27 Re: [PR] fix: refuse memory-limited NestedLoopJoin fallback for left-emission joins with a multi-partition probe side [datafusion] via GitHub
2026/08/27 Re: [PR] Account for transformer-retained batches in symmetric hash join [datafusion] via GitHub
2026/08/27 Re: [PR] fix: refuse memory-limited NestedLoopJoin fallback for left-emission joins with a multi-partition probe side [datafusion] via GitHub
2026/08/27 Re: [PR] Account for transformer-retained batches in symmetric hash join [datafusion] via GitHub
2026/08/27 Re: [PR] fix: `get_json_object` returns first value for duplicate keys to match Spark [datafusion-comet] via GitHub
2026/08/27 Re: [PR] [TESTING] arrow 10859 [datafusion] via GitHub
2026/08/27 Re: [PR] feat: project Spark 4 VARIANT columns in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: project Spark 4 VARIANT columns in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 [I] Support Spark's pushed one-field VariantStruct (whole-value pushVariantIntoScan rewrite) in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: account JVM UDF Arrow allocations in Spark task memory [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat(optimizer): coalesce peer first_value / last_value into a single struct aggregate [datafusion] via GitHub
2026/08/27 Re: [I] Versioned documentation [datafusion] via GitHub
2026/08/27 [PR] docs: update stale interval multiplication note in expressions.md [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support multiply_ym_interval with YearMonth interval codegen dispatch [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support divide_dt_interval with codegen dispatch [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf: reuse quantile summary buffers during merge [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 Re: [I] DataFusion / DataFusion-Spark functions whose Arrow return type drifts from Spark catalyst's declared type [datafusion-comet] via GitHub
2026/08/27 [I] Surface Parquet TIMESTAMP_MILLIS overflow as a Spark-faithful exception instead of a raw Arrow error [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: prevent silent overflow when reading Parquet TIMESTAMP_MILLIS values [datafusion-comet] via GitHub
2026/08/27 [I] bug: `SparkCollectList`/`SparkCollectSet` declare nullable list elements, diverging from Spark's `containsNull = false` [datafusion] via GitHub
2026/08/27 Re: [PR] fix: fall back for Parquet datetime rebasing [datafusion-comet] via GitHub
2026/08/27 Re: [PR] Add support for dictionary for approx_distinct [datafusion] via GitHub
2026/08/27 Re: [PR] deps: bump DataFusion 55.0 and Arrow/Parqet 59.2 [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: preserve Spark AVG buffer and overflow semantics [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: make wide date-to-timestamp casts safe [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf(spark): reduce map deduplication allocations [datafusion] via GitHub
2026/08/27 Re: [PR] fix: normalize noncanonical NaN literals in comparisons [datafusion-comet] via GitHub
2026/08/27 [PR] Fix bounded shuffle allocator memory usage reporting [datafusion-comet] via GitHub
2026/08/27 [PR] fix: preserve external sort workspace across spilling [datafusion] via GitHub
2026/08/27 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/27 Re: [PR] deps: bump DataFusion 55.0 and Arrow/Parqet 59.2 [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 [PR] fix: make Iceberg delete-file reflection failures fatal [datafusion-comet] via GitHub
2026/08/27 [PR] feat: add spark.comet.explain.planOnly.enabled, reported per query [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: SortPreservingMerge round-robin tie breaker reads stale poll counts, so tied keys are mostly drained from one partition [datafusion] via GitHub
2026/08/27 Re: [I] September 2026 DataFusion ASF Board Report [datafusion] via GitHub
2026/08/27 [I] `aggregation_time` metric is inflated up to (N+1)/2 times on GROUP BY nodes with N aggregate functions [datafusion] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: project Spark 4 VARIANT columns in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 [I] External sort can lose reserved spill workspace when memory availability decreases [datafusion] via GitHub
2026/08/27 Re: [PR] Add FFI query planner support [datafusion-python] via GitHub
2026/08/27 [I] Explain ObjectHashAggregate fallback when Comet shuffle is disabled [datafusion-comet] via GitHub
2026/08/27 [PR] ci: assign issues via take/untake comments [datafusion-ballista] via GitHub
2026/08/27 Re: [PR] fix: support empty struct types [datafusion-comet] via GitHub
2026/08/27 [PR] bench(h2o): window Top-N sweep over a declared-sorted input [datafusion] via GitHub
2026/08/27 Re: [I] Versioned documentation [datafusion] via GitHub
2026/08/27 Re: [PR] fix: count `aggregation_time` once per batch instead of once per accumulator [datafusion] via GitHub
2026/08/27 [PR] feat: add Celeborn shuffle manager and partition pusher (5/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf: optimizing take_n for DictionaryGroupValuesColumn [datafusion] via GitHub
2026/08/27 Re: [PR] change: fully deprecated the acceptance of value field in VirtualTables [datafusion] via GitHub
2026/08/27 Re: [PR] refactor: centralize data type support predicates [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: add experimental native support for in-memory cache, disabled by default [datafusion-comet] via GitHub
2026/08/27 Re: [I] Struct-cast narrowing can suppress cast errors and change field semantics [datafusion] via GitHub
2026/08/27 Re: [PR] fix: preserve explicit Struct casts and evolved field semantics [datafusion] via GitHub
2026/08/27 Re: [PR] feat: project Spark 4 VARIANT columns in native Parquet scans [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: revert unsafe partial aggregates after final fallback [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: preserve current AQE logical-stage links on Comet operators [datafusion-comet] via GitHub
2026/08/27 Re: [I] support Dictionary types in approx_distinct [datafusion] via GitHub
2026/08/27 Re: [PR] feat(optimizer): coalesce peer first_value / last_value into a single struct aggregate [datafusion] via GitHub
2026/08/27 [PR] Refresh statistics parser settings between query files [datafusion] via GitHub
2026/08/27 Re: [PR] feat: support dictionary in approx_distinct [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: support RunEndEncoded arrays in function and window frame type coercion [datafusion] via GitHub
2026/08/27 Re: [PR] feat: support Map for `CreateArray` literal [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support S3 compliant filesystems [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: account JVM UDF Arrow allocations in Spark task memory [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf: optimize levenshtein function [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: preserve explicit Struct casts and evolved field semantics [datafusion] via GitHub
2026/08/27 Re: [PR] perf: optimize levenshtein function [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: support empty struct types [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: report native operator spill metrics in Spark task metrics for non-shuffle stages [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: ignore structural tags when lifting expression coverage [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] main branch test fix: adjust dynamic filter assertion for hash collisions handling [datafusion] via GitHub
2026/08/27 Re: [PR] perf: track decimal overflow without rescanning results [datafusion-comet] via GitHub
2026/08/27 Re: [PR] perf: reuse quantile summary buffers during merge [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: make wide date-to-timestamp casts safe [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: full native make_interval with 2.6x faster than spark and 1.1x faster than codegen dispatch [datafusion-comet] via GitHub
2026/08/27 [PR] feat(scheduler): parallel bounded ROWS-frame windows via a rank-derived halo [datafusion-ballista] via GitHub
2026/08/27 [I] Expose native Parquet scan I/O and read-amplification metrics [datafusion-comet] via GitHub
2026/08/27 Re: [PR] test: cover unsorted contiguous groups in one partition [datafusion] via GitHub
2026/08/27 Re: [I] Add AI tooling disclosure text to contributor guide and fields to PR templates [datafusion] via GitHub
2026/08/27 Re: [PR] chore: disable ORC in Iceberg Spark tests [datafusion-comet] via GitHub
2026/08/27 [I] `DIV` right operand is parsed at precedence 0 in the MySQL and Spark dialects [datafusion-sqlparser-rs] via GitHub
2026/08/27 Re: [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 [I] Avoid object-store cache and registry collisions across backends and configurations [datafusion-comet] via GitHub
2026/08/27 Re: [I] ci: Prebuild Linux CI images with toolchains and dependencies [datafusion-comet] via GitHub
2026/08/27 Re: [PR] Add FFI query planner support [datafusion-python] via GitHub
2026/08/27 Re: [PR] feat: add spark.comet.explain.planOnly.enabled [datafusion-comet] via GitHub
2026/08/27 Re: [PR] Make `udaf_default_*` display/schema name helpers non-generic (214 KB smaller binary) [datafusion] via GitHub
2026/08/27 [PR] fix(proto): check integer conversions in common options and constraints [datafusion] via GitHub
2026/08/27 [PR] fix: isolate object-store registration by backend and configuration [datafusion-comet] via GitHub
2026/08/27 [PR] feat: share the session RuntimeEnv across the FFI boundary [datafusion] via GitHub
2026/08/27 Re: [PR] feat: preserving grouped state reads [datafusion] via GitHub
2026/08/27 Re: [PR] fix: normalize noncanonical NaN literals in comparisons [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support S3 compliant filesystems [datafusion-comet] via GitHub
2026/08/27 Re: [PR] WIP: DO NOT REVIEW: Benchmark enabling parquet filter pushdown by default with one-shot row group I/O [datafusion] via GitHub
2026/08/27 Re: [PR] feat: run rlike natively by default for Java-equivalent literal patterns [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: preserve explicit Struct casts and evolved field semantics [datafusion] via GitHub
2026/08/27 Re: [PR] fix: preserve explicit Struct casts and evolved field semantics [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add Celeborn shuffle manager and partition pusher (5/n) [datafusion-comet] via GitHub
2026/08/27 [I] MySQL `->` / `->>` bind too loosely against arithmetic and bitwise operators [datafusion-sqlparser-rs] via GitHub
2026/08/27 Re: [I] ci: Prebuild Linux CI images with toolchains and dependencies [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: support RunEndEncoded arrays in function and window frame type coercion [datafusion] via GitHub
2026/08/27 Re: [PR] variant: Integrate datafusion-variant into Datafusion [datafusion] via GitHub
2026/08/27 [PR] feat: complete Celeborn map-side shuffle push lifecycle (6/n) [datafusion-comet] via GitHub
2026/08/27 [PR] fix(executor): wake graceful shutdown after tasks drain [datafusion-ballista] via GitHub
2026/08/27 Re: [PR] feat: run rlike natively by default for Java-equivalent literal patterns [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: include ABFS container in object store cache key [datafusion-comet] via GitHub
2026/08/27 Re: [I] ci: Prebuild Linux CI images with toolchains and dependencies [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix(common): support empty struct in ScalarValue::compact and new_default [datafusion] via GitHub
2026/08/27 Re: [PR] variant: Integrate datafusion-variant into Datafusion [datafusion] via GitHub
2026/08/27 Re: [I] map_from_entries crashes on a null array element instead of returning NULL [datafusion-comet] via GitHub
2026/08/27 Re: [I] map_from_entries crashes on a null array element instead of returning NULL [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: report native operator spill metrics in Spark task metrics for non-shuffle stages [datafusion-comet] via GitHub
2026/08/27 Re: [I] Report native operator spill metrics in Spark task metrics for non-shuffle stages [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: make CometDiskBlockWriter spill registry per-task instead of executor-global [datafusion-comet] via GitHub
2026/08/27 [I] map_from_entries crashes on a null array element instead of returning NULL [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: support ASOF joins [datafusion] via GitHub
2026/08/27 Re: [PR] feat: add Celeborn shuffle manager and partition pusher (5/n) [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: default native replace for non-empty UTF8_BINARY literal search [datafusion-comet] via GitHub
2026/08/27 Re: [I] support Dictionary types in approx_distinct [datafusion] via GitHub
2026/08/27 [PR] ci: add pinned Linux CI image recipe and offline validation [pingz-1-32-0] [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat(core): range shuffle reads only the bytes a consumer's range covers [datafusion-ballista] via GitHub
2026/08/27 Re: [PR] fix: make wide date-to-timestamp casts safe [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat(core): range shuffle reads only the bytes a consumer's range covers [datafusion-ballista] via GitHub
2026/08/27 Re: [PR] fix: normalize floating-point values in native collect_set [datafusion-comet] via GitHub
2026/08/27 Re: [I] Versioned documentation [datafusion] via GitHub
2026/08/27 Re: [PR] feat: run rlike natively by default for Java-equivalent literal patterns [datafusion-comet] via GitHub
2026/08/27 Re: [PR] feat: expose native Parquet scan I/O and read-amplification metrics [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: native ansi-errors raised as spark error [datafusion-comet] via GitHub
2026/08/27 Re: [PR] fix: match Spark ordering in native array extrema [datafusion-comet] via GitHub