github

Messages by Date

2026/10/05 Re: [I] Add support for custom native UDFs [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: report row contents to native write statistics trackers [datafusion-comet] via GitHub
2026/10/05 Re: [I] Scope the Rust UDF registry to the session that registered the UDF [datafusion-comet] via GitHub
2026/10/05 Re: [I] Remove the per-UDF Mutex serializing Rust UDF batches [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: custom Rust UDFs via arrow-ffi [experimental] [datafusion-comet] via GitHub
2026/10/05 Re: [I] A Rust UDF silently answers calls to an ordinary Scala UDF registered under the same name [datafusion-comet] via GitHub
2026/10/05 [PR] fix: keep a Spark scan unconverted when the plan reads input_file_name [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 [PR] perf: compare nested ScalarValues by type before converting to ArrayData [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] feat: Use DataFusion date_trunc for scalar-format timestamp truncation [datafusion-comet] via GitHub
2026/10/05 Re: [PR] test: keep the Iceberg job-abort test's wait off Comet's Tokio workers [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: normalize float operands in the native comparison builder [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: normalize float operands in the native comparison builder [datafusion-comet] via GitHub
2026/10/05 Re: [I] size, arrays_zip, map_from_arrays and array_append return wrong answers for a nondeterministic child [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] bench: Add regexp pattern reuse benchmarks [datafusion] via GitHub
2026/10/05 Re: [I] Recover date_bin ordering propagation for coarse-precision timestamps [datafusion] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 Re: [I] RANGE window frames over an array or struct key with a null element span the whole partition [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: fall back for RANGE frames over nested keys that can hold a null [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: run physical requirement enforcement first, as a PhysicalAnalyzer phase [datafusion] via GitHub
2026/10/05 Re: [PR] feat: run physical requirement enforcement first, as a PhysicalAnalyzer phase [datafusion] via GitHub
2026/10/05 Re: [PR] feat: custom vectorized Java and Scala UDFs [experimental] [datafusion-comet] via GitHub
2026/10/05 [I] Native Parquet scan: FLOAT and DOUBLE comparisons in data filters don't prune with row-level pushdown [datafusion-comet] via GitHub
2026/10/05 Re: [PR] bench: Add regexp pattern reuse benchmarks [datafusion] via GitHub
2026/10/05 Re: [PR] bench: Add regexp pattern reuse benchmarks [datafusion] via GitHub
2026/10/05 Re: [PR] bench: Add regexp pattern reuse benchmarks [datafusion] via GitHub
2026/10/05 Re: [PR] fix: preserve outer join equivalences for null rows [datafusion] via GitHub
2026/10/05 Re: [PR] Information schema extension [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] feat: allowlist DataFusion configs, starting with spill compression [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 Re: [PR] fix: preserve unassigned inner join keys [datafusion] via GitHub
2026/10/05 Re: [PR] feat: support SortAggregateExec [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 Re: [PR] feat: support `WITH ... AS [NOT] MATERIALIZED` CTEs [datafusion] via GitHub
2026/10/05 Re: [PR] feat: support `WITH ... AS [NOT] MATERIALIZED` CTEs [datafusion] via GitHub
2026/10/05 Re: [PR] fix: normalize float operands in the native comparison builder [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 Re: [PR] fix: match Spark ANSI integral overflow errors (#6217) [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: normalize float operands in the native comparison builder [datafusion-comet] via GitHub
2026/10/05 Re: [PR] docs: update the timezone page for the fixes from the timezone EPIC [datafusion-comet] via GitHub
2026/10/05 Re: [I] ANSI integral overflow errors: wrong error class for Byte/Short arithmetic and missing try_ suggestion [datafusion-comet] via GitHub
2026/10/05 [PR] build(deps): bump rustls from 0.23.44 to 0.23.45 in /native [datafusion-comet] via GitHub
2026/10/05 Re: [I] Order-insensitive aggregates with an ORDER BY fail in grouped queries (min/max schema mismatch, avg/bit_*/stddev/var panic) [datafusion] via GitHub
2026/10/05 Re: [PR] fix: honor max_row_group_bytes in the parallel Parquet writer [datafusion] via GitHub
2026/10/05 Re: [PR] fix: honor max_row_group_bytes in the parallel Parquet writer [datafusion] via GitHub
2026/10/05 Re: [PR] chore: Add contributor sentiment to contribute [datafusion-comet] via GitHub
2026/10/05 Re: [I] Fuse the SerializeFromObject / MapElements / DeserializeToObject sandwich into a Comet projection instead of falling back [datafusion-comet] via GitHub
2026/10/05 Re: [PR] docs: date the float value and null count divergence to Iceberg 1.9 [datafusion-comet] via GitHub
2026/10/05 Re: [PR] chore: update the NOTICE copyright year to 2024-2026 [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: run the operators above a typed Dataset operation natively [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: preserve Spark AVG buffer and overflow semantics [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/05 Re: [PR] ci: drop non-existent suites from the Linux and macOS test matrices [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: support NullType output types in codegen dispatch [datafusion-comet] via GitHub
2026/10/05 [I] Slow physical planning with many typed NULL struct literals: ScalarValue equality converts nested arrays to ArrayData [datafusion] via GitHub
2026/10/05 Re: [PR] feat: support NullType output types in codegen dispatch [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: make the plan nodes inspectable and rebuildable [datafusion-iceberg] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 [PR] docs: add DataFusion security guidance [datafusion] via GitHub
2026/10/05 Re: [I] Add a "securing DataFusion" documentation [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [I] Consider removing the `take` action / open ticket assignment [datafusion] via GitHub
2026/10/05 [I] Consider removing the `take` action / open ticket assignment [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [PR] Update contributor guidelines regarding AI spam, reviews, code [datafusion] via GitHub
2026/10/05 Re: [I] Add a security policy [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] Add SECURITY.md for DataFusion [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 [PR] perf: Fix performance regression in unary math UDFs [datafusion] via GitHub
2026/10/05 Re: [PR] Add SECURITY.md for DataFusion [datafusion] via GitHub
2026/10/05 Re: [I] Add a "securing DataFusion" documentation [datafusion] via GitHub
2026/10/05 [I] Add a "securing DataFusion" documentation [datafusion] via GitHub
2026/10/05 Re: [PR] feat: carry completed join filters across Union inputs [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: filter decoded probe batches before intermediate joins [datafusion-comet] via GitHub
2026/10/05 Re: [PR] ci: share one Linux native build across CI workflows [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: custom Rust UDFs via arrow-ffi [experimental] [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: reuse prepared broadcast builds across executor tasks [datafusion-comet] via GitHub
2026/10/05 Re: [PR] Add SECURITY.md for DataFusion [datafusion] via GitHub
2026/10/05 Re: [PR] fix: run sync catalog calls on a separate runtime [datafusion-iceberg] via GitHub
2026/10/05 Re: [PR] Add SECURITY.md for DataFusion [datafusion] via GitHub
2026/10/05 Re: [PR] Add SECURITY.md for DataFusion [datafusion] via GitHub
2026/10/05 Re: [PR] fix: reject casts involving non-default collated strings [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: filter decoded probe batches before intermediate joins [datafusion-comet] via GitHub
2026/10/05 [PR] fix: preserve DISTINCT semantics in lateral decorrelation [datafusion] via GitHub
2026/10/05 Re: [PR] feat: Extend adaptive partial aggregation to more aggregate functions [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: preserve Spark evaluation for next_day and levenshtein [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: make wide date-to-timestamp casts safe [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: evaluate UTF8 array extrema collations natively [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: custom Rust UDFs via arrow-ffi [experimental] [datafusion-comet] via GitHub
2026/10/05 Re: [I] perf: Comet hash joins use more task time than Spark (skewed SHJ with nested payload, BHJ) [datafusion-comet] via GitHub
2026/10/05 Re: [I] Codegen dispatcher initializes kernels with an incorrect partition index under UNION ALL and coalesce [datafusion-comet] via GitHub
2026/10/05 [PR] fix: unescape LIKE prefixes before pushing them down as STARTS WITH [datafusion-iceberg] via GitHub
2026/10/05 Re: [I] [EPIC] Substrait: Additional features for producer and consumer for physical plans [datafusion] via GitHub
2026/10/05 Re: [PR] docs: name the AQE query stages on the operator support page [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: Use NativeType in get_example_type, information schema [datafusion] via GitHub
2026/10/05 Re: [PR] feat: custom Rust UDFs via arrow-ffi [experimental] [datafusion-comet] via GitHub
2026/10/05 Re: [PR] Spark, Databricks: allow an interval string without a unit [datafusion-sqlparser-rs] via GitHub
2026/10/05 [PR] Spark, Databricks: allow an interval string without a unit [datafusion-sqlparser-rs] via GitHub
2026/10/05 [PR] feat: allowlist DataFusion configs, starting with spill compression [datafusion-comet] via GitHub
2026/10/05 Re: [PR] Prototype: physical filter API (PhysicalFilter / FilterConjunct) with optional conjuncts [datafusion] via GitHub
2026/10/05 [PR] fix: initialize dispatched kernels with the partition the native plan computes [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: custom Rust UDFs via arrow-ffi [experimental] [datafusion-comet] via GitHub
2026/10/05 [PR] test: keep the Iceberg job-abort test's wait off Comet's Tokio workers [datafusion-comet] via GitHub
2026/10/05 [PR] feat: custom vectorized Java and Scala UDFs [experimental] [datafusion-comet] via GitHub
2026/10/05 Re: [PR] ci: Enforce PR limit to 3 for non-committers [datafusion] via GitHub
2026/10/05 Re: [PR] perf(sort-shuffle): only gc view columns that are sparse [datafusion-ballista] via GitHub
2026/10/05 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/05 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/05 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/05 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/05 Re: [PR] feat: normalize floats in native array_distinct and array_union [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: normalize float operands in the native comparison builder [datafusion-comet] via GitHub
2026/10/05 Re: [I] Call for Presentations: Community Showcase: Regular series for sharing what you're building with DataFusion [datafusion] via GitHub
2026/10/05 Re: [PR] fix: [branch-1.1] stop the leak of Arrow memory from struct outputs of the codegen dispatcher (#6552) [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: Make default sort order nulls last [datafusion-python] via GitHub
2026/10/05 Re: [PR] Document and enforce compatibility between an aggregate's accumulators [datafusion] via GitHub
2026/10/05 [I] TakeOrderedAndProject fails with "Subquery not found" when the sort order has a scalar subquery and the input has several partitions [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] feat: Use DataFusion date_trunc for scalar-format timestamp truncation [datafusion-comet] via GitHub
2026/10/05 Re: [I] Native Iceberg writer keeps a dictionary page for high-cardinality columns where iceberg-java writes none [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: choose dictionary encoding like iceberg-java in the native Iceberg writer [datafusion-comet] via GitHub
2026/10/05 Re: [I] Support custom vectorized Java UDFs that operate on Arrow vectors [datafusion-comet] via GitHub
2026/10/05 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/10/05 [PR] feat: support Spark 4.2 insert-only MERGE [datafusion-comet] via GitHub
2026/10/05 Re: [PR] Update findepi's affiliation in governance doc [datafusion] via GitHub
2026/10/05 Re: [I] Allow users to enable dictionary column reads from parquet files [datafusion] via GitHub
2026/10/05 Re: [PR] test: cover sequence's per-batch element limit and the batch size remedy [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: ship NOTICE.txt as META-INF/NOTICE in the comet-spark jar and sources jar [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: [branch-1.1] per-location credentials for native Iceberg reads and writes (#6478) [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: accept column names for aggregate function inputs [datafusion-python] via GitHub
2026/10/05 [PR] refactor: move the plan entry point logic into core functions [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: fuse Comet cache vector reads into Spark codegen [datafusion-comet] via GitHub
2026/10/05 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/10/05 [I] Support custom vectorized Java UDFs that operate on Arrow vectors [datafusion-comet] via GitHub
2026/10/05 Re: [I] Codegen dispatcher initializes kernels with an incorrect partition index under UNION ALL and coalesce [datafusion-comet] via GitHub
2026/10/05 Re: [I] Investigate nested TPC-H q21 slowdown: Comet 37% slower than Spark at SF1000 [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: track executor allocations and log memory usage [datafusion-ballista] via GitHub
2026/10/05 Re: [PR] feat: Use NativeType in get_example_type, information schema [datafusion] via GitHub
2026/10/05 Re: [PR] fix: gate unsupported Iceberg S3 write settings [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: gate unsupported Iceberg S3 write settings [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: fuse Comet cache vector reads into Spark codegen [datafusion-comet] via GitHub
2026/10/05 Re: [PR] refactor: remove unused cast compatibility flag [datafusion-comet] via GitHub
2026/10/05 [PR] fix: preserve unassigned inner join keys [datafusion] via GitHub
2026/10/05 Re: [I] Codegen dispatcher initializes kernels with an incorrect partition index under UNION ALL and coalesce [datafusion-comet] via GitHub
2026/10/05 Re: [I] Investigate nested TPC-H q21 slowdown: Comet 37% slower than Spark at SF1000 [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: support scalar Variant extraction for foldable paths [datafusion-comet] via GitHub
2026/10/05 [PR] feat(iceberg): plan WriteDelta in the split write path and keep it on the JVM DeltaWriter [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: report row contents to native write statistics trackers [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: support struct-typed scalar subquery results [datafusion-comet] via GitHub
2026/10/05 Re: [I] Plan Iceberg WriteDelta in the split write path and keep it on the JVM DeltaWriter [datafusion-comet] via GitHub
2026/10/05 [I] Plan Iceberg WriteDelta in the split write path and keep it on the JVM DeltaWriter [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: report row contents to native write statistics trackers [datafusion-comet] via GitHub
2026/10/05 Re: [I] Codegen dispatcher initializes kernels with an incorrect partition index under UNION ALL and coalesce [datafusion-comet] via GitHub
2026/10/05 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/10/05 Re: [PR] fix: infer LIMIT and OFFSET parameter types [datafusion] via GitHub
2026/10/05 Re: [PR] SQLite: Reject colon-based semi-structured data traversal [datafusion-sqlparser-rs] via GitHub
2026/10/05 [PR] chore: Add contributor sentiment to contribute [datafusion-comet] via GitHub
2026/10/05 [PR] perf: compare floats in Spark's order without normalizing copies of the operands [datafusion-comet] via GitHub
2026/10/05 [PR] chore: raise the native rust-version to 1.95, which iceberg-rust requires [datafusion-comet] via GitHub
2026/10/05 Re: [I] Native Iceberg write over-counts NaNs for nested float fields when the input batch is already sliced [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: Use DataFusion date_trunc for scalar-format timestamp truncation [datafusion-comet] via GitHub
2026/10/05 Re: [I] input_file_name() returns empty values above a converted Spark Parquet scan [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: preserve types in NVL and IFNULL [datafusion] via GitHub
2026/10/05 Re: [PR] fix: preserve types in NVL and IFNULL [datafusion] via GitHub
2026/10/05 Re: [PR] feat: support scalar Variant extraction for foldable paths [datafusion-comet] via GitHub
2026/10/05 Re: [I] Codegen dispatcher initializes kernels with an incorrect partition index under UNION ALL and coalesce [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: compact already-sliced batches before the native Iceberg writer counts NaNs [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: use native shuffle for row input by converting it to Arrow [datafusion-comet] via GitHub
2026/10/05 [PR] fix: have native shuffle read a converted child's Arrow stream [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: do not resolve DPP subqueries when AQE reads a native scan's partitioning [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: accept column names for aggregate function inputs [datafusion-python] via GitHub
2026/10/05 Re: [PR] chore: Add contributor sentiment to contribute [datafusion-comet] via GitHub
2026/10/05 Re: [PR] fix: restore Spark write execs when reverting transition-heavy stages [datafusion-comet] via GitHub
2026/10/05 [PR] SQLite: Reject colon-based semi-structured data traversal [datafusion-sqlparser-rs] via GitHub
2026/10/05 [I] Wrong results: eliminate_cross_join drops an equi-join key that spans two cross-joined relations [datafusion] via GitHub
2026/10/05 Re: [PR] feat: Lambda function support from DataFusion, illustrated with array_filter [datafusion-comet] via GitHub
2026/10/05 [I] Cached AQE queries fail after transition reversion on Spark 4.0+ [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: accept column names for aggregate function inputs [datafusion-python] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] feat: use native shuffle for row input by converting it to Arrow [datafusion-comet] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] feat: accept column names for aggregate function inputs [datafusion-python] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] perf: Optimize `left`, `right` [datafusion] via GitHub
2026/10/05 Re: [PR] feat: use native shuffle for row input by converting it to Arrow [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: accept column names for aggregate function inputs [datafusion-python] via GitHub
2026/10/05 [PR] build: drop the compiled maven-wrapper.jar by switching to the script-only wrapper [datafusion-comet] via GitHub
2026/10/05 [PR] docs: update the timezone page for the fixes from the timezone EPIC [datafusion-comet] via GitHub
2026/10/05 [PR] fix: fall back for nested sort keys whose null elements Spark orders differently [datafusion-comet] via GitHub
2026/10/05 Re: [PR] feat: normalize floats in native array_distinct and array_union [datafusion-comet] via GitHub