Messages by Thread
-
-
[PR] [branch-55] fix(smj): handle floating-point keys across batch boundaries (#25134) [datafusion]
Sunninsky (via GitHub) via github
-
Re: [I] Propagate window ranking statistics into rank filters [datafusion]
mohitgurav20 (via GitHub) via github
-
[PR] feat: add Spark-compatible array_position [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: split_part returns NULL for position 0 when every string in the batch is NULL [datafusion]
sohailshk (via GitHub) via github
-
[PR] style: run cargo fmt --all [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: generate the DataFusion Distributed comparison results from the published JSON [datafusion-ballista]
NoahKusaba (via GitHub) via github
-
[PR] docs: flesh out top-level README [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: count early emitted groups in the partial aggregation skip probe [datafusion]
comphead (via GitHub) via github
-
[I] Switch to Hawkeye instead of RAT [datafusion-spark]
andygrove (via GitHub) via github
-
Re: [I] Wrong results: `NOT IN` over two unbounded inputs loses its NULL handling (`SymmetricHashJoinExec` drops `null_aware`) [datafusion]
2010YOUY01 (via GitHub) via github
-
[I] Partial aggregation stops skipping after early emits under memory pressure [datafusion]
comphead (via GitHub) via github
-
Re: [PR] feat: aggregate a large final hash table as hash buckets (experimental, off by default) [datafusion]
comphead (via GitHub) via github
-
Re: [PR] fix: Unnest must not keep its input's uniqueness [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [I] [EPIC] Native DataSketches: theta, KLL, frequent items and tuple sketches [datafusion-comet]
cboumalh (via GitHub) via github
-
Re: [PR] feat: protobuf serialization for the materialized CTE plan nodes [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat: decide automatically when to materialize a CTE [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat: push filters that all references share into the body of a materialized CTE [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] Avoid concatenating record batches in joins [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] fix: reject GROUPING masks wider than 64 bits [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] build(deps): bump parquet from 59.3.1 to 59.3.2 in /native/native-executors [datafusion-comet]
comphead (via GitHub) via github
-
[PR] fix: compact over-fragmented string/binary view columns in hash join build [datafusion]
osscm (via GitHub) via github
-
[PR] fix: return an error for out-of-bounds Parquet protobuf projection indices [datafusion]
rxdrccq (via GitHub) via github
-
Re: [PR] build(deps): bump the codeql-actions group with 2 updates [datafusion-comet]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump swatinem/rust-cache from 2.9.2 to 2.9.3 in /.github/actions/setup-rust in the github-actions group across 1 directory [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump rustls from 0.23.45 to 0.23.46 [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump datafusion-sqllogictest from 55.0.0 to 55.2.0 [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump parquet from 59.3.0 to 59.3.2 [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump datafusion-cli from 55.0.0 to 55.2.0 [datafusion-iceberg]
comphead (via GitHub) via github
-
[PR] fix: preserve common equivalence classes in union output (#26625) [datafusion]
galaxytemple (via GitHub) via github
-
Re: [PR] docs: add AI-assisted contributions page to the contributor guide [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] feat: support kurtosis aggregate [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] test: extend C2R and R2C microbenchmarks to cover nested types [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] Fix ClickHouse numeric roundtrip test without bigdecimal [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
Re: [PR] chore: fix compiler warnings in the spark module [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] fix: fall back to Spark for mode on FLOAT and DOUBLE before Spark 3.5.2 [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] docs: list contrib/delta-spark/pom.xml in the version bump and add a dependency refresh step [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] fix: run flatten natively on arrays of binary and name the expression in fallback reasons [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] Preserve quotes in named placeholders [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
Re: [PR] docs: describe the long-lived branch for upgrading DataFusion [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] docs: add per-function documentation template with sha2 and substring examples [datafusion-spark]
andygrove (via GitHub) via github
-
Re: [PR] docs: explain the Enable CI on your fork check in the contributor guide [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] fix: don't double count column join keys in SortMergeJoinExec buffered batch reservation [datafusion]
Kristofferjoha (via GitHub) via github
-
Re: [PR] Generic: Disallow quoted identifiers in colon and at-sign placeholders [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
[I] [EPIC] Finish moving datafusion-spark into this repository [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: improve crate README and API docs for crates.io and docs.rs [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Epic: Document Spark-specific behavior for every expression [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] test: add an SQL reproducer for the canceled hash join partition hang [datafusion]
adriangb (via GitHub) via github
-
Re: [PR] fix: preserve filter semantics for casts and negation [datafusion-iceberg]
debugmiller (via GitHub) via github
-
Re: [PR] chore: add a manual PySpark runner for the Spark sqllogictest files [datafusion]
andygrove (via GitHub) via github
-
[PR] chore: add a manual PySpark runner for the Spark sqllogictest files [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] PostgreSQL: Support `ALTER EXTENSION ... UPDATE` [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
[PR] chore: move audit-datafusion-spark-expression skill to datafusion-spark repo [datafusion]
andygrove (via GitHub) via github
-
[PR] ci: add cargo fmt and clippy workflow [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: add audit-datafusion-spark-expression agent skill and AGENTS.md [datafusion-spark]
andygrove (via GitHub) via github
-
Re: [I] perf: a shuffle over a native plan takes the JVM row shuffle for round-robin and nested hash partitioning [datafusion-comet]
JonSnow1807 (via GitHub) via github
-
[PR] test: run sqllogictest files in CI [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: bound aggregate spill batches by the memory of the first spill [datafusion]
adriangb (via GitHub) via github
-
[PR] ci: add Apache RAT license header check [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: add README [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Re-apply apache/datafusion#26703 (dictionary values compaction in hex) once DataFusion 56 crates are released [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Support Spark-version-specific expectations in datafusion-spark sqllogictest files [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] encode accepts charsets and unmappable characters that Spark 4 rejects [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] / on integers returns an integer in Spark SQL, Spark always returns a DOUBLE [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] chore: add top-level workspace Cargo.toml [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] last_day, monthname, weekday, round and unbase64 reject arguments that Spark implicitly casts [datafusion-spark]
comphead (via GitHub) via github
-
[I] Add Spark-compatible AtLeastNNonNulls physical expression [datafusion-spark]
rich7420 (via GitHub) via github
-
[I] [Bug] round on a DECIMAL keeps the input type, Spark reduces the scale of the result [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] pmod and mod report Arrow's divide-by-zero message instead of Spark's REMAINDER_BY_ZERO text [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Spark aggregate functions do not report distinct_handling [datafusion-spark]
mkleen (via GitHub) via github
-
[I] Spark `negative` returns wrong results for decimal columns [datafusion-spark]
neilconway (via GitHub) via github
-
[I] [Bug] parse_url raises on a malformed URL when ANSI mode is off, Spark returns NULL [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] unbase64 rejects input that Spark's MIME decoder accepts [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] trunc and date_trunc handle unsupported, NULL and non-literal formats differently from Spark [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] pmod rejects string arguments that Spark implicitly casts to a numeric type [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Spark make_dt_interval/make_interval return NULL on overflow instead of erroring [datafusion-spark]
YutaLin (via GitHub) via github
-
[I] Spark `xxhash64` hashes the raw bits of a NaN instead of the canonical NaN [datafusion-spark]
andygrove (via GitHub) via github
-
[I] bug: `SparkCollectList`/`SparkCollectSet` declare nullable list elements, diverging from Spark's `containsNull = false` [datafusion-spark]
peterxcli (via GitHub) via github
-
[I] [Bug] pow differs from Spark for -0.0, NaN and infinite exponents [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] format_string prints the unscaled value for %s of a DECIMAL and strips trailing zeros for %g [datafusion-spark]
comphead (via GitHub) via github
-
[I] Support 2-argument ceil(decimal, scale) for Spark [datafusion-spark]
diegoQuinas (via GitHub) via github
-
[I] [Bug] spark factorial: BIGINT overflow should wrap in non-ANSI mode and raise CAST_OVERFLOW in ANSI mode, as in Spark [datafusion-spark]
ShayanGho (via GitHub) via github
-
[I] [Bug] date_part('SECOND', ts) drops the fractional seconds, Spark returns decimal(8,6) [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] atan2 does not normalize -0.0 the way Spark does [datafusion-spark]
comphead (via GitHub) via github
-
[I] spark: array_contains compares floats by bits, where Spark treats -0.0 as 0.0 and all NaNs as equal [datafusion-spark]
zhangfengcdt (via GitHub) via github
-
[I] [Bug] spark factorial rejects STRING, DECIMAL and floating-point inputs that Spark implicitly casts to INT [datafusion-spark]
ShayanGho (via GitHub) via github
-
[I] Some `datafusion-spark` expressions are missing the physical implementation [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] next_day cross-version divergence: ANSI default flip and error class change between Spark 3.5 and 4.x [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Extend `datafusion-spark` `sequence` function [datafusion-spark]
erenavsarogullari (via GitHub) via github
-
[I] Spark `round()` on floating-point types diverges from Spark HALF_UP semantics [datafusion-spark]
sjhddh (via GitHub) via github
-
[I] perf: Adopt bulk-NULL builders and NullBuffer::union_many in datafusion-spark [datafusion-spark]
mbutrovich (via GitHub) via github
-
[I] Add Spark-compatible Parquet reader [datafusion-spark]
andygrove (via GitHub) via github
-
[I] bug: datafusion-spark format_string %t timestamp specifiers do not match Spark behavior [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [datafusion-spark] Support year-month interval and day-time interval in spark sqllogictest [datafusion-spark]
hsiang-c (via GitHub) via github
-
[I] Introduce version-specific behavior in Spark expressions [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Support 2-argument ceil(value, scale) for Spark [datafusion-spark]
comphead (via GitHub) via github