github
Thread
Date
Earlier messages
Messages by Thread
[PR] Display input stage id on UnresolvedShuffleExec [datafusion-ballista]
via GitHub
Re: [I] Is it possible to support PyArrow backed UDFs in Comet natively? [datafusion-comet]
via GitHub
Re: [I] Eliminate remaining row<->Arrow round-trip in CometPythonMapInArrowExec [datafusion-comet]
via GitHub
[PR] chore: add `mimalloc` tests to assert `size` functions [datafusion]
via GitHub
[PR] bench: parquet scan with a table schema narrower than a nested column [datafusion]
via GitHub
[PR] refactor: extract parquet projection read plan into its own module [datafusion]
via GitHub
Re: [PR] refactor: extract parquet projection read plan into its own module [datafusion]
via GitHub
[PR] fix: don't duplicate volatile expressions when pushing projection into file scan [datafusion]
via GitHub
Re: [PR] fix: don't duplicate volatile expressions when pushing projection into file scan [datafusion]
via GitHub
[PR] Add shuffle-read fetch metrics and surface per-operator metrics in plan display [datafusion-ballista]
via GitHub
[PR] Push xlzmxnmwvkmz [datafusion]
via GitHub
[PR] feat: support `WindowGroupLimitExec` [datafusion-comet]
via GitHub
[I] feat: analyze memory usage for `size` functions [datafusion]
via GitHub
Re: [I] feat: analyze memory usage for `size` functions [datafusion]
via GitHub
Re: [I] feat: analyze memory usage for `size` functions [datafusion]
via GitHub
[I] UnresolvedShuffleExec should display the input stage number [datafusion-ballista]
via GitHub
Re: [I] Panic when casting `[]` to `FixedSizeList(0, Null)` [datafusion]
via GitHub
[PR] fix: register partitioning scalar subqueries for native shuffle to avoid "Subquery N not found" [datafusion-comet]
via GitHub
Re: [PR] fix: register partitioning scalar subqueries for native shuffle to avoid "Subquery N not found" [datafusion-comet]
via GitHub
Re: [PR] fix: register partitioning scalar subqueries for native shuffle to avoid "Subquery N not found" [datafusion-comet]
via GitHub
Re: [PR] fix: register partitioning scalar subqueries for native shuffle to avoid "Subquery N not found" [datafusion-comet]
via GitHub
[PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
Re: [PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
Re: [PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
Re: [PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
[PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
Re: [PR] Prune unread nested parquet leaves when a projected column is cast to a narrower type (nested schema pruning) [datafusion]
via GitHub
[PR] Add TPC-H distributed plan-stability test suite [datafusion-ballista]
via GitHub
Re: [PR] Add TPC-H distributed plan-stability test suite [datafusion-ballista]
via GitHub
Re: [PR] Add TPC-H distributed plan-stability test suite [datafusion-ballista]
via GitHub
[PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
Re: [PR] fix: emit JDK libjvm search path from core build script to fix -ljvm CI link failures [datafusion-comet]
via GitHub
[I] Remove legacy native HDFS client crates and standardize on OpenDAL HDFS [datafusion-comet]
via GitHub
[I] Support per-SessionContext object store credentials without os.environ (thread-safety) [datafusion-python]
via GitHub
Re: [I] Support per-SessionContext object store credentials without os.environ (thread-safety) [datafusion-python]
via GitHub
Re: [I] Support per-SessionContext object store credentials without os.environ (thread-safety) [datafusion-python]
via GitHub
[I] Support per-SessionContext object store credentials without os.environ (thread-safety) [datafusion-python]
via GitHub
Re: [I] [Feature] Support external Remote Shuffle Service (e.g., Apache Celeborn / Apache Uniffle) [datafusion-ballista]
via GitHub
Re: [I] CometHashAggregateExec doesn't participate in Spark's AQEPropagateEmptyRelation optimization [datafusion-comet]
via GitHub
[PR] fix: [DO NOT MERGE] [datafusion-comet]
via GitHub
[PR] feat: prune nested Parquet leaves when the projected schema narrows a nested column [datafusion]
via GitHub
[I] chore: DataFusion 54.0.0 [datafusion-comet]
via GitHub
[PR] chore: use Datafusion `substring` [datafusion-comet]
via GitHub
Re: [PR] chore: use Datafusion `substring` [datafusion-comet]
via GitHub
Re: [I] [Bug] map_from_arrays / map_from_entries do not enforce null-key rejection or spark.sql.mapKeyDedupPolicy [datafusion-comet]
via GitHub
Re: [I] [Bug] map_from_arrays / map_from_entries do not enforce null-key rejection or spark.sql.mapKeyDedupPolicy [datafusion-comet]
via GitHub
[PR] chore: move CometCollationSuite to spark-4.1+ test shim [datafusion-comet]
via GitHub
[PR] chore: fallback for non-default `spark.sql.mapKeyDedupPolicy` [datafusion-comet]
via GitHub
Re: [PR] chore: fallback for non-default `spark.sql.mapKeyDedupPolicy` [datafusion-comet]
via GitHub
Re: [PR] chore: fallback for `spark.sql.mapKeyDedupPolicy` == `LAST_WIN` [datafusion-comet]
via GitHub
Re: [PR] chore: fallback for `spark.sql.mapKeyDedupPolicy` == `LAST_WIN` [datafusion-comet]
via GitHub
Re: [PR] chore: fallback for `spark.sql.mapKeyDedupPolicy` == `LAST_WIN` [datafusion-comet]
via GitHub
[PR] docs: remove duplicate String to TimestampNTZ section from cast guide [datafusion-comet]
via GitHub
Re: [PR] docs: remove duplicate String to TimestampNTZ section from cast guide [datafusion-comet]
via GitHub
[PR] feat: enable mixed partial/final execution for sum and non-decimal avg [datafusion-comet]
via GitHub
Re: [PR] feat: enable mixed partial/final execution for sum and non-decimal avg [datafusion-comet]
via GitHub
Re: [PR] feat: enable mixed partial/final execution for sum and non-decimal avg [datafusion-comet]
via GitHub
[PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [PR] feat: add BatchNormalizer: re-chunk data source batches by rows and bytes (target_batch_size_bytes) [datafusion]
via GitHub
Re: [I] `= ANY` / `<> ALL` subquery fails to plan: `Schema contains duplicate unqualified field name mark` [datafusion]
via GitHub
Re: [I] CometFromUnixTime reports unsupported format patterns as Incompatible instead of Unsupported [datafusion-comet]
via GitHub
[PR] fix(sort): can have OOM when the largest batch is smaller than batch size [datafusion]
via GitHub
Re: [PR] fix(sort): can have OOM when the largest batch is smaller than batch size [datafusion]
via GitHub
Re: [PR] fix(sort): can have OOM when the largest batch is smaller than batch size [datafusion]
via GitHub
Re: [PR] fix(sort): can have OOM when the largest batch is smaller than batch size [datafusion]
via GitHub
Re: [I] Scalar subquery (`Expr::ScalarSubquery`) does not fail when subquery is not scalar [datafusion]
via GitHub
[PR] fix: Make FilePruner support constant columns [datafusion]
via GitHub
Re: [PR] fix: Make FilePruner support constant columns [datafusion]
via GitHub
Re: [PR] fix: Make FilePruner support constant columns [datafusion]
via GitHub
Re: [PR] fix: Make FilePruner support constant columns [datafusion]
via GitHub
Re: [PR] fix: Make FilePruner support constant columns [datafusion]
via GitHub
[PR] Move datafusion-cli main_inner impl into the datafusion-cli lib. [datafusion]
via GitHub
Re: [PR] Move datafusion-cli main_inner impl into the datafusion-cli lib. [datafusion]
via GitHub
Re: [PR] Move datafusion-cli main_inner impl into the datafusion-cli lib. [datafusion]
via GitHub
Re: [PR] Move datafusion-cli main_inner impl into the datafusion-cli lib. [datafusion]
via GitHub
Re: [PR] Move datafusion-cli main_inner impl into the datafusion-cli lib. [datafusion]
via GitHub
[I] Registering custom udf in datafusion-cli could be easier [datafusion]
via GitHub
Re: [I] Registering custom udf in datafusion-cli could be easier [datafusion]
via GitHub
Re: [I] Registering custom udf in datafusion-cli could be easier [datafusion]
via GitHub
Re: [I] Misleading error message when `CREATE EXTERNAL TABLE` with invalid path [datafusion]
via GitHub
Re: [I] Misleading error message when `CREATE EXTERNAL TABLE` with invalid path [datafusion]
via GitHub
Re: [I] Misleading error message when `CREATE EXTERNAL TABLE` with invalid path [datafusion]
via GitHub
Re: [I] Misleading error message when `CREATE EXTERNAL TABLE` with invalid path [datafusion]
via GitHub
[I] Untracked memory in `FilterExec`, `RepartitionExec`, `HashJoinExec` and `AsyncFuncExec` and more due to `LimitedBatchCoalescer` and arrow `BatchCoalescer` usage [datafusion]
via GitHub
[PR] Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] POC Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] POC Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] POC Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] POC Optimize near-unique string view group values [datafusion]
via GitHub
Re: [PR] POC Optimize near-unique string view group values [datafusion]
via GitHub
[PR] docs: add infino to known users [datafusion]
via GitHub
Re: [PR] docs: add infino to known users [datafusion]
via GitHub
Re: [PR] fix: support literal sha2() with 'Unsupported argument types' [datafusion-comet]
via GitHub
[I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
Re: [I] Comet native Parquet scan reads full nested columns despite pruned Spark ReadSchema [datafusion-comet]
via GitHub
[PR] chore: cleanup some TODO items in sqllogictests [datafusion]
via GitHub
Re: [PR] chore: cleanup some TODO items in sqllogictests [datafusion]
via GitHub
Re: [PR] chore: cleanup some TODO items in sqllogictests [datafusion]
via GitHub
Re: [I] [EPIC] Apply try_to_proto / try_from_proto pattern to ExecutionPlan [datafusion]
via GitHub
Re: [I] select distinct on map types yields ArrowError NotYetImplemented [datafusion]
via GitHub
Re: [I] select distinct on map types yields ArrowError NotYetImplemented [datafusion]
via GitHub
[PR] fix: cast `[]` to `FixedSizeList(0, _)` [datafusion]
via GitHub
Re: [PR] fix: cast `[]` to `FixedSizeList(0, _)` [datafusion]
via GitHub
[PR] docs: fix sidebar drawer mis-tap, missing aria-expanded, homepage permalink, and ASF links page [datafusion-comet]
via GitHub
Re: [PR] docs: fix sidebar drawer mis-tap, missing aria-expanded, homepage permalink, and ASF links page [datafusion-comet]
via GitHub
Re: [PR] fix: Validate arrow_cast time units [datafusion]
via GitHub
Re: [I] arrow_cast accepts invalid Time32(Microsecond)/Time32(Nanosecond)/Time64(Second)/Time64(Millisecond), panics on use [datafusion]
via GitHub
Re: [I] arrow_cast accepts invalid Time32(Microsecond)/Time32(Nanosecond)/Time64(Second)/Time64(Millisecond), panics on use [datafusion]
via GitHub
[PR] chore(deps): bump astral-sh/setup-uv from 8.3.0 to 8.3.1 [datafusion-ballista]
via GitHub
[PR] chore(deps): bump taiki-e/install-action from 2.82.7 to 2.82.10 [datafusion-ballista]
via GitHub
[PR] chore(deps): bump the all-other-cargo-deps group across 1 directory with 3 updates [datafusion]
via GitHub
Re: [PR] chore: update SQL builtin functions assertion modes [datafusion-comet]
via GitHub
Re: [PR] fix(writer): spark 38811 insert alter table add columns [datafusion-comet]
via GitHub
Re: [PR] feat: statistics-driven TopK optimization for parquet (file reorder + RG reorder + threshold init + cumulative prune) [datafusion]
via GitHub
Re: [PR] WIP: Extension type casts using extension registry [datafusion]
via GitHub
Re: [PR] Fix output_rows_skew sqllogictest flake [datafusion]
via GitHub
Re: [PR] perf(push_down_filter): skip filter revalidation [datafusion]
via GitHub
Re: [PR] feat: format-agnostic serde hook for PhysicalExpr (Column + NotExpr) [datafusion]
via GitHub
Re: [PR] Sa/udf wip [datafusion]
via GitHub
Re: [PR] Add bounded `unnest` + ordered `array_agg` reproducer benchmark and SLT coverage [datafusion]
via GitHub
Re: [PR] Add bounded `unnest` + ordered `array_agg` reproducer benchmark and SLT coverage [datafusion]
via GitHub
Re: [I] TPCDS Q72 Fails with `OffsetOverflowError(2147731589)` (AQE) [datafusion-ballista]
via GitHub
Re: [I] TPCDS Q72 Fails with `OffsetOverflowError(2147731589)` (AQE) [datafusion-ballista]
via GitHub
Re: [I] TPCDS Q72 Fails with `OffsetOverflowError(2147731589)` (AQE) [datafusion-ballista]
via GitHub
Re: [I] panic: array_resize capacity overflow with large target size [datafusion]
via GitHub
[PR] [codex] chore: update Rust toolchain to 1.96.1 [datafusion]
via GitHub
Re: [PR] [codex] chore: update Rust toolchain to 1.96.1 [datafusion]
via GitHub
Re: [PR] [codex] chore: update Rust toolchain to 1.96.1 [datafusion]
via GitHub
Re: [PR] Fix:22477 any all schema error [datafusion]
via GitHub
Re: [PR] Fix:22477 any all schema error [datafusion]
via GitHub
Earlier messages