github  

Messages by Thread

• • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Add `normalize_batch_schema` helper and migrate `RecursiveQueryExec` to enforce output schema consistency [datafusion] via GitHub
  • Re: [PR] Align recursive query schemas at plan-time with reusable projection helper [datafusion] via GitHub
  • Re: [PR] Align recursive query schemas at plan-time with reusable projection helper [datafusion] via GitHub
  • Re: [PR] Align recursive query schemas at plan-time with reusable projection helper [datafusion] via GitHub
  • Re: [PR] Align recursive query schemas at plan-time with reusable projection helper [datafusion] via GitHub
  • Re: [PR] Align recursive query schemas at plan-time with reusable projection helper [datafusion] via GitHub
  • Re: [PR] Add reusable plan-time schema alignment helper and apply to RecursiveQueryExec [datafusion] via GitHub
• [I] Breaking change detector CI step cant post comment [datafusion] via GitHub
  • Re: [I] Breaking change detector CI step cant post comment [datafusion] via GitHub
• [I] Introduce a reusable execution-layer helper for schema normalization [datafusion] via GitHub
• [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
  • Re: [PR] wip: Array remove optimize [datafusion] via GitHub
• [PR] chore(deps): bump rustls from 0.23.39 to 0.23.40 [datafusion-ballista] via GitHub
  • Re: [PR] chore(deps): bump rustls from 0.23.39 to 0.23.40 [datafusion-ballista] via GitHub
• [PR] chore(deps): bump ctor from 0.10.1 to 0.11.1 [datafusion-ballista] via GitHub
  • Re: [PR] chore(deps): bump ctor from 0.10.1 to 0.11.1 [datafusion-ballista] via GitHub
• Re: [I] Add support for lambda/higher order functions [datafusion] via GitHub
  • Re: [I] Add support for lambda/higher order functions [datafusion] via GitHub
  • Re: [I] Add support for lambda/higher order functions [datafusion] via GitHub
• [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
  • Re: [I] Small files problem. [datafusion-ballista] via GitHub
• [PR] fix: forbid lossy cast(for now) [datafusion] via GitHub
  • Re: [PR] fix: forbid lossy cast(for now) [datafusion] via GitHub
• Re: [D] datafusion mascot when? [datafusion] via GitHub
• Re: [PR] Adding support for TABLESPACE [datafusion-sqlparser-rs] via GitHub
• Re: [PR] PostgreSQL SQL/JSON Parser Support [datafusion-sqlparser-rs] via GitHub
• Re: [PR] Adding support for `PostgreSQL`'s `SUBSCRIPTION` (`CREATE`, `ALTER`, `DROP`, `COMMENT`) [datafusion-sqlparser-rs] via GitHub
• Re: [PR] Adding support for `IS JSON` & `IS NOT JSON` [datafusion-sqlparser-rs] via GitHub
• Re: [PR] Adding support for PostgreSQL's `STATISTICS` `CREATE`, `ALTER`, `DROP` and `COMMENT ON`. [datafusion-sqlparser-rs] via GitHub
• Re: [PR] feat: support Spark unbase64 expression [datafusion-comet] via GitHub
• Re: [PR] Add Substrait roundtrip support for `RecursiveQuery` and recursive CTE scans [datafusion] via GitHub
• Re: [PR] feat: support named parameters for table functions [datafusion] via GitHub
• Re: [PR] Substrait: Round-trip generate_series table function scans via ReadRel advanced_extension [datafusion] via GitHub
• Re: [PR] feat: allow to skip named parameters and fill skipped with NULL [datafusion] via GitHub
• Re: [PR] metrics: added more metrics for multi-column group by [datafusion] via GitHub
• Re: [PR] feat: add `LogicalPlanBuilderExt` trait to move some DataFrame convenience methods into builder [datafusion] via GitHub
• Re: [PR] fix: Wrap join operators with make_cooperative() for cancellation support [datafusion] via GitHub
• Re: [PR] Use arrow pool to fix memory over accounting in aggregations [datafusion] via GitHub
• Re: [PR] Incremental group emission in HashAggregate [datafusion] via GitHub
• Re: [PR] perf: skip double lookup in multi group by hash map [datafusion] via GitHub
• Re: [PR] feat: support stateless physical plans [datafusion] via GitHub
• Re: [PR] feat: Add `preselection_threshold` option to `BinaryExpr` [datafusion] via GitHub
  • Re: [PR] feat: Add `preselection_threshold` option to `BinaryExpr` [datafusion] via GitHub
• Re: [PR] Enable parquet filter pushdown by default [datafusion] via GitHub
• Re: [PR] fix: simplify IS NULL/IS NOT NULL literals for parquet pruning [datafusion] via GitHub
• Re: [PR] Optimize RequiredIndices column collection [datafusion] via GitHub
• Re: [PR] Fix distribution enforcement for chained aggregates to avoid SanityCheckPlan failures [datafusion] via GitHub
• Re: [PR] Add preserve_empty_as_null option to unnest for Spark explode_outer compatibility [datafusion] via GitHub
• Re: [PR] feat: Ensure catalog format in config is valid [datafusion] via GitHub
• Re: [PR] Co-locate function parameter names and types with `Signature::with_parameters` [datafusion] via GitHub
• Re: [PR] perf: add prefetching for aggregate multi group by [WIP] [datafusion] via GitHub
• [PR] Fix fully matched row groups with null counts [datafusion] via GitHub
  • Re: [PR] Fix fully matched row groups with null counts [datafusion] via GitHub
  • Re: [PR] Fix fully matched row groups with null counts [datafusion] via GitHub
• Re: [D] How do I create a UDF in datafusion rust? [datafusion] via GitHub
• [PR] Add ClickBench extended URL prefix filter benchmark [datafusion] via GitHub
  • Re: [PR] Add ClickBench extended URL prefix filter benchmark [datafusion] via GitHub
• [PR] Allow benchmark allocator features together [datafusion] via GitHub
• [PR] build: change default Maven profile to Spark 4.0 / Scala 2.13 [datafusion-comet] via GitHub
• [PR] refactor: route shim-registered expressions through CometExpressionSerde [datafusion-comet] via GitHub
  • Re: [PR] refactor: route shim-registered expressions through CometExpressionSerde [datafusion-comet] via GitHub
  • Re: [PR] refactor: route shim-registered expressions through CometExpressionSerde [datafusion-comet] via GitHub
  • Re: [PR] refactor: route shim-registered expressions through CometExpressionSerde [datafusion-comet] via GitHub
• Re: [I] [EPIC] Add support for Spark 4.0.1 [datafusion-comet] via GitHub
  • Re: [I] [EPIC] Add support for Spark 4.0.1 [datafusion-comet] via GitHub
• Re: [I] Reinstate macOS CI builds of Comet with Spark 4.0.0 [datafusion-comet] via GitHub
  • Re: [I] Reinstate macOS CI builds of Comet with Spark 4.0.0 [datafusion-comet] via GitHub
• Re: [I] [Feature] Support Spark expression: map_sort [datafusion-comet] via GitHub
• Re: [I] Add support for `MapSort` expression in Spark 4.0.0 [datafusion-comet] via GitHub
• [PR] docs: update Spark version support and add version compatibility page [datafusion-comet] via GitHub
  • Re: [PR] docs: update Spark version support and add version compatibility page [datafusion-comet] via GitHub
  • Re: [PR] docs: update Spark version support and add version compatibility page [datafusion-comet] via GitHub
• [I] Allow pickling PyExpr [datafusion-python] via GitHub
  • Re: [I] Allow pickling PyExpr [datafusion-python] via GitHub
• [I] CachedBatchSerializerNoUnwrapSuite: Comet replaces WholeStageCodegenExec [datafusion-comet] via GitHub
• [I] Comet native scan returns wrong schema for missing struct fields in Parquet [datafusion-comet] via GitHub
  • Re: [I] Comet native scan returns wrong schema for missing struct fields in Parquet [datafusion-comet] via GitHub
  • Re: [I] Comet native scan returns wrong schema for missing struct fields in Parquet [datafusion-comet] via GitHub
  • Re: [I] Comet native scan returns wrong schema for missing struct fields in Parquet [datafusion-comet] via GitHub
• [PR] chore: fix typos [datafusion] via GitHub
  • Re: [PR] chore: fix `iff` typos [datafusion] via GitHub
  • Re: [PR] chore: fix `iff` typos [datafusion] via GitHub
  • Re: [PR] chore: fix `iff` typos [datafusion] via GitHub
  • Re: [PR] chore: fix `iff` typos [datafusion] via GitHub
• [PR] ci: ignore dev/ changes except dev/diffs in workflows [datafusion-comet] via GitHub
• [PR] chore: support Spark 4.1/4.2 for golden files generation [datafusion-comet] via GitHub
  • Re: [PR] chore: support Spark 4.1/4.2 for golden files generation [datafusion-comet] via GitHub
  • Re: [PR] chore: support Spark 4.1/4.2 for golden files generation [datafusion-comet] via GitHub
  • Re: [PR] chore: support Spark 4.1/4.2 for golden files generation [datafusion-comet] via GitHub
• [PR] Move to skill directory [datafusion-python] via GitHub
  • Re: [PR] Move public skills to a directory to avoid downloading the whole repo [datafusion-python] via GitHub
• [I] datafusion-python skill includes all the source from the repo [datafusion-python] via GitHub
  • Re: [I] datafusion-python skill includes all the source from the repo [datafusion-python] via GitHub
  • Re: [I] datafusion-python skill includes all the source from the repo [datafusion-python] via GitHub
  • Re: [I] datafusion-python skill includes all the source from the repo [datafusion-python] via GitHub
• [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
  • Re: [PR] add any_match higher-order function [datafusion] via GitHub
• [PR] Update `astral-tokio-tar` to appease cargo_audit [datafusion] via GitHub
  • Re: [PR] Update `astral-tokio-tar` to appease cargo_audit [datafusion] via GitHub
  • Re: [PR] Update `astral-tokio-tar` to appease cargo_audit [datafusion] via GitHub
  • Re: [PR] Update `astral-tokio-tar` to appease cargo_audit [datafusion] via GitHub
• [I] security_audit is failing on main [datafusion] via GitHub
  • Re: [I] security_audit is failing on main [datafusion] via GitHub
  • Re: [I] security_audit is failing on main [datafusion] via GitHub
  • Re: [I] security_audit is failing on main [datafusion] via GitHub
• [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
  • Re: [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
  • Re: [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
  • Re: [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
  • Re: [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
  • Re: [PR] feat: SchedulerConfig improvement [datafusion-ballista] via GitHub
• [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
  • Re: [PR] perf: strength reduce hash partition modulo (up to 1.16x faster) [datafusion] via GitHub
• Re: [PR] chore(infra): remove build-macos-x86_64 [datafusion-ballista] via GitHub
  • Re: [PR] chore(infra): remove build-macos-x86_64 [datafusion-ballista] via GitHub
• [PR] docs: add contributor guide for bringing up a new Spark version [datafusion-comet] via GitHub
• [PR] Remove unnecessary Mutex in SharedMemoryReservation [datafusion] via GitHub
  • Re: [PR] Remove unnecessary Mutex in SharedMemoryReservation [datafusion] via GitHub
  • Re: [PR] Remove unnecessary Mutex in SharedMemoryReservation [datafusion] via GitHub
• Re: [I] Task metrics (bytes read) for CometIcebergNativeScan [datafusion-comet] via GitHub
• Re: [I] Add Native Support for List Functions (Dependent on Lambda Support) [datafusion] via GitHub
• [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
  • Re: [PR] test(sqllogictest): stabilize parquet output_rows_skew with WITH ORDER [datafusion] via GitHub
• [I] Improve the partition skew test coverage [datafusion] via GitHub
  • Re: [I] Improve the partition skew test coverage [datafusion] via GitHub
  • Re: [I] Improve the partition skew test coverage [datafusion] via GitHub
  • Re: [I] Improve the partition skew test coverage [datafusion] via GitHub
• [PR] feat: minor lambda perf improvements [datafusion] via GitHub
  • Re: [PR] feat: minor lambda perf improvements [datafusion] via GitHub
  • Re: [PR] feat: minor lambda perf improvements [datafusion] via GitHub
  • Re: [PR] feat: minor lambda perf improvements [datafusion] via GitHub
  • Re: [PR] feat: minor lambda perf improvements [datafusion] via GitHub
  • Re: [PR] feat: minor lambda perf improvements [datafusion] via GitHub
• Re: [PR] docs: support conditional content for snapshot vs release builds [datafusion-comet] via GitHub
  • Re: [PR] docs: support conditional content for snapshot vs release builds [datafusion-comet] via GitHub
• Re: [PR] added support for MapFromEntries [datafusion] via GitHub
  • Re: [PR] added support for MapFromEntries [datafusion] via GitHub
  • Re: [PR] added support for MapFromEntries [datafusion] via GitHub
• Re: [I] Make `GenericDistinctBuffer` generic over both `Hashable` and native types [datafusion] via GitHub
• [PR] feat(sort-shuffle): byte-copy spill files into consolidated output [datafusion-ballista] via GitHub
  • Re: [PR] feat(sort-shuffle): byte-copy spill files and enable block-IO transport [datafusion-ballista] via GitHub
  • Re: [PR] feat(sort-shuffle): byte-copy spill files and enable block-IO transport [datafusion-ballista] via GitHub
  • Re: [PR] feat(sort-shuffle): byte-copy spill files and enable block-IO transport [datafusion-ballista] via GitHub
  • Re: [PR] feat(sort-shuffle): byte-copy spill files and enable block-IO transport [datafusion-ballista] via GitHub

• Earlier messages
• Later messages