dependabot[bot] opened a new pull request, #1304: URL: https://github.com/apache/datafusion-python/pull/1304
Bumps [arrow-select](https://github.com/apache/arrow-rs) from 56.2.0 to 57.0.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/releases";>arrow-select's releases</a>.</em></p> <blockquote> <h2>arrow 57.0.0</h2> <!-- raw HTML omitted --> <h1>Changelog</h1> <h2><a href="https://github.com/apache/arrow-rs/tree/57.0.0";>57.0.0</a> (2025-10-19)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/56.2.0...57.0.0";>Full Changelog</a></p> <p><strong>Breaking changes:</strong></p> <ul> <li>Use <code>Arc<FileEncryptionProperties></code> everywhere to be be consistent with <code>FileDecryptionProperties</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8626";>#8626</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/alamb";>alamb</a>)</li> <li>feat: Improve DataType display for <code>RunEndEncoded</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8596";>#8596</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Add <code>ArrowError::AvroError</code>, remaining types and roundtrip tests to <code>arrow-avro</code>, <a href="https://redirect.github.com/apache/arrow-rs/pull/8595";>#8595</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/jecsand838";>jecsand838</a>)</li> <li>[thrift-remodel] Refactor Thrift encryption and store encodings as bitmask <a href="https://redirect.github.com/apache/arrow-rs/pull/8587";>#8587</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>feat: Enhance <code>Map</code> display formatting in DataType <a href="https://redirect.github.com/apache/arrow-rs/pull/8570";>#8570</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>feat: Enhance DataType display formatting for <code>ListView</code> and <code>LargeListView</code> variants <a href="https://redirect.github.com/apache/arrow-rs/pull/8569";>#8569</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Use custom thrift parser for parquet metadata (phase 1 of Thrift remodel) <a href="https://redirect.github.com/apache/arrow-rs/pull/8530";>#8530</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>refactor: improve display formatting for Union <a href="https://redirect.github.com/apache/arrow-rs/pull/8529";>#8529</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Use <code>Arc<FileDecryptionProperties></code> to reduce size of ParquetMetadata and avoid copying when <code>encryption</code> is enabled <a href="https://redirect.github.com/apache/arrow-rs/pull/8470";>#8470</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/alamb";>alamb</a>)</li> <li>Fix for column name based projection mask creation <a href="https://redirect.github.com/apache/arrow-rs/pull/8447";>#8447</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>Improve Display formatting of DataType::Timestamp <a href="https://redirect.github.com/apache/arrow-rs/pull/8425";>#8425</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Use more compact Debug formatting of Field <a href="https://redirect.github.com/apache/arrow-rs/pull/8424";>#8424</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Reuse zstd compression context when writing IPC <a href="https://redirect.github.com/apache/arrow-rs/pull/8405";>#8405</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow-flight";>arrow-flight</a>] (<a href="https://github.com/albertlockett";>albertlockett</a>)</li> <li>[Decimal] Add scale argument to validation functions to ensure accurate error logging <a href="https://redirect.github.com/apache/arrow-rs/pull/8396";>#8396</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Quote <code>DataType::Struct</code> field names in <code>Display</code> formatting <a href="https://redirect.github.com/apache/arrow-rs/pull/8291";>#8291</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Improve <code>Display</code> for <code>DataType</code> and <code>Field</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8290";>#8290</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Bump pyo3 to 0.26.0 <a href="https://redirect.github.com/apache/arrow-rs/pull/8286";>#8286</a> (<a href="https://github.com/mbrobbel";>mbrobbel</a>)</li> </ul> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Added Avro support (new <code>arrow-avro</code> crate) <a href="https://redirect.github.com/apache/arrow-rs/issues/4886";>#4886</a></li> <li>parquet-rewrite: supports compression level and write batch size <a href="https://redirect.github.com/apache/arrow-rs/issues/8639";>#8639</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/main/CHANGELOG.md";>arrow-select's changelog</a>.</em></p> <blockquote> <h2><a href="https://github.com/apache/arrow-rs/tree/57.0.0";>57.0.0</a> (2025-10-19)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/56.2.0...57.0.0";>Full Changelog</a></p> <p><strong>Breaking changes:</strong></p> <ul> <li>Use <code>Arc<FileEncryptionProperties></code> everywhere to be be consistent with <code>FileDecryptionProperties</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8626";>#8626</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/alamb";>alamb</a>)</li> <li>feat: Improve DataType display for <code>RunEndEncoded</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8596";>#8596</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Add <code>ArrowError::AvroError</code>, remaining types and roundtrip tests to <code>arrow-avro</code>, <a href="https://redirect.github.com/apache/arrow-rs/pull/8595";>#8595</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/jecsand838";>jecsand838</a>)</li> <li>[thrift-remodel] Refactor Thrift encryption and store encodings as bitmask <a href="https://redirect.github.com/apache/arrow-rs/pull/8587";>#8587</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>feat: Enhance <code>Map</code> display formatting in DataType <a href="https://redirect.github.com/apache/arrow-rs/pull/8570";>#8570</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>feat: Enhance DataType display formatting for <code>ListView</code> and <code>LargeListView</code> variants <a href="https://redirect.github.com/apache/arrow-rs/pull/8569";>#8569</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Use custom thrift parser for parquet metadata (phase 1 of Thrift remodel) <a href="https://redirect.github.com/apache/arrow-rs/pull/8530";>#8530</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>refactor: improve display formatting for Union <a href="https://redirect.github.com/apache/arrow-rs/pull/8529";>#8529</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Use <code>Arc<FileDecryptionProperties></code> to reduce size of ParquetMetadata and avoid copying when <code>encryption</code> is enabled <a href="https://redirect.github.com/apache/arrow-rs/pull/8470";>#8470</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/alamb";>alamb</a>)</li> <li>Fix for column name based projection mask creation <a href="https://redirect.github.com/apache/arrow-rs/pull/8447";>#8447</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/etseidl";>etseidl</a>)</li> <li>Improve Display formatting of DataType::Timestamp <a href="https://redirect.github.com/apache/arrow-rs/pull/8425";>#8425</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Use more compact Debug formatting of Field <a href="https://redirect.github.com/apache/arrow-rs/pull/8424";>#8424</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Reuse zstd compression context when writing IPC <a href="https://redirect.github.com/apache/arrow-rs/pull/8405";>#8405</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow-flight";>arrow-flight</a>] (<a href="https://github.com/albertlockett";>albertlockett</a>)</li> <li>[Decimal] Add scale argument to validation functions to ensure accurate error logging <a href="https://redirect.github.com/apache/arrow-rs/pull/8396";>#8396</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Weijun-H";>Weijun-H</a>)</li> <li>Quote <code>DataType::Struct</code> field names in <code>Display</code> formatting <a href="https://redirect.github.com/apache/arrow-rs/pull/8291";>#8291</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Improve <code>Display</code> for <code>DataType</code> and <code>Field</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/8290";>#8290</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/emilk";>emilk</a>)</li> <li>Bump pyo3 to 0.26.0 <a href="https://redirect.github.com/apache/arrow-rs/pull/8286";>#8286</a> (<a href="https://github.com/mbrobbel";>mbrobbel</a>)</li> </ul> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Added Avro support (new <code>arrow-avro</code> crate) <a href="https://redirect.github.com/apache/arrow-rs/issues/4886";>#4886</a></li> <li>parquet-rewrite: supports compression level and write batch size <a href="https://redirect.github.com/apache/arrow-rs/issues/8639";>#8639</a></li> <li>Error not panic when int96 stastistics aren't size 12 <a href="https://redirect.github.com/apache/arrow-rs/issues/8614";>#8614</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Variant] Make <code>VariantArray</code> iterable <a href="https://redirect.github.com/apache/arrow-rs/issues/8612";>#8612</a></li> <li>[Variant] impl <code>PartialEq</code> for <code>VariantArray</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8610";>#8610</a></li> <li>[Variant] Remove potential panics when probing <code>VariantArray</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8609";>#8609</a></li> <li>[Variant] Remove ceremony of going from list of <code>Variant</code> to <code>VariantArray</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8606";>#8606</a></li> <li>Eliminate redundant validation in <code>RecordBatch::project</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8591";>#8591</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[PARQUET][BENCH] Arrow writer bench with compression and/or page v2 <a href="https://redirect.github.com/apache/arrow-rs/issues/8559";>#8559</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Variant] casting functions are confusingly named <a href="https://redirect.github.com/apache/arrow-rs/issues/8531";>#8531</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Support writing GeospatialStatistics in Parquet writer <a href="https://redirect.github.com/apache/arrow-rs/issues/8523";>#8523</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[thrift-remodel] Optimize <code>convert_row_groups</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8517";>#8517</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Variant] Add variant to arrow primitive support for boolean/timestamp/time <a href="https://redirect.github.com/apache/arrow-rs/issues/8515";>#8515</a></li> <li>Test <code>thrift-remodel</code> branch with DataFusion <a href="https://redirect.github.com/apache/arrow-rs/issues/8513";>#8513</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Make <code>UnionArray::is_dense</code> Method Public <a href="https://redirect.github.com/apache/arrow-rs/issues/8503";>#8503</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Add <code>append_n</code> method to <code>FixedSizeBinaryDictionaryBuilder</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8497";>#8497</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet] Reduce size of ParquetMetadata when encryption feature is enabled <a href="https://redirect.github.com/apache/arrow-rs/issues/8469";>#8469</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Parquet] Remove useless mut requirements in geting bloom filter function <a href="https://redirect.github.com/apache/arrow-rs/issues/8461";>#8461</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Change <code>serde</code> dependency to <code>serde_core</code> where applicable <a href="https://redirect.github.com/apache/arrow-rs/issues/8451";>#8451</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet] Split <code>ParquetMetadataReader</code> into IO/decoder state machine and thrift parsing <a href="https://redirect.github.com/apache/arrow-rs/issues/8439";>#8439</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Remove compiler warning for redundant config enablement <a href="https://redirect.github.com/apache/arrow-rs/issues/8412";>#8412</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Add geospatial statistics creation support for GEOMETRY/GEOGRAPHY Parquet logical types <a href="https://redirect.github.com/apache/arrow-rs/issues/8411";>#8411</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li><code>arrow_json</code> lacks <code>with_timestamp_format</code> functions like <code>arrow_csv</code> had offered <a href="https://redirect.github.com/apache/arrow-rs/issues/8398";>#8398</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Unify API for writing column chunks / row groups in parallel <a href="https://redirect.github.com/apache/arrow-rs/issues/8389";>#8389</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/arrow-rs/commit/5faa7248bd0d2efec9e072c3f58014691c4bddf3";><code>5faa724</code></a> Prepare for <code>57.0.0</code> release (<a href="https://redirect.github.com/apache/arrow-rs/issues/8644";>#8644</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/0c33129b890027b6d421fdfe153e192196b65ad9";><code>0c33129</code></a> parquet-rewrite: add write_batch_size and compression_level config (<a href="https://redirect.github.com/apache/arrow-rs/issues/8642";>#8642</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/2f96204ec4a38246bd14ed9b45252498326a5b27";><code>2f96204</code></a> Adding <code>try_append_value</code> implementation to <code>ByteViewBuilder</code> (<a href="https://redirect.github.com/apache/arrow-rs/issues/8594";>#8594</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/f131b5469655c2a1afc3b23ce5e3f850d6a389cf";><code>f131b54</code></a> bench: create <code>zip</code> kernel benchmarks (<a href="https://redirect.github.com/apache/arrow-rs/issues/8654";>#8654</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d49f017fe1c6712ba32e2222c6f031278b588ca5";><code>d49f017</code></a> Introduce a ThriftProtocolError to avoid allocating and formattings strings f...</li> <li><a href="https://github.com/apache/arrow-rs/commit/a85d8b025610ad7eea2266cb4ac383f7fd0c767e";><code>a85d8b0</code></a> [Variant] impl <code>PartialEq</code> and <code>FromIterator\<Option<..>></code> for <code>VariantArray</code> ...</li> <li><a href="https://github.com/apache/arrow-rs/commit/2ca3d609cc99e0c153d1ab2e62af16a4b3f79a12";><code>2ca3d60</code></a> fix: incorrect assertion in <code>BitChunks::new</code> (<a href="https://redirect.github.com/apache/arrow-rs/issues/8620";>#8620</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/5a384f4c3ccd397dcb8763d89e958da3fa4c666c";><code>5a384f4</code></a> Undeprecate <code>ArrowWriter::into_serialized_writer</code> and add docs (<a href="https://redirect.github.com/apache/arrow-rs/issues/8621";>#8621</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/f3baa809ef1a21fcfa23268ec7c92896353d94f2";><code>f3baa80</code></a> [thrift-remodel] Add macro to reduce boilerplate necessary to implement Thrif...</li> <li><a href="https://github.com/apache/arrow-rs/commit/caeb4d2e88fb0fea57f1d30b139be1fd6195f174";><code>caeb4d2</code></a> feat: Improve DataType display for <code>RunEndEncoded</code> (<a href="https://redirect.github.com/apache/arrow-rs/issues/8596";>#8596</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/56.2.0...57.0.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
