dependabot[bot] opened a new pull request, #1313: URL: https://github.com/apache/datafusion-python/pull/1313
Bumps [arrow-select](https://github.com/apache/arrow-rs) from 56.2.0 to 57.1.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/releases";>arrow-select's releases</a>.</em></p> <blockquote> <h2>arrow 57.1.0</h2> <!-- raw HTML omitted --> <h1>Changelog</h1> <h2><a href="https://github.com/apache/arrow-rs/tree/57.1.0";>57.1.0</a> (2025-11-20)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/57.0.0...57.1.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Eliminate bound checks in filter kernels <a href="https://redirect.github.com/apache/arrow-rs/issues/8865";>#8865</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Respect page index policy option for ParquetObjectReader when it's not skip <a href="https://redirect.github.com/apache/arrow-rs/issues/8856";>#8856</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Speed up collect_bool and remove <code>unsafe</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8848";>#8848</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Error reading parquet FileMetaData with empty lists encoded as element-type=0 <a href="https://redirect.github.com/apache/arrow-rs/issues/8826";>#8826</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>ValueStatistics methods can't be used from generic context in external crate <a href="https://redirect.github.com/apache/arrow-rs/issues/8823";>#8823</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Custom Pretty-Printing Implementation for Column when Formatting Record Batches <a href="https://redirect.github.com/apache/arrow-rs/issues/8821";>#8821</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Parquet-concat: supports bloom filter and page index <a href="https://redirect.github.com/apache/arrow-rs/issues/8804";>#8804</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Parquet] virtual row group number support <a href="https://redirect.github.com/apache/arrow-rs/issues/8800";>#8800</a></li> <li>[Variant] Enforce shredded-type validation in <code>shred_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8795";>#8795</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Simplify decision logic to call <code>FilterBuilder::optimize</code> or not <a href="https://redirect.github.com/apache/arrow-rs/issues/8781";>#8781</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Add variant to arrow for DataType::{Binary, LargeBinary, BinaryView} <a href="https://redirect.github.com/apache/arrow-rs/issues/8767";>#8767</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Provide algorithm that allows zipping arrays whose values are not prealigned <a href="https://redirect.github.com/apache/arrow-rs/issues/8752";>#8752</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet] ParquetMetadataReader decodes too much metadata under point-get scenerio <a href="https://redirect.github.com/apache/arrow-rs/issues/8751";>#8751</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li><code>arrow-json</code> supports encoding binary arrays, but not decoding <a href="https://redirect.github.com/apache/arrow-rs/issues/8736";>#8736</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Allow <code>FilterPredicate</code> instances to be reused for RecordBatches <a href="https://redirect.github.com/apache/arrow-rs/issues/8692";>#8692</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>ArrowJsonBatch::from_batch is incomplete <a href="https://redirect.github.com/apache/arrow-rs/issues/8684";>#8684</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet-layout: More info about layout including footer size, page index, bloom filter? <a href="https://redirect.github.com/apache/arrow-rs/issues/8682";>#8682</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Rewrite <code>ParquetRecordBatchStream</code> (async API) in terms of the PushDecoder <a href="https://redirect.github.com/apache/arrow-rs/issues/8677";>#8677</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[JSON] Add encoding for binary view <a href="https://redirect.github.com/apache/arrow-rs/issues/8674";>#8674</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Refactor arrow-cast decimal casting to unify the rescale logic used in Parquet variant casts <a href="https://redirect.github.com/apache/arrow-rs/issues/8670";>#8670</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Support Uuid/<code>FixedSizeBinary(16)</code> shredding <a href="https://redirect.github.com/apache/arrow-rs/issues/8665";>#8665</a></li> <li>[Parquet]There should be an encoding counter to know how many encodings the repo supports in total <a href="https://redirect.github.com/apache/arrow-rs/issues/8662";>#8662</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/main/CHANGELOG.md";>arrow-select's changelog</a>.</em></p> <blockquote> <h2><a href="https://github.com/apache/arrow-rs/tree/57.1.0";>57.1.0</a> (2025-11-20)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/57.0.0...57.1.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Eliminate bound checks in filter kernels <a href="https://redirect.github.com/apache/arrow-rs/issues/8865";>#8865</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Respect page index policy option for ParquetObjectReader when it's not skip <a href="https://redirect.github.com/apache/arrow-rs/issues/8856";>#8856</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Speed up collect_bool and remove <code>unsafe</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8848";>#8848</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Error reading parquet FileMetaData with empty lists encoded as element-type=0 <a href="https://redirect.github.com/apache/arrow-rs/issues/8826";>#8826</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>ValueStatistics methods can't be used from generic context in external crate <a href="https://redirect.github.com/apache/arrow-rs/issues/8823";>#8823</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Custom Pretty-Printing Implementation for Column when Formatting Record Batches <a href="https://redirect.github.com/apache/arrow-rs/issues/8821";>#8821</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Parquet-concat: supports bloom filter and page index <a href="https://redirect.github.com/apache/arrow-rs/issues/8804";>#8804</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Parquet] virtual row number support <a href="https://redirect.github.com/apache/arrow-rs/issues/7299";>#7299</a></li> <li>[Variant] Enforce shredded-type validation in <code>shred_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8795";>#8795</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Simplify decision logic to call <code>FilterBuilder::optimize</code> or not <a href="https://redirect.github.com/apache/arrow-rs/issues/8781";>#8781</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Add variant to arrow for DataType::{Binary, LargeBinary, BinaryView} <a href="https://redirect.github.com/apache/arrow-rs/issues/8767";>#8767</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Provide algorithm that allows zipping arrays whose values are not prealigned <a href="https://redirect.github.com/apache/arrow-rs/issues/8752";>#8752</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet] ParquetMetadataReader decodes too much metadata under point-get scenerio <a href="https://redirect.github.com/apache/arrow-rs/issues/8751";>#8751</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li><code>arrow-json</code> supports encoding binary arrays, but not decoding <a href="https://redirect.github.com/apache/arrow-rs/issues/8736";>#8736</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Allow <code>FilterPredicate</code> instances to be reused for RecordBatches <a href="https://redirect.github.com/apache/arrow-rs/issues/8692";>#8692</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>ArrowJsonBatch::from_batch is incomplete <a href="https://redirect.github.com/apache/arrow-rs/issues/8684";>#8684</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet-layout: More info about layout including footer size, page index, bloom filter? <a href="https://redirect.github.com/apache/arrow-rs/issues/8682";>#8682</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Rewrite <code>ParquetRecordBatchStream</code> (async API) in terms of the PushDecoder <a href="https://redirect.github.com/apache/arrow-rs/issues/8677";>#8677</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[JSON] Add encoding for binary view <a href="https://redirect.github.com/apache/arrow-rs/issues/8674";>#8674</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Refactor arrow-cast decimal casting to unify the rescale logic used in Parquet variant casts <a href="https://redirect.github.com/apache/arrow-rs/issues/8670";>#8670</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Support Uuid/<code>FixedSizeBinary(16)</code> shredding <a href="https://redirect.github.com/apache/arrow-rs/issues/8665";>#8665</a></li> <li>[Parquet]There should be an encoding counter to know how many encodings the repo supports in total <a href="https://redirect.github.com/apache/arrow-rs/issues/8662";>#8662</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Improve <code>parse_data_type</code> for <code>List</code>, <code>ListView</code>, <code>LargeList</code>, <code>LargeListView</code>, <code>FixedSizeList</code>, <code>Union</code>, <code>Map</code>, <code>RunEndCoded</code>. <a href="https://redirect.github.com/apache/arrow-rs/issues/8648";>#8648</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Support variant to arrow primitive support null/time/decimal_* <a href="https://redirect.github.com/apache/arrow-rs/issues/8637";>#8637</a></li> <li>Return error from <code>RleDecoder::reset</code> rather than panic <a href="https://redirect.github.com/apache/arrow-rs/issues/8632";>#8632</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Add bitwise ops on <code>BooleanBufferBuilder</code> and <code>MutableBuffer</code> that mutate directly the buffer <a href="https://redirect.github.com/apache/arrow-rs/issues/8618";>#8618</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Add variant_to_arrow Utf-8, LargeUtf8, Utf8View types support <a href="https://redirect.github.com/apache/arrow-rs/issues/8567";>#8567</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> </ul> <p><strong>Fixed bugs:</strong></p> <ul> <li>Regression: Parsing <code>List(Int64)</code> results in nullable list in 57.0.0 and a non-nullable list in 57.1.0 <a href="https://redirect.github.com/apache/arrow-rs/issues/8883";>#8883</a></li> <li>Regression: FixedSlizeList data type parsing fails on 57.1.0 <a href="https://redirect.github.com/apache/arrow-rs/issues/8880";>#8880</a></li> <li>(dyn ArrayFormatterFactory + 'static) can't be safely shared between threads <a href="https://redirect.github.com/apache/arrow-rs/issues/8875";>#8875</a></li> <li>RowNumber reader has wrong row group ordering <a href="https://redirect.github.com/apache/arrow-rs/issues/8864";>#8864</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li><code>ThriftMetadataWriter::write_column_indexes</code> cannot handle a <code>ColumnIndexMetaData::NONE</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8815";>#8815</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>"Archery test With other arrows" Integration test failing on main: <a href="https://redirect.github.com/apache/arrow-rs/issues/8813";>#8813</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet] Writing in 57.0.0 seems 10% slower than 56.0.0 <a href="https://redirect.github.com/apache/arrow-rs/issues/8783";>#8783</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Parquet reader cannot handle files with unknown logical types <a href="https://redirect.github.com/apache/arrow-rs/issues/8776";>#8776</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>zip now treats nulls as false in provided mask regardless of the underlying bit value <a href="https://redirect.github.com/apache/arrow-rs/issues/8721";>#8721</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[avro] Incorrect version in crate.io landing page <a href="https://redirect.github.com/apache/arrow-rs/issues/8691";>#8691</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Array: ViewType gc() has bug when array sum length exceed i32::MAX <a href="https://redirect.github.com/apache/arrow-rs/issues/8681";>#8681</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Parquet 56: encounter <code>error: item_reader def levels are None</code> when reading nested field with row filter <a href="https://redirect.github.com/apache/arrow-rs/issues/8657";>#8657</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Degnerate and non-nullable <code>FixedSizeListArray</code>s are not handled <a href="https://redirect.github.com/apache/arrow-rs/issues/8623";>#8623</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Parquet]Performance Degradation with RowFilter on Unsorted Columns due to Fragmented ReadPlan <a href="https://redirect.github.com/apache/arrow-rs/issues/8565";>#8565</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/arrow-rs/commit/779e9bd2ee43d7d882782e6bf6a11ee0944af229";><code>779e9bd</code></a> Prepare for 57.1.0 release: Changelog and Version (<a href="https://redirect.github.com/apache/arrow-rs/issues/8874";>#8874</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/ed9efe78e4cc958cc96707557818e754419debb0";><code>ed9efe7</code></a> Fix regression caused by changes in Display for DataType - display (`List(non...</li> <li><a href="https://github.com/apache/arrow-rs/commit/21e9ceb58612a540f19e44b139b490bf81f7d0f2";><code>21e9ceb</code></a> Support parsing for old style FixedSizeList (<a href="https://redirect.github.com/apache/arrow-rs/issues/8882";>#8882</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/fea605cb16f7524cb69a197bfa581a1d4f5fe5d0";><code>fea605c</code></a> [Variant] Fix cast logic for Variant to Arrow for DataType::Null (<a href="https://redirect.github.com/apache/arrow-rs/issues/8825";>#8825</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/66752048ced2903dde4e748b065078467a2c9d92";><code>6675204</code></a> Make ArrayFormatterFactory Send + Sync and add a test (<a href="https://redirect.github.com/apache/arrow-rs/issues/8878";>#8878</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d1a428cfbac756fea58b2c58d44b4eb385feccc2";><code>d1a428c</code></a> Speed up filter some more (up to 2x) (<a href="https://redirect.github.com/apache/arrow-rs/issues/8868";>#8868</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/b5c831a1d90b0c5a20f974c3d1c2bda776026f96";><code>b5c831a</code></a> Allow Users to Provide Custom <code>ArrayFormatter</code>s when Pretty-Printing Record B...</li> <li><a href="https://github.com/apache/arrow-rs/commit/389f404004117411b27d13fddbaa9e3df1391214";><code>389f404</code></a> Fix errors when reading nested Lists with pushdown predicates. (<a href="https://redirect.github.com/apache/arrow-rs/issues/8866";>#8866</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/0dcc401820e6695c02e3f6b638c59332adb94bcd";><code>0dcc401</code></a> Make <code>ArrowReaderOptions::with_virtual_columns</code> error rather than panic on in...</li> <li><a href="https://github.com/apache/arrow-rs/commit/c5c8076398d62780b0c192c59a784e6196016ab8";><code>c5c8076</code></a> docs: Add examples for creating MutableBuffer from Vec (<a href="https://redirect.github.com/apache/arrow-rs/issues/8852";>#8852</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/56.2.0...57.1.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
