dependabot[bot] opened a new pull request, #1630: URL: https://github.com/apache/datafusion-python/pull/1630
Bumps [arrow-schema](https://github.com/apache/arrow-rs) from 58.3.0 to 59.1.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/releases";>arrow-schema's releases</a>.</em></p> <blockquote> <h2>arrow 59.1.0</h2> <!-- raw HTML omitted --> <h1>Changelog</h1> <h2><a href="https://github.com/apache/arrow-rs/tree/59.1.0";>59.1.0</a> (2026-07-03)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/59.0.0...59.1.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Fast path for nested <code>DictionaryArray</code> casting <a href="https://redirect.github.com/apache/arrow-rs/issues/10247";>#10247</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet/arrow: reading multiple nested columns fails with "Not all children array length are the same!" when a list continues across DataPageV2 page boundary <a href="https://redirect.github.com/apache/arrow-rs/issues/10243";>#10243</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Add product aggregate kernel to arrow-rs <a href="https://redirect.github.com/apache/arrow-rs/issues/10150";>#10150</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Stricter <code>DataType</code> parsing <a href="https://redirect.github.com/apache/arrow-rs/issues/10146";>#10146</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Support validating CSV headers against Schema <a href="https://redirect.github.com/apache/arrow-rs/issues/10143";>#10143</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>arrow-ipc: Supports compression level configuration for arrow-ipc writer <a href="https://redirect.github.com/apache/arrow-rs/issues/10132";>#10132</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] <code>VariantArray</code> field API naming <a href="https://redirect.github.com/apache/arrow-rs/issues/10093";>#10093</a></li> <li>Add <code>StructArray::field_</code> APIs symmetric to <code>StructArray::column_</code> ones <a href="https://redirect.github.com/apache/arrow-rs/issues/10092";>#10092</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>arrow-buffer: implement Saturating, CheckedShl, Not num-traits for i256 <a href="https://redirect.github.com/apache/arrow-rs/issues/10087";>#10087</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>feat: native concat for <code>MapArray</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/10047";>#10047</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Add <code>variant_to_arrow</code> <code>Dictionary/REE</code> type support <a href="https://redirect.github.com/apache/arrow-rs/issues/10013";>#10013</a></li> </ul> <p><strong>Fixed bugs:</strong></p> <ul> <li>arrow-row on fixed size binary/list with size 0 and no nulls return wrong length <a href="https://redirect.github.com/apache/arrow-rs/issues/10270";>#10270</a></li> <li>casting list to 0-size fixedsizelist can cause incorrect output length <a href="https://redirect.github.com/apache/arrow-rs/issues/10227";>#10227</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Buffer count mismatched with metadata when encoding records with dictionary of dictionaries <a href="https://redirect.github.com/apache/arrow-rs/issues/10213";>#10213</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li><code>Buffer::into_mutable</code> is not consistent regarding sliced data and can lead to panics <a href="https://redirect.github.com/apache/arrow-rs/issues/10117";>#10117</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet_derive: cannot read or write columns whose name is a Rust keyword (raw identifiers like r#type become column "r#type") <a href="https://redirect.github.com/apache/arrow-rs/issues/10112";>#10112</a></li> <li>parquet: fix OffsetBuffer panic on corrupt input <a href="https://redirect.github.com/apache/arrow-rs/issues/10107";>#10107</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Parquet geospatial conversion uses metadata key "algorithm" instead of "edges" in geoarrow metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/9929";>#9929</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/main/CHANGELOG.md";>arrow-schema's changelog</a>.</em></p> <blockquote> <h2><a href="https://github.com/apache/arrow-rs/tree/59.1.0";>59.1.0</a> (2026-07-03)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/59.0.0...59.1.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>Fast path for nested <code>DictionaryArray</code> casting <a href="https://redirect.github.com/apache/arrow-rs/issues/10247";>#10247</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet/arrow: reading multiple nested columns fails with "Not all children array length are the same!" when a list continues across DataPageV2 page boundary <a href="https://redirect.github.com/apache/arrow-rs/issues/10243";>#10243</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Add product aggregate kernel to arrow-rs <a href="https://redirect.github.com/apache/arrow-rs/issues/10150";>#10150</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Stricter <code>DataType</code> parsing <a href="https://redirect.github.com/apache/arrow-rs/issues/10146";>#10146</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Support validating CSV headers against Schema <a href="https://redirect.github.com/apache/arrow-rs/issues/10143";>#10143</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>arrow-ipc: Supports compression level configuration for arrow-ipc writer <a href="https://redirect.github.com/apache/arrow-rs/issues/10132";>#10132</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] <code>VariantArray</code> field API naming <a href="https://redirect.github.com/apache/arrow-rs/issues/10093";>#10093</a></li> <li>Add <code>StructArray::field_</code> APIs symmetric to <code>StructArray::column_</code> ones <a href="https://redirect.github.com/apache/arrow-rs/issues/10092";>#10092</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>arrow-buffer: implement Saturating, CheckedShl, Not num-traits for i256 <a href="https://redirect.github.com/apache/arrow-rs/issues/10087";>#10087</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>feat: native concat for <code>MapArray</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/10047";>#10047</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>[Variant] Add <code>variant_to_arrow</code> <code>Dictionary/REE</code> type support <a href="https://redirect.github.com/apache/arrow-rs/issues/10013";>#10013</a></li> </ul> <p><strong>Fixed bugs:</strong></p> <ul> <li>arrow-row on fixed size binary/list with size 0 and no nulls return wrong length <a href="https://redirect.github.com/apache/arrow-rs/issues/10270";>#10270</a></li> <li>casting list to 0-size fixedsizelist can cause incorrect output length <a href="https://redirect.github.com/apache/arrow-rs/issues/10227";>#10227</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Buffer count mismatched with metadata when encoding records with dictionary of dictionaries <a href="https://redirect.github.com/apache/arrow-rs/issues/10213";>#10213</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li><code>Buffer::into_mutable</code> is not consistent regarding sliced data and can lead to panics <a href="https://redirect.github.com/apache/arrow-rs/issues/10117";>#10117</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>parquet_derive: cannot read or write columns whose name is a Rust keyword (raw identifiers like r#type become column "r#type") <a href="https://redirect.github.com/apache/arrow-rs/issues/10112";>#10112</a></li> <li>parquet: fix OffsetBuffer panic on corrupt input <a href="https://redirect.github.com/apache/arrow-rs/issues/10107";>#10107</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>Parquet geospatial conversion uses metadata key "algorithm" instead of "edges" in geoarrow metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/9929";>#9929</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <p><strong>Documentation updates:</strong></p> <ul> <li>doc: More comments to <code>concat_batches</code> <a href="https://redirect.github.com/apache/arrow-rs/pull/10178";>#10178</a> (<a href="https://github.com/2010YOUY01";>2010YOUY01</a>)</li> <li>Minor: improve PageStore docs with a temp-file spilling example <a href="https://redirect.github.com/apache/arrow-rs/pull/10074";>#10074</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/alamb";>alamb</a>)</li> </ul> <p><strong>Performance improvements:</strong></p> <ul> <li>perf: interleave_list for List<Primitive> could be optimized? <a href="https://redirect.github.com/apache/arrow-rs/issues/10022";>#10022</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>perf(arrow-ord): Avoid full index materialization for small-limit lexsorts <a href="https://redirect.github.com/apache/arrow-rs/issues/9990";>#9990</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>]</li> <li>Replace conversion of binary->string in arrow-row from arraydata to direct construction <a href="https://redirect.github.com/apache/arrow-rs/pull/10261";>#10261</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Jefffrey";>Jefffrey</a>)</li> <li>[arrow-flight encode path]re-use flatbufferbuilder <a href="https://redirect.github.com/apache/arrow-rs/pull/10220";>#10220</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Rich-T-kid";>Rich-T-kid</a>)</li> <li>[10125] arrow-flight decode path optimizations (add <code>skip_validation</code> to arrow-flight) <a href="https://redirect.github.com/apache/arrow-rs/pull/10206";>#10206</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow-flight";>arrow-flight</a>] (<a href="https://github.com/Rich-T-kid";>Rich-T-kid</a>)</li> <li>Improve performance of <code>concat_elements</code> ByteViewArray concatenation <a href="https://redirect.github.com/apache/arrow-rs/pull/10161";>#10161</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/pepijnve";>pepijnve</a>)</li> <li>[arrow-flight] Optimize flight, remove some allocations, add dictionary focused benchmarks <a href="https://redirect.github.com/apache/arrow-rs/pull/10126";>#10126</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] [<a href="https://github.com/apache/arrow-rs/labels/arrow-flight";>arrow-flight</a>] (<a href="https://github.com/Rich-T-kid";>Rich-T-kid</a>)</li> <li>optimize(concat): concat map implementation <a href="https://redirect.github.com/apache/arrow-rs/pull/10048";>#10048</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/mapleFU";>mapleFU</a>)</li> <li>Reduce copies in Arrow IPC writer <a href="https://redirect.github.com/apache/arrow-rs/pull/10044";>#10044</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/Rich-T-kid";>Rich-T-kid</a>)</li> <li>perf(interleave): Optimize list interleave_list when child is primitive <a href="https://redirect.github.com/apache/arrow-rs/pull/10025";>#10025</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/mapleFU";>mapleFU</a>)</li> </ul> <p><strong>Closed issues:</strong></p> <ul> <li>Soundness: Unsound alignment contract in public <code>FromBytes</code> trait and <code>BitReader::get_batch</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/10164";>#10164</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>ParquetPushDecoder: expose the next row-group index that try_next_reader will yield <a href="https://redirect.github.com/apache/arrow-rs/issues/10148";>#10148</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/arrow-rs/commit/b1de629ae82ee417e24a413f8f6815c884ec971b";><code>b1de629</code></a> Prepare for <code>59.1.0</code> release (<a href="https://redirect.github.com/apache/arrow-rs/issues/10274";>#10274</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/c36e926c0c8cee4ffefcd4eda96c6c11ac1a8632";><code>c36e926</code></a> feat: Add support for <code>MapArray</code> in <code>arrow_row</code> (<a href="https://redirect.github.com/apache/arrow-rs/issues/9486";>#9486</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d2519a1b721a968301b8f7ebb02af46cfa64e644";><code>d2519a1</code></a> fix(arrow-row): allow to convert non empty fixed size binary/list array with ...</li> <li><a href="https://github.com/apache/arrow-rs/commit/ddef6cfc9f932c77fb7fe0a867654d70d8e102c0";><code>ddef6cf</code></a> chore: Fix audit CI run by ignore quick-xml audit advisories (<a href="https://redirect.github.com/apache/arrow-rs/issues/10267";>#10267</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d96902565afc119d009a3a2aa48e3541347b98f6";><code>d969025</code></a> fix main: parquet test compilation failure (<a href="https://redirect.github.com/apache/arrow-rs/issues/10266";>#10266</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/c7dc6b8baeb6e1746e20e77ffbe990dd7d1d1042";><code>c7dc6b8</code></a> Add validated row decode benchmark (<a href="https://redirect.github.com/apache/arrow-rs/issues/10259";>#10259</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/73077404cdeaa52bad71602a1a7234a5b04418ab";><code>7307740</code></a> fix: write error for dbg output of out of range timestamps (<a href="https://redirect.github.com/apache/arrow-rs/issues/10130";>#10130</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/af1c24a48d137a62fccde3de63d9b0b225a985f3";><code>af1c24a</code></a> minor: drive-by refactors for dicts in substring & filter (<a href="https://redirect.github.com/apache/arrow-rs/issues/10264";>#10264</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/7095ce437c4bd2b7ba160a728b33640ec9cce3ea";><code>7095ce4</code></a> Replace conversion of binary->string in arrow-row from arraydata to direct co...</li> <li><a href="https://github.com/apache/arrow-rs/commit/8c7df18f05f6f7e0435b43a347e7dd22edf34a14";><code>8c7df18</code></a> reduce noise in flight benchmarks [tokio-threads] [# of columns in benchmarks...</li> <li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/58.3.0...59.1.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
