dependabot[bot] opened a new pull request, #3075: URL: https://github.com/apache/iceberg-python/pull/3075
Bumps [ray](https://github.com/ray-project/ray) from 2.53.0 to 2.54.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/ray-project/ray/releases";>ray's releases</a>.</em></p> <blockquote> <h2>Ray-2.54.0</h2> <h2>Ray Data</h2> <p>🎉 New Features</p> <ul> <li>Add checkpointing support to Ray Data (<a href="https://redirect.github.com/ray-project/ray/issues/59409";>#59409</a>)</li> <li>Compute Expressions: list operations (<a href="https://redirect.github.com/ray-project/ray/issues/59346";>#59346</a>), fixed-size arrays (<a href="https://redirect.github.com/ray-project/ray/issues/58741";>#58741</a>), string padding (<a href="https://redirect.github.com/ray-project/ray/issues/59552";>#59552</a>), logarithmic (<a href="https://redirect.github.com/ray-project/ray/issues/59549";>#59549</a>), trigonometric (<a href="https://redirect.github.com/ray-project/ray/issues/59712";>#59712</a>), arithmetic (<a href="https://redirect.github.com/ray-project/ray/issues/59678";>#59678</a>), and rounding (<a href="https://redirect.github.com/ray-project/ray/issues/59295";>#59295</a>)</li> <li>Add <code>sql_params</code> support to <code>read_sql</code> (<a href="https://redirect.github.com/ray-project/ray/issues/60030";>#60030</a>)</li> <li>Add <code>AsList</code> aggregation (<a href="https://redirect.github.com/ray-project/ray/issues/59920";>#59920</a>)</li> <li>Support <code>CountDistinct</code> aggregate (<a href="https://redirect.github.com/ray-project/ray/issues/59030";>#59030</a>)</li> <li>Add credential provider abstraction for Databricks UC datasource (<a href="https://redirect.github.com/ray-project/ray/issues/60457";>#60457</a>)</li> <li>Support callable classes for <code>UDFExpr</code> (<a href="https://redirect.github.com/ray-project/ray/issues/56725";>#56725</a>)</li> <li>Add autoscaler metrics to Data Dashboard (<a href="https://redirect.github.com/ray-project/ray/issues/60472";>#60472</a>)</li> <li>Add optional filesystem parameter to download expression (<a href="https://redirect.github.com/ray-project/ray/issues/60677";>#60677</a>)</li> <li>Allow specifying partitioning style or flavor in <code>write_parquet()</code> (<a href="https://redirect.github.com/ray-project/ray/issues/59102";>#59102</a>)</li> <li>New cluster autoscaler enabled by default (<a href="https://redirect.github.com/ray-project/ray/issues/60474";>#60474</a>)</li> </ul> <p>💫 Enhancements</p> <ul> <li>Improve numerical stability in scalers by handling near-zero values (<a href="https://redirect.github.com/ray-project/ray/issues/60488";>#60488</a>)</li> <li>Export dataset operator output schema to event logger (<a href="https://redirect.github.com/ray-project/ray/issues/60086";>#60086</a>)</li> <li>Iceberg: add retry policy for Storage + Catalog writes (<a href="https://redirect.github.com/ray-project/ray/issues/60620";>#60620</a>)</li> <li>Iceberg: remove calls to Catalog Table in write tasks (<a href="https://redirect.github.com/ray-project/ray/issues/60476";>#60476</a>)</li> <li>Expose logical operators and rules via package exports (<a href="https://redirect.github.com/ray-project/ray/issues/60297";>#60297</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60296";>#60296</a>)</li> <li>Demote Sort from requiring <code>preserve_order</code> (<a href="https://redirect.github.com/ray-project/ray/issues/60555";>#60555</a>)</li> <li>Improve appearance of repr(dataset) (<a href="https://redirect.github.com/ray-project/ray/issues/59631";>#59631</a>)</li> <li>Allow configuring <code>DefaultClusterAutoscalerV2</code> thresholds via env vars (<a href="https://redirect.github.com/ray-project/ray/issues/60133";>#60133</a>)</li> <li>Use Arrow IPC for Arrow Schema serialization/deserialization (<a href="https://redirect.github.com/ray-project/ray/issues/60195";>#60195</a>)</li> <li>Store _source_paths in object store to prevent excessive spilling during read task serialization (<a href="https://redirect.github.com/ray-project/ray/issues/59999";>#59999</a>)</li> <li>Add more shuffle fusion rules (<a href="https://redirect.github.com/ray-project/ray/issues/59985";>#59985</a>)</li> <li>Enable and tune <code>DownstreamCapacityBackpressurePolicy</code> (<a href="https://redirect.github.com/ray-project/ray/issues/59753";>#59753</a>)</li> <li>Enable concurrency cap backpressure with tuning (<a href="https://redirect.github.com/ray-project/ray/issues/59392";>#59392</a>)</li> <li>Set default actor pool scale up threshold to 1.75 (<a href="https://redirect.github.com/ray-project/ray/issues/59512";>#59512</a>)</li> <li>Don't downscale actors if the operator hasn't received any inputs (<a href="https://redirect.github.com/ray-project/ray/issues/59883";>#59883</a>)</li> <li>Don't reserve GPU budget for non-GPU tasks (<a href="https://redirect.github.com/ray-project/ray/issues/59789";>#59789</a>)</li> <li>Only return selected data columns in hive-partitioned Parquet files (<a href="https://redirect.github.com/ray-project/ray/issues/60236";>#60236</a>)</li> <li>Ordered + FIFO bundle queue (<a href="https://redirect.github.com/ray-project/ray/issues/60228";>#60228</a>)</li> <li>Add <code>node_id</code>, <code>pid</code>, attempt number for hanging tasks (<a href="https://redirect.github.com/ray-project/ray/issues/59793";>#59793</a>)</li> <li>Revise resource allocator task scheduling to factor in pending task outputs (<a href="https://redirect.github.com/ray-project/ray/issues/60639";>#60639</a>)</li> <li>Track block serialization time (<a href="https://redirect.github.com/ray-project/ray/issues/60574";>#60574</a>)</li> <li>Use metrics from <code>OpRuntimeMetrics</code> for progress (<a href="https://redirect.github.com/ray-project/ray/issues/60304";>#60304</a>)</li> <li>Tabular form for streaming executor op metrics (<a href="https://redirect.github.com/ray-project/ray/issues/59774";>#59774</a>)</li> <li>Info-log cluster scale-up decisions (<a href="https://redirect.github.com/ray-project/ray/issues/60357";>#60357</a>)</li> <li>Use plain mode instead of grid mode for <code>OpMetrics</code> logging (<a href="https://redirect.github.com/ray-project/ray/issues/59907";>#59907</a>)</li> <li>Progress reporting refactors (<a href="https://redirect.github.com/ray-project/ray/issues/59350";>#59350</a>, <a href="https://redirect.github.com/ray-project/ray/issues/59629";>#59629</a>, <a href="https://redirect.github.com/ray-project/ray/issues/59880";>#59880</a>)</li> <li>Remove deprecated <code>TENSOR_COLUMN_NAME</code> constant (<a href="https://redirect.github.com/ray-project/ray/issues/60573";>#60573</a>)</li> <li>Remove <code>meta_provider</code> parameter (<a href="https://redirect.github.com/ray-project/ray/issues/60379";>#60379</a>)</li> <li>Decouple Ray Train from Ray Data by removing top-level <code>ray.data</code> imports (<a href="https://redirect.github.com/ray-project/ray/issues/60292";>#60292</a>)</li> <li>Move extension types to ray.data (<a href="https://redirect.github.com/ray-project/ray/issues/59420";>#59420</a>)</li> <li>Skip upscaling validation warning for fixed-size actor pools (<a href="https://redirect.github.com/ray-project/ray/issues/60569";>#60569</a>)</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/ray-project/ray/commit/48bd1f8fa43d0e8222b0f57357b99b48c7437ed3";><code>48bd1f8</code></a> [data] revert "continue grabbing task state until response is not None" (<a href="https://redirect.github.com/ray-project/ray/issues/61066";>#61066</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/165b4aace988c5d1bcd5cf50481083018347f4aa";><code>165b4aa</code></a> [Data][Cherry-pick] Fixed min_scheduling_resources to fallback to incremental...</li> <li><a href="https://github.com/ray-project/ray/commit/6835277714833f456a754eeee58203d128117d65";><code>6835277</code></a> [rllib] disable failing tests that are not release blocking (<a href="https://redirect.github.com/ray-project/ray/issues/60933";>#60933</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/f8e1102869bbddcd8661b2eb154f741c9f5e4912";><code>f8e1102</code></a> [Core] Fix test_failed_task_runtime_env_setup failure on windows (<a href="https://redirect.github.com/ray-project/ray/issues/60852";>#60852</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/6";>#6</a>...</li> <li><a href="https://github.com/ray-project/ray/commit/620214fbd57a09b1caed96a29c36f12003316a2f";><code>620214f</code></a> [RLlib] Fix _test_dependency_torch (<a href="https://redirect.github.com/ray-project/ray/issues/60742";>#60742</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/60888";>#60888</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/5d2115c6a8b5db7b70125fcdfa95ff224f55c7be";><code>5d2115c</code></a> cherrypick part of <a href="https://redirect.github.com/ray-project/ray/issues/60887";>#60887</a> (<a href="https://redirect.github.com/ray-project/ray/issues/60897";>#60897</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/e94871d2c10f0f10dc8e1380de27adf9dc4673e7";><code>e94871d</code></a> [Data][Cherry-pick] Prevent <code>Limit</code> from getting pushed past <code>map_groups</code> (<a href="https://redirect.github.com/ray-project/ray/issues/6";>#6</a>...</li> <li><a href="https://github.com/ray-project/ray/commit/a77457bac527a3b2f98c3915937423b91e0bd5b5";><code>a77457b</code></a> [Data] Fixing <code>ReservationOpResourceAllocator</code> to properly borrow resources f...</li> <li><a href="https://github.com/ray-project/ray/commit/0f27a3a2aeaeac172edba341d88ee875c56158ec";><code>0f27a3a</code></a> [Serve] Video analysis example fix (<a href="https://redirect.github.com/ray-project/ray/issues/60784";>#60784</a>) (<a href="https://redirect.github.com/ray-project/ray/issues/60871";>#60871</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/1b1a9bd2503aa643e021c740a356cf4a040dded0";><code>1b1a9bd</code></a> [Data] Fixing output backpressure unblocking sequence to properly handle term...</li> <li>Additional commits viewable in <a href="https://github.com/ray-project/ray/compare/ray-2.53.0...ray-2.54.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/iceberg-python/network/alerts). </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
