dependabot[bot] opened a new pull request, #38282: URL: https://github.com/apache/beam/pull/38282
Bumps [ray](https://github.com/ray-project/ray) from 2.54.0 to 2.55.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/ray-project/ray/releases";>ray's releases</a>.</em></p> <blockquote> <h2>Ray-2.55.0</h2> <h2>Ray Data</h2> <h3>🎉 New Features</h3> <ul> <li>Add <code>DataSourceV2</code> API with scanner/reader framework, file listing, and file partitioning (<a href="https://redirect.github.com/ray-project/ray/issues/61220";>#61220</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61615";>#61615</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61997";>#61997</a>)</li> <li>Support GPU shuffle with <code>rapidsmpf</code> 26.2 (<a href="https://redirect.github.com/ray-project/ray/issues/61371";>#61371</a>, <a href="https://redirect.github.com/ray-project/ray/issues/62062";>#62062</a>)</li> <li>Add Kafka datasink, migrate to <code>confluent-kafka</code>, support <code>datetime</code> offsets (<a href="https://redirect.github.com/ray-project/ray/issues/60307";>#60307</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61284";>#61284</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60909";>#60909</a>)</li> <li>Add Turbopuffer datasink (<a href="https://redirect.github.com/ray-project/ray/issues/58910";>#58910</a>)</li> <li>Add 2-phase commit checkpointing with trie recovery and load method (<a href="https://redirect.github.com/ray-project/ray/issues/61821";>#61821</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60951";>#60951</a>)</li> <li>Queue-based autoscaling policy integrated with task consumers (<a href="https://redirect.github.com/ray-project/ray/issues/59548";>#59548</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60851";>#60851</a>)</li> <li>Enable autoscaling for GPU stages (<a href="https://redirect.github.com/ray-project/ray/issues/61130";>#61130</a>)</li> <li>Expressions: add <code>random()</code>, <code>uuid()</code>, <code>cast</code>, and map namespace support (<a href="https://redirect.github.com/ray-project/ray/issues/59656";>#59656</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60695";>#60695</a>, <a href="https://redirect.github.com/ray-project/ray/issues/59879";>#59879</a>)</li> <li>Add support for Arrow native fixed-shape tensor type (<a href="https://redirect.github.com/ray-project/ray/issues/56284";>#56284</a>)</li> <li>Support writing tensors to tfrecords (<a href="https://redirect.github.com/ray-project/ray/issues/60859";>#60859</a>)</li> <li>Add <code>pathlib.Path</code> support to <code>read_*</code> functions (<a href="https://redirect.github.com/ray-project/ray/issues/61126";>#61126</a>)</li> <li>Add <code>cudf</code> as a <code>batch_format</code> (<a href="https://redirect.github.com/ray-project/ray/issues/61329";>#61329</a>)</li> <li>Allow <code>ActorPoolStrategy</code> for <code>read_datasource()</code> via <code>compute</code> parameter (<a href="https://redirect.github.com/ray-project/ray/issues/59633";>#59633</a>)</li> <li>Introduce <code>ExecutionCache</code> for streamlined caching (<a href="https://redirect.github.com/ray-project/ray/issues/60996";>#60996</a>)</li> <li>Support <code>strict=False</code> mode for <code>StreamingRepartition</code> (<a href="https://redirect.github.com/ray-project/ray/issues/60295";>#60295</a>)</li> <li>Port changes from lance-ray into Ray Data (<a href="https://redirect.github.com/ray-project/ray/issues/60497";>#60497</a>)</li> <li>Enable PyArrow compute-to-expression conversion for predicate pushdown (<a href="https://redirect.github.com/ray-project/ray/issues/61617";>#61617</a>)</li> <li>Add vLLM metrics export and Data LLM Grafana dashboard (<a href="https://redirect.github.com/ray-project/ray/issues/60385";>#60385</a>)</li> <li>Include logical memory in resource manager scheduling decisions (<a href="https://redirect.github.com/ray-project/ray/issues/60774";>#60774</a>)</li> <li>Add monotonically increasing ID support (<a href="https://redirect.github.com/ray-project/ray/issues/59290";>#59290</a>)</li> </ul> <h3>💫 Enhancements</h3> <ul> <li>Performance: cache <code>_map_task</code> args, heap-based actor ranking, actor pool map improvements (<a href="https://redirect.github.com/ray-project/ray/issues/61996";>#61996</a>, <a href="https://redirect.github.com/ray-project/ray/issues/62114";>#62114</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61591";>#61591</a>)</li> <li>Optimize concat tables and PyArrow schema hashing (<a href="https://redirect.github.com/ray-project/ray/issues/61315";>#61315</a>, <a href="https://redirect.github.com/ray-project/ray/issues/62108";>#62108</a>)</li> <li>Reduce default <code>DownstreamCapacityBackpressurePolicy</code> threshold to 50% (<a href="https://redirect.github.com/ray-project/ray/issues/61890";>#61890</a>)</li> <li>Improve reproducibility for random APIs (<a href="https://redirect.github.com/ray-project/ray/issues/59662";>#59662</a>)</li> <li>Clamp batch size to fall within C++ 32-bit int range (<a href="https://redirect.github.com/ray-project/ray/issues/62242";>#62242</a>)</li> <li>Account for external consumer object store usage in resource manager budget (<a href="https://redirect.github.com/ray-project/ray/issues/62117";>#62117</a>)</li> <li>Make <code>get_parquet_dataset</code> configurable in number of fragments to scan (<a href="https://redirect.github.com/ray-project/ray/issues/61670";>#61670</a>)</li> <li>Consolidate schema inference and make all preprocessors implement <code>SerializablePreprocessorBase</code> (<a href="https://redirect.github.com/ray-project/ray/issues/61213";>#61213</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61341";>#61341</a>)</li> <li>Disable hanging issue detection by default (<a href="https://redirect.github.com/ray-project/ray/issues/62405";>#62405</a>)</li> <li>Make execution callback dataflow explicit to prevent state leakage (<a href="https://redirect.github.com/ray-project/ray/issues/61405";>#61405</a>)</li> <li>Log <code>DataContext</code> in JSON format at execution start for traceability (<a href="https://redirect.github.com/ray-project/ray/issues/61150";>#61150</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61428";>#61428</a>)</li> <li>Autoscaler: configurable traceback, Prometheus gauges, relaxed constraints (<a href="https://redirect.github.com/ray-project/ray/issues/62210";>#62210</a>, <a href="https://redirect.github.com/ray-project/ray/issues/62209";>#62209</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61917";>#61917</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61385";>#61385</a>)</li> <li>Add metrics for task scheduling time, output backpressure, and logical memory (<a href="https://redirect.github.com/ray-project/ray/issues/61192";>#61192</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61007";>#61007</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61436";>#61436</a>)</li> <li>Prevent operators from dominating entire shared object store budget (<a href="https://redirect.github.com/ray-project/ray/issues/61605";>#61605</a>)</li> <li>Eliminate generators to avoid intermediate state pinning (<a href="https://redirect.github.com/ray-project/ray/issues/60598";>#60598</a>)</li> <li>Default log encoding to UTF-8 on Windows (<a href="https://redirect.github.com/ray-project/ray/issues/61143";>#61143</a>)</li> <li>Remove legacy <code>BlockList</code>, <code>locality_with_output</code>, old callback API, PyArrow 9.0 checks (<a href="https://redirect.github.com/ray-project/ray/issues/60575";>#60575</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61044";>#61044</a>, <a href="https://redirect.github.com/ray-project/ray/issues/62055";>#62055</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61483";>#61483</a>)</li> <li>Upgrade to <code>pyiceberg</code> 0.11.0; cap <code>pandas</code> to <3 (<a href="https://redirect.github.com/ray-project/ray/issues/61062";>#61062</a>, <a href="https://redirect.github.com/ray-project/ray/issues/60406";>#60406</a>)</li> <li>Refactor logical operators to frozen dataclasses (<a href="https://redirect.github.com/ray-project/ray/issues/61059";>#61059</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61308";>#61308</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61348";>#61348</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61349";>#61349</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61351";>#61351</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61364";>#61364</a>, <a href="https://redirect.github.com/ray-project/ray/issues/61481";>#61481</a>)</li> <li>Prevent aggregator head node scheduling (<a href="https://redirect.github.com/ray-project/ray/issues/61288";>#61288</a>)</li> <li>Add error for <code>local://</code> paths with a zero-resource head node (<a href="https://redirect.github.com/ray-project/ray/issues/60709";>#60709</a>)</li> </ul> <h3>🔨 Fixes</h3> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/ray-project/ray/commit/58af3fc5cad7e74001b3f89bffd9052a9e7aa2bb";><code>58af3fc</code></a> Cherry picking to 2.55 (<a href="https://redirect.github.com/ray-project/ray/issues/62517";>#62517</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/2ecf83a736697730b8f60a0e30aa755be72a3ebc";><code>2ecf83a</code></a> cherrypick part of <a href="https://redirect.github.com/ray-project/ray/issues/62485";>#62485</a> (<a href="https://redirect.github.com/ray-project/ray/issues/62520";>#62520</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/3c9dfdfa32147c6a1406e1dda685350e1841889e";><code>3c9dfdf</code></a> [train] Cherrypick validation resumption deflake (<a href="https://redirect.github.com/ray-project/ray/issues/62448";>#62448</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/6fcc3f4298277cff5f3349356cac4f458f6ba07d";><code>6fcc3f4</code></a> [core] Cherry-pick: Deflake test_dashboard_port_conflict (<a href="https://redirect.github.com/ray-project/ray/issues/62413";>#62413</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/50920689520672bab7fe278b403f7a570d37e93f";><code>5092068</code></a> windows base build fix: install together (<a href="https://redirect.github.com/ray-project/ray/issues/62415";>#62415</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/232459596f2845d9c7703080adaeb14cdb63f0f3";><code>2324595</code></a> [data] Disable hanging issue detection by default 2.55 (<a href="https://redirect.github.com/ray-project/ray/issues/62405";>#62405</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/bc588f5d005b85b009c7ae4f4fb6cedf6f18367d";><code>bc588f5</code></a> [Serve][Bugfix] Fix Serve autoscaling delay to use wall-clock time (#… (<a href="https://redirect.github.com/ray-project/ray/issues/62331";>#62331</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/81122e7b26081fbae30097665b6561c8ee5b2b8c";><code>81122e7</code></a> 2.55.0 version change (<a href="https://redirect.github.com/ray-project/ray/issues/62307";>#62307</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/4127cd62cd372f9721d8ccc01d2103f178b3f64e";><code>4127cd6</code></a> [core] Disable test_torch_tensor_dag_gpu cgraph test (<a href="https://redirect.github.com/ray-project/ray/issues/62303";>#62303</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/0d06134c5cfab7d027746fee822a872355b64670";><code>0d06134</code></a> [Train] Add HF TRL (Transformer Reinforcement Learning) example (<a href="https://redirect.github.com/ray-project/ray/issues/61627";>#61627</a>)</li> <li>Additional commits viewable in <a href="https://github.com/ray-project/ray/compare/ray-2.54.0...ray-2.55.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/beam/network/alerts). </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
