I think I found a bug when trying to use the new StateStore source reading from RocksDB. Not sure if it should be a blocker or not but I don't think it currently can read RocksDB state store checkpoints. This was from RC2 or RC3, but I don't see any relevant issues or fixes for this. Trying to test out RC6 now.
https://issues.apache.org/jira/browse/SPARK-52188 On Thu, May 15, 2025 at 3:32 AM Max Gekk <max.g...@gmail.com> wrote: > +1 > > On Thu, May 15, 2025 at 4:50 AM Kent Yao <y...@apache.org> wrote: > >> +1 >> >> Jules Damji <jules.da...@gmail.com> 于2025年5月15日周四 04:05写道： >> >>> +1 (non-binding) >>> — >>> Sent from my iPhone >>> Pardon the dumb thumb typos :) >>> >>> On May 14, 2025, at 11:29 AM, Denny Lee <denny.g....@gmail.com> wrote: >>> >>> >>> +1 (non-binding) >>> >>> On Wed, May 14, 2025 at 10:34 AM Chao Sun <sunc...@apache.org> wrote: >>> >>>> +1 >>>> >>>> On Wed, May 14, 2025 at 10:30 AM Holden Karau <holden.ka...@gmail.com> >>>> wrote: >>>> >>>>> +1 >>>>> >>>>> On Wed, May 14, 2025 at 10:10 AM L. C. Hsieh <vii...@gmail.com> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> On Tue, May 13, 2025 at 3:28 PM Wenchen Fan <cloud0...@gmail.com> >>>>>> wrote: >>>>>> > >>>>>> > Please vote on releasing the following candidate as Apache Spark >>>>>> version 4.0.0. >>>>>> > >>>>>> > The vote is open until May 16 (PST) and passes if a majority +1 PMC >>>>>> votes are cast, with a minimum of 3 +1 votes. >>>>>> > >>>>>> > [ ] +1 Release this package as Apache Spark 4.0.0 >>>>>> > [ ] -1 Do not release this package because ... >>>>>> > >>>>>> > To learn more about Apache Spark, please see >>>>>> https://spark.apache.org/ >>>>>> > >>>>>> > The tag to be voted on is v4.0.0-rc6 (commit >>>>>> 9a99ecb03a2d35f5f38decd686b55511a5c7c535) >>>>>> > https://github.com/apache/spark/tree/v4.0.0-rc6 >>>>>> > >>>>>> > The release files, including signatures, digests, etc. can be found >>>>>> at: >>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-bin/ >>>>>> > >>>>>> > Signatures used for Spark RCs can be found in this file: >>>>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS >>>>>> > >>>>>> > The staging repository for this release can be found at: >>>>>> > >>>>>> https://repository.apache.org/content/repositories/orgapachespark-1484/ >>>>>> > >>>>>> > The documentation corresponding to this release can be found at: >>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-docs/ >>>>>> > >>>>>> > The list of bug fixes going into 4.0.0 can be found at the >>>>>> following URL: >>>>>> > https://issues.apache.org/jira/projects/SPARK/versions/12353359 >>>>>> > >>>>>> > This release is using the release script of the tag v4.0.0-rc6. >>>>>> > >>>>>> > FAQ >>>>>> > >>>>>> > ========================= >>>>>> > How can I help test this release? >>>>>> > ========================= >>>>>> > >>>>>> > If you are a Spark user, you can help us test this release by taking >>>>>> > an existing Spark workload and running on this release candidate, >>>>>> then >>>>>> > reporting any regressions. >>>>>> > >>>>>> > If you're working in PySpark you can set up a virtual env and >>>>>> install >>>>>> > the current RC and see if anything important breaks, in the >>>>>> Java/Scala >>>>>> > you can add the staging repository to your projects resolvers and >>>>>> test >>>>>> > with the RC (make sure to clean up the artifact cache before/after >>>>>> so >>>>>> > you don't end up building with a out of date RC going forward). >>>>>> >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>> >>>>>> >>>>> >>>>> -- >>>>> Twitter: https://twitter.com/holdenkarau >>>>> Fight Health Insurance: https://www.fighthealthinsurance.com/ >>>>> <https://www.fighthealthinsurance.com/?q=hk_email> >>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>> Pronouns: she/her >>>>> >>>> -- Adam Binford
