UPDATE: The fix is merged. @Adam Binford <adam...@gmail.com> if you could help verifying this in latest branch-4.0, that would be great. Thanks for reporting the issue!
On Sat, May 17, 2025 at 3:05 AM Anish Shrigondekar <anish.shrigonde...@databricks.com.invalid> wrote: > Hi Adam, > > Thanks for reporting the issue. @Eric Marnadi > <eric.marn...@databricks.com> has a PR for the fix here - > https://github.com/apache/spark/pull/50924 > > @Wenchen Fan <cloud0...@gmail.com> - would be good to include this in 4.0 > RC > > Thanks, > Anish > > On Fri, May 16, 2025 at 8:05 AM Adam Binford <adam...@gmail.com> wrote: > >> I think I found a bug when trying to use the new StateStore source >> reading from RocksDB. Not sure if it should be a blocker or not but I don't >> think it currently can read RocksDB state store checkpoints. This was from >> RC2 or RC3, but I don't see any relevant issues or fixes for this. Trying >> to test out RC6 now. >> >> https://issues.apache.org/jira/browse/SPARK-52188 >> >> On Thu, May 15, 2025 at 3:32 AM Max Gekk <max.g...@gmail.com> wrote: >> >>> +1 >>> >>> On Thu, May 15, 2025 at 4:50 AM Kent Yao <y...@apache.org> wrote: >>> >>>> +1 >>>> >>>> Jules Damji <jules.da...@gmail.com> 于2025年5月15日周四 04:05写道： >>>> >>>>> +1 (non-binding) >>>>> — >>>>> Sent from my iPhone >>>>> Pardon the dumb thumb typos :) >>>>> >>>>> On May 14, 2025, at 11:29 AM, Denny Lee <denny.g....@gmail.com> wrote: >>>>> >>>>> >>>>> +1 (non-binding) >>>>> >>>>> On Wed, May 14, 2025 at 10:34 AM Chao Sun <sunc...@apache.org> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> On Wed, May 14, 2025 at 10:30 AM Holden Karau <holden.ka...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Wed, May 14, 2025 at 10:10 AM L. C. Hsieh <vii...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> On Tue, May 13, 2025 at 3:28 PM Wenchen Fan <cloud0...@gmail.com> >>>>>>>> wrote: >>>>>>>> > >>>>>>>> > Please vote on releasing the following candidate as Apache Spark >>>>>>>> version 4.0.0. >>>>>>>> > >>>>>>>> > The vote is open until May 16 (PST) and passes if a majority +1 >>>>>>>> PMC votes are cast, with a minimum of 3 +1 votes. >>>>>>>> > >>>>>>>> > [ ] +1 Release this package as Apache Spark 4.0.0 >>>>>>>> > [ ] -1 Do not release this package because ... >>>>>>>> > >>>>>>>> > To learn more about Apache Spark, please see >>>>>>>> https://spark.apache.org/ >>>>>>>> > >>>>>>>> > The tag to be voted on is v4.0.0-rc6 (commit >>>>>>>> 9a99ecb03a2d35f5f38decd686b55511a5c7c535) >>>>>>>> > https://github.com/apache/spark/tree/v4.0.0-rc6 >>>>>>>> > >>>>>>>> > The release files, including signatures, digests, etc. can be >>>>>>>> found at: >>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-bin/ >>>>>>>> > >>>>>>>> > Signatures used for Spark RCs can be found in this file: >>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS >>>>>>>> > >>>>>>>> > The staging repository for this release can be found at: >>>>>>>> > >>>>>>>> https://repository.apache.org/content/repositories/orgapachespark-1484/ >>>>>>>> > >>>>>>>> > The documentation corresponding to this release can be found at: >>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-docs/ >>>>>>>> > >>>>>>>> > The list of bug fixes going into 4.0.0 can be found at the >>>>>>>> following URL: >>>>>>>> > https://issues.apache.org/jira/projects/SPARK/versions/12353359 >>>>>>>> > >>>>>>>> > This release is using the release script of the tag v4.0.0-rc6. >>>>>>>> > >>>>>>>> > FAQ >>>>>>>> > >>>>>>>> > ========================= >>>>>>>> > How can I help test this release? >>>>>>>> > ========================= >>>>>>>> > >>>>>>>> > If you are a Spark user, you can help us test this release by >>>>>>>> taking >>>>>>>> > an existing Spark workload and running on this release candidate, >>>>>>>> then >>>>>>>> > reporting any regressions. >>>>>>>> > >>>>>>>> > If you're working in PySpark you can set up a virtual env and >>>>>>>> install >>>>>>>> > the current RC and see if anything important breaks, in the >>>>>>>> Java/Scala >>>>>>>> > you can add the staging repository to your projects resolvers and >>>>>>>> test >>>>>>>> > with the RC (make sure to clean up the artifact cache >>>>>>>> before/after so >>>>>>>> > you don't end up building with a out of date RC going forward). >>>>>>>> >>>>>>>> >>>>>>>> --------------------------------------------------------------------- >>>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Twitter: https://twitter.com/holdenkarau >>>>>>> Fight Health Insurance: https://www.fighthealthinsurance.com/ >>>>>>> <https://www.fighthealthinsurance.com/?q=hk_email> >>>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>>> Pronouns: she/her >>>>>>> >>>>>> >> >> -- >> Adam Binford >> >
