-1, The pull request at https://github.com/apache/spark/pull/49604 introduced a connection-related example module and successfully merged it into branch-4.0, which is a commendable achievement.
However, it is recommended that this example module should rely on the snapshot version of its corresponding development branch. Subsequently, after the release of a new version, it should be updated to depend on the latest released version of that branch, rather than a historical or preview release version (for instance, in the v4.0.0 tag, it should depend on Spark 4.0.0 instead of 4.0.0-preview2). It appears that the pull request at https://github.com/apache/spark/pull/50187 is currently discussing and addressing this issue; however, it is still in progress. I firmly believe that this issue should be resolved before the release of Apache Spark 4.0.0. Best regards, Jie Yang On 2025/03/23 01:26:43 Ángel Álvarez Pascua wrote: > Great to hear that! > > Fortunately, I was waiting for someone to answer and hadn't looked at it > yet. > > Seems a quite straightforward solution for an issue that shouldn't have to > exist if the right unit test had been implemented. What do you think about > adding a test to check this issue doesn't happen again? > > > > I'm planning to write an article about Spark Connect, so ... thanks again > for providing the project to start playing around. > > El dom, 23 mar 2025, 2:01, Bobby <wbo4...@gmail.com> escribió: > > > Thx @Ángel <angel.alvarez.pas...@gmail.com> , I had a PR > > https://github.com/apache/spark/pull/50334 to fix it. Please help review. > > > > Ángel Álvarez Pascua <angel.alvarez.pas...@gmail.com> 于2025年3月22日周六 > > 16:27写道： > > > >> Is anyone looking into this issue? If not, I'd like to try fixing it. > >> I've never tried out Spark Connect, so... 2x1! (way better than spending > >> the weekend binge-watching on Netflix 😅🤣). > >> > >> @Bobby <wbo4...@gmail.com> , thanks a lot, not only for reporting the > >> issue but also for providing a time-saving project for testing. > >> > >> El sáb, 22 mar 2025 a las 1:11, Bobby (<wbo4...@gmail.com>) escribió: > >> > >>> I think https://issues.apache.org/jira/browse/SPARK-51537 should be > >>> fixed before 4.0.0 release, or else, the executor side will not use global > >>> jars added by `--jars` in the connect mode, which could result in > >>> deserialization exceptions. > >>> > >> > --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
