+1 On Tue, Nov 26, 2024 at 3:47 PM Hyukjin Kwon <gurwls...@apache.org> wrote:
> +1 > > On Mon, 25 Nov 2024 at 23:33, Bjørn Jørgensen <bjornjorgen...@gmail.com> > wrote: > >> +1 >> >> man. 25. nov. 2024 kl. 14:48 skrev Herman van Hovell >> <her...@databricks.com.invalid>: >> >>> Hi All, >>> >>> I would like to start a discussion on "Spark Connect the default API in >>> Spark 4.0". >>> >>> The rationale for this change is that Spark Connect brings a lot of >>> improvements with respect to simplicity, stability, isolation, >>> upgradability, and extensibility (all detailed in the SPIP). In a nutshell: >>> we want to introduce a flag, spark.api.mode, that allows a user to >>> choose between classic or connect mode, the default being connect. A >>> user can easily fallback to Classic by setting spark.api.mode to classic >>> . >>> >>> SPIP: >>> https://docs.google.com/document/d/1C0kuQEliG78HujVwdnSk0wjNwHEDdwo2o8aVq7kbhTo/edit?tab=t.0#heading=h.r2c3xrbiklu3 >>> JIRA: https://issues.apache.org/jira/browse/SPARK-50411 >>> >>> I am looking forward to your feedback! >>> >>> Cheers, >>> Herman >>> >> >> >> -- >> Bjørn Jørgensen >> Vestre Aspehaug 4, 6010 Ålesund >> Norge >> >> +47 480 94 297 >> >
