It'll have to come with the next 3.5 release regardless, that will happen later as needed. I think we should just get it in soonish to enable that if needed.
On Mon, Mar 24, 2025, 12:14 PM Bjørn Jørgensen <bjornjorgen...@gmail.com> wrote: > Yes, I did make that PR a long time ago. It was merged on 20.11.2023. > > I can backport it.. it is only changing - to _ but I don't think that we > have anyone to make a new spark version 3.5.X today and release it? > Or do we have anyone that will make a new spark 3.5 release very soon? > > https://github.com/apache/spark/pull/50369 > <https://github.com/apache/spark/pull/50369> > > man. 24. mars 2025 kl. 17:32 skrev Sean Owen <sro...@apache.org>: > >> I think we're about to hear about this: >> >> setuptools 78.0.0, released yesterday, no longer allows dashes in keys in >> setup.cfg: >> https://setuptools.pypa.io/en/stable/history.html#v78-0-0 >> >> The pyspark packaging has 'description-file' instead of >> 'description_file' in its setup.cfg, and so will not install. >> >> This was addressed for Spark 4.0 in >> https://issues.apache.org/jira/browse/SPARK-45994 >> I think this just needs to be backported, but, it'll be kind of >> unfortunate because older releases won't install, I think. >> >> >> > > -- > Bjørn Jørgensen > Vestre Aspehaug 4, 6010 Ålesund > <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> > Norge > <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> > > +47 480 94 297 >
