Hi Mridul, The conclusion is that we will standardize the basic geo data types in Spark, which allows third-party data sources and user-defined functions to support geo data types natively when integrating with Spark. The majority of geo processing functions will still be in Apache Sedona (or other Spark plugin projects) instead of Spark itself. @Jia Yu <ji...@apache.org> feel free to correct me if I missed anything.
On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <mri...@gmail.com> wrote: > Hi, > > What was the conclusion of the discussion with Apache Sedona project ? > Are they aligned with leveraging the support being built here ? > > Regards, > Mridul > > On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <ltn...@gmail.com> wrote: > >> +1 >> >> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <ruife...@apache.org> wrote: >> >>> +1 >>> >>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <gatorsm...@gmail.com> wrote: >>> >>>> +1 >>>> >>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <yumw...@apache.org> wrote: >>>> >>>>> +1 >>>>> >>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <denny.g....@gmail.com> >>>>> wrote: >>>>> >>>>>> +1 (non-binding) >>>>>> >>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <cloud0...@gmail.com> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>> <r...@databricks.com.invalid> wrote: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> >>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen < >>>>>>>> bjornjorgen...@gmail.com> wrote: >>>>>>>> >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic < >>>>>>>>> stefanovic.mila...@gmail.com>: >>>>>>>>> >>>>>>>>>> +1 (non-binding) >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Milan >>>>>>>>>> >>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <ji...@apache.org> wrote: >>>>>>>>>> >>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>> >>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Jia Yu >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho < >>>>>>>>>>> szehon.apa...@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>> >>>>>>>>>>>> Thanks >>>>>>>>>>>> Szehon >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <dbt...@dbtsai.com> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. Thanks >>>>>>>>>>>>> for working on it. >>>>>>>>>>>>> >>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas < >>>>>>>>>>>>> menelaos.karave...@gmail.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> I started the discussion on adding geospatial types to Spark >>>>>>>>>>>>> on March 28th. >>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>> >>>>>>>>>>>>> At this point I would like to move to a formal vote on adding >>>>>>>>>>>>> support for geospatial types to Spark. >>>>>>>>>>>>> >>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>> >>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>> >>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>> >>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>> >>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>> >>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>> >>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Bjørn Jørgensen >>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>> Norge >>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>> >>>>>>>>> +47 480 94 297 >>>>>>>>> >>>>>>>>
