Hi Mridul, Just wanted to add that we intent to work with the Apache Sedona community anyways going forward.
- Menelaos > On May 6, 2025, at 6:45 AM, Wenchen Fan <cloud0...@gmail.com> wrote: > > Hi Mridul, > > The conclusion is that we will standardize the basic geo data types in Spark, > which allows third-party data sources and user-defined functions to support > geo data types natively when integrating with Spark. The majority of geo > processing functions will still be in Apache Sedona (or other Spark plugin > projects) instead of Spark itself. @Jia Yu <mailto:ji...@apache.org> feel > free to correct me if I missed anything. > > On Tue, May 6, 2025 at 11:51 AM Mridul Muralidharan <mri...@gmail.com > <mailto:mri...@gmail.com>> wrote: >> Hi, >> >> What was the conclusion of the discussion with Apache Sedona project ? >> Are they aligned with leveraging the support being built here ? >> >> Regards, >> Mridul >> >> On Mon, May 5, 2025 at 10:22 PM Gengliang Wang <ltn...@gmail.com >> <mailto:ltn...@gmail.com>> wrote: >>> +1 >>> >>> On Mon, May 5, 2025 at 6:54 PM Ruifeng Zheng <ruife...@apache.org >>> <mailto:ruife...@apache.org>> wrote: >>>> +1 >>>> >>>> On Tue, May 6, 2025 at 9:51 AM Xiao Li <gatorsm...@gmail.com >>>> <mailto:gatorsm...@gmail.com>> wrote: >>>>> +1 >>>>> >>>>> On Mon, May 5, 2025 at 18:35 Yuming Wang <yumw...@apache.org >>>>> <mailto:yumw...@apache.org>> wrote: >>>>>> +1 >>>>>> >>>>>> On Tue, May 6, 2025 at 9:12 AM Denny Lee <denny.g....@gmail.com >>>>>> <mailto:denny.g....@gmail.com>> wrote: >>>>>>> +1 (non-binding) >>>>>>> >>>>>>> On Mon, May 5, 2025 at 18:03 Wenchen Fan <cloud0...@gmail.com >>>>>>> <mailto:cloud0...@gmail.com>> wrote: >>>>>>>> +1 >>>>>>>> >>>>>>>> On Tue, May 6, 2025 at 3:40 AM Reynold Xin >>>>>>>> <r...@databricks.com.invalid> wrote: >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen >>>>>>>>> <bjornjorgen...@gmail.com <mailto:bjornjorgen...@gmail.com>> wrote: >>>>>>>>>> +1 >>>>>>>>>> >>>>>>>>>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic >>>>>>>>>> <stefanovic.mila...@gmail.com <mailto:stefanovic.mila...@gmail.com>>: >>>>>>>>>>> +1 (non-binding) >>>>>>>>>>> >>>>>>>>>>> Thanks, >>>>>>>>>>> Milan >>>>>>>>>>> >>>>>>>>>>> On Mon, 5 May 2025 at 21:25, Jia Yu <ji...@apache.org >>>>>>>>>>> <mailto:ji...@apache.org>> wrote: >>>>>>>>>>>> Thanks for putting this together. >>>>>>>>>>>> >>>>>>>>>>>> +0 (non-binding) from my side. Happy to see geospatial data is >>>>>>>>>>>> getting attention but we need to make it right. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Jia Yu >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 5, 2025 at 12:15 PM Szehon Ho <szehon.apa...@gmail.com >>>>>>>>>>>> <mailto:szehon.apa...@gmail.com>> wrote: >>>>>>>>>>>>> +1 (non binding) >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks >>>>>>>>>>>>> Szehon >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, May 5, 2025 at 11:17 AM DB Tsai <dbt...@dbtsai.com >>>>>>>>>>>>> <mailto:dbt...@dbtsai.com>> wrote: >>>>>>>>>>>>>> +1, geospatial types will be a great feature for Spark. Thanks >>>>>>>>>>>>>> for working on it. >>>>>>>>>>>>>> >>>>>>>>>>>>>>> On May 5, 2025, at 11:04 AM, Menelaos Karavelas >>>>>>>>>>>>>>> <menelaos.karave...@gmail.com >>>>>>>>>>>>>>> <mailto:menelaos.karave...@gmail.com>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I started the discussion on adding geospatial types to Spark >>>>>>>>>>>>>>> on March 28th. >>>>>>>>>>>>>>> Since then there has been some discussion in the dev mailing >>>>>>>>>>>>>>> list, as well as in the SPIP doc. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> At this point I would like to move to a formal vote on adding >>>>>>>>>>>>>>> support for geospatial types to Spark. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *Discussion thread:* >>>>>>>>>>>>>>> https://lists.apache.org/thread/07ozv8ccfddd5tnfl8t74dr4tvnjdkpg >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *SPIP:* >>>>>>>>>>>>>>> https://docs.google.com/document/d/1cYSNPGh95OjnpS0k_KDHGM9Ae3j-_0Wnc_eGBZL4D3w/edit?tab=t.0 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> *JIRA:* >>>>>>>>>>>>>>> https://issues.apache.org/jira/browse/SPARK-51658 >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Please vote on the SPIP for the next 72 hours: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> [ ] +1: Accept the proposal as an official SPIP >>>>>>>>>>>>>>> [ ] +0 >>>>>>>>>>>>>>> [ ] -1: I don’t think this is a good idea because >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Menelaos Karavelas >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Bjørn Jørgensen >>>>>>>>>> Vestre Aspehaug 4, 6010 Ålesund >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> Norge >>>>>>>>>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>>>>>>>>> >>>>>>>>>> +47 480 94 297
