Re: [Suggest] Add geo function to core

2023-01-17 Thread Bjørn Jørgensen
Mosaic by Databricks Labs tir. 17. jan. 2023 kl. 15:53 skrev Grigory Pomadchin : > Hey Mo, > > That is awesome, great to hear! > > Best, > > Grigory > > On Tue, Jan 17, 2023 at 9:03 AM Mo Sarwat wrote: > >> Grigory, >> >> Thanks a lot for chiming - I

Re: [Suggest] Add geo function to core

2023-01-17 Thread Grigory Pomadchin
Hey Mo, That is awesome, great to hear! Best, Grigory On Tue, Jan 17, 2023 at 9:03 AM Mo Sarwat wrote: > Grigory, > > Thanks a lot for chiming - I really like the PostGIS to PostgreSQL > analogy. That is exactly what Sedona (an Apache project) is to Spark. Spark > core should remain light / g

Re: [Suggest] Add geo function to core

2023-01-17 Thread Mo Sarwat
Grigory, Thanks a lot for chiming - I really like the PostGIS to PostgreSQL analogy. That is exactly what Sedona (an Apache project) is to Spark. Spark core should remain light / generic enough (similar to PostgreSQL) and all spatial functionalities should be pluggable extensions (Sedona). Othe

Re: [Suggest] Add geo function to core

2023-01-16 Thread Grigory Pomadchin
Hey folks, Traditionally GIS functionality is distributed a bit separately - i.e. PostGIS is a great example; and indeed for GIS needs Sedona / GeoMesa / GeoWave may work out; I think GeoMesa implements GeoHash (see https://www.geomesa.org/documentation/stable/user/spark/sparksql_functions.html -

Re: [Suggest] Add geo function to core

2023-01-16 Thread Mo Sarwat
Martin, thanks for chiming in and mentioning Apache SIS. However, Mark was asking about Geo in Spark, which Sedona already supports. Yet, I like the idea of making all dependencies within the Apache family. I believe a good solution would be for you (or the SIS community at large) to include A

Re: [Suggest] Add geo function to core

2023-01-16 Thread Martin Desruisseaux
Hello Mark Indeed Sedona is surely a serious candidate. Maybe one aspect to take in consideration, depending how "core" the geospatial services would be, is that Sedona depends on a LGPL library (GeoTools, bundled separately) for map projections, Shapefile and GeoTIFF support. So those features

Re: [Suggest] Add geo function to core

2023-01-16 Thread Mo Sarwat
Mark, There is already another Apache project (namely Apache Sedona) that provides comprehensive support of geospatial operations in Spark. Please check it out: Github: https://github.com/apache/sedona Website: https://sedona.apache.org Please feel free to contribute more geospatial functions t