Re: Adding new connectors

On Fri, Mar 24, 2023 at 3:18 PM John Zhuge wrote: > Is this similar to Iceberg's hidden partitioning > ? > Check out the details in the spec: > https://iceberg.apache.org/spec/#partition-transforms > Yes, it's

Re: Adding new connectors

Is this similar to Iceberg's hidden partitioning ? Check out the details in the spec: https://iceberg.apache.org/spec/#partition-transforms On Fri, Mar 24, 2023 at 2:52 PM Alex Cruise wrote: > On Fri, Mar 24,

Re: Adding new connectors

On Fri, Mar 24, 2023 at 1:46 PM John Zhuge wrote: > Have you checked out SparkCatalog > > in > Apache Iceberg project? More docs at >

Re: Adding new connectors

Have you checked out SparkCatalog in Apache Iceberg project? More docs at https://iceberg.apache.org/docs/latest/spark-configuration/#catalogs On Fri, Mar 24, 2023 at 12:36 PM

Adding new connectors

Hey folks, please let me know this is more of a user@ post! I'm building a Spark connector for my company's data-lake-ish product, and it looks like there's very little documentation about how to go about it. I found ExternalCatalog a few days ago and have been implementing one of those, but it

Re: Invitation to Join the Fintech Track at Community Over Code 2023 - Share Your Apache Spark Expertise

Hi Javier, It is not very clear whether this call for paper includes the application of Spark as a part of solution or a means to itself? For example, "Real-time analytics and fraud detection using Apache Spark" may include multiple artefacts including Spark as part of a decision support engine

Invitation to Join the Fintech Track at Community Over Code 2023 - Share Your Apache Spark Expertise

Dear Apache Spark Community, I hope you're doing well. As valued members of the Apache Software Foundation (ASF) community, we all share a passion for open-source technology and its potential to drive innovation across various industries. With this in mind, we are excited to invite you to