The idea sounds interesting. Yes, we can discuss more detail in our community-sync meeting. thanks for bringing the topic:)
Best Weibin On 2024/07/28 15:12:41 Sem wrote: > Hello! > > I watched recently the talk about Delta format and found the concept of > Delta Kernels very interesting. Instead of providing multiple APIs, > they decided to provide so called kernels: extendable APIs with default > implementations that can be used to create connectors. At the moment > they are providing one kernel for JVM and one kernel for binary > connectors (in Rust). It is very close to our case. > > I think we can find a lot of useful tips by checking how it is done in > Delta. > > The link to the talk: > https://www.databricks.com/dataaisummit/session/delta-kernel-anatomy-delta-lake-connector > Link to the code: > 1. JVM kernel: https://github.com/delta-io/delta/tree/master/kernel > 2. Rust kernel: https://github.com/delta-incubator/delta-kernel-rs > > A part of the documentation, related to kernels: > https://delta.io/blog/delta-kernel/ > > May we discuss it during the next community-sync? > > Best regards, > Sem > > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@graphar.apache.org For additional commands, e-mail: dev-h...@graphar.apache.org