Hello! I watched recently the talk about Delta format and found the concept of Delta Kernels very interesting. Instead of providing multiple APIs, they decided to provide so called kernels: extendable APIs with default implementations that can be used to create connectors. At the moment they are providing one kernel for JVM and one kernel for binary connectors (in Rust). It is very close to our case.
I think we can find a lot of useful tips by checking how it is done in Delta. The link to the talk: https://www.databricks.com/dataaisummit/session/delta-kernel-anatomy-delta-lake-connector Link to the code: 1. JVM kernel: https://github.com/delta-io/delta/tree/master/kernel 2. Rust kernel: https://github.com/delta-incubator/delta-kernel-rs A part of the documentation, related to kernels: https://delta.io/blog/delta-kernel/ May we discuss it during the next community-sync? Best regards, Sem
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@graphar.apache.org For additional commands, e-mail: dev-h...@graphar.apache.org