At Dremio we have two things at the moment: A JDBC driver that is built on Arrow and served as the inspiration for some of the design choices in flight [1] A preview flight connector that doesn't yet expose JDBC [2]
These the former is built on Avatica (part of the Apache Calcite project) so the thinking has been that a Avatica on top of Flight client might make the most sense. I don't believe anyone has started thinking through how to do that though. [1] https://github.com/dremio/dremio-oss/tree/master/client/jdbc [2] https://github.com/dremio-hub/dremio-flight-connector On Wed, Jan 29, 2020 at 8:18 AM Micah Kornfield <emkornfi...@gmail.com> wrote: > Sorry as a follow-up Uwe wrote a blog post [1] about using the JDBC to > Arrow code via python. Other than that I'm not aware of anything. > > Thanks, > Micah > > [1] > > https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-pyarrow-jvm.html > > On Wed, Jan 29, 2020 at 8:07 AM Micah Kornfield <emkornfi...@gmail.com> > wrote: > > > Hi Andy, > > As far as I know there is no jdbc driver. What exists today is a wrapper > > to convert jdbc resultset to arrow. > > > > I believe dremio might have open sourced some code in their repo which > > wraps arrow inside of a jdbc driver. not sure if it uses flight or > another > > protocol for actual transport > > > > I think a driver on top of arrow data would be a good contribution. > > > > Thanks, > > Micah > > > > On Wednesday, January 29, 2020, Andy Grove <andygrov...@gmail.com> > wrote: > > > >> We're pretty close to having a Flight server implemented in Rust, > >> executing > >> SQL queries with DataFusion and I'm testing with a Java Flight client. > >> > >> Once this is working, I want to build a Flight JDBC driver. I see that > we > >> already have a JDBC driver in the project but I'm struggling to find > >> documentation about it. I searched all the markdown files in the Java > >> project and there are no mentions of JDBC. A quick Google search didn't > >> show anything immediately either. > >> > >> I want to get involved in the Java implementation and this is a good > place > >> for me to start and maybe my first task should be documenting the > current > >> JDBC driver. Can anyone tell me what the goals are for the current > driver? > >> Are there some docs somewhere that I missed? > >> > >> Thanks, > >> > >> Andy. > >> > > >
