Hello!
- Arrow flight sql is normally used with databases it seems like, but can you use it with an arrow flight server? Yes and no. Flight SQL is used to communicate with databases, but I don't think it bypasses a flight server, it's just that the target database is, or uses, a flight server to communicate with the client. I think any server that accepts the flight protocol should be considered a flight server. That being said, I am not sure which direction I should point you in. If you don't mind setting up a database with your flight server, it seems like [1] or [2] will be good references. If you don't want to do actual database things on your server, then I feel like flight RPC itself should be good enough for your use case (or at least, I'm not sure how you plan to use flight SQL without a database). If you want database-like interaction, but you don't want an actual database, I think you want to try and go the route of interfacing with Acero from your flight server. I can't find a prototype of this off hand, but building it yourself incrementally shouldn't be extremely difficult, depending on what features you need. [1]: https://github.com/voltrondata/SQLFlite [2]: https://github.com/Query-farm/duckdb-airport-extension/tree/main # ------------------------------ # Aldrin https://github.com/drin/ https://gitlab.com/octalene https://keybase.io/octalene On Thursday, April 10th, 2025 at 12:36, Amanda Weirich <acweiric...@gmail.com> wrote: > Hi all, > Has anybody created an Arrow Flight Server capable of responding to arrow > flight sql commands? > > Arrow flight sql is normally used with databases it seems like, but can you > use it with an arrow flight server? > > For reference, we would like to use an arrow flight client to query specific > columns of batches/tables sitting on an arrow flight server - no database > integration involved. Does something like this exist? Does anyone have any > recommendations for doing this? > > Thanks! > > --Amanda
publickey - octalene.dev@pm.me - 0x21969656.asc
Description: application/pgp-keys
signature.asc
Description: OpenPGP digital signature
