alamb commented on issue #14854: URL: https://github.com/apache/datafusion/issues/14854#issuecomment-2681983098
I think this sounds like a great idea ❤ At least for some transition time, we probably would need to offer `datafusion-storage-object-store` built in to maintain the existing backwards compatibility. Given the good things I have head about open dal, maybe it would be worth considering bringing `datafusion-storage-opendal` into the repo too 🤔 A separate IO API might also make keeping CPU and IO work separate, such as - #13692 - https://github.com/apache/datafusion/issues/12393 Anyhow, the first step towards this project is probably a POC PR sketching out what such an API might look like -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
