alamb commented on issue #13274: URL: https://github.com/apache/datafusion/issues/13274#issuecomment-2466651579
I have had a few days to reflect , and I personally think making it easy to integrate DataFusion into the "open data lake" stack might be my top priority over the coming months @julienledem wrote up a very nice piece descsribing this [The advent of the Open Data Lake](https://sympathetic.ink/2024/11/07/The-Advent-Of-The-Open-Data-Lake.html) In my mind, the specific work this entails stuff like - Making it easier to use iceberg/delta/hudi with DataFusion - Document different tokio runtimes - Make parquet reader in arrow-rs faster/better on remote object stores More to come -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
