alamb commented on issue #7079: URL: https://github.com/apache/arrow-datafusion/issues/7079#issuecomment-1652250526
Thank you for this writeup @devinjdangelo I think the best architectural decision would be to move DataFrame to use the same (partially implemented) code that handles writing into files (e.g. for `INSERT INTO ...`) -- https://docs.rs/datafusion/latest/datafusion/logical_expr/struct.DmlStatement.html We could then handle all the details of multi part writes, parallelization, etc there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
