blaginin commented on issue #13456: URL: https://github.com/apache/datafusion/issues/13456#issuecomment-2515612614
I think one problem with the current implementation of external storages is that it's pretty hard to test properly. For example, the issue in https://github.com/apache/datafusion/pull/13576 happened because right now, we only test that the external storage parameters are parsed, but we don’t even check if they’re parsed correctly. Maybe we should start mocking aws/iceberg/... and move more towards integration testing? That way, we’d be more confident that our external storage support actually works 😅 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
