houqp edited a comment on pull request #1072: URL: https://github.com/apache/arrow-datafusion/pull/1072#issuecomment-937478271
Interesting, from the discussion we had in https://github.com/rdettai/arrow-datafusion/pull/1, I got the opposite impression on where we are heading ;P I thought the conclusion from that discussion was: 1. We require all nodes in the ballista cluster to run binaries with the same set of object store crate/plugin statically compiled in 2. We don't need to do object store serialization if we require all nodes to have the same object store config synced on disk or in environment variables. If all nodes have the same object store config, then calling `ObjectStoreFoo::new` should result in the same object store being provisioned assuming the object store crate versions are compatible across nodes. With this in mind, do we still need a global singleton registry? The objectstore registry is already attached to ExecutionContext today, so it should be good enough right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
