yahoNanJing commented on PR #3595: URL: https://github.com/apache/arrow-datafusion/pull/3595#issuecomment-1255943180
> It would be superior imo if it matched the scheme and returned an error saying "need to compile with hdfs feature" if a hdfs url was requested but the feature was not enabled at compile time. Similar approaches could be taken for S3, GCP, etc... For a standalone system, we should know which object stores to be used before running it. Therefore, it's OK to make the decision at the compiling phase by enabling different features. If we want to support multiple object stores, like S3, HDFS, we can just enable multiple features there. And let the *ObjectStoreProvider* parse and decide which one to return. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
