yahoNanJing commented on PR #2906: URL: https://github.com/apache/arrow-datafusion/pull/2906#issuecomment-1184369507
Thanks @alamb for your comments. > Is the primary usecase "lazy" object store registration? Namely that the relevant ObjectStore instance isn't instantiated unless a URL in a plan requires it? Yes. By self-registration, we can achieve the "lazy" registration. > I thought the way Ballista (or other systems) would work would be that: For the ballista usage, it's necessary for us to introduce the object store extensions as optional features. The detailed usage way may differ for different object stores. For example, - For S3, we need to introduce additional configurations, like bucket, credential info, etc. - For HDFS, related configurations can be found in some specific locations. Therefore, we don't need to do any additional configurations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
