timvw commented on issue #3261: URL: https://github.com/apache/arrow-datafusion/issues/3261#issuecomment-1227656150
A couple of thoughts: * A ListingTableUrl is currently different than just a valid Url. ** When this is not true, why not simply use Url? ** Perhaps TablePath was a more suitable name for this concept? ** And the url field could have been an object_store::path * The "glob" syntax seems to be well-known and universally accepted to represent a set of files ** https://docs.rs/glob/latest/glob/struct.Pattern.html ** https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/fs/FileSystem.html#globStatus-org.apache.hadoop.fs.Path- ** https://sceweb.uhcl.edu/liaw/odi/ostore/doc/mo/7_unix.htm ** https://tldp.org/LDP/GNU-Linux-Tools-Summary/html/x11655.htm Anyway, instead of making all these breaking changes without too much thinking I propose to introduce a GlobbingTable which has Globs (similar to ListingTable and it's ListingTableUrl) in datafusion-contrib and see how it works out... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
