tustvold opened a new pull request, #2578:
URL: https://github.com/apache/arrow-datafusion/pull/2578
_Draft as builds on top of #2572_
# Which issue does this PR close?
Closes #2562
Part of #2489
# Rationale for this change
See tickets, the previous logic was inconsistent, and varied based on
call-site.
# What changes are included in this PR?
This extracts a `ListingTableUrl` that handles all the logic of translating
from the user-provided string, to a canonical representation that can be used
by the rest of DataFusion.
I'm having some difficulty with some of the ballista tests, likely related
to #2546, and would appreciate some help with this. Perhaps @thinkharderdev ?
# Are there any user-facing changes?
Yes, this makes changes both to the public API, and also the interpretation
of certain strings. In particular:
* If passed a string without a scheme, this must exist on the local
filesystem or parsing will return an error
* Globbing will only be applied to strings without a scheme, as glob
expressions aren't part of the specification
FYI @timvw
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
