rdblue commented on issue #24129: [SPARK-27190][SQL] add table capability for streaming URL: https://github.com/apache/spark/pull/24129#issuecomment-483458217 For the packages, I agree with you that it needs to happen before the next release. But I think there's value in choosing a good time to make that change. There are a lot of changes that can be done in parallel once #24246 is in, so in order to meet our goal of having a working v2 API in the next release, so we should get that in and fix organization in a follow-up since it is simpler. As far as whether to wait in this PR, I think it that this PR is incomplete without checks in the analyzer. It would be easy to overlook adding them later and I don't want to continue adding checks in one place that are not applied when we make reasonable changes to the code. That's the problem we had when v2 was initially added: checks that a write was safe were not applied.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
