cloud-fan commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#issuecomment-504652473 > That's what causes the problem above: the default catalog is used for the CTAS, but the session catalog is used for the SELECT. Yea I think this is the problem. This makes me think that maybe we are too rush to support changing default catalog. Without migrating Hive to DS v2, we can't apply the change of default catalog everywhere. Currently we can only change the default catalog for CREATE TABLE, which causes the inconsistency here. In the long term, I think every session should have its own session catalog, to do some internal management(like temp view management), and forward other requests to the v2 catalogs(either the default one if no catalog identifier specified, or the specified catalog). Making a v2 session catalog seems in the wrong direction to me.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
