aokolnychyi commented on code in PR #52599:
URL: https://github.com/apache/spark/pull/52599#discussion_r2427634324
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala:
##########
@@ -211,15 +218,29 @@ class CacheManager extends Logging with
AdaptiveSparkPlanHelper {
plan: LogicalPlan,
cascade: Boolean,
blocking: Boolean): Unit = {
- uncacheByCondition(spark, _.sameResult(plan), cascade, blocking)
+ EliminateSubqueryAliases(plan) match {
Review Comment:
Added this branch to avoid changes in the behavior. Some connectors (like
Iceberg) use these methods for their custom commands. I wanted to be on the
safer side and keep the old behavior for these calls. That's it, if any of
these methods are called with `DataSourceV2Relation` without time travel spec,
we will invalidate all cache entries (including time travel) like before.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
