MaxGekk commented on a change in pull request #31172:
URL: https://github.com/apache/spark/pull/31172#discussion_r556853471
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala
##########
@@ -162,7 +160,7 @@ class DataSourceV2Strategy(session: SparkSession) extends
Strategy with Predicat
}
case RefreshTable(r: ResolvedTable) =>
- RefreshTableExec(r.catalog, r.identifier, invalidateCache(r,
recacheTable = true)) :: Nil
+ RefreshTableExec(r.catalog, r.identifier, recacheTable(r)) :: Nil
Review comment:
Let's imagine, we have cached Table1, and cached View1 which uses Table1.
1. Current implementation: remove Table1 and View1, and add Table1 back.
View1 will be uncached forever.
2. Proposed: clear cached data of Table1 and View1, and keep them cached,
so, next action will fill the cache for both Table1 and View1.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
