Chao Sun created SPARK-33435:
--------------------------------
Summary: DSv2: REFRESH TABLE should invalidate caches
Key: SPARK-33435
URL: https://issues.apache.org/jira/browse/SPARK-33435
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.1
Environment: R
Reporter: Chao Sun
Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache but
not all the caches that referencing the table to be refreshed. This may cause
correctness issue if these caches go stale and get queried later.
Note that since we don't support caching a v2 table yet, we can't recache the
table itself at the moment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
