[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches
[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > DSv2: REFRESH TABLE should invalidate caches > > > Key: SPARK-33435 > URL: https://issues.apache.org/jira/browse/SPARK-33435 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.0.1 >Reporter: Chao Sun >Assignee: Chao Sun >Priority: Major > Labels: DSv2, correctness > Fix For: 3.0.2, 3.1.0 > > > Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache > but not all the caches that referencing the table to be refreshed. This may > cause correctness issue if these caches go stale and get queried later. > Note that since we don't support caching a v2 table yet, we can't recache the > table itself at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches
[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33435: -- Labels: DSv2 correctness (was: DSv2) > DSv2: REFRESH TABLE should invalidate caches > > > Key: SPARK-33435 > URL: https://issues.apache.org/jira/browse/SPARK-33435 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.1 >Reporter: Chao Sun >Assignee: Chao Sun >Priority: Major > Labels: DSv2, correctness > Fix For: 3.0.2, 3.1.0 > > > Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache > but not all the caches that referencing the table to be refreshed. This may > cause correctness issue if these caches go stale and get queried later. > Note that since we don't support caching a v2 table yet, we can't recache the > table itself at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches
[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33435: -- Fix Version/s: 3.0.2 > DSv2: REFRESH TABLE should invalidate caches > > > Key: SPARK-33435 > URL: https://issues.apache.org/jira/browse/SPARK-33435 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.1 >Reporter: Chao Sun >Assignee: Chao Sun >Priority: Major > Labels: DSv2 > Fix For: 3.0.2, 3.1.0 > > > Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache > but not all the caches that referencing the table to be refreshed. This may > cause correctness issue if these caches go stale and get queried later. > Note that since we don't support caching a v2 table yet, we can't recache the > table itself at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches
[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Labels: DSv2 (was: ) > DSv2: REFRESH TABLE should invalidate caches > > > Key: SPARK-33435 > URL: https://issues.apache.org/jira/browse/SPARK-33435 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.1 >Reporter: Chao Sun >Priority: Major > Labels: DSv2 > > Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache > but not all the caches that referencing the table to be refreshed. This may > cause correctness issue if these caches go stale and get queried later. > Note that since we don't support caching a v2 table yet, we can't recache the > table itself at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches
[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Environment: (was: R) > DSv2: REFRESH TABLE should invalidate caches > > > Key: SPARK-33435 > URL: https://issues.apache.org/jira/browse/SPARK-33435 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.0.1 >Reporter: Chao Sun >Priority: Major > > Currently, in DSv2 {{RefreshTableExec}}, we only invalidate metadata cache > but not all the caches that referencing the table to be refreshed. This may > cause correctness issue if these caches go stale and get queried later. > Note that since we don't support caching a v2 table yet, we can't recache the > table itself at the moment. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org