[
https://issues.apache.org/jira/browse/SPARK-21607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ant_nebula updated SPARK-21607:
-------------------------------
Description:
AS SPARK-19765, from version 2.1.1, UNCACHE TABLE also un-cache all cached
plans that refer to this table.
My scene like this picture below. When I have finished step 1, I cannot do
dropTempView "ods_table1" and "dwd_table2", util I also finish step 2. It waste
a lot of memory.
Can dropTempView function add a param like dropTempView(viewName: String,
dropSelfOnly: Boolean). As my scene, After dropTempView "dwd_table2",
"dw_table3" would still keep cache in memory.
Or add a new feacture: supports create materialized views.
!spark stream scene.png!
was:
AS SPARK-19765, from version 2.1.1, UNCACHE TABLE also un-cache all cached
plans that refer to this table.
My scene like this picture below. When I have finished step 1, I cannot do
dropTempView "ods_table1" and "dwd_table2", util I also finish step 2. It waste
a lot of memory.
Can dropTempView function add a param like dropTempView(viewName: String,
dropSelfOnly: Boolean). As my scene, After dropTempView "dwd_table2",
"dw_table3" would still keep cache in memory.
Or add a new feacture: supports create materialized views.
> Can dropTempView function add a param like dropTempView(viewName: String,
> dropSelfOnly: Boolean)
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-21607
> URL: https://issues.apache.org/jira/browse/SPARK-21607
> Project: Spark
> Issue Type: Request
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: ant_nebula
> Attachments: spark stream scene.png
>
>
> AS SPARK-19765, from version 2.1.1, UNCACHE TABLE also un-cache all cached
> plans that refer to this table.
> My scene like this picture below. When I have finished step 1, I cannot do
> dropTempView "ods_table1" and "dwd_table2", util I also finish step 2. It
> waste a lot of memory.
> Can dropTempView function add a param like dropTempView(viewName: String,
> dropSelfOnly: Boolean). As my scene, After dropTempView "dwd_table2",
> "dw_table3" would still keep cache in memory.
> Or add a new feacture: supports create materialized views.
> !spark stream scene.png!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
