[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427417#comment-17427417
]
wangkang commented on SPARK-3563:
-
I meet the same question. A user runs a spark streaming job, the
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136899#comment-14136899
]
Sean Owen commented on SPARK-3563:
--
I am no expert, but I believe this is on purpose, in
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137014#comment-14137014
]
shenhong commented on SPARK-3563:
-
Thanks Sean Owen!
I don‘t have set spark.cleaner.ttl,
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137246#comment-14137246
]
Saisai Shao commented on SPARK-3563:
In my thought, I think it relies on JVM's GC
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14137348#comment-14137348
]
shenhong commented on SPARK-3563:
-
Thanks, Saisai. I thank you are right, it depend on
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138100#comment-14138100
]
Patrick Wendell commented on SPARK-3563:
Eventually the references should be
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138376#comment-14138376
]
shenhong commented on SPARK-3563:
-
I have just trigger the driver a full GC, and the
[
https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138389#comment-14138389
]
Saisai Shao commented on SPARK-3563:
I think it relies on JVM's GC strategy to treat
