[ https://issues.apache.org/jira/browse/SPARK-21869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16992975#comment-16992975 ]
Shixiong Zhu commented on SPARK-21869: -------------------------------------- Reopened this. https://github.com/apache/spark/pull/25853 has been reverted. > A cached Kafka producer should not be closed if any task is using it. > --------------------------------------------------------------------- > > Key: SPARK-21869 > URL: https://issues.apache.org/jira/browse/SPARK-21869 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.4.4, 3.0.0 > Reporter: Shixiong Zhu > Assignee: Gabor Somogyi > Priority: Major > Fix For: 3.0.0 > > > Right now a cached Kafka producer may be closed if a large task uses it for > more than 10 minutes. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org