Aviem Zur created BEAM-1392:
-------------------------------
Summary: DoFn teardown not called on empty partitions
Key: BEAM-1392
URL: https://issues.apache.org/jira/browse/BEAM-1392
Project: Beam
Issue Type: Bug
Components: runner-spark
Reporter: Aviem Zur
Assignee: Aviem Zur
DoFn teardown is not called on empty partitions.
Discovered in a long running Kafka pipeline (read from Kafka -> write to Kafka)
where some partitions did not have data and Kafka producers where being created
but not closed, eventually resulting in {{Too many open files}} exception.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
