[
https://issues.apache.org/jira/browse/BEAM-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Bradshaw closed BEAM-3689.
---------------------------------
Resolution: Fixed
Based on my reading of the PR, this is fixed.
> Direct runner leak a reader for every 10 input records
> ------------------------------------------------------
>
> Key: BEAM-3689
> URL: https://issues.apache.org/jira/browse/BEAM-3689
> Project: Beam
> Issue Type: Improvement
> Components: runner-direct
> Reporter: Raghu Angadi
> Assignee: Raghu Angadi
> Priority: Major
> Fix For: 2.4.0
>
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> Direct runner reads 10 records at a time from a reader. I think the intention
> is to reuse the reader, but it reuses only if the reader is idle initially,
> not when the source has messages available.
> When I was testing KafkaIO with direct runner it kept opening new reader for
> every 10 records and soon ran out of file descriptors.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
