[
https://issues.apache.org/jira/browse/BEAM-12220?focusedWorklogId=589634&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-589634
]
ASF GitHub Bot logged work on BEAM-12220:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Apr/21 09:51
Start Date: 27/Apr/21 09:51
Worklog Time Spent: 10m
Work Description: iemejia merged pull request #14631:
URL: https://github.com/apache/beam/pull/14631
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 589634)
Time Spent: 20m (was: 10m)
> ZipFiles.zipDirectory leaks native JVM memory
> ---------------------------------------------
>
> Key: BEAM-12220
> URL: https://issues.apache.org/jira/browse/BEAM-12220
> Project: Beam
> Issue Type: Bug
> Components: runner-core, runner-dataflow, sdk-java-core
> Affects Versions: 2.22.0
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Noticed this in a long-running JVM process starting multiple Dataflow
> pipelines. Heap usage slowly rose as observed by {{jcmd <pid>
> VM.native_memory summary.diff}}, but a heap dump did not show a consistent
> amount of usage.
> Followed [this
> guide|https://github.com/jeffgriffith/native-jvm-leaks/blob/master/README.md]
> for identify native memory leaks, which pointed me to java.util.ZipFile.
> We use it in
> [runners.core-construction.PipelineResources|https://github.com/apache/beam/blob/8e6695643b69da1ab83c9aad16a913cf6e442823/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/resources/PipelineResources.java#L132]
> via
> [sdk.util.ZipFiles|https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/util/ZipFiles.java]
> Closing the ZipOutputStream
> [here|https://github.com/apache/beam/blob/47cfbcb63f4d0642d26106485bc6fdb894da3086/sdks/java/core/src/main/java/org/apache/beam/sdk/util/ZipFiles.java#L226]
> seems to alleviate the issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
