[
https://issues.apache.org/jira/browse/BEAM-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17131837#comment-17131837
]
Beam JIRA Bot commented on BEAM-3145:
-------------------------------------
This issue is P2 but has been unassigned without any comment for 60 days so it
has been labeled "stale-P2". If this issue is still affecting you, we care!
Please comment and remove the label. Otherwise, in 14 days the issue will be
moved to P3.
Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed
explanation of what these priorities mean.
> Improve cleanup of zombie temporary files in WriteFiles
> -------------------------------------------------------
>
> Key: BEAM-3145
> URL: https://issues.apache.org/jira/browse/BEAM-3145
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Reporter: Eugene Kirpichov
> Priority: P2
> Labels: stale-P2
>
> See user issue in
> https://stackoverflow.com/questions/47113773/dataflow-2-1-0-streaming-application-is-not-cleaning-temp-folders
> For windowed writes, the proper solution is probably to put temp files into
> finer-grained directories, e.g. sharded by date or hour, and somehow clean
> them up by globbing and deleting the entire directory when the watermark goes
> past said date. It's complicated by late data and multiple trigger firings,
> of course.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
