[
https://issues.apache.org/jira/browse/BEAM-8439?focusedWorklogId=331365&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-331365
]
ASF GitHub Bot logged work on BEAM-8439:
----------------------------------------
Author: ASF GitHub Bot
Created on: 21/Oct/19 11:37
Start Date: 21/Oct/19 11:37
Worklog Time Spent: 10m
Work Description: je-ik commented on issue #9841: [BEAM-8439] enable
empty bundles in ParDoLifecycleTest
URL: https://github.com/apache/beam/pull/9841#issuecomment-544475075
@mxm I'm not sure if I follow - how would this change avoid creating empty
bundles at the end of input, when watermark might move to the "infinity"?
Couldn't this end up in the same situation?
I'm not sure if a bundle creation time should be a concern here, because if
an "empty bundle" is created, then it pretty much signals, that the pipeline is
somewhat "empty" - e.g. it has too high parallelism, or no data is not flowing
in. In either case, the performance of creating empty bundle should be
negligible (because these will not be created too often).
My biggest concern here would be, if modifying the test is actually aligned
with Beam's model. I'll rise a question on mailing list and then we can decide
what to do.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 331365)
Time Spent: 1h 10m (was: 1h)
> Flink fails ParDoLifecycleTests
> -------------------------------
>
> Key: BEAM-8439
> URL: https://issues.apache.org/jira/browse/BEAM-8439
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Jan Lukavský
> Assignee: Jan Lukavský
> Priority: Major
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> ParDoLifecycleTest.testTeardownCalledAfterExceptionInFinishBundleStateful
> fails consistently
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
