[
https://issues.apache.org/jira/browse/BEAM-6510?focusedWorklogId=191725&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-191725
]
ASF GitHub Bot logged work on BEAM-6510:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Jan/19 15:06
Start Date: 29/Jan/19 15:06
Worklog Time Spent: 10m
Work Description: mxm commented on issue #7660: [BEAM-6510] Use
TestFlinkRunner for Nexmark tests
URL: https://github.com/apache/beam/pull/7660#issuecomment-458573983
This is definitely solveable, but only directly in Flink. The root problem
is that once any operator shuts down, even after taking a final checkpoint,
downstream operators can't take checkpoints anymore. Often the source is done
early (think of an Impulse source), but there is still work to do which needs
to be checkpointed.
We need a global view of the watermarks, at least of the sink watermarks, to
ensure that the job can safely be shutdown. The JobManager could maintain such
a view and instruct all operators to shutdown once the global min watermark is
Long.MAX_VALUE and a final checkpoint has been taken.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 191725)
Time Spent: 1h 40m (was: 1.5h)
> [beam_PostCommit_Java_Nexmark_Flink] Consistently timing out
> ------------------------------------------------------------
>
> Key: BEAM-6510
> URL: https://issues.apache.org/jira/browse/BEAM-6510
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Daniel Oliveira
> Assignee: Kenneth Knowles
> Priority: Major
> Labels: SQL, currently-failing
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> _Use this form to file an issue for test failure:_
> * [Jenkins
> Job|https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/1688/]
> (This is the first instance where it times out.)
> * [Gradle Build Scan|https://scans.gradle.com/s/cnh2qe3m5xbw4]
> Initial investigation:
> Test seems to be timing out without an obvious reason. Strangely, the Gradle
> scans show it succeeding no problem.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
