[
https://issues.apache.org/jira/browse/BEAM-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15220383#comment-15220383
]
ASF GitHub Bot commented on BEAM-162:
-------------------------------------
GitHub user mshields822 opened a pull request:
https://github.com/apache/incubator-beam/pull/105
[BEAM-162] Check for closed windows early
Rather than squash speculation on the bug I'll post this early.
Will do unit test and try to get more randomization into NexMark Q11 so we
can tease out these rare failures before our customers do.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mshields822/incubator-beam beam-162
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/105.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #105
----
commit 11ab1c69d8c0cbe09e3efe62a76520fd5dc30550
Author: Mark Shields <[email protected]>
Date: 2016-03-31T17:57:55Z
Check for closed windows early
----
> assert fail using session windows
> ---------------------------------
>
> Key: BEAM-162
> URL: https://issues.apache.org/jira/browse/BEAM-162
> Project: Beam
> Issue Type: Bug
> Components: runner-core
> Reporter: Mark Shields
> Assignee: Mark Shields
>
> java.lang.IllegalStateException: Window
> [2016-03-31T05:35:31.158Z..2016-03-31T06:05:31.158Z) should have been added
> at
> com.google.cloud.dataflow.sdk.repackaged.com.google.common.base.Preconditions.checkState(Preconditions.java:199)
> at
> com.google.cloud.dataflow.sdk.util.ReduceFnRunner.processElement(ReduceFnRunner.java:440)
> at
> com.google.cloud.dataflow.sdk.util.ReduceFnRunner.processElements(ReduceFnRunner.java:282)
> at
> com.google.cloud.dataflow.sdk.util.GroupAlsoByWindowViaWindowSetDoFn.processElement(GroupAlsoByWindowViaWindowSetDoFn.java:83)
> at
> com.google.cloud.dataflow.sdk.util.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:49)
> at
> com.google.cloud.dataflow.sdk.util.DoFnRunnerBase.processElement(DoFnRunnerBase.java:138)
> at
> com.google.cloud.dataflow.sdk.util.LateDataDroppingDoFnRunner.processElement(LateDataDroppingDoFnRunner.java:67)
> at
> com.google.cloud.dataflow.sdk.runners.worker.SimpleParDoFn.processElement(SimpleParDoFn.java:191)
> at
> com.google.cloud.dataflow.sdk.runners.worker.ForwardingParDoFn.processElement(ForwardingParDoFn.java:42)
> at
> com.google.cloud.dataflow.sdk.runners.worker.DataflowWorkerLoggingParDoFn.processElement(DataflowWorkerLoggingParDoFn.java:47)
> at
> com.google.cloud.dataflow.sdk.util.common.worker.ParDoOperation.process(ParDoOperation.java:53)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
