[
https://issues.apache.org/jira/browse/BEAM-12842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411379#comment-17411379
]
Sam Rohde commented on BEAM-12842:
----------------------------------
The test is essentially a copy of testBasic except with an extra log existence
assertion at the end. This would indicate a flake with the test infrastructure.
Looks like this is the first flake for the test, so maybe it's related a recent
change? The three most recent changes in the Dataflow worker are the following,
with the first two being related to streaming:
*
[https://github.com/apache/beam/commit/2135e5e6d1ffc778a4efc83b78dc8af86c6db3be#diff-d47e0a84a3abe960382f7eda4159284c6af01b17e6214268ba54e978f1681414]
*
[https://github.com/apache/beam/commit/de7e7d3e82a461f7250917c1011ad0e88d00e0bf#diff-d47e0a84a3abe960382f7eda4159284c6af01b17e6214268ba54e978f1681414]
*
[https://github.com/apache/beam/commit/8bd1e208685518148fa574797bd7d7c08d430bf5#diff-d47e0a84a3abe960382f7eda4159284c6af01b17e6214268ba54e978f1681414]
> StreamingDataflowWorkerTest.testHotKeyLogging tests are flaky
> -------------------------------------------------------------
>
> Key: BEAM-12842
> URL: https://issues.apache.org/jira/browse/BEAM-12842
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Valentyn Tymofieiev
> Assignee: Sam Rohde
> Priority: P1
> Labels: test-failures
>
> Hi Sam, would you be able to please help take a look at these test failures:
> https://ci-beam.apache.org/job/beam_PreCommit_Java_Cron/4455/testReport/junit/org.apache.beam.runners.dataflow.worker/StreamingDataflowWorkerTest/testHotKeyLogging_1___streamingEngine_true___2/
> {noformat}
> org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.testHotKeyLogging[1:
> [streamingEngine=true]]
> Failing for the past 1 build (Since #4455 )
> Took 15 sec.
> Error Message
> java.lang.AssertionError: Should have received 2000 more commits beyond 0
> commits already seen, but after 10s have only seen {0=key: "key"
> work_token: 0
> output_messages {
> bundles {
> key: "key"
> messages {
> timestamp: 0
> data: "data0"
> metadata: "\017\000\000\000\001\200\000\000\000\000\000\b\272\350\a"
> }
> messages_ids: ""
> }
> destination_stream_id: "out"
> }
> sharding_key: 12345
> cache_token: 3
> , 1=key: "key"
> work_token: 1
> output_messages {
> bundles {
> key: "key"
> messages {
> timestamp: 0
> data: "data1"
> metadata: "\017\000\000\000\001\200\000\000\000\000\000\b\272\350\a"
> }
> messages_ids: ""
> }
> destination_stream_id: "out"
> }
> sharding_key: 12345
> cache_token: 3
> , 2=key: "key"
> work_token: 2
> output_messages {
> bundles {
> key: "key"
> messages {
> timestamp: 0
> data: "data2"
> metadata: "\017\000\000\000\001\200\000\000\000\000\000\b\272\350\a"
> }
> messages_ids: ""
> }
> destination_stream_id: "out"
> }
> ...
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
