See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1252/display/redirect?page=changes>
Changes:
[Boyuan Zhang] [BEAM-11325] ReadFromKafkaDoFn should stop reading when
topic/partition
[heejong] [BEAM-10890] Log error counts to debug BigQuery streaming insert
[heejong] add API_REQUEST_LATENCIES, match by MetricName
[noreply] [BEAM-11092][Go SDK] Ack Harness monitoring requests (#13788)
[noreply] [BEAM-10961] Enabled strict dependencies on samza (#13667)
[heejong] fix encoding error in windows
[noreply] [BEAM-11200] Update Go SDK version on release. (#13789)
[noreply] Remove boilerplate notes from 2.27.0
------------------------------------------
[...truncated 3.67 MB...]
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(509048,
1)
{timestamp_ms=1611315194000}
late data for:
user5_AndroidGreenQuokka,AndroidGreenQuokka,18,1611315194000,2021-01-22
03:41:43.231
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r1541eb5ce9095922_0000017729e6e458_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r1541eb5ce9095922_0000017729e6e458_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6fec857bc3c6f2bf_0000017729e7de15_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6fec857bc3c6f2bf_0000017729e7de15_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r11f70c0b4fa83a9f_0000017729e8d8a2_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r11f70c0b4fa83a9f_0000017729e8d8a2_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (0s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (1s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (2s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (3s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (4s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (5s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (6s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (7s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (8s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (9s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (10s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (11s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (12s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (13s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (14s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (15s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (16s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (17s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (18s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (19s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (20s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (21s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (22s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (23s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (24s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (25s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (26s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (27s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (28s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (29s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (30s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (31s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (32s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (33s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (53s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (56s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (57s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (58s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (59s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (60s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (61s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (62s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (63s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (64s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (65s) Current status:
PENDING
Waiting on bqjob_r77df7879cc7a8255_0000017729e8e5d4_1 ... (65s) Current status:
DONE
+--------------------------+
| user |
+--------------------------+
| user0_ArmyGreenWombat |
| user3_BarnRedWombat |
| user5_AlmondAntechinus |
| user7_AsparagusCassowary |
| user10_FuchsiaBilby |
| user13_AzureCockatoo |
| user8_AsparagusWombat |
| user2_AquaBandicoot |
| user10_AlmondBandicoot |
| user13_FuchsiaKookaburra |
+--------------------------+
Verified Almond
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep
leaderboard-validation-1611315096685-239 | grep Running | cut -d' ' -f1)
Cancelled job [2021-01-22_03_31_50-5766685016160448246]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runQuickstartJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 45m 16s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/4sfg74gzm4t3c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]