See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1189/display/redirect?page=changes>
Changes:
[sychen] Add an option to GroupIntoBatches to output ShardedKeys. Update
Dataflow
[teodor] Nexmark: fix typos and clean unused options
[emilyye] add to dashboard
[emilyye] fix Java 11 HOME
[noreply] [BEAM-10124] Announce ContextualTextIO in Beam 2.26.0. (#13402)
[noreply] [BEAM-10896] Support ZetaSQL UNNEST syntax on array of struct type
[noreply] [BEAM-11324] Add additional verification in PartitioningSession
(#13401)
[noreply] [BEAM-10921]: Fix BEAM-10921 and underlying issues (#13335)
[noreply] remove tabs in shared
[noreply] [BEAM-9980] do not use hardcoded python versions in validate container
[noreply] [BEAM-9980] do not use hardcoded python versions in chicago taxi
example
------------------------------------------
[...truncated 590.55 KB...]
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rbd25aaa68ef3c76_00000175ff1f5cf9_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rbd25aaa68ef3c76_00000175ff1f5cf9_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 25, 2020 11:17:31 AM
org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS LINE REPRESENTS CORRUPT DATA AND WILL CAUSE A PARSE
ERROR,1606302918000,2020-11-25 03:15:18.196, For input string: "2020-11-25
03:15:18.196"
.............................................................................................................................................................................................................................................................................................................................................DELAY(478880,
1)
{timestamp_ms=1606302607000}
late data for: Robot-4,AsparagusPlatypus,8,1606302607000,2020-11-25 03:18:06.030
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r3c9aa73269969b37_00000175ff205875_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r3c9aa73269969b37_00000175ff205875_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 25, 2020 11:18:37 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_user
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r33b3f78cc4c2139_00000175ff21511d_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r33b3f78cc4c2139_00000175ff21511d_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DirectRunner_user]
LIMIT 10"
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (0s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (1s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (2s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (3s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (4s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (5s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (6s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (7s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (8s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (9s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (10s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (11s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (12s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (13s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (14s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (15s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (16s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (17s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (18s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (19s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (20s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (21s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (22s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (23s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (24s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (25s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (26s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (27s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (28s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (29s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (30s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (31s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (32s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (48s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (53s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (56s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (57s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (58s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (59s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (60s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (61s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (62s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (63s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (64s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (65s) Current status:
PENDING
Waiting on bqjob_r7f52d55431df557b_00000175ff216073_1 ... (65s) Current status:
DONE
+-------------------------+
| user |
+-------------------------+
| user6_AmaranthWallaby |
| user4_AzurePlatypus |
| user7_RubyBandicoot |
| user7_FuchsiaCaneToad |
| user6_AmberCaneToad |
| user6_AzureCassowary |
| user3_AsparagusPlatypus |
| user16_AquaEchidna |
| user5_AquaEchidna |
| user6_RubyBandicoot |
+-------------------------+
Verified Amaranth
**************************************
* SUCCESS: LeaderBoard successfully run on DirectRunner.
**************************************
[SUCCESS]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:flink:1.10:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 20m 31s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/yhop2c4xnlc3i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
