See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/919/display/redirect?page=changes>
Changes:
[heejong] [BEAM-9056] Staging artifacts from environment
[github] Fixing apache_beam.io.gcp.bigquery_test:PubSubBigQueryIT. at head
[github] Verify schema early in ToJson and JsonToRow (#11105)
[github] Merge pull request #11103 from [BEAM-9494] Reifying outputs from BQ
file
[github] [BEAM-8335] Implemented Capture Size limitation (#11050)
[github] [BEAM-9294] Move RowJsonException out of RowJsonSerializer (#11102)
[github] Merge pull request #11046: [BEAM-9442] Properly handle nullable fields
[ankurgoenka] [BEAM-9287] disable validates runner test which uses teststreams
for
[sunjincheng121] [BEAM-9299-PR]Upgrade Flink Runner 1.8x to 1.8.3 and 1.9x to
1.9.2
------------------------------------------
[...truncated 3.28 MB...]
Waiting on bqjob_r26e482723b91ff1c_00000170d3a255aa_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r73fc2f7c16da918d_00000170d3a34d9c_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r73fc2f7c16da918d_00000170d3a34d9c_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
............................................................................................................................................................................................................................................................................DELAY(399164,
1)
{timestamp_ms=1584098301000}
late data for:
user1_AmberAntechinus,AmberAntechinus,11,1584098301000,2020-03-13 04:25:00.675
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6aa6e01dfd78e26d_00000170d3a44520_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6aa6e01dfd78e26d_00000170d3a44520_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5bb865a93e01c94d_00000170d3a53c6f_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5bb865a93e01c94d_00000170d3a53c6f_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (0s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (1s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (2s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (3s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (4s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (5s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (6s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (7s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (8s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (9s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (10s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (11s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (12s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (13s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (14s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (15s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (16s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (17s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (18s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (19s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (20s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (21s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (22s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (23s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (24s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (25s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (26s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (27s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (28s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (29s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (30s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (31s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (32s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (33s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (48s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (53s) Current status:
PENDING
...................................................................................................................................................................................................................................................................................................Introducing
a parse error.
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (56s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (57s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (58s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (59s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (60s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (61s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (62s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (63s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (64s) Current status:
PENDING
Waiting on bqjob_r14d8970934cca327_00000170d3a54a17_1 ... (64s) Current status:
DONE
+------------------------------+
| user |
+------------------------------+
| user8_AlmondPossum |
| user1_ArmyGreenBandicoot |
| user2_ArmyGreenMarmot |
| user6_BattleshipGreyCaneToad |
| user17_BananaCassowary |
| user10_AlmondDingo |
| user10_AmberNumbat |
| user10_AndroidGreenEmu |
| user4_AndroidGreenWombat |
| user0_AlmondBilby |
+------------------------------+
Verified Almond
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep
leaderboard-validation-1584098083327-189 | grep Running | cut -d' ' -f1)
ERROR: (gcloud.dataflow.jobs.cancel) argument JOB_ID [JOB_ID ...]: Must be
specified.
Usage: gcloud dataflow jobs cancel JOB_ID [JOB_ID ...] [optional flags]
optional flags may be --help | --region
For detailed information on this command and its flags, run:
gcloud dataflow jobs cancel --help
ERROR: (gcloud.dataflow.jobs.cancel) argument JOB_ID [JOB_ID ...]: Must be
specified.
Usage: gcloud dataflow jobs cancel JOB_ID [JOB_ID ...] [optional flags]
optional flags may be --help | --region
For detailed information on this command and its flags, run:
gcloud dataflow jobs cancel --help
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 27m 23s
8 actionable tasks: 8 executed
Publishing build scan...
https://gradle.com/s/wpjts2lq667rm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
