See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/987/display/redirect?page=changes>
Changes:
[pawel.pasterz] [BEAM-2530] PreCommit Dataflow examples - test compiled with
java 11
[pabloem] [BEAM-9967] Adding support for BQ labels on Query/Export jobs. (Roll
[github] [BEAM-9634] Add natural language analysis transform (#11611)
[github] [BEAM-9430] Fixes the bounds of initial watermark set to estimators
[kcweaver] [BEAM-9993] Add option defaults for Flink Python tests.
[github] [BEAM-9941] Added a test of a GBK followed by a Flatten with an unknown
[github] Clarify pubsub IO comment about timestamps (#11672)
[iemejia] [BEAM-9833] Add yamllint config
[iemejia] [BEAM-9833] Fix .asf.yaml issues, sort labels and disable rebase
button
[github] Clarifies an error message in Katas to explain what is actually wrong.
[github] Merge pull request #11210 from [BEAM-8949] SpannerIO integration tests
[github] [BEAM-9876] Migrate the Beam website from Jekyll to Hugo to enable
[github] Update the range for pyarrow to qualify pyarrow 0.17.x (#11699)
[yifanzou] Run Inventory job twice a day at 6 and 18.
[github] Update release notes link for 2.20.0
------------------------------------------
[...truncated 3.30 MB...]
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r7a10edfdf0a56a59_00000172181fa287_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r7a10edfdf0a56a59_00000172181fa287_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5639d0c7bb7a0acc_0000017218209acf_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5639d0c7bb7a0acc_0000017218209acf_1 ... (1s) Current status:
RUNNING
Waiting on bqjob_r5639d0c7bb7a0acc_0000017218209acf_1 ... (1s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r12aac7e4acbf8ab6_0000017218219859_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r12aac7e4acbf8ab6_0000017218219859_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5a0da748ebc2e1d_00000172182290b3_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5a0da748ebc2e1d_00000172182290b3_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(540025,
1)
{timestamp_ms=1589542309000}
late data for:
user7_AliceBlueCassowary,AliceBlueCassowary,15,1589542309000,2020-05-15
04:40:49.888
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r732c56a7b61f70c_00000172182388b6_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r732c56a7b61f70c_00000172182388b6_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r2443e70edd78805a_000001721824829b_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2443e70edd78805a_000001721824829b_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r66e44e707ec78487_0000017218257bb2_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r66e44e707ec78487_0000017218257bb2_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r67d5877bba4a0e2e_000001721826743f_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r67d5877bba4a0e2e_000001721826743f_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r633a02233fcb508c_0000017218276be4_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r633a02233fcb508c_0000017218276be4_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
................................................................................................................................................................................DELAY(456625,
1)
{timestamp_ms=1589542694000}
late data for:
user0_AndroidGreenKookaburra,AndroidGreenKookaburra,19,1589542694000,2020-05-15
04:45:51.156
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r354f73f25a143736_0000017218286392_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r354f73f25a143736_0000017218286392_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
...........................................................................................................................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r35de513eddf67389_0000017218295d16_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r35de513eddf67389_0000017218295d16_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6127ee92f636845e_00000172182a5573_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6127ee92f636845e_00000172182a5573_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6017a74519bc3fa2_00000172182b4e3d_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6017a74519bc3fa2_00000172182b4e3d_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
..................................................................................................................................................................................................................................................................................................................................................................................
team (AmethystBandicoot, num members: 16, starting at: 1589542248123, expires
in: 20, robot: null) is too old; replacing.
start time: 1589542248123, end time: 1589543448123, current time:1589543448277
[-(AmethystBandicoot, num members: 16, starting at: 1589542248123, expires in:
20, robot: null)]
[+(ApricotCockatoo, num members: 6, starting at: 1589543448278, expires in: 34,
robot: null)]
..........DELAY(525812, 1)
{timestamp_ms=1589542928000}
late data for:
user7_AliceBlueCassowary,AliceBlueCassowary,2,1589542928000,2020-05-15
04:50:53.816
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep
leaderboard-validation-1589542241349-509 | grep Running | cut -d' ' -f1)
ERROR: (gcloud.dataflow.jobs.cancel) argument JOB_ID [JOB_ID ...]: Must be
specified.
Usage: gcloud dataflow jobs cancel JOB_ID [JOB_ID ...] [optional flags]
optional flags may be --help | --region
For detailed information on this command and its flags, run:
gcloud dataflow jobs cancel --help
ERROR: (gcloud.dataflow.jobs.cancel) argument JOB_ID [JOB_ID ...]: Must be
specified.
Usage: gcloud dataflow jobs cancel JOB_ID [JOB_ID ...] [optional flags]
optional flags may be --help | --region
For detailed information on this command and its flags, run:
gcloud dataflow jobs cancel --help
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 50m 37s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/xoqehqmq7q3n6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
