See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1374/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12089] Clarify usage of --artifacts-dir for job servers.
[Ismaël Mejía] [BEAM-12329] Drain S3 read InputStreams to avoid warnings
[noreply] [BEAM-12320] Raise timeout and add logging in PubsubTableProviderIT.
[noreply] Fix overview.md for cross-language pattern
[noreply] [BEAM-12333] Changing TimerKey to include TimerFamilyId (#14802)
------------------------------------------
[...truncated 3.93 MB...]
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r13e99dc5d246e25e_000001797f6bf358_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r13e99dc5d246e25e_000001797f6bf358_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r7fab6d9acdf5fcac_000001797f6ce947_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r7fab6d9acdf5fcac_000001797f6ce947_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r2b30b959d8503755_000001797f6ddf75_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2b30b959d8503755_000001797f6ddf75_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(359648,
1)
{timestamp_ms=1621340267000}
late data for: user17_AquaEmu,AquaEmu,7,1621340267000,2021-05-18 05:23:47.534
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r31b1fe34b4a36f82_000001797f6ed652_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r31b1fe34b4a36f82_000001797f6ed652_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r76d1e2b668caa187_000001797f6fcc55_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r76d1e2b668caa187_000001797f6fcc55_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r55a98e31610587e3_000001797f70c294_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r55a98e31610587e3_000001797f70c294_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r4c3324528e1eac6b_000001797f71b8c3_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r4c3324528e1eac6b_000001797f71b8c3_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r4d0811ec6c8a3731_000001797f72af20_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r4d0811ec6c8a3731_000001797f72af20_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(595482,
1)
{timestamp_ms=1621340332000}
late data for: user10_AuburnNumbat,AuburnNumbat,3,1621340332000,2021-05-18
05:28:47.822
.........Introducing a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_ra8fe28d44a28b26_000001797f73a5f2_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_ra8fe28d44a28b26_000001797f73a5f2_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5728cd5bae8b609f_000001797f749cc0_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5728cd5bae8b609f_000001797f749cc0_1 ... (1s) Current status:
RUNNING
Waiting on bqjob_r5728cd5bae8b609f_000001797f749cc0_1 ... (2s) Current status:
RUNNING
Waiting on bqjob_r5728cd5bae8b609f_000001797f749cc0_1 ... (2s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r4e1ad21c093df834_000001797f759b89_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r4e1ad21c093df834_000001797f759b89_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r32940913df6067a_000001797f7691d2_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r32940913df6067a_000001797f7691d2_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r4ec5f92856358c3f_000001797f769e58_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r4ec5f92856358c3f_000001797f769e58_1 ... (0s) Current status:
DONE
+--------------------------+
| user |
+--------------------------+
| user3_AquaPossum |
| user6_AmaranthBandicoot |
| user1_BananaPlatypus |
| user2_BananaDingo |
| user0_AlmondDingo |
| user7_MagentaBandicoot |
| user12_AuburnNumbat |
| user5_AmethystWombat |
| user6_AuburnCockatoo |
| user9_AppleGreenPlatypus |
+--------------------------+
Verified Magenta
RUNNING_JOB=`gcloud dataflow jobs list | grep
leaderboard-validation-1621340322194-268 | grep Running | cut -d' ' -f1`
if [ ! -z "${RUNNING_JOB}" ]
then
gcloud dataflow jobs cancel ${RUNNING_JOB}
else
echo "Job 'leaderboard-validation-1621340322194-268' is not running."
fi
Cancelled job [2021-05-18_05_18_56-13064346592108413482]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:twister2:runQuickstartJavaTwister2'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 32m 18s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/j6obvfrtzzjso
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
