See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1370/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-8644] Bump freemarker to 2.3.31
[Kyle Weaver] [BEAM-12332] [zetasql] Support NUMERIC type in Java UDF.
[zyichi] [BEAM-12311] Increase python post commit job timeout to 2 hours.
------------------------------------------
[...truncated 3.91 MB...]
Waiting on bqjob_r2cbd37ca02cd85f2_000001796ad1eb1c_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2cbd37ca02cd85f2_000001796ad1eb1c_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
May 14, 2021 12:20:19 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-14T12:20:19.127Z: Autoscaling: Raised the number of workers to 1
so that the pipeline can catch up with its backlog and keep up with its input
rate.
May 14, 2021 12:20:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-14T12:20:59.241Z: Workers have started successfully.
May 14, 2021 12:20:59 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-14T12:20:59.314Z: Workers have started successfully.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r33f93270e8d20743_000001796ad2e1ab_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r33f93270e8d20743_000001796ad2e1ab_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r1a1ac6154ad01db5_000001796ad3d8a3_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r1a1ac6154ad01db5_000001796ad3d8a3_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6e41b47091c1d2c_000001796ad4d09d_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6e41b47091c1d2c_000001796ad4d09d_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(388430,
1)
{timestamp_ms=1620994665000}
late data for: user9_AlmondKoala,AlmondKoala,9,1620994665000,2021-05-14
05:24:13.525
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r30b8aa2dbdc72d0d_000001796ad5c72e_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r30b8aa2dbdc72d0d_000001796ad5c72e_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r375c5aa624dfd10b_000001796ad6be5e_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r375c5aa624dfd10b_000001796ad6be5e_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r2a75b846e112670c_000001796ad7b52f_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2a75b846e112670c_000001796ad7b52f_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_ra517115205740ad_000001796ad8abe9_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_ra517115205740ad_000001796ad8abe9_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r10a7bcd3b7ef4704_000001796ad9a2ce_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r10a7bcd3b7ef4704_000001796ad9a2ce_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(323286,
1)
{timestamp_ms=1620995030000}
late data for: user0_RubyPossum,RubyPossum,9,1620995030000,2021-05-14
05:29:13.917
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rc039ebec2a3857a_000001796ada9994_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rc039ebec2a3857a_000001796ada9994_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r7e8c7f9c762a5a97_000001796adb906e_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r7e8c7f9c762a5a97_000001796adb906e_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rea83232cd841781_000001796adc8745_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rea83232cd841781_000001796adc8745_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r60a68ae0a241f5ad_000001796add7df8_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r60a68ae0a241f5ad_000001796add7df8_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r12613f2a197cc88d_000001796add8a42_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r12613f2a197cc88d_000001796add8a42_1 ... (0s) Current status:
DONE
+------------------------------+
| user |
+------------------------------+
| user5_RubyPossum |
| user3_BisqueNumbat |
| user4_AuburnMarmot |
| user15_BeigeWombat |
| user0_AntiqueBrassAntechinus |
| user3_AmberCockatoo |
| user1_AzureDingo |
| user5_AzureCockatoo |
| user5_ArmyGreenAntechinus |
| user8_AlmondQuokka |
+------------------------------+
Verified Almond
RUNNING_JOB=`gcloud dataflow jobs list | grep
leaderboard-validation-1620994746633-999 | grep Running | cut -d' ' -f1`
if [ ! -z "${RUNNING_JOB}" ]
then
gcloud dataflow jobs cancel ${RUNNING_JOB}
else
echo "Job 'leaderboard-validation-1620994746633-999' is not running."
fi
Cancelled job [2021-05-14_05_19_23-14401064485362499330]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 32m 41s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/vwvdncwaqg5hm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
