See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1372/display/redirect>
Changes:
------------------------------------------
[...truncated 3.92 MB...]
Waiting on bqjob_r875a6ff6a887b40_00000179751db604_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
May 16, 2021 12:19:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-16T12:19:14.899Z: Autoscaling: Raised the number of workers to 1
so that the pipeline can catch up with its backlog and keep up with its input
rate.
May 16, 2021 12:19:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-16T12:19:46.786Z: Workers have started successfully.
May 16, 2021 12:19:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-16T12:19:46.807Z: Workers have started successfully.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_re39ae85c245373f_00000179751eaf9a_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_re39ae85c245373f_00000179751eaf9a_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r6a3d60f87482f0d9_00000179751fa6f7_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r6a3d60f87482f0d9_00000179751fa6f7_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r2568092e06b41296_0000017975209e48_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2568092e06b41296_0000017975209e48_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(571408,
1)
{timestamp_ms=1621167219000}
late data for: user3_AmberCaneToad,AmberCaneToad,12,1621167219000,2021-05-16
05:23:10.412
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r7df0619cdac380e2_000001797521951a_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r7df0619cdac380e2_000001797521951a_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rc02b9cbdb23fcfe_0000017975228d72_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rc02b9cbdb23fcfe_0000017975228d72_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r66e9b7c0de6040a4_0000017975238466_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r66e9b7c0de6040a4_0000017975238466_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r777d728124933784_0000017975247bab_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r777d728124933784_0000017975247bab_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
.....................................................................................................................................................................................................................................................................................................................................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r3bd13879a94a692_0000017975257236_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r3bd13879a94a692_0000017975257236_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
..................................................................................................................................................................................DELAY(330123,
1)
{timestamp_ms=1621167760000}
late data for: user1_BeigeDingo,BeigeDingo,2,1621167760000,2021-05-16
05:28:11.097
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r1900e4b2d4d522cf_0000017975266ca7_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r1900e4b2d4d522cf_0000017975266ca7_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
..............................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r2e390920abce3350_00000179752763f3_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r2e390920abce3350_00000179752763f3_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
...................................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r1b691a0a6b6eb549_0000017975285a9c_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r1b691a0a6b6eb549_0000017975285a9c_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r3df0485f62783ba4_0000017975295241_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r3df0485f62783ba4_0000017975295241_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r17eedf95b374d550_0000017975295f13_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r17eedf95b374d550_0000017975295f13_1 ... (0s) Current status:
DONE
+-------------------------+
| user |
+-------------------------+
| user15_AquaCockatoo |
| user8_BananaPlatypus |
| user10_AmberCaneToad |
| user6_RubyPossum |
| user6_BananaBandicoot |
| user13_AmaranthCaneToad |
| user5_ApricotKoala |
| user0_AmaranthCockatoo |
| user7_AlmondAntechinus |
| user9_BattleshipGreyEmu |
+-------------------------+
Verified Almond
RUNNING_JOB=`gcloud dataflow jobs list | grep
leaderboard-validation-1621167484529-864 | grep Running | cut -d' ' -f1`
if [ ! -z "${RUNNING_JOB}" ]
then
gcloud dataflow jobs cancel ${RUNNING_JOB}
else
echo "Job 'leaderboard-validation-1621167484529-864' is not running."
fi
Cancelled job [2021-05-16_05_18_21-15477042269387351049]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 31m 44s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/3h67ffdkali2k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
