See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1308/display/redirect?page=changes>
Changes:
[yoshiki.obata] [BEAM-9372] remove python version check whether python 3.6
above or not
[shehzaad] [BEAM-10961] enable strict dependency checking for
sdks/java/io/debezium
[shehzaad] [BEAM-10961] Enable strict dependency checking on Google Cloud
Dataflow
[Ismaël Mejía] [BEAM-11958] Don't use new Jackson APIs to avoid classpath
issues when
[Kenneth Knowles] Include Cron run in postcommit health dashboard
[Robert Bradshaw] [BEAM-11719] Allow encoding protos and dataclasses as
deterministically.
[Robert Bradshaw] Better type inference for GroupBy.
[Robert Bradshaw] Add support for named tuples.
[Robert Bradshaw] Named tuple pickling fix for Python 3.6.
[noreply] [BEAM-11962] Disable failing test (#14202)
[Kenneth Knowles] GroupIntoBatches test uses stateful ParDo
[Kenneth Knowles] Always use portable job submission for Dataflow runner v2
[noreply] [BEAM-11715] [BEAM-11694] Re-enable (conditional) combiner packing.
[Kenneth Knowles] Moving to 2.30.0-SNAPSHOT on master branch.
[noreply] [BEAM-11887] Change SortingFlinkCombineRunner usage to only for
Sessions
[Kenneth Knowles] Only clone to depth 1 for cutting release branch
------------------------------------------
[...truncated 4.00 MB...]
late data for:
user5_BattleshipGreyBilby,BattleshipGreyBilby,2,1615552099000,2021-03-12
04:34:14.276
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r47504e5be7846279_00000178266e8701_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r47504e5be7846279_00000178266e8701_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.....................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r55eda336a5b12dce_00000178266f7ded_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r55eda336a5b12dce_00000178266f7ded_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r138e4c54947e437e_0000017826707519_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r138e4c54947e437e_0000017826707519_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_re7f65269c85a414_0000017826716e80_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_re7f65269c85a414_0000017826716e80_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (0s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (1s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (2s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (3s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (4s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (5s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (6s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (7s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (8s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (9s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (10s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (11s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (12s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (13s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (14s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (15s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (16s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (17s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (18s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (19s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (20s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (21s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (22s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (23s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (24s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (25s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (26s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (27s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (28s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (29s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (30s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (31s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (32s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (33s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (48s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (53s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (56s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (57s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (58s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (59s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (60s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (61s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (62s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (63s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (64s) Current status:
PENDING
Waiting on bqjob_r63348e4a7375fef1_0000017826717c1c_1 ... (64s) Current status:
DONE
+-----------------------------+
| user |
+-----------------------------+
| user2_BeigeWombat |
| user8_BananaKoala |
| user1_AmethystBandicoot |
| user0_AmaranthEmu |
| user12_BattleshipGreyWombat |
| user15_ArmyGreenEchidna |
| user17_AquaKookaburra |
| user6_AliceBlueCaneToad |
| user9_BeigeWombat |
| user1_AquaKookaburra |
+-----------------------------+
Verified AliceBlue
RUNNING_JOB=`gcloud dataflow jobs list | grep
leaderboard-validation-1615551845269-682 | grep Running | cut -d' ' -f1`
if [ ! -z "${RUNNING_JOB}" ]
then
gcloud dataflow jobs cancel ${RUNNING_JOB}
else
echo "Job 'leaderboard-validation-1615551845269-682' is not running."
fi
Job 'leaderboard-validation-1615551845269-682' is not running.
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 38m 46s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/bed2ac2dw5lbq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
