See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1211/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-11401][BEAM-11366] Change ReaderCache invalidations to be
[dpcollins] [BEAM-10114] Convert PubsubLiteIO read to use SplittableDoFn.
[dpcollins] Fix test.
[dpcollins] fix: Testing issues
[dpcollins] [BEAM-10114] Convert PubsubLiteIO to use an SDF for reads.
[dpcollins] [BEAM-10114] Add byte and time limiting
[dpcollins] [BEAM-10114] Add byte and time limiting
[dpcollins] [BEAM-10114] Add byte and time limiting
[dpcollins] [BEAM-10114] Add byte and time limiting
[dpcollins] [BEAM-10114] Add byte and time limiting
[dpcollins] [BEAM-10114] Add byte and time limiting
[David Morávek] [BEAM-11443] Implement byte-based GBK for Flink Streaming
Runner.
[dpcollins] fix: Linter issues
[dpcollins] fix: linters
[dpcollins] fix: linters
[Boyuan Zhang] Enable more tests on Java + Python FnRunner
[Pablo Estrada] Adding limitations of SchemaUpdateOptions to BQIO javadoc.
[zyichi] Bump up python container versions
[noreply] Do not add unnecessary experiment use_multiple_sdk_containers.
(#13475)
[zyichi] Skip dynamic timer test in portable spark test
[noreply] [BEAM-11360] Updates Dataflow Python multi-language pipelines to use
[Robert Bradshaw] [BEAM-11472] Support SDF on non-splitting runners such as
legacy
[noreply] Revert "Do not add unnecessary experiment
use_multiple_sdk_containers."
[dpcollins] fix: Remove unnecessary shuffle.
[dpcollins] fix: Address comments
[noreply] [BEAM-11075] Go SDK SideInput load tests (#13436)
------------------------------------------
[...truncated 795.99 KB...]
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.....................................................................................................................................................................................................................................................................................DELAY(359233,
1)
{timestamp_ms=1608118628000}
late data for:
user2_AliceBlueEchidna,AliceBlueEchidna,18,1608118628000,2020-12-16 03:43:07.899
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r79cdb92802e11576_000001766b5ce00b_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r79cdb92802e11576_000001766b5ce00b_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5efca87b57ddcaa5_000001766b5ddd41_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5efca87b57ddcaa5_000001766b5ddd41_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
........................................................................................................................................................................................................................................Introducing
a parse error.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r73ca1afcec321207_000001766b5ed7ad_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r73ca1afcec321207_000001766b5ed7ad_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rd553fa71ab4d2c8_000001766b5fd0d7_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rd553fa71ab4d2c8_000001766b5fd0d7_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
bq query --batch "SELECT user FROM
[apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_user]
LIMIT 10"
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (0s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (1s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (2s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (3s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (4s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (5s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (6s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (7s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (8s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (9s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (10s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (11s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (12s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (13s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (14s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (15s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (16s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (17s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (18s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (19s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (20s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (21s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (22s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (23s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (24s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (25s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (26s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (27s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (28s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (29s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (30s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (31s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (32s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (33s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (34s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (35s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (36s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (37s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (38s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (39s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (40s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (41s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (42s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (43s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (44s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (45s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (46s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (47s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (49s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (50s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (51s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (52s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (53s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (54s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (55s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (56s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (57s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (58s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (59s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (60s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (61s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (62s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (63s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (64s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (65s) Current status:
PENDING
Waiting on bqjob_r2f70dc63a3a05e42_000001766b5fe367_1 ... (65s) Current status:
DONE
+--------------------------+
| user |
+--------------------------+
| user3_AuburnCaneToad |
| user10_AmberKookaburra |
| user1_AliceBlueEchidna |
| user6_AzureKoala |
| user13_ApricotEmu |
| user11_BeigeEchidna |
| user11_BattleshipGreyEmu |
| user4_AlmondBandicoot |
| user3_RubyCockatoo |
| user0_FuchsiaEmu |
+--------------------------+
Verified AliceBlue
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep
leaderboard-validation-1608118374893-517 | grep Running | cut -d' ' -f1)
Cancelled job [2020-12-16_03_33_13-15595681554581857349]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner. with Streaming Engine
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:flink:1.10:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 47m 48s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/33646ppfge7gm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
