See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1545/display/redirect?page=changes>
Changes:
[noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899)
[noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773)
[noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910)
[noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887)
[noreply] [Go SDK] Go SDK Exits Experimental (#15894)
[joseinigo] [BEAM-13080] Fix number of default keys
[joseinigo] [BEAM-13080] Fix number of default keys
------------------------------------------
[...truncated 2.84 MB...]
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_rc77279b40be4150_0000017cf5305a63_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_rc77279b40be4150_0000017cf5305a63_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 06, 2021 12:19:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-11-06T12:19:34.636Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5a19515f9bb7f1a3_0000017cf531513c_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5a19515f9bb7f1a3_0000017cf531513c_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5415c23eb4d945eb_0000017cf53247a7_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5415c23eb4d945eb_0000017cf53247a7_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r39e4c235ed52d824_0000017cf5333dcf_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r39e4c235ed52d824_0000017cf5333dcf_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 06, 2021 12:22:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-11-06T12:22:30.681Z: Staged package
beam-model-job-management-2.35.0-SNAPSHOT-KKvQytaubkgYfKazujDngGgj18UIzulC-O8L4fytBD0.jar
at location
'gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-model-job-management-2.35.0-SNAPSHOT-KKvQytaubkgYfKazujDngGgj18UIzulC-O8L4fytBD0.jar'
is inaccessible.
Nov 06, 2021 12:22:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-11-06T12:22:30.905Z: Staged package
beam-sdks-java-extensions-arrow-2.35.0-SNAPSHOT-VXwYbZZoCuthyx7EE36b9V56wyEY_qfjWrx1joiidWI.jar
at location
'gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-extensions-arrow-2.35.0-SNAPSHOT-VXwYbZZoCuthyx7EE36b9V56wyEY_qfjWrx1joiidWI.jar'
is inaccessible.
Nov 06, 2021 12:22:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-11-06T12:22:34.985Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(537194,
1)
{timestamp_ms=1636200858000}
late data for: user5_AmberCassowary,AmberCassowary,11,1636200858000,2021-11-06
05:23:16.079
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r452b038346ea8b5a_0000017cf53433dc_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r452b038346ea8b5a_0000017cf53433dc_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5dddd48e2fe4e46c_0000017cf5352b4f_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5dddd48e2fe4e46c_0000017cf5352b4f_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 06, 2021 12:25:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-11-06T12:25:35.465Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r261a4f403170212_0000017cf53621cb_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r261a4f403170212_0000017cf53621cb_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r41c8a29b64521753_0000017cf53718bb_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r41c8a29b64521753_0000017cf53718bb_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5764e2fcfffde4f4_0000017cf538106c_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5764e2fcfffde4f4_0000017cf538106c_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(462464,
1)
{timestamp_ms=1636201236000}
late data for:
user7_MagentaKookaburra,MagentaKookaburra,1,1636201236000,2021-11-06
05:28:18.917
Nov 06, 2021 12:28:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-11-06T12:28:30.656Z: Staged package
beam-model-job-management-2.35.0-SNAPSHOT-KKvQytaubkgYfKazujDngGgj18UIzulC-O8L4fytBD0.jar
at location
'gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-model-job-management-2.35.0-SNAPSHOT-KKvQytaubkgYfKazujDngGgj18UIzulC-O8L4fytBD0.jar'
is inaccessible.
Nov 06, 2021 12:28:31 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-11-06T12:28:30.835Z: Staged package
beam-sdks-java-extensions-arrow-2.35.0-SNAPSHOT-VXwYbZZoCuthyx7EE36b9V56wyEY_qfjWrx1joiidWI.jar
at location
'gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/beam-sdks-java-extensions-arrow-2.35.0-SNAPSHOT-VXwYbZZoCuthyx7EE36b9V56wyEY_qfjWrx1joiidWI.jar'
is inaccessible.
Nov 06, 2021 12:28:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-11-06T12:28:34.764Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r554fc492c1075a57_0000017cf539076a_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r554fc492c1075a57_0000017cf539076a_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r1fff9db4134cb8f1_0000017cf539fedc_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r1fff9db4134cb8f1_0000017cf539fedc_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r4e161e5c57ae3213_0000017cf53af529_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r4e161e5c57ae3213_0000017cf53af529_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
Nov 06, 2021 12:31:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-11-06T12:31:34.850Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r5bd679b35e0b0208_0000017cf53beb62_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r5bd679b35e0b0208_0000017cf53beb62_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| hourly_team_score_python_dataflow |
| hourly_team_score_python_direct |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Waiting for pipeline to produce more results...
RUNNING_JOB=`gcloud dataflow jobs list | grep
leaderboard-validation-1636200776453-919 | grep Running | cut -d' ' -f1`
if [ ! -z "${RUNNING_JOB}" ]
then
gcloud dataflow jobs cancel ${RUNNING_JOB}
else
echo "Job 'leaderboard-validation-1636200776453-919' is not running."
fi
Cancelled job [2021-11-06_05_13_15-5476843435203134303]
[ERROR] FAILED: Failed running LeaderBoard on DataflowRunner
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 32m 42s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/oppsr3mdwqgqk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
