See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/10974/display/redirect>
Changes:
------------------------------------------
[...truncated 2.30 MB...]
ff9d6d4ffed1: Preparing
d7f77018c8d5: Preparing
801d9ec76403: Preparing
4bae804cfcdc: Preparing
891fa86dfd1d: Preparing
4438bc41581a: Preparing
f370a05d981b: Preparing
7f1b631aaf7c: Waiting
1ee553d83395: Waiting
8c0c799ffbd2: Waiting
bf40d52f8afa: Waiting
ff9d6d4ffed1: Waiting
d7f77018c8d5: Waiting
801d9ec76403: Waiting
4bae804cfcdc: Waiting
891fa86dfd1d: Waiting
4438bc41581a: Waiting
f370a05d981b: Waiting
cbe775659ac1: Pushed
7f1b631aaf7c: Pushed
1ee553d83395: Pushed
8c0c799ffbd2: Pushed
bf40d52f8afa: Layer already exists
ff9d6d4ffed1: Layer already exists
d7f77018c8d5: Layer already exists
801d9ec76403: Layer already exists
4bae804cfcdc: Layer already exists
891fa86dfd1d: Layer already exists
4438bc41581a: Layer already exists
f370a05d981b: Layer already exists
444dd351bcf4: Pushed
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
This script must be executed in the root of beam project. Please set
GCS_LOCATION, PROJECT and REGION as desired.
# Where to store integration test outputs.
GCS_LOCATION=${GCS_LOCATION:-gs://temp-storage-for-end-to-end-tests}
# Project for the container and integration test
PROJECT=${PROJECT:-apache-beam-testing}
REGION=${REGION:-us-central1}
IMAGE_PREFIX="$(grep 'docker_image_default_repo_prefix' gradle.properties | cut
-d'=' -f2)"
SDK_VERSION="$(grep 'sdk_version' gradle.properties | cut -d'=' -f2)"
PY_VERSION=$1
IMAGE_NAME="${IMAGE_PREFIX}python${PY_VERSION}_sdk"
CONTAINER_PROJECT="sdks:python:container:py${PY_VERSION//.}" # Note: we
substitute away the dot in the version.
PY_INTERPRETER="python${PY_VERSION}"
XUNIT_FILE="pytest-$IMAGE_NAME.xml"
# Verify in the root of the repository
test -d sdks/python/container
# Verify docker and gcloud commands exist
command -v docker
/usr/bin/docker
command -v gcloud
/usr/bin/gcloud
docker -v
Docker version 20.10.23, build 7155243
gcloud -v
Google Cloud SDK 406.0.0
alpha 2022.10.17
beta 2022.10.17
bq 2.0.79
bundled-python3-unix 3.9.12
core 2022.10.17
gcloud-crc32c 1.0.0
gsutil 5.14
# Verify docker image has been built.
docker images | grep "apache/$IMAGE_NAME" | grep "$SDK_VERSION"
apache/beam_python3.8_sdk
2.50.0.dev 6c819b99443a 47 seconds ago 4.12GB
TAG=$(date +%Y%m%d-%H%M%S%N)
CONTAINER=us.gcr.io/$PROJECT/$USER/$IMAGE_NAME
PREBUILD_SDK_CONTAINER_REGISTRY_PATH=us.gcr.io/$PROJECT/$USER/prebuild_python${PY_VERSION//.}_sdk
echo "Using container $CONTAINER"
# Tag the docker container.
docker tag "apache/$IMAGE_NAME:$SDK_VERSION" "$CONTAINER:$TAG"
Using container us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk
# Push the container.
gcloud docker -- push $CONTAINER:$TAG
WARNING: `gcloud docker` will not be supported for Docker client versions above
18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See:
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk]
444dd351bcf4: Preparing
bfb37be03385: Preparing
2ae66e3c00a7: Preparing
7f1b631aaf7c: Preparing
1ee553d83395: Preparing
aff25dd5ddb0: Preparing
77e1f2fba20a: Preparing
2eaa4ad2751a: Preparing
f9f5dc620ebf: Preparing
801d9ec76403: Preparing
4bae804cfcdc: Preparing
891fa86dfd1d: Preparing
4438bc41581a: Preparing
f370a05d981b: Preparing
444dd351bcf4: Waiting
2eaa4ad2751a: Waiting
f9f5dc620ebf: Waiting
801d9ec76403: Waiting
4bae804cfcdc: Waiting
891fa86dfd1d: Waiting
4438bc41581a: Waiting
f370a05d981b: Waiting
bfb37be03385: Waiting
1ee553d83395: Waiting
2ae66e3c00a7: Waiting
aff25dd5ddb0: Waiting
7f1b631aaf7c: Waiting
77e1f2fba20a: Waiting
bfb37be03385: Pushed
444dd351bcf4: Pushed
7f1b631aaf7c: Layer already exists
1ee553d83395: Layer already exists
aff25dd5ddb0: Pushed
77e1f2fba20a: Layer already exists
2eaa4ad2751a: Layer already exists
f9f5dc620ebf: Layer already exists
801d9ec76403: Layer already exists
4bae804cfcdc: Layer already exists
891fa86dfd1d: Layer already exists
4438bc41581a: Layer already exists
f370a05d981b: Layer already exists
> Task :sdks:python:test-suites:dataflow:py311:validatesContainer
eba7c8cfe7c8: Pushed
blob unknown: Manifest
"sha256:12b1740a31973cb66a6397cce828bdfb3dd1b3a119f5afdfc2f88386df624f4d" blob
"sha256:9a9e034800a1747ea288f38f6087c036acac99dd3ec5255bf7798abd8c23a304"
unknown to registry.
> Task :sdks:python:test-suites:dataflow:py311:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer
blob unknown: Manifest
"sha256:b0315119bae7b83d78ef84be2a30338feff5dab2c05e2a9fbe565a8967f329cb" blob
"sha256:9a9e034800a1747ea288f38f6087c036acac99dd3ec5255bf7798abd8c23a304"
unknown to registry.
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
blob unknown: Manifest
"sha256:14abc29449db8e938bdcde19faf92df2234eec97a440a2e710ca4a95fb837d48" blob
"sha256:9a9e034800a1747ea288f38f6087c036acac99dd3ec5255bf7798abd8c23a304"
unknown to registry.
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
blob unknown: Manifest
"sha256:679a7be10e740db6343e8bdf8882e0f3da7c535cb76d35e0017478d0410c5be8" blob
"sha256:9a9e034800a1747ea288f38f6087c036acac99dd3ec5255bf7798abd8c23a304"
unknown to registry.
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 342
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 342
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 342
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 342
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18m 49s
62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date
Publishing build scan...
Publishing build scan failed due to network error
'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
Publishing failed.
The response from https://ge.apache.org/scans/publish/gradle/3.13.2/token was
not from Gradle Enterprise.
The specified server address may be incorrect, or your network environment may
be interfering.
Please report this problem to your Gradle Enterprise administrator via
https://ge.apache.org/help and include the following via copy/paste:
----------
Gradle version: 7.6.2
Plugin version: 3.13.2
Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/token
Request ID: 166439bf-103d-48f1-9c5d-9f6775f2c0a8
Response status code: 502
Response content type: text/html
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
