See 
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/8974/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in 
BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on 
Dataflow,

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test 
for


------------------------------------------
[...truncated 84.19 KB...]
  Attempting uninstall: pluggy
    Found existing installation: pluggy 1.0.0
    Uninstalling pluggy-1.0.0:
      Successfully uninstalled pluggy-1.0.0

> Task :sdks:python:test-suites:dataflow:py37:installGcpTest
  Building wheel for apache-beam (setup.py): finished with status 'done'
  Created wheel for apache-beam: 
filename=apache_beam-2.38.0.dev0-py3-none-any.whl size=2694808 
sha256=c2255afcdfef9491c4810ea8ac3567732597c210d53c068f1212929b3848e6fb
  Stored in directory: 
/home/jenkins/.cache/pip/wheels/18/bd/48/584e2d350bb659681294f31cc0773a0499a232825b103450c0
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, 
crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, 
typing-extensions, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, 
pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, 
pbr, orjson, oauthlib, numpy, more-itertools, jmespath, isodate, idna, 
greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, 
execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, 
atomicwrites, sqlalchemy, requests, pydot, pyarrow, pluggy, pandas, overrides, 
mock, httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, 
freezegun, cffi, botocore, s3transfer, requests-oauthlib, requests_mock, 
pytest, oauth2client, hdfs, grpc-google-iam-v1, google-api-core, docker, 
deprecation, cryptography, azure-core, testcontainers, pytest-timeout, 
pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, 
pytest-xdist, google-cloud-vision, google-cloud-videointelligence, 
google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, 
google-cloud-language, google-cloud-dlp, google-cloud-datastore, 
google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, 
azure-storage-blob, google-cloud-pubsublite
  Attempting uninstall: pyparsing
    Found existing installation: pyparsing 3.0.7
    Uninstalling pyparsing-3.0.7:
      Successfully uninstalled pyparsing-3.0.7
  Attempting uninstall: pluggy
    Found existing installation: pluggy 1.0.0
    Uninstalling pluggy-1.0.0:
      Successfully uninstalled pluggy-1.0.0

> Task :sdks:python:test-suites:dataflow:py38:installGcpTest
  Building wheel for apache-beam (setup.py): finished with status 'done'
  Created wheel for apache-beam: 
filename=apache_beam-2.38.0.dev0-py3-none-any.whl size=2694808 
sha256=2ae027daa78697ef9d6a1a1878152dee69c78acc73f3834da82efbbff84cf898
  Stored in directory: 
/home/jenkins/.cache/pip/wheels/b8/4b/7e/ed467ea733f4beb3f55f279be12a1063550965fd4bd02dd42f
Successfully built apache-beam
Installing collected packages: wcwidth, pytz, pyasn1, parameterized, docopt, 
crcmod, certifi, wrapt, websocket-client, urllib3, typing-utils, 
typing-extensions, tenacity, rsa, pyyaml, python-dateutil, pyparsing, pymysql, 
pymongo, pyhamcrest, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, 
pluggy, pbr, orjson, oauthlib, numpy, more-itertools, jmespath, isodate, idna, 
greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, 
execnet, dill, cloudpickle, charset-normalizer, cachetools, attrs, 
atomicwrites, sqlalchemy, requests, pydot, pyarrow, pandas, overrides, mock, 
httplib2, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, 
freezegun, cffi, botocore, s3transfer, requests-oauthlib, requests_mock, 
pytest, oauth2client, hdfs, grpc-google-iam-v1, google-api-core, docker, 
deprecation, cryptography, azure-core, testcontainers, pytest-timeout, 
pytest-forked, msrest, google-cloud-core, google-apitools, boto3, apache-beam, 
pytest-xdist, google-cloud-vision, google-cloud-videointelligence, 
google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, 
google-cloud-language, google-cloud-dlp, google-cloud-datastore, 
google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, 
azure-storage-blob, google-cloud-pubsublite
  Attempting uninstall: pyparsing
    Found existing installation: pyparsing 3.0.7
    Uninstalling pyparsing-3.0.7:
      Successfully uninstalled pyparsing-3.0.7
  Attempting uninstall: pluggy
    Found existing installation: pluggy 1.0.0
    Uninstalling pluggy-1.0.0:
      Successfully uninstalled pluggy-1.0.0
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 
azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.21 botocore-1.24.21 
cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 
cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 deprecation-2.1.0 dill-0.3.1.1 
docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.10 fasteners-0.17.3 
freezegun-1.2.0 google-api-core-1.31.5 google-apitools-0.5.31 
google-auth-1.35.0 google-cloud-bigquery-2.34.2 
google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 
google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 
google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 
google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 
google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 
google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 
googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 
grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 
isodate-0.6.1 jmespath-1.0.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 
numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.7 overrides-6.1.0 
pandas-1.4.1 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 
psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 
pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 
pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 
pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 
requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 
s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 
typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 
websocket-client-1.3.1 wrapt-1.14.0

> Task :sdks:python:test-suites:dataflow:py39:installGcpTest
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 
azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.21 botocore-1.24.21 
cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 
cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 deprecation-2.1.0 dill-0.3.1.1 
docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.10 fasteners-0.17.3 
freezegun-1.2.0 google-api-core-1.31.5 google-apitools-0.5.31 
google-auth-1.35.0 google-cloud-bigquery-2.34.2 
google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 
google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 
google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 
google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 
google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 
google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 
googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 
grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 
isodate-0.6.1 jmespath-1.0.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 
numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.7 overrides-6.1.0 
pandas-1.4.1 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 
psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 
pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 
pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 
pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 
requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 
s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 
typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 
websocket-client-1.3.1 wrapt-1.14.0

> Task :sdks:python:test-suites:dataflow:py36:installGcpTest
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 
azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.21 botocore-1.24.21 
cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 
cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 dataclasses-0.8 
deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 
fastavro-1.4.7 fasteners-0.17.3 freezegun-1.2.0 google-api-core-1.31.5 
google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.34.2 
google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 
google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 
google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 
google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 
google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 
google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 
googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 
grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 
isodate-0.6.1 jmespath-0.10.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 
numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.1 overrides-6.1.0 
pandas-1.1.5 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 
psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 
pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 
pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 
pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 
requests-2.27.1 requests-mock-1.9.3 requests-oauthlib-1.3.1 rsa-4.8 
s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 
typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 
websocket-client-1.3.1 wrapt-1.14.0

> Task :sdks:python:test-suites:dataflow:py37:installGcpTest
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 
azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.21 botocore-1.24.21 
cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 
cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 deprecation-2.1.0 dill-0.3.1.1 
docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.10 fasteners-0.17.3 
freezegun-1.2.0 google-api-core-1.31.5 google-apitools-0.5.31 
google-auth-1.35.0 google-cloud-bigquery-2.34.2 
google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 
google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 
google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 
google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 
google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 
google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 
googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 
grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 
isodate-0.6.1 jmespath-1.0.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 
numpy-1.21.5 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.7 overrides-6.1.0 
pandas-1.3.5 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 
psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 
pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 
pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 
pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 
requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 
s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 
typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 
websocket-client-1.3.1 wrapt-1.14.0

> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container 
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py37:copyGolangLicenses
> Task :sdks:python:container:py39:copyGolangLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py39:dockerPrepare
> Task :sdks:python:container:py38:dockerPrepare
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:python:container:py37:dockerPrepare
> Task :sdks:python:container:py39:docker
> Task :sdks:python:container:py38:docker
> Task :sdks:python:container:py36:docker
> Task :sdks:python:container:py37:docker

> Task :sdks:python:container:py39:docker
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip 
install 'pip-licenses<3.0.0' pyyaml tenacity &&       python 
/tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:container:py37:docker FAILED
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip 
install 'pip-licenses<3.0.0' pyyaml tenacity &&       python 
/tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py38:docker FAILED
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip 
install 'pip-licenses<3.0.0' pyyaml tenacity &&       python 
/tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:test-suites:dataflow:py36:validatesContainer

# Where to store integration test outputs.
GCS_LOCATION=${GCS_LOCATION:-gs://temp-storage-for-end-to-end-tests}

# Project for the container and integration test
PROJECT=${PROJECT:-apache-beam-testing}
REGION=${REGION:-us-central1}
IMAGE_PREFIX="$(grep 'docker_image_default_repo_prefix' gradle.properties | cut 
-d'=' -f2)"
SDK_VERSION="$(grep 'sdk_version' gradle.properties | cut -d'=' -f2)"
PY_VERSION=$1
IMAGE_NAME="${IMAGE_PREFIX}python${PY_VERSION}_sdk"
CONTAINER_PROJECT="sdks:python:container:py${PY_VERSION//.}"  # Note: we 
substitute away the dot in the version.
PY_INTERPRETER="python${PY_VERSION}"

XUNIT_FILE="pytest-$IMAGE_NAME.xml"

# Verify in the root of the repository
test -d sdks/python/container

# Verify docker and gcloud commands exist
command -v docker
command -v gcloud
docker -v
gcloud -v

# Verify docker image has been built.
docker images | grep "apache/$IMAGE_NAME" | grep "$SDK_VERSION"

TAG=$(date +%Y%m%d-%H%M%S%N)
CONTAINER=us.gcr.io/$PROJECT/$USER/$IMAGE_NAME
PREBUILD_SDK_CONTAINER_REGISTRY_PATH=us.gcr.io/$PROJECT/$USER/prebuild_python${PY_VERSION//.}_sdk
echo "Using container $CONTAINER"

# Tag the docker container.
docker tag "apache/$IMAGE_NAME:$SDK_VERSION" "$CONTAINER:$TAG"

# Push the container.
gcloud docker -- push $CONTAINER:$TAG
WARNING: `gcloud docker` will not be supported for Docker client versions above 
18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: 
https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker


function cleanup_container {
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container image"
  for image in $(docker images --format '{{.Repository}}:{{.Tag}}' | grep 
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH)
    do docker rmi $image || echo "Failed to remove prebuilt sdk container image"
  done
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to 
delete container"
  for digest in $(gcloud container images list-tags 
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk  
--format="get(digest)")
    do gcloud container images delete 
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk@$digest 
--force-delete-tags --quiet || echo "Failed to remove prebuilt sdk container 
image"
  done

  echo "Removed the container"
}
trap cleanup_container EXIT

echo ">>> Successfully built and push container $CONTAINER"

cd sdks/python
SDK_LOCATION=$2

# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
pytest -o junit_suite_name=$IMAGE_NAME \
  -m="it_validatescontainer" \
  --show-capture=no \
  --numprocesses=1 \
  --timeout=900 \
  --junitxml=$XUNIT_FILE \
  --ignore-glob '.*py3\d?\.py$' \
  --log-cli-level=INFO \
  --test-pipeline-options=" \
    --runner=TestDataflowRunner \
    --project=$PROJECT \
    --region=$REGION \
    --sdk_container_image=$CONTAINER:$TAG \
    --staging_location=$GCS_LOCATION/staging-validatesrunner-test \
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1 \
    --docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"

echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
Digests:
- 
us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7dc8e37deb8f972aece1426ad6ec1cf99f265524a6918196a36d17027cc0ebcf
  Associated tags:
 - 20220318-061925435643192
Tags:
- 
us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20220318-061925435643192
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk:20220318-061925435643192].
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk@sha256:7dc8e37deb8f972aece1426ad6ec1cf99f265524a6918196a36d17027cc0ebcf].
Digests:
- 
us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:5512e9e0760956cc411aaa0954065e9b77e8089b24bbfbfca81840efbfaabdf6
  Associated tags:
 - da641812-2720-41c8-80c1-e297311f9ba8
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:da641812-2720-41c8-80c1-e297311f9ba8].
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:5512e9e0760956cc411aaa0954065e9b77e8089b24bbfbfca81840efbfaabdf6].
Digests:
- 
us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:503960dbaa25477f5fc8a71510171a816b4d12325a3cfac7d6bd3995fc36af0e
  Associated tags:
 - a638e3ea-d4ad-4be4-8284-abd5eb1da1a5
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk:a638e3ea-d4ad-4be4-8284-abd5eb1da1a5].
Deleted 
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python36_sdk/beam_python_prebuilt_sdk@sha256:503960dbaa25477f5fc8a71510171a816b4d12325a3cfac7d6bd3995fc36af0e].

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py37:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

BUILD FAILED in 57m 53s
59 actionable tasks: 48 executed, 4 from cache, 7 up-to-date

Publishing build scan...
https://gradle.com/s/zl7p4vix6kvfs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to