See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/10718/display/redirect>
Changes:
------------------------------------------
[...truncated 2.53 MB...]
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
pytest -o junit_suite_name=$IMAGE_NAME \
-m="it_validatescontainer" \
--show-capture=no \
--numprocesses=1 \
--timeout=1800 \
--junitxml=$XUNIT_FILE \
--ignore-glob '.*py3\d?\.py$' \
--log-cli-level=INFO \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--region=$REGION \
--sdk_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:615c3b0082f3ba78d403840cad07ba3f01256273bad7d3994bb66518350e4c72
Associated tags:
- 20230528-165413717531821
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20230528-165413717531821
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20230528-165413717531821].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:615c3b0082f3ba78d403840cad07ba3f01256273bad7d3994bb66518350e4c72].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:7ec58697693a9d07019194703eb0a1945b16ff74aa3280602c3d98519522284f
Associated tags:
- f0480f8f-7250-4872-b050-e694e9f7a61c
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:f0480f8f-7250-4872-b050-e694e9f7a61c].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:7ec58697693a9d07019194703eb0a1945b16ff74aa3280602c3d98519522284f].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:f6567ab4f8c907102d7986b5fa7e5e842d2503b660fa7c6c6b1bc6eea09dd99c
Associated tags:
- cc26c7fb-1864-44d0-920c-4723326f7567
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:cc26c7fb-1864-44d0-920c-4723326f7567].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:f6567ab4f8c907102d7986b5fa7e5e842d2503b660fa7c6c6b1bc6eea09dd99c].
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer
[gw0] [ 60%] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_use_sibling_sdk_workers
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
[gw0] [ 60%] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_use_sibling_sdk_workers
> Task :sdks:python:test-suites:dataflow:py311:validatesContainer
[gw0] [ 80%] PASSED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_use_sibling_sdk_workers
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
[gw0] [100%] SKIPPED
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:15
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:121
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870:
36 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870:
26 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2349
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2349:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.11_sdk.xml>
-
=========== 4 passed, 10 skipped, 84 warnings in 1976.05s (0:32:56) ============
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230528-165445925795209
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:6efd1de229239881b393bf6af744a78fd222fccbe3dbac4b43f6a5286509d04e
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:2165d1ac-32f7-4983-8e84-839fbbe5f648
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:3fa4674e51aac178edd6230e6da7d73f44d776c748b35f2fa4932a9722ceea55
Deleted: sha256:c68dd5ff75695bbe5df283657745cb84dcd7c2a1a723376c36a6c52b1c16504e
Deleted: sha256:67ef40f7edddf45f91952090fe8c9cb066c1b20ba03f7e29069c2b31b01aeeae
Deleted: sha256:3b6f69b4b7ab6e120ba91ac11d71b4877ca3c0b5db17386574f018553c7e1e82
Deleted: sha256:1902816d1d6b9a6f976d1320240305b4aef3f4900bf3dd69c5603845d99a8beb
Deleted: sha256:16b90fa24ecbadae3149818b3b7d6854360d95b89e945f36b759729f34a44be3
Deleted: sha256:13b7bbfe5a21e0ec2b0abd2fef1a85930673ff49eb8d77adafb80bf22121b3d4
Deleted: sha256:03f26c8a326816bf01134849931e50d16e399edfa491a404db8aa67b6877d8bc
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:6efd1de229239881b393bf6af744a78fd222fccbe3dbac4b43f6a5286509d04e
Associated tags:
- 20230528-165445925795209
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230528-165445925795209
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230528-165445925795209].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:6efd1de229239881b393bf6af744a78fd222fccbe3dbac4b43f6a5286509d04e].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:3fa4674e51aac178edd6230e6da7d73f44d776c748b35f2fa4932a9722ceea55
Associated tags:
- 2165d1ac-32f7-4983-8e84-839fbbe5f648
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:2165d1ac-32f7-4983-8e84-839fbbe5f648].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:3fa4674e51aac178edd6230e6da7d73f44d776c748b35f2fa4932a9722ceea55].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:245f1c9e7e0dab45af87ff0968f3a5483cf30ffb434704579f5ea4f6f96c04dd
Associated tags:
- 59848fee-dfb9-4603-88f1-c5f792ee2f2a
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:59848fee-dfb9-4603-88f1-c5f792ee2f2a].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:245f1c9e7e0dab45af87ff0968f3a5483cf30ffb434704579f5ea4f6f96c04dd].
Removed the container
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:ae7a55fea92ac9ba4dab5188c4deb0a2a84603c6f3d4827afaf6c11b75ea63f8
Associated tags:
- 20230528-165451191580755
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20230528-165451191580755
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20230528-165451191580755].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:ae7a55fea92ac9ba4dab5188c4deb0a2a84603c6f3d4827afaf6c11b75ea63f8].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:3e89ac0186da7cb915be863237835d3c19f8ac1bb7e299aed3d489dadcdf18e9
Associated tags:
- 044dc970-6a2e-4853-815c-38be10eda177
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:044dc970-6a2e-4853-815c-38be10eda177].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:3e89ac0186da7cb915be863237835d3c19f8ac1bb7e299aed3d489dadcdf18e9].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:36fb3a07d515724a8a6b3237f8e82f153b3c2885db9fe051adf891ad8c124883
Associated tags:
- 87bc9f88-7921-49f1-824c-3aa10c5b256e
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:87bc9f88-7921-49f1-824c-3aa10c5b256e].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:36fb3a07d515724a8a6b3237f8e82f153b3c2885db9fe051adf891ad8c124883].
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
echo ">>> SUCCESS DATAFLOW RUNNER VALIDATESCONTAINER TEST"
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:24e9faea78ca400985af965be4ffc3511b6bb59caf072e38a3f527e50ed9340d
Associated tags:
- 20230528-165451268063522
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20230528-165451268063522
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20230528-165451268063522].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:24e9faea78ca400985af965be4ffc3511b6bb59caf072e38a3f527e50ed9340d].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:c741f13a43ba8f31aa31e99bec9aca056fe9f338dc3703794fa678a1eaf988f3
Associated tags:
- a04f1b8d-0e90-4b0e-83ef-fce8813f47f8
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:a04f1b8d-0e90-4b0e-83ef-fce8813f47f8].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:c741f13a43ba8f31aa31e99bec9aca056fe9f338dc3703794fa678a1eaf988f3].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:6f3eb56bd5b3f0b8fbb35c3600262627ef344a8ac9bdd05e07f2d8d0fde66b0c
Associated tags:
- 4bdda9ce-5f12-411d-b865-b3f42cda13cf
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:4bdda9ce-5f12-411d-b865-b3f42cda13cf].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:6f3eb56bd5b3f0b8fbb35c3600262627ef344a8ac9bdd05e07f2d8d0fde66b0c].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 52m 30s
72 actionable tasks: 60 executed, 4 from cache, 8 up-to-date
Publishing build scan...
https://ge.apache.org/s/ninyhckrtexrg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
