See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/518/display/redirect>
Changes:
------------------------------------------
[...truncated 2.80 MB...]
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f4c9523c350>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
consoleUrl = (
"Console URL: https://console.cloud.google.com/";
f"dataflow/jobs/<RegionId>/{self.job_id()}"
"?project=<ProjectId>")
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely. '
'{}'.format(consoleUrl))
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
_LOGGER.error(consoleUrl)
> raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
E
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow
pipeline failed. State: FAILED, Error:
E Workflow failed. Causes: Job appears to be stuck. Several workers
have failed to start up in a row, and no worker has successfully started up for
this job. Last error reported: Unable to pull container image due to error:
image pull request failed with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image..
apache_beam/runners/dataflow/dataflow_runner.py:765: DataflowRuntimeException
----------------------------- Captured stdout call -----------------------------
Worker logs:
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:322 Copying Beam SDK
"<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/build/apache-beam.tar.gz";>
to staging location.
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:239
Compressed source files for building sdk container at
/tmp/tmpmwlpvmwg/source.tgz
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:313
Starting GCS upload to
gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/source-51165497-dc8f-49f3-b2a5-2a7839ceb1d1.tgz...
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:332
Completed GCS upload to
gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/source-51165497-dc8f-49f3-b2a5-2a7839ceb1d1.tgz.
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:281
Building sdk container with Google Cloud Build, this may take a few minutes,
you may check build log at
https://console.cloud.google.com/cloud-build/builds/29893a1b-4036-4aa4-a6d1-31a4387450c9?project=844138762903
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:303
Python SDK container pre-build finished in 171.14 seconds
INFO
apache_beam.runners.portability.sdk_container_builder:sdk_container_builder.py:306
Python SDK container built and pushed as
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1.
INFO root:environments.py:313 Using provided Python SDK container image:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
INFO root:environments.py:320 Python SDK container image set to
"us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1"
for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function pack_combiners at 0x7f4cc5a727a0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function sort_stages at 0x7f4cc5a73060>
====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/pipeline.pb
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:843
Create job: <Job
clientRequestId: '20230822143932376328-9986'
createTime: '2023-08-22T14:39:33.315735Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2023-08-22_07_39_32-3840696519862004965'
location: 'us-central1'
name: 'beamapp-jenkins-0822143932-375278-zmwbf9ko'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2023-08-22T14:39:33.315735Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:845
Created job with id: [2023-08-22_07_39_32-3840696519862004965]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:846
Submitted job: 2023-08-22_07_39_32-3840696519862004965
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:847 To
access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58
Console log:
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-08-22_07_39_32-3840696519862004965?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-08-22_07_39_32-3840696519862004965 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:39:36.293Z: JOB_MESSAGE_BASIC: Worker configuration:
e2-standard-2 in us-central1-b.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:39:38.518Z: JOB_MESSAGE_BASIC: Executing operation
Read/Read/Impulse+Read/Read/Map(<lambda at
iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:39:38.535Z: JOB_MESSAGE_BASIC: Executing operation
Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at
core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:39:38.571Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-b...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:39:46.746Z: JOB_MESSAGE_BASIC: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:41:30.575Z: JOB_MESSAGE_WARNING: A worker was unable to start up.
Error: Unable to pull container image due to error: image pull request failed
with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:42:48.449Z: JOB_MESSAGE_WARNING: A worker was unable to start up.
Error: Unable to pull container image due to error: image pull request failed
with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:44:04.812Z: JOB_MESSAGE_WARNING: A worker was unable to start up.
Error: Unable to pull container image due to error: image pull request failed
with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:45:22.531Z: JOB_MESSAGE_WARNING: A worker was unable to start up.
Error: Unable to pull container image due to error: image pull request failed
with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.037Z: JOB_MESSAGE_WARNING: A worker was unable to start up.
Error: Unable to pull container image due to error: image pull request failed
with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image.
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208
2023-08-22T14:46:51.057Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: Job
appears to be stuck. Several workers have failed to start up in a row, and no
worker has successfully started up for this job. Last error reported: Unable to
pull container image due to error: image pull request failed with error: Error
response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image..
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.177Z: JOB_MESSAGE_WARNING: Unable to delete temp files:
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S04-0-9cb94bca001afb0/[email protected]."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.181Z: JOB_MESSAGE_WARNING: Unable to delete temp files:
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S01-1-70e1921d325985cb/[email protected]."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.183Z: JOB_MESSAGE_WARNING: Unable to delete temp files:
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/beamapp-jenkins-0822143932-375278-zmwbf9ko.1692715172.375459/dax-tmp-2023-08-22_07_39_32-3840696519862004965-S01-0-ef85f10cb0210506/[email protected]."
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.200Z: JOB_MESSAGE_WARNING:
S04:Read/Read/Impulse+Read/Read/Map(<lambda at
iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing
failed.
WARNING apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:206
2023-08-22T14:46:51.221Z: JOB_MESSAGE_WARNING:
S01:Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at
core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite
failed.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:46:51.231Z: JOB_MESSAGE_BASIC: Finished operation
Read/Read/Impulse+Read/Read/Map(<lambda at
iobase.py:911>)+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction+ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/SplitWithSizing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:46:51.249Z: JOB_MESSAGE_BASIC: Finished operation
Write/Write/WriteImpl/DoOnce/Impulse+Write/Write/WriteImpl/DoOnce/FlatMap(<lambda
at
core.py:3736>)+Write/Write/WriteImpl/DoOnce/Map(decode)+Write/Write/WriteImpl/InitializeWrite
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:46:51.361Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-08-22T14:49:08.560Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-08-22_07_39_32-3840696519862004965 is in state JOB_STATE_FAILED
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:764
Console URL:
https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-08-22_07_39_32-3840696519862004965?project=<ProjectId>
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:18:
DeprecationWarning: pkg_resources is deprecated as an API. See
https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
40 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
32 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/pytest-beam_python3.11_sdk.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_cloud_build
- apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException:
Dataflow pipeline failed. State: FAILED, Error:
Workflow failed. Causes: Job appears to be stuck. Several workers have failed
to start up in a row, and no worker has successfully started up for this job.
Last error reported: Unable to pull container image due to error: image pull
request failed with error: Error response from daemon: manifest for
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:51165497-dc8f-49f3-b2a5-2a7839ceb1d1
not found: manifest unknown: Failed to fetch
"51165497-dc8f-49f3-b2a5-2a7839ceb1d1" from request
"/v2/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk/manifests/51165497-dc8f-49f3-b2a5-2a7839ceb1d1"..
This is likely due to an invalid SDK container image URL. Please verify any
provided SDK container image is valid and that Dataflow workers have
permissions to pull image..
====== 1 failed, 3 passed, 16 skipped, 91 warnings in 2024.58s (0:33:44) =======
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:e0a01cc4-4209-4565-a24f-9989c41d9c11
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0
Deleted: sha256:e95d237889a10c2a8d5f88a6abf0d6480035bec479b2fc9c3512c53391137292
Deleted: sha256:0c21d02bddf9845264ec89c5353cc194f4b596ad421ebb8ac432f3cd71bcb0ec
Deleted: sha256:88dffd2ef1819b3f2785339047edac1c84cdfc0562bf4ed403e335764f2255fa
Deleted: sha256:c32cb64a611f100a2874bff53652bc6fc9e5dff5552a7cc9b565f96852b50c80
Deleted: sha256:e2e99ef1bff065e6b412f085ca0d09e8185cd7a7e6d86707cb9de52779096c5c
Deleted: sha256:d833bcc63725299032db37c2707fc28cdfcac9f9e7a83ff1c5768cc77d785c6e
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622
Associated tags:
- 20230822-142654044225678
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk:20230822-142654044225678].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.11_sdk@sha256:8ceb19cbcca4958a0dd078df7bf8ff58e0428382ca2cfd3e0bb300da6cd81622].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0
Associated tags:
- e0a01cc4-4209-4565-a24f-9989c41d9c11
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk:e0a01cc4-4209-4565-a24f-9989c41d9c11].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python311_sdk/beam_python_prebuilt_sdk@sha256:0dbc9643e61ee76c9ab8a12ac76e7057c3b30d3fd2e64709895654bce26005e0].
Removed the container
> Task :sdks:python:test-suites:dataflow:py311:validatesContainer FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 351
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 351
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont_with_RC/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 351
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 50m 3s
66 actionable tasks: 55 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://ge.apache.org/s/aazn5t4evkmtg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
