See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/2338/display/redirect>
Changes:
------------------------------------------
[...truncated 1.32 MB...]
f"dataflow/jobs/<RegionId>/{self.job_id()}"
"?project=<ProjectId>")
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely. '
'{}'.format(consoleUrl))
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
_LOGGER.error(consoleUrl)
> raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
E
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow
pipeline failed. State: FAILED, Error:
E Workflow failed.
apache_beam/runners/dataflow/dataflow_runner.py:765: DataflowRuntimeException
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:322 Copying Beam SDK
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz";>
to staging location.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:397
Pipeline has additional dependencies to be installed in SDK worker container,
consider using the SDK container image pre-building workflow to avoid
repetitive installations. Learn more on
https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
INFO root:environments.py:313 Using provided Python SDK container image:
gcr.io/cloud-dataflow/v1beta3/beam_python3.11_sdk:beam-master-20230717
INFO root:environments.py:320 Python SDK container image set to
"gcr.io/cloud-dataflow/v1beta3/beam_python3.11_sdk:beam-master-20230717" for
Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7f072d4b0c20>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7f072d4b14e0>
====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/icedtea-sound-uoIQCGhMffp0D_gc1dkBtXBGXr18Bkb5Qx-e-CvP00s.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/icedtea-sound-uoIQCGhMffp0D_gc1dkBtXBGXr18Bkb5Qx-e-CvP00s.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/jaccess-T1qVdaqZDj2uNq1tdHEk1lwFMYQiwMhYa0jqGU9fUMg.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/jaccess-T1qVdaqZDj2uNq1tdHEk1lwFMYQiwMhYa0jqGU9fUMg.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/localedata-dQT9YOGvbd1zEqcZsyJ1W4l8jNhxoX3b1nmMhdIbCb8.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/localedata-dQT9YOGvbd1zEqcZsyJ1W4l8jNhxoX3b1nmMhdIbCb8.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/nashorn-gZxbPAWCb1KP7OCbxUu1prmT4YMEDX-mGdJFjkB3pfs.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/nashorn-gZxbPAWCb1KP7OCbxUu1prmT4YMEDX-mGdJFjkB3pfs.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/cldrdata-_GVjPlS0invvNh7wlTfv_CNVOxTj3Y-xvSW1Xw2r_-4.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/cldrdata-_GVjPlS0invvNh7wlTfv_CNVOxTj3Y-xvSW1Xw2r_-4.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/dnsns-lI-xDSEZtu3C8A4-qt_7RcyP_ql7OU0LNZreNR5piTU.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/dnsns-lI-xDSEZtu3C8A4-qt_7RcyP_ql7OU0LNZreNR5piTU.jar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/beam-sdks-java-testing-expansion-service-testExpansionService-2.51.0-SNAPSHOT-SNAPSHOT-GvjCMA6Q8okuEUsDghaZdLPlepLr0QNHDrRLj2u0buw.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/beam-sdks-java-testing-expansion-service-testExpansionService-2.51.0-SNAPSHOT-SNAPSHOT-GvjCMA6Q8okuEUsDghaZdLPlepLr0QNHDrRLj2u0buw.jar
in 8 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/dataflow_python_sdk.tar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0905182507-629290-f9kotkri.1693938307.629447/pipeline.pb
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:843
Create job: <Job
clientRequestId: '20230905182507630179-1790'
createTime: '2023-09-05T18:25:20.118046Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2023-09-05_11_25_17-18167428420233682197'
location: 'us-central1'
name: 'beamapp-jenkins-0905182507-629290-f9kotkri'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2023-09-05T18:25:20.118046Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:845
Created job with id: [2023-09-05_11_25_17-18167428420233682197]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:846
Submitted job: 2023-09-05_11_25_17-18167428420233682197
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:847 To
access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-09-05_11_25_17-18167428420233682197?project=apache-beam-testing
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58
Console log:
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-09-05_11_25_17-18167428420233682197?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-09-05_11_25_17-18167428420233682197 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:23.810Z: JOB_MESSAGE_BASIC: Worker configuration:
e2-standard-2 in us-central1-a.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:26.357Z: JOB_MESSAGE_BASIC: Executing operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:26.445Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-a...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:26.917Z: JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:35.614Z: JOB_MESSAGE_BASIC: Executing operation
Create/Impulse+Create/FlatMap(<lambda at
core.py:3736>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:25:50.228Z: JOB_MESSAGE_BASIC: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208
2023-09-05T18:26:29.178Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone
us-central1-a failed to bring up any of the desired 1 workers. Please refer to
https://cloud.google.com/dataflow/docs/guides/common-errors#worker-pool-failure
for help troubleshooting. QUOTA_EXCEEDED: Instance
'beamapp-jenkins-090518250-09051125-tbmy-harness-n142' creation failed: Quota
'IN_USE_ADDRESSES' exceeded. Limit: 1200.0 in region us-central1.
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208
2023-09-05T18:26:29.201Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:26:29.259Z: JOB_MESSAGE_BASIC: Finished operation
Create/Impulse+Create/FlatMap(<lambda at
core.py:3736>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:26:29.402Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-05T18:26:47.337Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-09-05_11_25_17-18167428420233682197 is in state JOB_STATE_FAILED
ERROR apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:764
Console URL:
https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-09-05_11_25_17-18167428420233682197?project=<ProjectId>
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py>:28:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:18:
DeprecationWarning: pkg_resources is deprecated as an API. See
https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
180 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
144 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350:
36 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/transforms/validate_runner_xlang_test.py: 7 warnings
apache_beam/io/external/generate_sequence_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py>:679:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
- apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException:
Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
FAILED
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
- apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException:
Dataflow pipeline failed. State: FAILED, Error:
Workflow failed.
====== 2 failed, 8 passed, 16 skipped, 423 warnings in 734.14s (0:12:14) =======
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230905180430
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dfd743078b3207becb277f96e30613e5073ca6d69f537b3866180665ce19fa7c
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230905180430]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dfd743078b3207becb277f96e30613e5073ca6d69f537b3866180665ce19fa7c]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230905180430]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dfd743078b3207becb277f96e30613e5073ca6d69f537b3866180665ce19fa7c])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dfd743078b3207becb277f96e30613e5073ca6d69f537b3866180665ce19fa7c
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230905180430
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5330fd4a959fe5f7886b9617c88a8be4efd18a36189d0d6c148f0e03e456cc1c
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230905180430]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5330fd4a959fe5f7886b9617c88a8be4efd18a36189d0d6c148f0e03e456cc1c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230905180430]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5330fd4a959fe5f7886b9617c88a8be4efd18a36189d0d6c148f0e03e456cc1c])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5330fd4a959fe5f7886b9617c88a8be4efd18a36189d0d6c148f0e03e456cc1c
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2618609.
Stopping expansion service pid: 2618610.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 23m 24s
146 actionable tasks: 25 executed, 121 up-to-date
Publishing build scan...
https://ge.apache.org/s/7mnpm43he635c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
