See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/2374/display/redirect>
Changes:
------------------------------------------
[...truncated 743.88 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
`PCOLLECTION`.`a` * `PCOLLECTION`.`a` AS `s`, `LENGTH`(`PCOLLECTION`.`b`) AS `c`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 22,
2023 12:27:12 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalProject(s=[*($0, $0)], c=[LENGTH($1)])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 22,
2023 12:27:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamCalcRel(expr#0..1=[{inputs}], expr#2=[*($t0, $t0)], expr#3=[LENGTH($t1)],
s=[$t2], c=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.runners.portability.stager:stager.py:322 Copying Beam SDK
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz";>
to staging location.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:399
Pipeline has additional dependencies to be installed in SDK worker container,
consider using the SDK container image pre-building workflow to avoid
repetitive installations. Learn more on
https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
INFO root:environments.py:313 Using provided Python SDK container image:
gcr.io/cloud-dataflow/v1beta3/beam_python3.11_sdk:beam-master-20230915
INFO root:environments.py:320 Python SDK container image set to
"gcr.io/cloud-dataflow/v1beta3/beam_python3.11_sdk:beam-master-20230915" for
Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7f0ee6b567a0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7f0ee6b57060>
====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT-Ww6CdNTSLCxQtBmiroYFj-MoRFVPSE25xUyzp2lcGcM.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT-Ww6CdNTSLCxQtBmiroYFj-MoRFVPSE25xUyzp2lcGcM.jar
in 13 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/dataflow_python_sdk.tar
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:668
Starting GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:684
Completed GCS upload to
gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0922122722-250417-zxz6xnth.1695385642.250575/pipeline.pb
in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:843
Create job: <Job
clientRequestId: '20230922122722251347-5768'
createTime: '2023-09-22T12:27:36.499461Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2023-09-22_05_27_35-2795251054029856095'
location: 'us-central1'
name: 'beamapp-jenkins-0922122722-250417-zxz6xnth'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2023-09-22T12:27:36.499461Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:845
Created job with id: [2023-09-22_05_27_35-2795251054029856095]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:846
Submitted job: 2023-09-22_05_27_35-2795251054029856095
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:847 To
access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-09-22_05_27_35-2795251054029856095?project=apache-beam-testing
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58
Console log:
INFO
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-09-22_05_27_35-2795251054029856095?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-09-22_05_27_35-2795251054029856095 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:27:39.343Z: JOB_MESSAGE_BASIC: Worker configuration:
e2-standard-2 in us-central1-a.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:27:41.476Z: JOB_MESSAGE_BASIC: Executing operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:27:41.534Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-a...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:27:41.770Z: JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:27:50.692Z: JOB_MESSAGE_BASIC: Executing operation
Create/Impulse+Create/FlatMap(<lambda at
core.py:3744>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:28:02.801Z: JOB_MESSAGE_BASIC: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:56.957Z: JOB_MESSAGE_BASIC: All workers have finished the
startup processes and began to receive work requests.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.050Z: JOB_MESSAGE_BASIC: Finished operation
Create/Impulse+Create/FlatMap(<lambda at
core.py:3744>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.101Z: JOB_MESSAGE_BASIC: Executing operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.490Z: JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.552Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.687Z: JOB_MESSAGE_BASIC: Finished operation
assert_that/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.786Z: JOB_MESSAGE_BASIC: Executing operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Map(<lambda
at
sql_test.py:148>)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/Flatten/InputIdentity+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T12:31:58.808Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:3744>)+assert_that/Create/Map(decode)+assert_that/Group/CoGroupByKeyImpl/Tag[0]+assert_that/Group/CoGroupByKeyImpl/Flatten/InputIdentity+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T13:41:58.452Z: JOB_MESSAGE_BASIC: Cancel request is committed for
workflow job: 2023-09-22_05_27_35-2795251054029856095.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T13:41:58.480Z: JOB_MESSAGE_BASIC: Finished operation
Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Create/Map(decode)+Map(<lambda
at
sql_test.py:148>)+SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParMultiDo(Calc)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/CoGroupByKeyImpl/Tag[1]+assert_that/Group/CoGroupByKeyImpl/Flatten/InputIdentity+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T13:41:58.480Z: JOB_MESSAGE_BASIC: Finished operation
assert_that/Create/Impulse+assert_that/Create/FlatMap(<lambda at
core.py:3744>)+assert_that/Create/Map(decode)+assert_that/Group/CoGroupByKeyImpl/Tag[0]+assert_that/Group/CoGroupByKeyImpl/Flatten/InputIdentity+assert_that/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204
2023-09-22T13:41:58.663Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154
Job 2023-09-22_05_27_35-2795251054029856095 is in state JOB_STATE_CANCELLING
WARNING apache_beam.utils.retry:retry.py:290 Retry with exponential backoff:
waiting for 4.296248556928849 seconds before retrying list_messages because we
caught exception: KeyError: 'https:dataflow.googleapis.com'
Traceback for above exception (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 275, in wrapper
return fun(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 1000, in list_messages
response = self._client.projects_locations_jobs_messages.List(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 550, in List
return self._RunMethod(config, request, global_params=global_params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
line 728, in _RunMethod
http_response = http_wrapper.MakeRequest(
^^^^^^^^^^^^^^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/apitools/base/py/http_wrapper.py";,>
line 359, in MakeRequest
retry_func(ExceptionRetryArgs(http, http_request, e, retry,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/apitools/base/py/http_wrapper.py";,>
line 305, in HandleExceptionsAndRebuildHttpConnections
RebuildHttpConnections(retry_args.http)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/apitools/base/py/http_wrapper.py";,>
line 244, in RebuildHttpConnections
del http.connections[conn_key]
~~~~~~~~~~~~~~~~^^^^^^^^^^
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py>:28:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:18:
DeprecationWarning: pkg_resources is deprecated as an API. See
https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
171 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
144 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350:
36 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project
apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py>:725:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - Failed:
Timeout >4500.0s
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row - Failed:
Timeout >4500.0s
====== 2 failed, 7 passed, 16 skipped, 413 warnings in 4679.89s (1:17:59) ======
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230922121746
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee32452a17e8ba5a7c91d2085877f9cfb4bcad6247fcd2324ba713fc4eab5972
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230922121746]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee32452a17e8ba5a7c91d2085877f9cfb4bcad6247fcd2324ba713fc4eab5972]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230922121746]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee32452a17e8ba5a7c91d2085877f9cfb4bcad6247fcd2324ba713fc4eab5972])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:ee32452a17e8ba5a7c91d2085877f9cfb4bcad6247fcd2324ba713fc4eab5972
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230922121746
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2af2c7d55064ccdfdc618ffad975dc2108042f7b858fdb34e7820c36481581a
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230922121746]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2af2c7d55064ccdfdc618ffad975dc2108042f7b858fdb34e7820c36481581a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230922121746]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2af2c7d55064ccdfdc618ffad975dc2108042f7b858fdb34e7820c36481581a])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c2af2c7d55064ccdfdc618ffad975dc2108042f7b858fdb34e7820c36481581a
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1264351.
Stopping expansion service pid: 1264352.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 27m 25s
179 actionable tasks: 119 executed, 54 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/rqamjbg6trbgw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
