See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4491/display/redirect>
Changes:
------------------------------------------
[...truncated 2.41 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at
localhost:36983.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:24 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:24 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:25 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
`PCOLLECTION`.`shopper`, `PCOLLECTION`.`cart`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WHERE
`PCOLLECTION`.`shopper` = 'alice'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalProject(shopper=[$0], cart=[$1])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalFilter(condition=[=($0, 'alice')])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Aug 19,
2023 12:19:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamCalcRel(expr#0..1=[{inputs}], expr#2=['alice':VARCHAR], expr#3=[=($t0,
$t2)], proj#0..1=[{exprs}], $condition=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to
"apache/beam_python3.11_sdk:2.51.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function pack_combiners at 0x7fcfce205da0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function lift_combiners at 0x7fcfce205e40>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function sort_stages at 0x7fcfce206660>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:576
Job state changed to RUNNING
INFO root:portable_runner.py:569 ==================== <function
annotate_downstream_side_inputs at 0x7f4899a4c180> ====================
INFO root:portable_runner.py:569 ==================== <function
fix_side_input_pcoll_coders at 0x7f4899a4c2c0> ====================
INFO root:portable_runner.py:569 ==================== <function
pack_combiners at 0x7f4899a4c860> ====================
INFO root:portable_runner.py:569 ==================== <function
lift_combiners at 0x7f4899a4c900> ====================
INFO root:portable_runner.py:569 ==================== <function expand_sdf
at 0x7f4899a4cae0> ====================
INFO root:portable_runner.py:569 ==================== <function expand_gbk
at 0x7f4899a4cb80> ====================
INFO root:portable_runner.py:569 ==================== <function
sink_flattens at 0x7f4899a4ccc0> ====================
INFO root:portable_runner.py:569 ==================== <function
greedily_fuse at 0x7f4899a4cd60> ====================
INFO root:portable_runner.py:569 ==================== <function
read_to_impulse at 0x7f4899a4ce00> ====================
INFO root:portable_runner.py:569 ==================== <function
impulse_to_input at 0x7f4899a4cea0> ====================
INFO root:portable_runner.py:569 ==================== <function sort_stages
at 0x7f4899a4d120> ====================
INFO root:portable_runner.py:569 ==================== <function
add_impulse_to_dangling_transforms at 0x7f4899a4d260> ====================
INFO root:portable_runner.py:569 ==================== <function
setup_timer_mapping at 0x7f4899a4d080> ====================
INFO root:portable_runner.py:569 ==================== <function
populate_data_channel_coders at 0x7f4899a4d1c0> ====================
INFO root:portable_runner.py:569 starting control server on port 42955
INFO root:portable_runner.py:569 starting data server on port 41573
INFO root:portable_runner.py:569 starting state server on port 35099
INFO root:portable_runner.py:569 starting logging server on port 39295
INFO root:portable_runner.py:569 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f488863b890> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n%apache/beam_python3.11_sdk:2.51.0.dev')
INFO root:portable_runner.py:569 Attempting to pull image
apache/beam_python3.11_sdk:2.51.0.dev
INFO root:portable_runner.py:569 Unable to pull image
apache/beam_python3.11_sdk:2.51.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:569 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:569 Docker container is running. container_id
= b'7f201899cde31fd1e72410c31da43910e5663e243ace5bc9e7200e1db235c11f',
worker_id = worker_52
INFO root:portable_runner.py:569 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f48887cc8d0> for environment external_4beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.51.0.dev')
INFO root:portable_runner.py:569 Attempting to pull image
apache/beam_java8_sdk:2.51.0.dev
INFO root:portable_runner.py:569 Unable to pull image
apache/beam_java8_sdk:2.51.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:569 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:569 Docker container is running. container_id
= b'3e11068c5007b7c48adc20ea51d3633bdc6d438a01f8bc282449d861c2a4cd80',
worker_id = worker_53
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/hdfs/config.py>:28:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:18:
DeprecationWarning: pkg_resources is deprecated as an API. See
https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
20 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871:
16 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:676:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 567, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py";,>
line 541, in __next__
return self._next()
^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py";,>
line 967, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:45993 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2023-08-19T00:18:05.542055163+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 567, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py";,>
line 541, in __next__
return self._next()
^^^^^^^^^^^^
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.11/site-packages/grpc/_channel.py";,>
line 967, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:45993 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2023-08-19T00:19:19.059079645+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:45993 {created_time:"2023-08-19T00:18:05.541089879+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
- grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:45993 {created_time:"2023-08-19T00:19:19.058118664+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:45993 {created_time:"2023-08-19T00:20:35.785125269+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
= 3 failed, 6 passed, 15 skipped, 6957 deselected, 57 warnings in 431.46s
(0:07:11) =
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1184176
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1228788.
Stopping expansion service pid: 1228789.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 35m 36s
171 actionable tasks: 26 executed, 145 up-to-date
Publishing build scan...
Publishing failed.
The response from https://ge.apache.org/scans/publish/gradle/3.13.2/token was
not from Gradle Enterprise.
The specified server address may be incorrect, or your network environment may
be interfering.
Please report this problem to your Gradle Enterprise administrator via
https://ge.apache.org/help and include the following via copy/paste:
----------
Gradle version: 7.6.2
Plugin version: 3.13.2
Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/token
Request ID: 606feb0c-6301-4d26-8e12-318525c2a1fe
Response status code: 502
Response content type: text/html
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
