See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3449/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/tetratelabs/wazero in /sdks (#24453)
[noreply] [BEAM-12164] Support querying against Postgres for the SpannerIO
change
------------------------------------------
[...truncated 3.01 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@443118b0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
kafka:read
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:21 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:21 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:23 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dec 01,
2022 12:23:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.10_sdk:2.44.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.10_sdk:2.44.0.dev
INFO root:environments.py:302 Python SDK container image set to
"apache/beam_python3.10_sdk:2.44.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function pack_combiners at 0x7f9f115cf9a0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function lift_combiners at 0x7f9f115cfa30>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function sort_stages at 0x7f9f115d01f0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581
Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment
is apache/beam_python3.10_sdk:2.44.0.dev
INFO root:portable_runner.py:574 ==================== <function
annotate_downstream_side_inputs at 0x7f4e872a3e20> ====================
INFO root:portable_runner.py:574 ==================== <function
fix_side_input_pcoll_coders at 0x7f4e872a3f40> ====================
INFO root:portable_runner.py:574 ==================== <function
pack_combiners at 0x7f4e872a84c0> ====================
INFO root:portable_runner.py:574 ==================== <function
lift_combiners at 0x7f4e872a8550> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf
at 0x7f4e872a8700> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk
at 0x7f4e872a8790> ====================
INFO root:portable_runner.py:574 ==================== <function
sink_flattens at 0x7f4e872a88b0> ====================
INFO root:portable_runner.py:574 ==================== <function
greedily_fuse at 0x7f4e872a8940> ====================
INFO root:portable_runner.py:574 ==================== <function
read_to_impulse at 0x7f4e872a89d0> ====================
INFO root:portable_runner.py:574 ==================== <function
impulse_to_input at 0x7f4e872a8a60> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages
at 0x7f4e872a8ca0> ====================
INFO root:portable_runner.py:574 ==================== <function
add_impulse_to_dangling_transforms at 0x7f4e872a8dc0> ====================
INFO root:portable_runner.py:574 ==================== <function
setup_timer_mapping at 0x7f4e872a8c10> ====================
INFO root:portable_runner.py:574 ==================== <function
populate_data_channel_coders at 0x7f4e872a8d30> ====================
INFO root:portable_runner.py:574 starting control server on port 35331
INFO root:portable_runner.py:574 starting data server on port 41187
INFO root:portable_runner.py:574 starting state server on port 36959
INFO root:portable_runner.py:574 starting logging server on port 35075
INFO root:portable_runner.py:574 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f4e60688c70> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n%apache/beam_python3.10_sdk:2.44.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image
apache/beam_python3.10_sdk:2.44.0.dev
INFO root:portable_runner.py:574 Unable to pull image
apache/beam_python3.10_sdk:2.44.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:574 Docker container is running. container_id
= b'dfcd6ed97dc6dd5519da1262868b4c8a449c595a416df38ddccadf793159b2bd',
worker_id = worker_85
INFO root:portable_runner.py:574 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f4e606c1d20> for environment external_8beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.44.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image
apache/beam_java8_sdk:2.44.0.dev
INFO root:portable_runner.py:574 Unable to pull image
apache/beam_java8_sdk:2.44.0.dev, defaulting to local image if it exists
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 572, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2022-12-01T12:18:40.939102995+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 572, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {created_time:"2022-12-01T12:19:54.682192985+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 572, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {created_time:"2022-12-01T12:21:08.194081117+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
wait_until_finish_read
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 572, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.10/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2022-12-01T12:22:22.544097638+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2022-12-01T12:17:27.160184012+00:00"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
- grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {created_time:"2022-12-01T12:18:40.938184034+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2022-12-01T12:19:54.681190173+00:00"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2022-12-01T12:21:08.193204367+00:00"}"
>
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row -
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {created_time:"2022-12-01T12:22:22.543191657+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
FAILED
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
- grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:37919 {created_time:"2022-12-01T12:24:32.699153222+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
= 6 failed, 3 passed, 5 skipped, 6735 deselected, 10 warnings in 573.60s
(0:09:33) =
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1818165
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1821024.
Stopping expansion service pid: 1821025.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 38m 58s
232 actionable tasks: 32 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/ouuvvigk5aari
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
