See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3602/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'7eb46f7145d6c30950ab76568d26aeb31e39c4940a0f85765de626745ed97e11',
worker_id = worker_88
INFO root:portable_runner.py:577 Completed job in 22.432056427001953
seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [100%]
=================================== FAILURES ===================================
_____________________ SqlTransformTest.test_generate_data ______________________
self = <apache_beam.transforms.sql_test.SqlTransformTest
testMethod=test_generate_data>
def test_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT) AS `id`,
CAST('foo' AS VARCHAR) AS `str`,
CAST(3.14 AS DOUBLE) AS `flt`""")
> assert_that(out, equal_to([(1, "foo", 3.14)]))
apache_beam/transforms/sql_test.py:79:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:600: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:607: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:613: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_channel.py:426:
in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...27.0.0.1:43049
{created_time:"2023-01-08T18:04:54.769163784+00:00", grpc_status:4,
grpc_message:"Deadline Exceeded"}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous:
<_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:43049 {created_time:"2023-01-08T18:04:54.769163784+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
E >
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_channel.py:826:
_MultiThreadedRendezvous
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO root:external.py:851 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar'>
'50343'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.45.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting
expansion service at localhost:50343
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:36 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38425407
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@43bc63a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@702657cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6a6cb05c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@40a4337a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6025e1b6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@22ff4249
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2d1ef81a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c402120
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@327514f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5b12b668
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1165b38
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c12331b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7586beff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3b69e7d1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:bigquery_storage_read:v1
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:50343.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:39 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:39 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:39 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
CAST(1 AS INTEGER) AS `id`, CAST('foo' AS VARCHAR) AS `str`, CAST(3.14 AS
DOUBLE) AS `flt`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalValues(tuples=[[{ 1, 'foo', 3.14 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 08,
2023 6:03:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamValuesRel(tuples=[[{ 1, 'foo', 3.14 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.45.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.45.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function pack_combiners at 0x7f3a07b93290>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function lift_combiners at 0x7f3a07b93320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:710
==================== <function sort_stages at 0x7f3a07b93a70>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment
is apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 ==================== <function
annotate_downstream_side_inputs at 0x7fd6e9d6f5f0> ====================
INFO root:portable_runner.py:577 ==================== <function
fix_side_input_pcoll_coders at 0x7fd6e9d6f710> ====================
INFO root:portable_runner.py:577 ==================== <function
pack_combiners at 0x7fd6e9d6fc20> ====================
INFO root:portable_runner.py:577 ==================== <function
lift_combiners at 0x7fd6e9d6fcb0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf
at 0x7fd6e9d6fe60> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk
at 0x7fd6e9d6fef0> ====================
INFO root:portable_runner.py:577 ==================== <function
sink_flattens at 0x7fd6e9d70050> ====================
INFO root:portable_runner.py:577 ==================== <function
greedily_fuse at 0x7fd6e9d700e0> ====================
INFO root:portable_runner.py:577 ==================== <function
read_to_impulse at 0x7fd6e9d70170> ====================
INFO root:portable_runner.py:577 ==================== <function
impulse_to_input at 0x7fd6e9d70200> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages
at 0x7fd6e9d70440> ====================
INFO root:portable_runner.py:577 ==================== <function
add_impulse_to_dangling_transforms at 0x7fd6e9d70560> ====================
INFO root:portable_runner.py:577 ==================== <function
setup_timer_mapping at 0x7fd6e9d703b0> ====================
INFO root:portable_runner.py:577 ==================== <function
populate_data_channel_coders at 0x7fd6e9d704d0> ====================
INFO root:portable_runner.py:577 starting control server on port 36319
INFO root:portable_runner.py:577 starting data server on port 40859
INFO root:portable_runner.py:577 starting state server on port 37205
INFO root:portable_runner.py:577 starting logging server on port 34127
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fd6e83e5310> for environment external_3beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_java8_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_java8_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'9c77146a35069481f098ffcf9b8099ee33c00221ef583a7defdb1d34b763ecf2',
worker_id = worker_75
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7fd6e832e190> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.7_sdk:2.45.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_python3.7_sdk:2.45.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_python3.7_sdk:2.45.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'2e67a20cd43d298d6e1be0d72df6c6c352e77e37b9629a9f0fccfed2149d2194',
worker_id = worker_76
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
- grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:43049 {created_time:"2023-01-08T18:04:54.769163784+00:00",
grpc_status:4, grpc_message:"Deadline Exceeded"}"
>
= 1 failed, 8 passed, 6 skipped, 6788 deselected, 1 warning in 640.19s
(0:10:40) =
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 572, in read_messages
for message in self._message_stream:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_channel.py";,>
line 426, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_channel.py";,>
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer
ipv4:127.0.0.1:43049 {grpc_message:"Deadline Exceeded", grpc_status:4,
created_time:"2023-01-08T18:04:54.773133177+00:00"}"
>
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1441241
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1455219.
Stopping expansion service pid: 1455220.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 50m 20s
248 actionable tasks: 170 executed, 66 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/nvlw42rlc2th2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
