See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/8332/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-12802] Refactor DataStreamsDecoder so that it becomes aware
of the
[ajamato] [BEAM-11994] Instantiate a new ServiceCallMetric before each request
to
[Ankur Goenka] Remove duplicate 2.33.0 section
[noreply] add python spark example in documentation (#15426)
------------------------------------------
[...truncated 206.21 KB...]
[33mThe above exception was the direct cause of the following exception:[0m
self =
<apache_beam.runners.dataflow.dataflow_exercise_streaming_metrics_pipeline_test.ExerciseStreamingMetricsPipelineTest
testMethod=test_streaming_pipeline_returns_expected_user_metrics_fnapi_it>
[1m def setUp(self):[0m
[1m """Creates all required topics and subs."""[0m
[1m self.test_pipeline = TestPipeline(is_integration_test=True)[0m
[1m self.project = self.test_pipeline.get_option('project')[0m
[1m self.uuid = str(uuid.uuid4())[0m
[1m [0m
[1m # Set up PubSub environment.[0m
[1m from google.cloud import pubsub[0m
[1m self.pub_client = pubsub.PublisherClient()[0m
[1m self.input_topic_name = INPUT_TOPIC + self.uuid[0m
[1m self.input_topic = self.pub_client.create_topic([0m
[1m self.pub_client.topic_path(self.project,
self.input_topic_name))[0m
[1m [0m
[1m self.output_topic_name = OUTPUT_TOPIC + self.uuid[0m
[1m self.output_topic = self.pub_client.create_topic([0m
[1m self.pub_client.topic_path(self.project,
self.output_topic_name))[0m
[1m [0m
[1m self.sub_client = pubsub.SubscriberClient()[0m
[1m self.input_sub_name = INPUT_SUB + self.uuid[0m
[1m self.input_sub = self.sub_client.create_subscription([0m
[1m self.sub_client.subscription_path(self.project,
self.input_sub_name),[0m
[1m self.input_topic.name)[0m
[1m self.output_sub_name = OUTPUT_SUB + self.uuid[0m
[1m self.output_sub = self.sub_client.create_subscription([0m
[1m self.sub_client.subscription_path(self.project,
self.output_sub_name),[0m
[1m self.output_topic.name,[0m
[1m> ack_deadline_seconds=60)[0m
[1m[31mapache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py[0m:79:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/cloud/pubsub_v1/_gapic.py[0m:40:
in <lambda>
[1m fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py[0m:439:
in create_subscription
[1m request, retry=retry, timeout=timeout, metadata=metadata[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py[0m:145:
in __call__
[1m return wrapped_func(*args, **kwargs)[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/api_core/retry.py[0m:291:
in retry_wrapped_func
[1m on_error=on_error,[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/api_core/retry.py[0m:189:
in retry_target
[1m return target()[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/api_core/timeout.py[0m:214:
in func_with_timeout
[1m return func(*args, **kwargs)[0m
[1m[31m../../build/gradleenv/-1734967053/lib/python3.6/site-packages/google/api_core/grpc_helpers.py[0m:69:
in error_remapped_callable
[1m six.raise_from(exceptions.from_grpc_error(exc), exc)[0m
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
...4.95:443","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Deadline
Exceeded","grpc_status":4}"
>
[1m> ???[0m
[1m[31mE google.api_core.exceptions.DeadlineExceeded: 504 Deadline
Exceeded[0m
[1m[31m<string>[0m:3: DeadlineExceeded
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py36-noxdist.xml>
-
[31m[1m================== 1 failed, 4991 deselected in 84.99 seconds
==================[0m
> Task :sdks:python:test-suites:dataflow:py36:validatesRunnerStreamingTests
> FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests
[31mFAILED[0m
=================================== FAILURES ===================================
[31m[1m_
ExerciseStreamingMetricsPipelineTest.test_streaming_pipeline_returns_expected_user_metrics_fnapi_it
_[0m
args = (name:
"projects/apache-beam-testing/subscriptions/exercise_streaming_metrics_subscription_input1f007ebe-eb19-4904-bd4...ic:
"projects/apache-beam-testing/topics/exercise_streaming_metrics_topic_input1f007ebe-eb19-4904-bd46-ba3c12b5bda9"
,)
kwargs = {'metadata': [('x-goog-request-params',
'name=projects/apache-beam-testing/subscriptions/exercise_streaming_metrics_su...904-bd46-ba3c12b5bda9'),
('x-goog-api-client', 'gl-python/3.8.5 grpc/1.39.0 gax/1.31.2 gapic/1.7.0')],
'timeout': 60.0}
[1m @six.wraps(callable_)[0m
[1m def error_remapped_callable(*args, **kwargs):[0m
[1m try:[0m
[1m> return callable_(*args, **kwargs)[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/grpc_helpers.py[0m:67:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <grpc._channel._UnaryUnaryMultiCallable object at 0x7fefaa74cd30>
request = name:
"projects/apache-beam-testing/subscriptions/exercise_streaming_metrics_subscription_input1f007ebe-eb19-4904-bd46...opic:
"projects/apache-beam-testing/topics/exercise_streaming_metrics_topic_input1f007ebe-eb19-4904-bd46-ba3c12b5bda9"
timeout = 60.0
metadata = [('x-goog-request-params',
'name=projects/apache-beam-testing/subscriptions/exercise_streaming_metrics_subscription_input1f007ebe-eb19-4904-bd46-ba3c12b5bda9'),
('x-goog-api-client', 'gl-python/3.8.5 grpc/1.39.0 gax/1.31.2 gapic/1.7.0')]
credentials = None, wait_for_ready = None, compression = None
[1m def __call__(self,[0m
[1m request,[0m
[1m timeout=None,[0m
[1m metadata=None,[0m
[1m credentials=None,[0m
[1m wait_for_ready=None,[0m
[1m compression=None):[0m
[1m state, call, = self._blocking(request, timeout, metadata,
credentials,[0m
[1m wait_for_ready, compression)[0m
[1m> return _end_unary_response_blocking(state, call, False, None)[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/grpc/_channel.py[0m:946:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
state = <grpc._channel._RPCState object at 0x7fefaa777e50>
call = <grpc._cython.cygrpc.SegregatedCall object at 0x7fefaa778700>
with_call = False, deadline = None
[1m def _end_unary_response_blocking(state, call, with_call, deadline):[0m
[1m if state.code is grpc.StatusCode.OK:[0m
[1m if with_call:[0m
[1m rendezvous = _MultiThreadedRendezvous(state, call, None,
deadline)[0m
[1m return state.response, rendezvous[0m
[1m else:[0m
[1m return state.response[0m
[1m else:[0m
[1m> raise _InactiveRpcError(state)[0m
[1m[31mE grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC
that terminated with:[0m
[1m[31mE status = StatusCode.DEADLINE_EXCEEDED[0m
[1m[31mE details = "Deadline Exceeded"[0m
[1m[31mE debug_error_string =
"{"created":"@1630438212.000400714","description":"Error received from peer
ipv4:108.177.121.95:443","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Deadline
Exceeded","grpc_status":4}"[0m
[1m[31mE >[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/grpc/_channel.py[0m:849:
_InactiveRpcError
[33mThe above exception was the direct cause of the following exception:[0m
self =
<apache_beam.runners.dataflow.dataflow_exercise_streaming_metrics_pipeline_test.ExerciseStreamingMetricsPipelineTest
testMethod=test_streaming_pipeline_returns_expected_user_metrics_fnapi_it>
[1m def setUp(self):[0m
[1m """Creates all required topics and subs."""[0m
[1m self.test_pipeline = TestPipeline(is_integration_test=True)[0m
[1m self.project = self.test_pipeline.get_option('project')[0m
[1m self.uuid = str(uuid.uuid4())[0m
[1m [0m
[1m # Set up PubSub environment.[0m
[1m from google.cloud import pubsub[0m
[1m self.pub_client = pubsub.PublisherClient()[0m
[1m self.input_topic_name = INPUT_TOPIC + self.uuid[0m
[1m self.input_topic = self.pub_client.create_topic([0m
[1m self.pub_client.topic_path(self.project,
self.input_topic_name))[0m
[1m [0m
[1m self.output_topic_name = OUTPUT_TOPIC + self.uuid[0m
[1m self.output_topic = self.pub_client.create_topic([0m
[1m self.pub_client.topic_path(self.project,
self.output_topic_name))[0m
[1m [0m
[1m self.sub_client = pubsub.SubscriberClient()[0m
[1m self.input_sub_name = INPUT_SUB + self.uuid[0m
[1m> self.input_sub = self.sub_client.create_subscription([0m
[1m self.sub_client.subscription_path(self.project,
self.input_sub_name),[0m
[1m self.input_topic.name)[0m
[1m[31mapache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py[0m:72:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/cloud/pubsub_v1/_gapic.py[0m:40:
in <lambda>
[1m fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py[0m:438:
in create_subscription
[1m return self._inner_api_calls["create_subscription"]([0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/gapic_v1/method.py[0m:145:
in __call__
[1m return wrapped_func(*args, **kwargs)[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/retry.py[0m:286:
in retry_wrapped_func
[1m return retry_target([0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/retry.py[0m:189:
in retry_target
[1m return target()[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/timeout.py[0m:214:
in func_with_timeout
[1m return func(*args, **kwargs)[0m
[1m[31m../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/api_core/grpc_helpers.py[0m:69:
in error_remapped_callable
[1m six.raise_from(exceptions.from_grpc_error(exc), exc)[0m
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
value = None
from_value = <_InactiveRpcError of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
...1.95:443","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Deadline
Exceeded","grpc_status":4}"
>
[1m> ???[0m
[1m[31mE google.api_core.exceptions.DeadlineExceeded: 504 Deadline
Exceeded[0m
[1m[31m<string>[0m:3: DeadlineExceeded
[33m=============================== warnings summary
===============================[0m
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-noxdist.xml>
-
[31m[1m============ 1 failed, 4991 deselected, 1 warnings in 69.97 seconds
============[0m
> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests
> FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 204
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 204
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py36:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 204
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 27m 35s
92 actionable tasks: 71 executed, 21 from cache
Publishing build scan...
https://gradle.com/s/dilsosguyzax2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
