See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/749/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12342] Upgrade Spark 2 to version 2.4.8
[Udi Meiri] [BEAM-12352] Skip
GcsIOIntegrationTest.test_copy{,_batch}_rewrite_token
[noreply] [BEAM-3713] Move validatesRunnerBatchTests and
validatesRunnerStreaming
------------------------------------------
[...truncated 84.94 KB...]
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 163, in run_cogroup_by_key
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 601, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.418025146","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_combine_globally
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 270, in test_combine_globally
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 181, in run_combine_globally
TEST_COMGL_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.439582038","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_group_by_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 262, in test_group_by_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 140, in run_group_by_key
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.454144580","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_multi_input_output_with_sideinput
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 258, in test_multi_input_output_with_sideinput
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 119, in run_multi_input_output_with_sideinput
TEST_MULTI_URN, None, self.expansion_service)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 601, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.509295784","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_combine_per_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 274, in test_combine_per_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 200, in run_combine_per_key
TEST_COMPK_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.515955070","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_prefix
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 254, in test_prefix
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 98, in run_prefix
self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.536525248","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_partition
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 282, in test_partition
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 235, in run_partition
TEST_PARTITION_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1621556213.570684037","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Method
not found!","grpc_status":12}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 8 tests in 5.938s
FAILED (errors=8)
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de978ce1c14392ce8e3c23648d4dc6e856a9d46e59647ff45080dbfaca31b3bd
Associated tags:
- 20210521000345
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210521000345
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210521000345].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:de978ce1c14392ce8e3c23648d4dc6e856a9d46e59647ff45080dbfaca31b3bd].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 38s
113 actionable tasks: 86 executed, 23 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/7aap45mbytavi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
