See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/741/display/redirect?page=changes>
Changes:
[Boyuan Zhang] [BEAM-12353] Sickbay new added failing test for Dataflow runner
v2.
[noreply] [BEAM-12346] Enable basic ValidatesPortableRunner tests in Samza
Runner
[noreply] [BEAM-12361] Ensure that Reshuffle.AssignToShard numBuckets is
respected
[noreply] Run Jenkins jobs for Nexmark Dataflow V2 Java 8 and 11 (#14774)
[noreply] [BEAM-7372][BEAM-9372] Cleanup py2 and py35 codepath from runners
worker
------------------------------------------
[...truncated 664.16 KB...]
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.198871561","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_group_by_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 262, in test_group_by_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 140, in run_group_by_key
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.198949070","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_combine_globally
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 270, in test_combine_globally
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 181, in run_combine_globally
TEST_COMGL_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.199590303","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_multi_input_output_with_sideinput
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 258, in test_multi_input_output_with_sideinput
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 119, in run_multi_input_output_with_sideinput
TEST_MULTI_URN, None, self.expansion_service)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 601, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.198863271","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_partition
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 282, in test_partition
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 235, in run_partition
TEST_PARTITION_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.199014455","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_combine_per_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 274, in test_combine_per_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 200, in run_combine_per_key
TEST_COMPK_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.201116571","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
======================================================================
ERROR: test_generate_sequence
(apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/external/generate_sequence_test.py";,>
line 48, in test_generate_sequence
| GenerateSequence(start=1, stop=10, expansion_service=address))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 601, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 694, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 141, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 185, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 215, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 295, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand"
debug_error_string =
"{"created":"@1621383243.199078251","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found:
org.apache.beam.model.expansion.v1.ExpansionService/Expand","grpc_status":12}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 8 tests in 5.790s
FAILED (errors=8)
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Skipping invalid pid: 345.
Stopping expansion service pid: 351.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519000102
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0e81a87d2adbe760066724a0e4d10699fe0b980dca498085199c94e6255518b7
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0e81a87d2adbe760066724a0e4d10699fe0b980dca498085199c94e6255518b7
Associated tags:
- 20210519000102
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519000102
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210519000102].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0e81a87d2adbe760066724a0e4d10699fe0b980dca498085199c94e6255518b7].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 40s
113 actionable tasks: 85 executed, 24 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/3b6d7wxocgk32
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
