See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/421/display/redirect?page=changes>
Changes:
[noreply] Minor fix in unit test
[samuelw] Add profiling option to nexmark gradle launching. Passing the
[Robert Bradshaw] [BEAM-11719] Use deterministic coders for grouping keys.
[Robert Bradshaw] Fix bigquery file load.
[Robert Bradshaw] Fix GroupWithCoderTest.test_basics_without_type_check to check
[Robert Bradshaw] Add the ability to register additional fallback coders.
[cvm] Minor bugfix in typecoders.
[Robert Bradshaw] [BEAM-11719] Pipeline option for non-deterministic key coders.
[Robert Bradshaw] Lint, import fix.
[dpcollins] [BEAM-10114] Fix PerSubscriptionPartitionSdf to not rely on the
presence
[dpcollins] [BEAM-10114] Fix PerSubscriptionPartitionSdf to not rely on the
presence
[Robert Bradshaw] Fixup
[Fokko Driesprong] [BEAM-11864] Use objects.equals instead of raw comparison
[noreply] [BEAM-10961] enable strict dependency checking for sdks/java/io/thrift
[noreply] [BEAM-10961] enable strict dependency checking for
sdks/java/io/parquet
[noreply] [BEAM-10961] Enable strict dependency checking on
------------------------------------------
[...truncated 643.73 KB...]
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.092644700","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_cogroup_by_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 269, in test_cogroup_by_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 166, in run_cogroup_by_key
| beam.Map(lambda x: "{}:{}".format(x[0], ','.join(sorted(x[1])))))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 573, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.096120255","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_combine_globally
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 273, in test_combine_globally
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 184, in run_combine_globally
TEST_COMGL_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.135183098","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_combine_per_key
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 277, in test_combine_per_key
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 203, in run_combine_per_key
TEST_COMPK_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.177635821","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_multi_input_output_with_sideinput
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 261, in test_multi_input_output_with_sideinput
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 122, in run_multi_input_output_with_sideinput
TEST_MULTI_URN, None, self.expansion_service)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 573, in __ror__
result = p.apply(self, pvalueish, label)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.222164523","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_partition
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 285, in test_partition
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 238, in run_partition
TEST_PARTITION_URN, None, self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.293399038","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
======================================================================
ERROR: test_prefix
(apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 257, in test_prefix
test_pipeline or self.create_pipeline())
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/validate_runner_xlang_test.py";,>
line 101, in run_prefix
self.expansion_service))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pvalue.py";,>
line 142, in __or__
return self.pipeline.apply(ptransform, self)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 689, in apply
pvalueish_result = self.runner.apply(transform, pvalueish, self._options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in apply
return super(DataflowRunner, self).apply(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 188, in apply
return m(transform, input, options)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/runners/runner.py";,>
line 218, in apply_PTransform
return transform.expand(input)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/transforms/external.py";,>
line 316, in expand
response = service.Expand(request)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 923, in __call__
return _end_unary_response_blocking(state, call, False, None)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,>
line 826, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNIMPLEMENTED
details = "Method not found!"
debug_error_string =
"{"created":"@1614298797.321683084","description":"Error received from peer
ipv4:127.0.0.1:18091","file":"src/core/lib/surface/call.cc","file_line":1067,"grpc_message":"Method
not found!","grpc_status":12}"
>
----------------------------------------------------------------------
XML: nosetests-xlangValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 8 tests in 7.340s
FAILED (errors=8)
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f4e3b2dd711f659827338c0f0425dd47690eec3d2dd84340ea951ac64ced307
Associated tags:
- 20210226000208
Tags:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210226000208
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210226000208].
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7f4e3b2dd711f659827338c0f0425dd47690eec3d2dd84340ea951ac64ced307].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18m 36s
112 actionable tasks: 85 executed, 23 from cache, 4 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/ec6m7eb6peecm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
