See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/36/display/redirect?page=changes>
Changes: [mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare [noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing ------------------------------------------ [...truncated 449.41 KB...] 8ba9f690e8ba: Layer already exists 3e607d59ef9f: Layer already exists 1e18e7e1fcc2: Layer already exists c3a0d593ed24: Layer already exists 26a504e63be4: Layer already exists 8bf42db0de72: Layer already exists 31892cc314cb: Layer already exists 11936051f93b: Layer already exists 6625950eb1aa: Pushed 75a7ce4da556: Pushed 3356a3824ff9: Pushed c31844ca3e89: Pushed 20220202180550: digest: sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78 size: 5361 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 44363 Launching Python expansion service @ 35781 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180550 >>> --experiments=use_runner_v2 --experiments=shuffle_mode=appliance >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw2] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw1] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw3] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw4] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw6] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw5] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] [gw7] Python 3.6.15 (default, Jan 15 2022, 19:47:13) -- [GCC 9.3.0] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10] scheduling tests via LoadScheduling apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder [gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform [gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key [gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw0] FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally [gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput [gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key [gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw2] FAILED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix =================================== FAILURES =================================== ____________________ ValidateRunnerXlangTest.test_partition ____________________ [gw0] linux -- Python 3.6.15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/bin/python3.6> self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_partition> test_pipeline = None @pytest.mark.xlang_transforms def test_partition(self, test_pipeline=None): CrossLanguageTestPipelines().run_partition( > test_pipeline or self.create_pipeline()) apache_beam/transforms/validate_runner_xlang_test.py:290: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/transforms/validate_runner_xlang_test.py:235: in run_partition TEST_PARTITION_URN, None, self.expansion_service)) apache_beam/pvalue.py:137: in __or__ return self.pipeline.apply(ptransform, self) apache_beam/pipeline.py:708: in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) apache_beam/runners/dataflow/dataflow_runner.py:141: in apply return super().apply(transform, input, options) apache_beam/runners/runner.py:185: in apply return m(transform, input, options) apache_beam/runners/runner.py:215: in apply_PTransform return transform.expand(input) apache_beam/transforms/external.py:509: in expand response = service.Expand(request) ../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__ return _end_unary_response_blocking(state, call, False, None) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ state = <grpc._channel._RPCState object at 0x7ffa180c6be0> call = <grpc._cython.cygrpc.SegregatedCall object at 0x7ffa18224088> with_call = False, deadline = None def _end_unary_response_blocking(state, call, with_call, deadline): if state.code is grpc.StatusCode.OK: if with_call: rendezvous = _MultiThreadedRendezvous(state, call, None, deadline) return state.response, rendezvous else: return state.response else: > raise _InactiveRpcError(state) E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: E status = StatusCode.UNAVAILABLE E details = "failed to connect to all addresses" E debug_error_string = "{"created":"@1643826757.276652091","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3134,"referenced_errors":[{"created":"@1643826757.276651012","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":163,"grpc_status":14}]}" E > ../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError _____________________ ValidateRunnerXlangTest.test_prefix ______________________ [gw2] linux -- Python 3.6.15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/bin/python3.6> self = <apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest testMethod=test_prefix> test_pipeline = None @pytest.mark.xlang_transforms def test_prefix(self, test_pipeline=None): CrossLanguageTestPipelines().run_prefix( > test_pipeline or self.create_pipeline()) apache_beam/transforms/validate_runner_xlang_test.py:254: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ apache_beam/transforms/validate_runner_xlang_test.py:98: in run_prefix self.expansion_service)) apache_beam/pvalue.py:137: in __or__ return self.pipeline.apply(ptransform, self) apache_beam/pipeline.py:708: in apply pvalueish_result = self.runner.apply(transform, pvalueish, self._options) apache_beam/runners/dataflow/dataflow_runner.py:141: in apply return super().apply(transform, input, options) apache_beam/runners/runner.py:185: in apply return m(transform, input, options) apache_beam/runners/runner.py:215: in apply_PTransform return transform.expand(input) apache_beam/transforms/external.py:509: in expand response = service.Expand(request) ../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:946: in __call__ return _end_unary_response_blocking(state, call, False, None) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ state = <grpc._channel._RPCState object at 0x7f9777e99ba8> call = <grpc._cython.cygrpc.SegregatedCall object at 0x7f97848b8888> with_call = False, deadline = None def _end_unary_response_blocking(state, call, with_call, deadline): if state.code is grpc.StatusCode.OK: if with_call: rendezvous = _MultiThreadedRendezvous(state, call, None, deadline) return state.response, rendezvous else: return state.response else: > raise _InactiveRpcError(state) E grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with: E status = StatusCode.UNAVAILABLE E details = "failed to connect to all addresses" E debug_error_string = "{"created":"@1643826790.960178440","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3134,"referenced_errors":[{"created":"@1643826790.960177358","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":163,"grpc_status":14}]}" E > ../../build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py:849: _InactiveRpcError =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =============== 2 failed, 8 passed, 8 warnings in 760.84 seconds =============== > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 3404482. Stopping expansion service pid: 3404483. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220202180550 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220202180550] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220202180550] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:dca4f9fbbf3ae71b7cb2fd9d2f0f5a76000f784e948b062907c4045eafd5fd78]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180550 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180550] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220202180550] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1bb2052c260fe250495d8d7ce7b4cf4160d1b97660e977477e34b919b61d997c]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 28m 25s 113 actionable tasks: 78 executed, 29 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/gevdmkp46zraa Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
