See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/1720/display/redirect>
Changes: ------------------------------------------ [...truncated 574.22 KB...] a90e3914fb92: Layer already exists 053a1f71007e: Layer already exists ec09eb83ea03: Layer already exists 4daaafb5398f: Pushed 9b9355663c19: Pushed c8d5d8c423de: Pushed 20230404045239: digest: sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005 size: 5774 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 42891 Launching Python expansion service @ 43803 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --region=us-central1 >>> --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404045239 >>> >>> --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> >>> pytest options: --capture=no --numprocesses=8 --timeout=4500 >>> --log-cli-level=INFO >>> collect markers: -m=uses_java_expansion_service ============================= test session starts ============================== platform linux -- Python 3.7.12, pytest-7.2.2, pluggy-1.0.0 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python,> configfile: pytest.ini plugins: hypothesis-6.70.2, xdist-3.2.1, timeout-2.1.0, requests-mock-1.10.0 timeout: 4500.0s timeout method: signal timeout func_only: False gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I [gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] [gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10) -- [GCC 9.3.0] gw0 [10] / gw1 [10] / gw2 [10] / gw3 [10] / gw4 [10] / gw5 [10] / gw6 [10] / gw7 [10] scheduling tests via LoadScheduling apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw2] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_external_transform [gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput [gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally [gw1] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence_java_class_lookup_payload_builder apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition [gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key [gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key [gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key [gw1] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix [gw0] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition =============================== warnings summary =============================== ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 162 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870: 117 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2349: 36 warnings <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2349: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(parent) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py:20 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages pkg_resources.declare_namespace(__name__) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 10 passed, 9 skipped, 360 warnings in 1219.45s (0:20:19) =========== > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404045239 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404045239] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20230404045239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:54095082b3e1f68821612d5a49c70f37512d6f163eb97dc341a61e34edda9005]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404045239 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404045239] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230404045239] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1400f88e671eefc9c641c411a4b7cfd41afcc4779e160a8e8fd6be658b78f5af]. > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 1654762. Stopping expansion service pid: 1654763. Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD SUCCESSFUL in 29m 51s 156 actionable tasks: 105 executed, 45 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/ofcuw42ohxf3e Build step 'Invoke Gradle script' changed build result to SUCCESS [beam_PostCommit_XVR_PythonUsingJava_Dataflow] $ /bin/bash -xe /tmp/jenkins2250975818053663230.sh + echo '*** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.11 ***' *** RUN CROSS-LANGUAGE DATAFLOW PYTHON WITH JAVA EXTERNAL TRANSFORMS USING PYTHON 3.11 *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/gradlew> --continue --max-workers=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.11 :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.5.1/userguide/gradle_daemon.html#sec:disabling_the_daemon. Daemon will be stopped at the end of the build Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.20.2 go1.20.2: already downloaded in /home/jenkins/sdk/go1.20.2 GOCMD=/home/jenkins/go/bin/go1.20.2 FAILURE: Build failed with an exception. * What went wrong: Could not determine the dependencies of task ':runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer'. > Task with path ':sdks:python:container:py311:docker' not found in project > ':runners:google-cloud-dataflow-java'. * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 19s 10 actionable tasks: 10 up-to-date Publishing build scan... https://gradle.com/s/ec4tbbpqlxzg4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
