See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9917/display/redirect?page=changes>
Changes: [noreply] [Go SDK] S3 implementation of the Beam filesystem (#23992) ------------------------------------------ [...truncated 1.97 MB...] <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/typehints/pandas_type_compatibility_test.py:66 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:89 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml> - =========================== short test summary info ============================ FAILED apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it_with_prebuilt_sdk_container_local_docker - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: java.lang.RuntimeException: java.lang.NoSuchMethodError: java.nio.ByteBuffer.clear()Ljava/nio/ByteBuffer; at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn$1.output(GroupAlsoByWindowsParDoFn.java:187) at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner$1.outputWindowedValue(GroupAlsoByWindowFnRunner.java:108) at org.apache.beam.runners.dataflow.worker.util.BatchGroupAlsoByWindowViaIteratorsFn.processElement(BatchGroupAlsoByWindowViaIteratorsFn.java:128) at org.apache.beam.runners.dataflow.worker.util.BatchGroupAlsoByWindowViaIteratorsFn.processElement(BatchGroupAlsoByWindowViaIteratorsFn.java:56) at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner.invokeProcessElement(GroupAlsoByWindowFnRunner.java:121) at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner.processElement(GroupAlsoByWindowFnRunner.java:73) at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn.processElement(GroupAlsoByWindowsParDoFn.java:117) at org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:44) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:49) at org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:218) at org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:169) at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:83) at org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389) at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:239) at org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:142) Caused by: java.lang.NoSuchMethodError: java.nio.ByteBuffer.clear()Ljava/nio/ByteBuffer; at org.apache.beam.sdk.util.BufferedElementCountingOutputStream.outputBuffer(BufferedElementCountingOutputStream.java:197) at org.apache.beam.sdk.util.BufferedElementCountingOutputStream.flush(BufferedElementCountingOutputStream.java:180) at org.apache.beam.sdk.util.BufferedElementCountingOutputStream.finish(BufferedElementCountingOutputStream.java:119) at org.apache.beam.sdk.coders.IterableLikeCoder.encode(IterableLikeCoder.java:126) at org.apache.beam.sdk.coders.IterableLikeCoder.encode(IterableLikeCoder.java:59) at org.apache.beam.sdk.coders.Coder.encode(Coder.java:136) at org.apache.beam.sdk.coders.KvCoder.encode(KvCoder.java:73) at org.apache.beam.sdk.coders.KvCoder.encode(KvCoder.java:37) at org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:607) at org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:598) at org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:558) at org.apache.beam.sdk.fn.data.BeamFnDataOutboundAggregator$Receiver.accept(BeamFnDataOutboundAggregator.java:340) at org.apache.beam.sdk.fn.data.BeamFnDataOutboundObserver.accept(BeamFnDataOutboundObserver.java:85) at org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.process(RemoteGrpcPortWriteOperation.java:206) at org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:49) at org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn$1.output(GroupAlsoByWindowsParDoFn.java:185) ... 17 more ======= 1 failed, 3 passed, 5 skipped, 6 warnings in 2221.82s (0:37:01) ======== cleanup_container Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221109-105432540377646 Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:b5d26b6ed9d074a2903ccecc0239f00668856501173f3fb6141ea3c76f318033 Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:5fbc40e5-ae64-4cee-b9f3-7d47dea3095d Untagged: us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:6f478d0b830b67996b8148c189a9fa7483f0aaeb552364d4b70d0a3ca5994bc9 Deleted: sha256:eb128ef280963285610101277217c460a505e2a13cac2cb4a738135b49cd8827 Deleted: sha256:67b4b5ebd4212fcab2859bf9cf78c71427e922c5b10c999d1b1bab1fd9eeddd4 Deleted: sha256:8d81892eb58b5c82229b0433362ab6e4579203391d921390b47531633ab5aa6b Deleted: sha256:db6d4da85f0d0bb4fccb7fbc65e35d8f494d5fa8b8c205e72b80b9bc33daf233 Deleted: sha256:60351ebbf56f9e303bea4cf65a52252e32186fa5b817d69090f46ff651467665 Deleted: sha256:2afbacc86d2eb82a64487fb8d34228e40a28c4f4c8493cb3300c925b00279048 WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:b5d26b6ed9d074a2903ccecc0239f00668856501173f3fb6141ea3c76f318033 Associated tags: - 20221109-105432540377646 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221109-105432540377646 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221109-105432540377646]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:b5d26b6ed9d074a2903ccecc0239f00668856501173f3fb6141ea3c76f318033]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:6f478d0b830b67996b8148c189a9fa7483f0aaeb552364d4b70d0a3ca5994bc9 Associated tags: - 5fbc40e5-ae64-4cee-b9f3-7d47dea3095d Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:5fbc40e5-ae64-4cee-b9f3-7d47dea3095d]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:6f478d0b830b67996b8148c189a9fa7483f0aaeb552364d4b70d0a3ca5994bc9]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:e5669228650b21fa9606e362b2fdb2996a00954eef374e6c8787c4917b25cecb Associated tags: - 524851d8-56db-4d5e-8c28-0f469b7a1306 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:524851d8-56db-4d5e-8c28-0f469b7a1306]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:e5669228650b21fa9606e362b2fdb2996a00954eef374e6c8787c4917b25cecb]. Removed the container > Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py310:validatesContainer cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:412394c1502660597533ebfde3ca3ae136fed5e26e34233886de5cfdb17dc1ee Associated tags: - 20221109-105432446803329 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221109-105432446803329 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221109-105432446803329]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:412394c1502660597533ebfde3ca3ae136fed5e26e34233886de5cfdb17dc1ee]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:92f410555a9ac7a9d1227a48db74020ead52b468797de16fc93e0ad04b6cfd5c Associated tags: - 58f54b21-90fd-4a02-9277-904ff85f9340 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:58f54b21-90fd-4a02-9277-904ff85f9340]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:92f410555a9ac7a9d1227a48db74020ead52b468797de16fc93e0ad04b6cfd5c]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:da5f2a9a46851c368a9235a9ae8252123d8127e309e232f526b3b761d22b4e4a Associated tags: - 936a832c-06fe-4cd7-a2d6-4918c8de4a2b Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:936a832c-06fe-4cd7-a2d6-4918c8de4a2b]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:da5f2a9a46851c368a9235a9ae8252123d8127e309e232f526b3b761d22b4e4a]. > Task :sdks:python:test-suites:dataflow:py310:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py37:validatesContainer cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:ffb8e02137ab693510baa5a310e8f6f386defbdfa4493d2cfb3120d0daaf7aa4 Associated tags: - 20221109-105432728813565 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221109-105432728813565 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221109-105432728813565]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:ffb8e02137ab693510baa5a310e8f6f386defbdfa4493d2cfb3120d0daaf7aa4]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:5ca72a19f2745885ebd09933604b0d7727067a5bab5435a741fb3b4df8dcbbca Associated tags: - fcda9270-1ffc-4a3c-92c4-acf2303a922e Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:fcda9270-1ffc-4a3c-92c4-acf2303a922e]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:5ca72a19f2745885ebd09933604b0d7727067a5bab5435a741fb3b4df8dcbbca]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:7eea0e409c897b16783d67c5aff894c74b67b0a5d228d1fb03e434abfca4c019 Associated tags: - b4786e65-63f4-4d31-a7dd-3ed3eb114d35 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:b4786e65-63f4-4d31-a7dd-3ed3eb114d35]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:7eea0e409c897b16783d67c5aff894c74b67b0a5d228d1fb03e434abfca4c019]. > Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED > Task :sdks:python:test-suites:dataflow:py39:validatesContainer cleanup_container WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly. Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:1d552e1b5dcc7e3c62b7e6c1f3697a21641390f488387296a30bebdabdf2d947 Associated tags: - 20221109-105432785116958 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221109-105432785116958 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221109-105432785116958]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:1d552e1b5dcc7e3c62b7e6c1f3697a21641390f488387296a30bebdabdf2d947]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:a70d108a7da7a095da54dd09426adbf887b3c25d477e1d47fa40321c540419a7 Associated tags: - 174206c6-d6ab-4cf4-a44b-4e02187a1d33 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:174206c6-d6ab-4cf4-a44b-4e02187a1d33]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:a70d108a7da7a095da54dd09426adbf887b3c25d477e1d47fa40321c540419a7]. Digests: - us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:39d9bab64c00d87e0e139a86be037f0a9d6f499a628d4b3fd4062d65eaabe0de Associated tags: - 4cb4dc85-c587-4a4e-9276-07ccf2dbebb5 Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:4cb4dc85-c587-4a4e-9276-07ccf2dbebb5]. Deleted [us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:39d9bab64c00d87e0e139a86be037f0a9d6f499a628d4b3fd4062d65eaabe0de]. > Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED FAILURE: Build completed with 4 failures. 1: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 363 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 363 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py310:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 3: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 363 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py37:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 4: Task failed with an exception. ----------- * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 363 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:validatesContainer'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 56m 26s 62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date Publishing build scan... https://gradle.com/s/4fxuifgivypfm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
