See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9898/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Move logging to its own module.
[Robert Bradshaw] Cleanup worker logging.
[noreply] Improve Iterator error message (#23972)
[noreply] Update watermark during periodic sequence/impulse (#23507)
[noreply] TFX image classification example (#23456)
[noreply] Immediately truncate full restriction on drain of periodic impulse
[noreply] [Task]: PR Bot will push commits only if they are non-empty (#23937)
[noreply] Bump cloud.google.com/go/datastore from 1.8.0 to 1.9.0 in /sdks
(#23916)
[Robert Bradshaw] Remove obsolete TODO.
------------------------------------------
[...truncated 1.90 MB...]
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:598)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:558)
at
org.apache.beam.sdk.fn.data.BeamFnDataOutboundAggregator$Receiver.accept(BeamFnDataOutboundAggregator.java:340)
at
org.apache.beam.sdk.fn.data.BeamFnDataOutboundObserver.accept(BeamFnDataOutboundObserver.java:85)
at
org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.process(RemoteGrpcPortWriteOperation.java:206)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:49)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn$1.output(GroupAlsoByWindowsParDoFn.java:185)
... 17 more
FAILED
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
- apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException:
Dataflow pipeline failed. State: FAILED, Error:
java.lang.RuntimeException: java.lang.NoSuchMethodError:
java.nio.ByteBuffer.clear()Ljava/nio/ByteBuffer;
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn$1.output(GroupAlsoByWindowsParDoFn.java:187)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner$1.outputWindowedValue(GroupAlsoByWindowFnRunner.java:108)
at
org.apache.beam.runners.dataflow.worker.util.BatchGroupAlsoByWindowViaIteratorsFn.processElement(BatchGroupAlsoByWindowViaIteratorsFn.java:128)
at
org.apache.beam.runners.dataflow.worker.util.BatchGroupAlsoByWindowViaIteratorsFn.processElement(BatchGroupAlsoByWindowViaIteratorsFn.java:56)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner.invokeProcessElement(GroupAlsoByWindowFnRunner.java:121)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowFnRunner.processElement(GroupAlsoByWindowFnRunner.java:73)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn.processElement(GroupAlsoByWindowsParDoFn.java:117)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.process(ParDoOperation.java:44)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:49)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:218)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:169)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:83)
at
org.apache.beam.runners.dataflow.worker.fn.control.BeamFnMapTaskExecutor.execute(BeamFnMapTaskExecutor.java:127)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:420)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:389)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
at
org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.start(DataflowRunnerHarness.java:239)
at
org.apache.beam.runners.dataflow.worker.DataflowRunnerHarness.main(DataflowRunnerHarness.java:142)
Caused by: java.lang.NoSuchMethodError:
java.nio.ByteBuffer.clear()Ljava/nio/ByteBuffer;
at
org.apache.beam.sdk.util.BufferedElementCountingOutputStream.outputBuffer(BufferedElementCountingOutputStream.java:197)
at
org.apache.beam.sdk.util.BufferedElementCountingOutputStream.flush(BufferedElementCountingOutputStream.java:180)
at
org.apache.beam.sdk.util.BufferedElementCountingOutputStream.finish(BufferedElementCountingOutputStream.java:119)
at
org.apache.beam.sdk.coders.IterableLikeCoder.encode(IterableLikeCoder.java:126)
at
org.apache.beam.sdk.coders.IterableLikeCoder.encode(IterableLikeCoder.java:59)
at org.apache.beam.sdk.coders.Coder.encode(Coder.java:136)
at org.apache.beam.sdk.coders.KvCoder.encode(KvCoder.java:73)
at org.apache.beam.sdk.coders.KvCoder.encode(KvCoder.java:37)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:607)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:598)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.encode(WindowedValue.java:558)
at
org.apache.beam.sdk.fn.data.BeamFnDataOutboundAggregator$Receiver.accept(BeamFnDataOutboundAggregator.java:340)
at
org.apache.beam.sdk.fn.data.BeamFnDataOutboundObserver.accept(BeamFnDataOutboundObserver.java:85)
at
org.apache.beam.runners.dataflow.worker.fn.data.RemoteGrpcPortWriteOperation.process(RemoteGrpcPortWriteOperation.java:206)
at
org.apache.beam.runners.dataflow.worker.util.common.worker.OutputReceiver.process(OutputReceiver.java:49)
at
org.apache.beam.runners.dataflow.worker.GroupAlsoByWindowsParDoFn$1.output(GroupAlsoByWindowsParDoFn.java:185)
... 17 more
============ 4 failed, 5 skipped, 6 warnings in 2272.55s (0:37:52) =============
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221104-165903663077537
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:7dea5fd4e2c521b2ca448d296b6d3b0a0178f084419041e6e7e886e36b7cded7
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:e174450c-9fea-4be8-b04a-273de6fce629
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f7e2219c66025f57fd5258227d12eed11635a9be2814f05956b99f2e467cfeef
Deleted: sha256:213e40c62de5cccf45b04f8d6acffe8683ea295be05eed0b71c8d07586598280
Deleted: sha256:26bd60931fa91562906332699023d5f2993cdfe18430ab244153ed26d2518b5c
Deleted: sha256:fcb741643694a292beaa6e71265bed13e986f143238a45d0e1eb8d18581bc415
Deleted: sha256:33e4fa3125dd27b56a9033cb49dcff2b103488072cf6a2b1a254c04916588434
Deleted: sha256:2ae2e6eda49db5e9fed72237a26a605f2ac96bb1b05f37ac2a97dafae77010d1
Deleted: sha256:ccd69517e78c86b9d4351c530da82a5464a73191d08a4fad74bb8d3c019e5718
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:7dea5fd4e2c521b2ca448d296b6d3b0a0178f084419041e6e7e886e36b7cded7
Associated tags:
- 20221104-165903663077537
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221104-165903663077537
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221104-165903663077537].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:7dea5fd4e2c521b2ca448d296b6d3b0a0178f084419041e6e7e886e36b7cded7].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f7e2219c66025f57fd5258227d12eed11635a9be2814f05956b99f2e467cfeef
Associated tags:
- e174450c-9fea-4be8-b04a-273de6fce629
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:e174450c-9fea-4be8-b04a-273de6fce629].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f7e2219c66025f57fd5258227d12eed11635a9be2814f05956b99f2e467cfeef].
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221104-165854667900026
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:6884881b3136ace1ee6047d4139d020af0822048ff8de5808722109df2df2f57
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:2b31ad03-125a-4cb2-8b2a-1be218c6ec9d
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:196acceef4c07cc76d817df666850c73d56770d7bd243c08e0ab185f734ec67d
Deleted: sha256:a1eff6143c81c6e15bdcdeb3002e23fe682cc6946a92c6bb3206bbf547b26b03
Deleted: sha256:f8825e91265d7adc3ae193a27ee5509e38b3082f61aa81b54e617d01fbec958c
Deleted: sha256:942b9b35bc536914e8541022603427fb0e82e1a18a8decdfaae32ca0ab0f75bd
Deleted: sha256:3a275745cabf6f1b2913c97f8235c9eafe741343662a7dced19af6070d1a04f7
Deleted: sha256:519480759f75b882923563f9edf89a028d1918d3dd68b7cc519d2e7469eaa536
Deleted: sha256:cf4325d9936106ac6a951b97024f0bc72acd200667a1c5bd1799caa657686e37
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:6884881b3136ace1ee6047d4139d020af0822048ff8de5808722109df2df2f57
Associated tags:
- 20221104-165854667900026
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221104-165854667900026
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221104-165854667900026].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:6884881b3136ace1ee6047d4139d020af0822048ff8de5808722109df2df2f57].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:196acceef4c07cc76d817df666850c73d56770d7bd243c08e0ab185f734ec67d
Associated tags:
- 2b31ad03-125a-4cb2-8b2a-1be218c6ec9d
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:2b31ad03-125a-4cb2-8b2a-1be218c6ec9d].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:196acceef4c07cc76d817df666850c73d56770d7bd243c08e0ab185f734ec67d].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:dc2be629b6d7659f770f0d7bd0f476f1d01372764c7ee0361568c48859f6dcff
Associated tags:
- ea2c399c-8d4b-4697-aafc-1ec49343c107
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:ea2c399c-8d4b-4697-aafc-1ec49343c107].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:dc2be629b6d7659f770f0d7bd0f476f1d01372764c7ee0361568c48859f6dcff].
Removed the container
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:9bcee77ed2ba3a212560c68e87acd520d0159e79c2df12983d42d513d6cc9a26
Associated tags:
- fe9bf100-aebb-4a56-80d3-6ebdbb28eea3
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:fe9bf100-aebb-4a56-80d3-6ebdbb28eea3].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:9bcee77ed2ba3a212560c68e87acd520d0159e79c2df12983d42d513d6cc9a26].
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:bda7484d980f963985e2b072de58148b663f10ab721d7714150bcf5f7b35abe1
Associated tags:
- 20221104-165859535495133
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221104-165859535495133
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221104-165859535495133].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:bda7484d980f963985e2b072de58148b663f10ab721d7714150bcf5f7b35abe1].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:ff7be0a0739fc8e627b5ffd30b07b2756466212d1fe035f30fb2573c22799eb0
Associated tags:
- 20221104-165908910525598
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221104-165908910525598
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221104-165908910525598].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:ff7be0a0739fc8e627b5ffd30b07b2756466212d1fe035f30fb2573c22799eb0].
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:58cd60511b16948bf188bc4b50515c401e2b979d3f974f07d8358e26251afc40
Associated tags:
- 4600e6f7-2c6b-49a8-a09f-e8566b1cdafe
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:4600e6f7-2c6b-49a8-a09f-e8566b1cdafe].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:58cd60511b16948bf188bc4b50515c401e2b979d3f974f07d8358e26251afc40].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:8bc8474cbd5f67548d01567a670d17bcb5750858d0af3769e3d8e841b121c3b2
Associated tags:
- 80222421-9410-4ace-8c38-f02d0a343440
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:80222421-9410-4ace-8c38-f02d0a343440].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:8bc8474cbd5f67548d01567a670d17bcb5750858d0af3769e3d8e841b121c3b2].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:6b05cb3f5cd6b09e12791f0e849205a25e9b7d5c47f5f6af3931790bc40df3de
Associated tags:
- cf647382-141b-47aa-bd6b-ec44d4453cfb
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:cf647382-141b-47aa-bd6b-ec44d4453cfb].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:6b05cb3f5cd6b09e12791f0e849205a25e9b7d5c47f5f6af3931790bc40df3de].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9a51a8fbc376a23348c1a59a1a3d41d77135650b785e9f93f2ce39d1d7486dcf
Associated tags:
- 8b8e6c94-a4cc-4e45-87fc-b5d99238ab03
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:8b8e6c94-a4cc-4e45-87fc-b5d99238ab03].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:9a51a8fbc376a23348c1a59a1a3d41d77135650b785e9f93f2ce39d1d7486dcf].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 11s
62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/3u6eljbdc7p6a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
