See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/246/display/redirect?page=changes>
Changes:
[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled
[Jeff Tapper] Update Java LTS roadmap info on website for Java 17
[Pablo Estrada] Simplify README for new users
[Kyle Weaver] [BEAM-13106] Support Flink 1.14.
[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.
[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.
[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest
[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow
[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum
[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a
specific case
[Kenneth Knowles] Add test category UsesProcessingTimeTimers
[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers
[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests
[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.
[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT
[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and
PortableRunner exceptions
[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)
[relax] Fix TableRow conversion for the case of fields named "f"
[noreply] Bump dataflow.fnapi_container_version (#16874)
[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify
[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew
[noreply] Case studies page improvements (#16702)
[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on
[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)
[thiagotnunes] fix: fix bug when retrieving either string or json
[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to
minimize
[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive
[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner
[noreply] Remove build status from PR (#16902)
------------------------------------------
[...truncated 962.91 KB...]
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/strea
Feb 19, 2022 4:03:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:03:35.307Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Feb 19, 2022 4:03:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:03:35.346Z: Worker pool stopped.
Feb 19, 2022 4:03:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-02-19_04_48_48-3087146533562638637 finished with status
CANCELLED.
Load test results for test (ID): b0fe1192-e3fd-4359-a3cd-15e1bd23f94c and
timestamp: 2022-02-19T12:48:42.648000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11390.007
dataflow_v2_java11_total_bytes_count 3.63530377E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219124635
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219124635]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219124635]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967
ERROR: (gcloud.container.images.delete) Not found: response:
{'docker-distribution-api-version': 'registry/2.0', 'content-type':
'application/json', 'date': 'Sat, 19 Feb 2022 16:03:48 GMT', 'server': 'Docker
Registry', 'cache-control': 'private', 'x-xss-protection': '0',
'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status':
'404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest:
'sha256:0845c54623ae950186c40c626e985c26e6f4208adc845ed37f746edda062b967': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'>
line: 297
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 17m 28s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/uzgnwtb3xlkeg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
