See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Streaming_Java17/62/display/redirect?page=changes>
Changes:
[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled
[Jeff Tapper] Update Java LTS roadmap info on website for Java 17
[Pablo Estrada] Simplify README for new users
[Kyle Weaver] [BEAM-13106] Support Flink 1.14.
[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.
[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.
[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest
[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow
[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum
[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a
specific case
[Kenneth Knowles] Add test category UsesProcessingTimeTimers
[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers
[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests
[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.
[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT
[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and
PortableRunner exceptions
[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)
[relax] Fix TableRow conversion for the case of fields named "f"
[noreply] Bump dataflow.fnapi_container_version (#16874)
[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify
[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew
[noreply] Case studies page improvements (#16702)
[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on
[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)
[thiagotnunes] fix: fix bug when retrieving either string or json
[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to
minimize
[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive
[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner
[noreply] Remove build status from PR (#16902)
------------------------------------------
[...truncated 455.93 KB...]
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/dax/workflow/****/streaming/streaming_rpc_windmill_service_server.cc:688
==>
./dist_proc/dax/workflow/****/streaming/windowing_api_delegate.h:67
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:214
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. T
Feb 19, 2022 2:23:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:53.629Z: Staged package
hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar'
is inaccessible.
Feb 19, 2022 2:23:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:53.673Z: Staged package
hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar'
is inaccessible.
Feb 19, 2022 2:23:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:53.782Z: Staged package
j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar'
is inaccessible.
Feb 19, 2022 2:23:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:53.925Z: Staged package
jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar'
is inaccessible.
Feb 19, 2022 2:23:54 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:54.056Z: Staged package
jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar'
is inaccessible.
Feb 19, 2022 2:23:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:54.165Z: Staged package
javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar at
location
'gs://temp-storage-for-perf-tests/loadtests/staging/javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar'
is inaccessible.
Feb 19, 2022 2:23:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-02-19T14:23:54.237Z: Staged package
json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar at location
'gs://temp-storage-for-perf-tests/loadtests/staging/json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar'
is inaccessible.
Feb 19, 2022 2:23:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-02-19T14:23:55.298Z: One or more access checks for temp location
or staged files failed. Please refer to other error messages for details. For
more information on security and permissions, please see
https://cloud.google.com/dataflow/security-and-permissions.
Feb 19, 2022 3:40:41 PM org.apache.beam.sdk.metrics.MetricsEnvironment
getCurrentContainer
WARNING: Reporting metrics are not supported in the current execution
environment.
Feb 19, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:00:43.100Z: Cancel request is committed for workflow job:
2022-02-19_04_38_38-4711337483547601338.
Feb 19, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:00:43.134Z: Cleaning up.
Feb 19, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:00:43.190Z: Stopping **** pool...
Feb 19, 2022 4:00:43 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:00:43.236Z: Stopping **** pool...
Feb 19, 2022 4:03:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:03:04.605Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Feb 19, 2022 4:03:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-02-19T16:03:04.639Z: Worker pool stopped.
Feb 19, 2022 4:03:11 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-02-19_04_38_38-4711337483547601338 finished with status
CANCELLED.
Load test results for test (ID): a661d839-1906-49f5-8968-83235c00983c and
timestamp: 2022-02-19T12:38:32.929000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 11991.314
dataflow_v2_java17_total_bytes_count 3.54713284E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at
org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219123614
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81
Deleted: sha256:3c423726ab9363e4d00408d34380976b419030ef1d5b24721111c53fa66de2c4
Deleted: sha256:75411ec94b698ca7db00419fe5fef5ae8b9eb67912f1dad43163bc0066f66b87
Deleted: sha256:b837c2438bd11ea3ed3a0fbc2185b257d80862ab5005fd53d7dd52577ad1a1f6
Deleted: sha256:126a3b5e3e5d30f6f1f798b00ff4ea7bdb7e7790a13d16632e23ae80cdb90324
Deleted: sha256:97481abd42016c7e93b5841e078b6d0c469f45a67ddd4815f7facd6a27b30271
Deleted: sha256:5e68b61330d91fef3b4c22c908b8e841a7a6f8c95f4d5d32d0717a1115c97037
Deleted: sha256:21a4dbbf7614b54914919ca98eeb2ef5cdf1ac41d19bf63bb0c7ddae0bed06c0
Deleted: sha256:4846de45ce156a7f946bbfe8f463954f317729001274fc4694aa1d1893c3b0e0
Deleted: sha256:bbe767b371f8dcba12de888f099b06500f9aa9b08e0b73ecd93d836af14d093d
Deleted: sha256:d7459e76138ded7944e88fe82a0fa6e76e6ef104315ace45778ee4777872cad1
Deleted: sha256:2563084365745696356ceaf0fbc056076e4c418a7431a395d2e46f10ae3b0c90
Deleted: sha256:1ab8283bb118ec225ad0a73d7c60ba9afe9e1eda394517e1870f8dff627b0e3b
Deleted: sha256:5edd13676f82292ac6590afb4521c72d433a3068b5f2fb64b344e44036bfbdd5
Deleted: sha256:58b497267e94725c3e97f20c9d28aaae7191efac8cf6c0fa6448a9dbf7cee9c5
Deleted: sha256:d6524ba6f158924859aeefc3e8778ea997c8e1b86ed378694e7c37feaf24ca90
Deleted: sha256:96ce392f8327872fe9c035229632c49cf1c7aae1a315302c6fa9b6bd4cc18b0d
Deleted: sha256:bc6db1b36044863caa156087444225e75c0dd668fe6d4287d5c90b553bd04a1c
Deleted: sha256:db8083f907bf23bd05a0ced5da72e684eadc18f781a48a633bc39dc7be21747d
Deleted: sha256:564b42f7ab387caeec0292ab455cb7d6767c6e81bf29ad8930323deb26d27c5c
Deleted: sha256:fea99065cb0d8f68f6e35f220096eb9776698737ed808486f2e4c5e869d8bafd
Deleted: sha256:080e7ca1d07ecf8d49463bddcc9a0dbfd45017d5b5d283e54d9584806a879735
Deleted: sha256:3b4552e7d456914d5716e1b4d6b2c8bc04979ecdc651ce238ef21dd459f4078c
Deleted: sha256:08e71de8d981e31c6b8b0bbcecfd71463f38a7d22c36fc7678c2c001cdc6a2ed
Deleted: sha256:e3ba66dabc62713259f986f96730a3b752df8d4134bd43d538731d7fd47ce275
Deleted: sha256:7021395496e04813f8c35a31e60547419ef2f0a731688de2a72ee8ee7b8996d7
Deleted: sha256:d6c18b576f9bcaefb2e2d0e38151df6876967cef9c2a4cf8133e8957ad82a9ce
Deleted: sha256:5222263beed96383880e29c1547e7d49e880313e94418cc087b3dc81306664a1
Deleted: sha256:646ebe7ea944feb146e1ffdb74cab1764b4ccb1782711b9d70ac1457096143b1
Deleted: sha256:dd94fb87a211d54a188763c51ee0e61f9effbc286f1bd057ab70436ddf64e638
Deleted: sha256:cb37765bc16b8d89996dedfc2476105148f9c3381ef35bca6dbd43ca83e31bd2
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219123614]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220219123614]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1293f3c1f5c749373548c4fedf4150758d7d60d2d7845b2b7fb2524854eefd81].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 27m 21s
109 actionable tasks: 72 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/7namch4m7i442
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
