See
<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/122/display/redirect?page=changes>
Changes:
[vachan] Annotating Read API tests.
[bulat.safiullin] [BEAM-14247] [Website] add image
[bulat.safiullin] [BEAM-14247] [Website] center image
[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0
[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds
[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)
[noreply] Update .asf.yaml (#17409)
[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing
[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()
[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)
[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix
[yiru] fix: BigQuery Storage Connector trace id population missing bracket
[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)
[noreply] Update Beam website to release 2.38.0 (#17378)
[noreply] [BEAM-14213] Add API and construction time validation for Batched
DoFns
[noreply] Minor: Update release guide regarding archive.apache.org (#17419)
[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing
(#17396)
[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)
------------------------------------------
[...truncated 390.73 KB...]
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
generic::internal: The work item requesting state read is no longer valid on
the backend. The work has already completed or will be retried. This is
expected during autoscaling events.
passed through:
==>
dist_proc/windmill/client/streaming_rpc_client.cc:706
==>
dist_proc/dax/workflow/****/streaming/merge_windows_fn.cc:222
Apr 21, 2022 4:00:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:00:40.288Z: Cancel request is committed for workflow job:
2022-04-21_05_59_48-2449072131454036555.
Apr 21, 2022 4:00:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:00:40.332Z: Cleaning up.
Apr 21, 2022 4:00:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:00:40.382Z: Stopping **** pool...
Apr 21, 2022 4:00:40 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:00:40.448Z: Stopping **** pool...
Apr 21, 2022 4:03:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:03:13.351Z: Autoscaling: Reduced the number of ****s to 0
based on low average **** CPU utilization, and the pipeline having sufficiently
low backlog and keeping up with input rate.
Apr 21, 2022 4:03:13 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-21T16:03:13.389Z: Worker pool stopped.
Apr 21, 2022 4:03:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2022-04-21_05_59_48-2449072131454036555 finished with status
CANCELLED.
Load test results for test (ID): 58666e92-4433-4f76-ba4f-d3eb51bdfd0b and
timestamp: 2022-04-21T12:59:41.764000000Z:
Metric: Value:
dataflow_v2_java17_runtime_sec 10627.845
dataflow_v2_java17_total_bytes_count 8.66201047E9
Exception in thread "main" java.lang.RuntimeException: Invalid job state:
CANCELLED.
at
org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:51)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:139)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.run(GroupByKeyLoadTest.java:57)
at
org.apache.beam.sdk.loadtests.GroupByKeyLoadTest.main(GroupByKeyLoadTest.java:131)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220421125742
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4
Deleted: sha256:54c1278f976b2c1efe123e58f2f6f563fb7cedb1176e202f64cddd79767e5edf
Deleted: sha256:d8a70f3c69387037fd61a0952cf5086c809093c2dafc5fbff5cde50d4be4b124
Deleted: sha256:ade26e7b70af5987f45d8dd030e17fc2749d94508a301da4e4374a4730d3ff09
Deleted: sha256:023f10f4fa879c2dd491b29775444a2cb3927319858373acc3aad3bbf68daddf
Deleted: sha256:3d809f8963b22ebfee565e06d13b518c349ae802b03498eef653a5040606dfdc
Deleted: sha256:d141e0ae28636383c4a1fb1732dfa38225c5d306e938211c1edf5c97ae808bca
Deleted: sha256:bf4f6750db519d498e5bfcbf90bd8abff4191d7b32c68d7004a02a420d0cfbf1
Deleted: sha256:717c1fcff722b9c76bf8f6d3b49f0b08b12d374614136d100d4c1658b94a3ce7
Deleted: sha256:6329d933846f958cbd53ff4f5d76de832c67bfce99ee09a548b8995b458ff398
Deleted: sha256:dba54f1e058803b5434de50dec3524c6d5be449c923aa96ef08a66d18420180d
Deleted: sha256:b6d61efee925ba37f2e4659961754f45899166977522d5da425a6b783c02b5aa
Deleted: sha256:be83bf8751eebf4eec54aade8d85a2e68cb4134fb010cdbcfca496d43d3fff72
Deleted: sha256:b6fb48f3ac8fc9c8db5c1623f16bad0131541f3dcdeec36c50871a182bbc3e96
Deleted: sha256:afdaa74830c69372d715c315fc3e1e296f2f3092ada1b5bc2e5c4a2160b88abf
Deleted: sha256:dd53e0c744a30203465913f46964eefdb83b3f4bf89be5bcad4482aaadcf8fb8
Deleted: sha256:616fd4f9a778d9dacb91b1b318ee3191ca1174e78ac0f3a5cde089cf312ad53d
Deleted: sha256:732758ec19436c5dfb5cf9b4f953b68a0cb9f19e57b37fac92652bda0e56ba4c
Deleted: sha256:63a370cc62931b304a112c91777d1cb35fbd7103efd9df82f019d0ed59ba729c
Deleted: sha256:1a8b0486a4dca98d0985d9c4c2918339ff173f5066e0584b065bb7d4f18663ca
Deleted: sha256:7bdb87b90a6dbf9e93d66e37fc0ee350a6d4f91d8d55f9452fc1ce92dc0636d4
Deleted: sha256:c4b3c13f8a06f799b75949cd5d7ebe7a7660f59e57c73320df30185d86e38354
Deleted: sha256:f65aa64ecac8d4a1ac3c540f080bb386ee95040bf9f774cad7cda1c961f65f38
Deleted: sha256:0f06bde8171ab09282f6dd53dbd5b49d1b6d17b0865f730da66399489a2e515e
Deleted: sha256:f694b1cb45635fb707e3f252e8e7be1024773129f0ca18e162dba9d97a1c4d58
Deleted: sha256:ad35ebf6de881fc1686f91fa2d509b517f623f22fa0b9d452e368eec6aad5156
Deleted: sha256:7995f24a27efcd8ade0517e65919ad901c9de5f577bff8211001ebe0558007d0
Deleted: sha256:70feb5fa3ceae831b6c3db9ba4f5cc0da8a6f444f8a093b71a09f7b20bbc9a6e
Deleted: sha256:68714a582c62c871c61872515b2c4b31e8562f5e83ce0357fc0cef0cda5f3a57
Deleted: sha256:6ea9c7223ad0756196cdde2592ce0c5ee3eea21a5fb8580860ff1f4e7d527b18
Deleted: sha256:c41961f6b259c575f12aa09a81dcd0f053500e4bd9f1ffd5db15f5c5c647b1dc
Deleted: sha256:4b51ff4d164ba2dc9f7a1d8dc1886b3575ae8d270b29b30650417038f08179b7
Deleted: sha256:9231fc072d2aef1976e4c17dd24d91a9f7aac00580b909cc4852faf0d9456cd1
Deleted: sha256:f29c1e6202b9e00b6febf877baa381c61dc614242d71bfdaffcc7c64d399eb18
Deleted: sha256:817de138ec9a1ae3d3f696a5dafa28f506a41e451e7f916a0796df78ec62f8e1
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220421125742]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220421125742]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:96773310d8722458016e30cb5ba9fe503d2e46a598580919f7e53cb6998006e4].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 6m 20s
110 actionable tasks: 73 executed, 33 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/uw3s7mps6qlfq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
