See
<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/6527/display/redirect?page=changes>
Changes:
[noreply] Add more typescript examples to the programming guide. (#23058)
[noreply] Merge pull request #23505: opt in for schema update. addresses #23504
------------------------------------------
[...truncated 388.54 KB...]
SLF4J: Found binding in
[jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.43.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-reload4j/1.7.36/db708f7d959dee1857ac524636e85ecf2e1781c1/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll STANDARD_ERROR
Oct 05, 2022 11:07:52 PM org.apache.beam.runners.dataflow.DataflowRunner
validateSdkContainerImageOptions
WARNING: Prefer --sdkContainerImage over deprecated legacy option
--****HarnessContainerImage.
Oct 05, 2022 11:07:54 PM
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory
tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket:
dataflow-staging-us-central1-844138762903
Oct 05, 2022 11:07:55 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 409, performed 0 retries due to
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP
framework says request can be retried, (caller responsible for retrying):
https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Oct 05, 2022 11:07:55 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Oct 05, 2022 11:07:56 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 419 files. Enable logging at DEBUG level to see
which files will be staged.
Oct 05, 2022 11:07:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Oct 05, 2022 11:08:00 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 420 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Oct 05, 2022 11:08:00 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.43.0-SNAPSHOT-SdARy_HvySN5Hf_sPn3Pbq9Dz-CwlnVUjc_wQ_CFZTI.jar
Oct 05, 2022 11:08:01 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test2573071268511004104.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-iJO2sKFLmBE7USlI__NjK76WTqUDew2O2to9kKeKfFA.jar
Oct 05, 2022 11:08:01 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test4746745038590475544.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-8-RSJq9-LaYi_MF_zRdl3gynbq0orsODPPrPxiZTw3M.jar
Oct 05, 2022 11:08:01 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 418 files cached, 2 files newly uploaded in 0
seconds
Oct 05, 2022 11:08:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Oct 05, 2022 11:08:01 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <428633 bytes, hash
608ebac05e99c1619b57ad3c1acbc1f4ef146d65f3bc928ae1b0c0174e6730c7> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-YI66wF6ZwWGbV608GsvB9O8UbWXzvJKK4bDAF05nMMc.pb
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce text lines as step s2
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce Avro records as step s3
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time as step s4
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/RewindowIntoGlobal/Window.Assign as step s5
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles as step s6
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step s7
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step s8
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum as step s9
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as step s10
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
as step s11
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/GatherTempFileResults/View.AsList/CreateDataflowView as step s12
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
as step s13
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
as step s14
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
as step s15
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Finalize as step s16
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
as step s17
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s18
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s19
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s20
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write Avro records to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map as
step s21
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect middle time as step s22
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Values/Values/Map as step s23
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all files/Match filepatterns as step s24
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all files/Reshuffle.ViaRandomKey/Pair with random key as
step s25
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all
files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s26
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as
step s27
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all
files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as step s28
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Match all files/Reshuffle.ViaRandomKey/Values/Values/Map as
step s29
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read matches/ParDo(ToReadableFile) as step s30
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via FileBasedSource/Split into ranges as
step s31
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via FileBasedSource/Reshuffle/Pair with
random key as step s32
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign as step s33
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/GroupByKey as step s34
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via
FileBasedSource/Reshuffle/Reshuffle/ExpandIterable as step s35
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via
FileBasedSource/Reshuffle/Values/Values/Map as step s36
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read files/Read all via FileBasedSource/Read ranges as step s37
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time as step s38
Oct 05, 2022 11:08:04 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Parse Avro records to Strings as step s39
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/WithKeys/AddKeys/Map as step s40
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Combine.perKey(Hashing)/GroupByKey as step
s41
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues as step s42
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Values/Values/Map as step s43
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) as step s44
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/View.AsIterable/CreateDataflowView as step
s45
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/CreateVoid/Read(CreateSource) as step s46
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/ProduceDefault as step s47
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Calculate hashcode/Flatten.PCollections as step s48
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Reify.Window/ParDo(Anonymous) as step
s49
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(ToSingletonIterables) as step s50
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Create.Values/Read(CreateSource) as
step s51
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Flatten.PCollections as step s52
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Window.Into()/Flatten.PCollections as
step s53
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/WithKeys/AddKeys/Map as step s54
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/GroupByKey as step s55
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/Values/Values/Map as step s56
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GroupGlobally/ParDo(Concat) as step s57
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/GetPane/Map as step s58
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/RunChecks as step s59
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$0/VerifyAssertions/ParDo(DefaultConclude) as step s60
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
as step s61
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey
as step s62
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
as step s63
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
as step s64
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
as step s65
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly
as step s66
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
as step s67
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView as step s68
Oct 05, 2022 11:08:05 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Delete test files as step s69
Oct 05, 2022 11:08:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.43.0-SNAPSHOT
Oct 05, 2022 11:08:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-10-05_16_08_05-10030167513205552838?project=apache-beam-testing
Oct 05, 2022 11:08:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-10-05_16_08_05-10030167513205552838
Oct 05, 2022 11:08:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2022-10-05_16_08_05-10030167513205552838
Oct 05, 2022 11:08:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-05T23:08:21.535Z: Worker configuration: e2-standard-2 in
us-central1-a.
Oct 05, 2022 11:08:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-10-05T23:08:22.823Z: Workflow failed. Causes: Project
apache-beam-testing has insufficient quota(s) to execute this workflow with 1
instances in region us-central1. Quota summary (required/available): 1/38752
instances, 2/1222 CPUs, 25/338260 disk GB, 0/728 SSD disk GB, 1/274 instance
groups, 1/277 managed instance groups, 1/427 instance templates, 1/0 in-use IP
addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about
requesting more quota.
Oct 05, 2022 11:08:22 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-05T23:08:22.873Z: Cleaning up.
Oct 05, 2022 11:08:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-05T23:08:22.918Z: Worker pool stopped.
Oct 05, 2022 11:08:24 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-05T23:08:24.113Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 05, 2022 11:08:40 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-10-05_16_08_05-10030167513205552838 failed with status
FAILED.
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll STANDARD_OUT
Load test results for test (ID): 7095b287-8cdd-44e4-acd2-4e6c1c9809b9 and
timestamp: 2022-10-05T23:08:40.504000000Z:
Metric: Value:
write_time 0.0
dataset_size 1.08973E9
run_time 0.0
read_time 0.0
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll FAILED
java.lang.AssertionError: Values should be different. Actual: FAILED
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failEquals(Assert.java:187)
at org.junit.Assert.assertNotEquals(Assert.java:163)
at org.junit.Assert.assertNotEquals(Assert.java:177)
at
org.apache.beam.sdk.io.avro.AvroIOIT.writeThenReadAll(AvroIOIT.java:165)
1 test completed, 1 failed
Finished generating test XML results (0.025 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** Thread
5,5,main]) completed. Took 53.486 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 23s
153 actionable tasks: 91 executed, 60 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/daz3lrle5gdnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]