See
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/3774/display/redirect>
Changes:
------------------------------------------
[...truncated 249.18 KB...]
Build cache key for task ':sdks:java:io:google-cloud-platform:testJar' is
9eebbea7b36c1a640cf1a2885465024f
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar':
Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for
':',5,main]) completed. Took 0.216 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for
':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava'
is 1beea82d3dff626bbf0bf85fba4d36fa
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date
because:
No history is available.
Custom actions are attached to task
':runners:google-cloud-dataflow-java:compileTestJava'.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@264304a1:
{executionTime=5565, hostName=apache-ci-beam-jenkins-7, operatingSystem=Linux,
buildInvocationId=ipnjtpxs6vf65kxtxil3koh4lq, creationTime=1597537345526,
identity=:runners:google-cloud-dataflow-java:compileTestJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src}>
Unpacked trees for task ':runners:google-cloud-dataflow-java:compileTestJava'
from cache.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for
':',5,main]) completed. Took 0.193 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for
':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no
actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for
':',5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for
':',5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Build cache key for task ':runners:google-cloud-dataflow-java:testJar' is
e3df4099d8fa7f3650c10ac69be3c42b
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar':
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for
':',5,main]) completed. Took 0.029 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar
Build cache key for task
':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is
68e124d2ea00a33ce0f080fb6f10b3f2
Caching disabled for task
':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar': Caching has
not been enabled for the task
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not
up-to-date because:
No history is available.
Custom actions are attached to task
':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
*******************
GRADLE SHADOW STATS
Total Jars: 16 (includes project)
Total Time: 3.495s [3495ms]
Average Time/Jar: 0.2184375s [218.4375ms]
*******************
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar
(Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 4.471 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for
':' Thread 2,5,main]) started.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is
7484077dec5a855b1f04d6109531db20
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date
because:
Task.upToDateWhen is false.
Custom actions are attached to task
':sdks:java:io:file-based-io-tests:integrationTest'.
Starting process 'Gradle Test Executor 1'. Working directory:
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/file-based-io-tests>
Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java
-DbeamTestPipelineOptions=["--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_TFRecordIOIT/3774/","--bigQueryDataset=beam_performance","--bigQueryTable=tfrecordioit_results","--influxMeasurement=tfrecordioit_results","--numberOfRecords=18000000","--expectedHash=543104423f8b6eb097acb9f111c19fe4","--datasetSize=1019380000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT.jar","--region=us-central1";]>
-Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager
-Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US
-Duser.language=en -Duser.variant -ea -cp
/home/jenkins/.gradle/caches/5.2.1/****Main/gradle-****.jar
****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.25/110cefe2df103412849d72ef7a67e4e91e4266b4/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
Aug 16, 2020 12:22:11 PM
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory
tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket:
dataflow-staging-us-central1-844138762903
Aug 16, 2020 12:22:12 PM
org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler
handleResponse
WARNING: Request failed with code 409, performed 0 retries due to
IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP
framework says request can be retried, (caller responsible for retrying):
https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Aug 16, 2020 12:22:12 PM
org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory
create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 16, 2020 12:22:12 PM org.apache.beam.runners.dataflow.DataflowRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 276 files. Enable logging at DEBUG level to see
which files will be staged.
Aug 16, 2020 12:22:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing
implications related to Google Compute Engine usage and other Google Cloud
Services.
Aug 16, 2020 12:22:14 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Uploading 277 files from PipelineOptions.filesToStage to staging
location to prepare for execution.
Aug 16, 2020 12:22:15 PM
org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes
forFileToStage
INFO: Staging custom dataflow-****.jar as
beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT-NYG8hzhZ7IhTQImHNz4Y9hBWs2TgYWY9gJmSfJvfsS0.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/core-construction-java/build/libs/beam-runners-core-construction-java-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-core-construction-java-2.25.0-SNAPSHOT-nO2OJ1YzzLoJRv6NWaboyRDs0zVi4qZdHSgUH9C1WDA.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/xml/build/libs/beam-sdks-java-io-xml-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-xml-2.25.0-SNAPSHOT-8z7VUPbn8U_ssSHibCfucziujR2ZK_0uYqkKnbOHNb4.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/xml/build/libs/beam-sdks-java-io-xml-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-xml-2.25.0-SNAPSHOT-tests-Ct8khf8P4uvSPaeQris4F2ADHNHjCz1v-bjtnG_DM6A.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-direct-java-2.25.0-SNAPSHOT-rLJMEKtsrMKG7QgOHdl5Y5Oba_EqAnFTunW8hjktj5o.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/parquet/build/libs/beam-sdks-java-io-parquet-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-parquet-2.25.0-SNAPSHOT-tests-ci-f46e15GQEUQpim3x6-gXgi_JV-sO-I_gjjbskGZA.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.25.0-SNAPSHOT-tests-1lfVwTgxidyRh7bQ1erawVJv9U8zSrv7-qDyKi8OFMU.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/hadoop-common/build/libs/beam-sdks-java-io-hadoop-common-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-hadoop-common-2.25.0-SNAPSHOT-6rtuQsarMjT6ny6haxOpQMIBARrxRpOqaQuJZNSxoto.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/java-fn-execution/build/libs/beam-runners-java-fn-execution-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-java-fn-execution-2.25.0-SNAPSHOT--tE5k1BWMv-VuSuxkx-P2KZ6NCl8_2YeZsWYjKl0IDY.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.25.0-SNAPSHOT-tests-3rl_0HDtb-1GUWDFEwo1PnvppXJm8zy2e0G5mGfT1WU.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.25.0-SNAPSHOT-tests-CXxbniGPvGHVHlB1zNRlkiCfbqy6G1PGRFw9M0od1KU.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.25.0-SNAPSHOT-dqZi15PaK-wNJSBBLjyZx5_J8IaFJi1Oxcf5kzmRIBA.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/fn-execution/build/libs/beam-sdks-java-fn-execution-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-fn-execution-2.25.0-SNAPSHOT-6_5iun5qTv52YO0wR8bk0xCrdbA6WFo50-G4nWETzN0.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.25.0-SNAPSHOT-RyyIsguDcbu2M0Hd3iZRmLNqgdN84X98oilO8KKUzmg.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.25.0-SNAPSHOT-tests-gTHiLUEqHhbyklQIbyh0DR6Woa0QnpC0k9zUnu8Qa2U.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.25.0-SNAPSHOT-tests-ZSYUKaUT5OZX_xTaX96f7W2qhPZIiFohdRR7RXlWIlA.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.25.0-SNAPSHOT-tests.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.25.0-SNAPSHOT-tests-gq1ByJ49MGLwlNhQ217NCI05cux-xPpeG-pqc9uhptk.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/expansion-service/build/libs/beam-sdks-java-expansion-service-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-expansion-service-2.25.0-SNAPSHOT-xwHPnAIxgw4bDR7hQdmLZGvqjdOoJNulub_1m5Yr-y8.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/extensions/protobuf/build/libs/beam-sdks-java-extensions-protobuf-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-protobuf-2.25.0-SNAPSHOT-hI5TjX3tHx0TAxMTXTgddQQe9e92jIFbjdkeYoJeQs0.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading /tmp/test3729345835764060074.zip to
gs://dataflow-staging-us-central1-844138762903/temp/staging/test-HEaNBJjQgSrpe3z6NUmXpAMmV9WtXk-1F--pkMEEfXs.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.25.0-SNAPSHOT-xudop4XypiRVId2zcro6jRTQnZh2S496DyK1m5bDaLM.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.25.0-SNAPSHOT-v3FaEQvCiooVYQDT9XPwoPrHJYk5on_zlq4uUrK_zMs.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/parquet/build/libs/beam-sdks-java-io-parquet-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-parquet-2.25.0-SNAPSHOT-SFq2O1GijpyMwkAb9tH6PBumKpdqh1HfwHKyHASkey4.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/vendor/sdks-java-extensions-protobuf/build/libs/beam-vendor-sdks-java-extensions-protobuf-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-vendor-sdks-java-extensions-protobuf-2.25.0-SNAPSHOT-XLgufvjV597AtI_hTKtL50XhXQgtQJuS-hvWwwuic5k.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.25.0-SNAPSHOT-XILWIijWcak2-BNzyHDCcgNQICGvKl1xBFshsOhGYkE.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.25.0-SNAPSHOT-cViGOe5yL5Wc9RUQhVzEEGui_izGGCVSDm_21Sw10Tc.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-legacy-****-2.25.0-SNAPSHOT-NYG8hzhZ7IhTQImHNz4Y9hBWs2TgYWY9gJmSfJvfsS0.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/model/pipeline/build/libs/beam-model-pipeline-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-pipeline-2.25.0-SNAPSHOT-l5orEt4FmvIjjbpvxvwulKpP-9kEBxnslOkbHC_PUZo.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/model/job-management/build/libs/beam-model-job-management-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-job-management-2.25.0-SNAPSHOT-4AmQHXGYIgUu8ZapUMVWxrD4ZHxNjqfCEzEzTMJ25WE.jar
Aug 16, 2020 12:22:15 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/model/fn-execution/build/libs/beam-model-fn-execution-2.25.0-SNAPSHOT.jar>
to
gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-fn-execution-2.25.0-SNAPSHOT-0G6__EBoW0Nid5ZN7mRLxVo0ZEdLRc_YEw2IbZp2jV0.jar
Aug 16, 2020 12:22:16 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 248 files cached, 29 files newly uploaded in
1 seconds
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce text lines as step s2
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Transform strings to bytes/Map as step s3
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Record time before writing as step s4
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to files/Write/RewindowIntoGlobal/Window.Assign
as step s5
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles as step s6
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step s7
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step s8
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/WriteUnshardedBundlesToTempFiles/DropShardNum as step s9
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as step s10
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
as step s11
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/GatherTempFileResults/View.AsList/CreateDataflowView as step s12
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
as step s13
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
as step s14
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
as step s15
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to files/Write/FinalizeTempFileBundles/Finalize
as step s16
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
as step s17
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
as step s18
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey
as step s19
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
as step s20
Aug 16, 2020 12:22:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write content to
files/Write/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map as
step s21
Aug 16, 2020 12:22:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://dataflow-staging-us-central1-844138762903/temp/staging/
Aug 16, 2020 12:22:16 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <165948 bytes, hash
7034e6971b8e6e7ac0d05542be3d2d1b6469fb6badd4cfe8f0b6ef415b1cba57> to
gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-cDTmlxuObnrA0FVCvj0tG2Rp-2ut1M_o8LbvQVsculc.pb
Aug 16, 2020 12:22:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.25.0-SNAPSHOT
Aug 16, 2020 12:22:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-16_05_22_17-11293865979415674518?project=apache-beam-testing
Aug 16, 2020 12:22:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2020-08-16_05_22_17-11293865979415674518
Aug 16, 2020 12:22:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2020-08-16_05_22_17-11293865979415674518
Aug 16, 2020 12:22:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-16T12:22:31.131Z: Worker configuration: n1-standard-1 in
us-central1-f.
Aug 16, 2020 12:22:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2020-08-16T12:22:31.751Z: Workflow failed. Causes: The Compute
Engine API has not fully initialized. Please try again in a few minutes.,
Unable to get GCE information for project apache-beam-testing.
Aug 16, 2020 12:22:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-16T12:22:31.787Z: Cleaning up.
Aug 16, 2020 12:22:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-08-16T12:22:31.853Z: Worker pool stopped.
Aug 16, 2020 12:22:34 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2020-08-16T12:22:32.859Z: Your project already contains 100
Dataflow-created metric descriptors and Stackdriver will not create new
Dataflow custom metrics for this job. Each unique user-defined metric name
(independent of the DoFn in which it is defined) produces a new metric
descriptor. To delete old / unused metric descriptors see
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 16, 2020 12:22:40 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2020-08-16_05_22_17-11293865979415674518 failed with status
FAILED.
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll FAILED
java.lang.IllegalStateException: Unable to find any files matching
gs://temp-storage-for-perf-tests/beam_PerformanceTests_TFRecordIOIT/3774/_1597580529980*
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkState(Preconditions.java:588)
at org.apache.beam.sdk.io.TFRecordIO$Read.expand(TFRecordIO.java:188)
at org.apache.beam.sdk.io.TFRecordIO$Read.expand(TFRecordIO.java:109)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:542)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:476)
at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:44)
at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:171)
at
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT.writeThenReadAll(TFRecordIOIT.java:151)
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.031 secs) into:
<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for
':' Thread 2,5,main]) completed. Took 35.144 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 23s
92 actionable tasks: 59 executed, 33 from cache
Publishing build scan...
https://gradle.com/s/whg2vwwx6cauw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
