See
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/422/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-4565] Fix hot key fanout in the face of combiner lifting.
[robertwb] Fix and test global combine with fanout.
[ankurgoenka] Fixing key lookup in
FlinkBatchSideInputHandlerFactory.SideInputHandler
[echauchot] [BEAM-4283] Fix naming of the BigQuery fields
[iemejia] [BEAM-3314] Set correctly host and port on RedisIO
[iemejia] [BEAM-3314] Fix error-prone warnings and add extra test for Read
[migryz] Point gearpump to master
------------------------------------------
[...truncated 251.61 KB...]
Jun 21, 2018 6:19:32 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.6.0-SNAPSHOT-shaded.jar>
to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/beam-sdks-java-core-2.6.0-SNAPSHOT-shaded-n0VbdWHjsrLA9Bezgh1fbA.jar
Jun 21, 2018 6:19:32 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
/home/jenkins/.m2/repository/it/unimi/dsi/fastutil/6.5.7/fastutil-6.5.7.jar to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/fastutil-6.5.7-ke0rpg4VnGkMiiBmj4nUCQ.jar
Jun 21, 2018 6:19:32 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/model/fn-execution/build/libs/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded.jar>
to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/beam-model-fn-execution-2.6.0-SNAPSHOT-shaded-7pcTi1FWmv2sWeNWW4oTXA.jar
Jun 21, 2018 6:19:32 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.6.0-SNAPSHOT-shaded.jar>
to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/beam-runners-direct-java-2.6.0-SNAPSHOT-shaded-3sXu8p5UBR3ccMgdmgouXg.jar
Jun 21, 2018 6:19:32 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.6.0-SNAPSHOT-shaded-tests.jar>
to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/beam-sdks-java-core-2.6.0-SNAPSHOT-shaded-tests-IB-4gVrBmiyo7u4Fu0UnPA.jar
Jun 21, 2018 6:19:33 PM org.apache.beam.runners.dataflow.util.PackageUtil
stageClasspathElements
INFO: Staging files complete: 0 files cached, 288 files newly uploaded
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate sequence/Read(BoundedCountingSource) as step s1
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Produce db rows as step s2
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Pair with random key as step s3
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before
writing/Reshuffle/Window.Into()/Window.Assign as step s4
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Reshuffle/GroupByKey as step s5
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Reshuffle/ExpandIterable as step
s6
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Prevent fusion before writing/Values/Values/Map as step s7
Jun 21, 2018 6:19:34 PM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write using JDBCIO/ParDo(Write) as step s8
Jun 21, 2018 6:19:34 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/
Jun 21, 2018 6:19:34 PM org.apache.beam.runners.dataflow.util.PackageUtil
tryStagePackage
INFO: Uploading <16058 bytes, hash 4Yk_QCMQ9q7uEL0eXTXcUA> to
gs://temp-storage-for-perf-tests/hadoopinputformatioit0readusinghadoopinputformat-jenkins-0621181927-8cbeca11/output/results/staging/pipeline-4Yk_QCMQ9q7uEL0eXTXcUA.pb
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat STANDARD_OUT
Dataflow SDK version: 2.6.0-SNAPSHOT
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat STANDARD_ERROR
Jun 21, 2018 6:19:35 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-21_11_19_34-10577389735803716763?project=apache-beam-testing
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat STANDARD_OUT
Submitted job: 2018-06-21_11_19_34-10577389735803716763
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat STANDARD_ERROR
Jun 21, 2018 6:19:35 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-06-21_11_19_34-10577389735803716763
Jun 21, 2018 6:19:35 PM org.apache.beam.runners.dataflow.TestDataflowRunner
run
INFO: Running Dataflow job 2018-06-21_11_19_34-10577389735803716763 with 0
expected assertions.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:34.819Z: Autoscaling is enabled for job
2018-06-21_11_19_34-10577389735803716763. The number of workers will be between
1 and 1000.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:34.836Z: Autoscaling was automatically enabled for
job 2018-06-21_11_19_34-10577389735803716763.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2018-06-21T18:19:37.435Z: The workflow name is not a valid Cloud
Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring
will be labeled with this modified job name:
hadoopinputformatioit0readusinghadoopinputformat-jenkins-0-5rcq. For the best
monitoring experience, please name your job with a valid Cloud Label. For
details, see:
https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:37.479Z: Checking required Cloud APIs are enabled.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:37.796Z: Checking permissions granted to controller
Service Account.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:44.685Z: Worker configuration: n1-standard-1 in
us-central1-b.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.204Z: Expanding CoGroupByKey operations into
optimizable parts.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.259Z: Expanding GroupByKey operations into
optimizable parts.
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.288Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.386Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.411Z: Fusing consumer Produce db rows into
Generate sequence/Read(BoundedCountingSource)
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.439Z: Fusing consumer Prevent fusion before
writing/Reshuffle/Window.Into()/Window.Assign into Prevent fusion before
writing/Pair with random key
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.464Z: Fusing consumer Prevent fusion before
writing/Reshuffle/ExpandIterable into Prevent fusion before
writing/Reshuffle/GroupByKey/GroupByWindow
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.495Z: Fusing consumer Prevent fusion before
writing/Reshuffle/GroupByKey/GroupByWindow into Prevent fusion before
writing/Reshuffle/GroupByKey/Read
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.518Z: Fusing consumer Write using
JDBCIO/ParDo(Write) into Prevent fusion before writing/Values/Values/Map
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.545Z: Fusing consumer Prevent fusion before
writing/Values/Values/Map into Prevent fusion before
writing/Reshuffle/ExpandIterable
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.580Z: Fusing consumer Prevent fusion before
writing/Pair with random key into Produce db rows
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.602Z: Fusing consumer Prevent fusion before
writing/Reshuffle/GroupByKey/Reify into Prevent fusion before
writing/Reshuffle/Window.Into()/Window.Assign
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.632Z: Fusing consumer Prevent fusion before
writing/Reshuffle/GroupByKey/Write into Prevent fusion before
writing/Reshuffle/GroupByKey/Reify
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.929Z: Executing operation Prevent fusion before
writing/Reshuffle/GroupByKey/Create
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:45.994Z: Starting 1 workers in us-central1-b...
Jun 21, 2018 6:19:49 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:46.135Z: Executing operation Generate
sequence/Read(BoundedCountingSource)+Produce db rows+Prevent fusion before
writing/Pair with random key+Prevent fusion before
writing/Reshuffle/Window.Into()/Window.Assign+Prevent fusion before
writing/Reshuffle/GroupByKey/Reify+Prevent fusion before
writing/Reshuffle/GroupByKey/Write
Jun 21, 2018 6:19:56 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:19:55.951Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-06-21T18:20:34.776Z: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED:
Quota 'DISKS_TOTAL_GB' exceeded. Limit: 45000.0 in region us-central1.
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-06-21T18:20:34.815Z: Workflow failed.
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:20:34.934Z: Cleaning up.
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:20:35.043Z: Stopping worker pool...
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
INFO: Dataflow job 2018-06-21_11_19_34-10577389735803716763 threw
exception. Failure message was: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED:
Quota 'DISKS_TOTAL_GB' exceeded. Limit: 45000.0 in region us-central1.
Jun 21, 2018 6:20:35 PM
org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
INFO: Dataflow job 2018-06-21_11_19_34-10577389735803716763 threw
exception. Failure message was: Workflow failed.
Jun 21, 2018 6:20:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-21T18:20:46.908Z: Worker pool stopped.
Jun 21, 2018 6:20:55 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-21_11_19_34-10577389735803716763 failed with status
FAILED.
Jun 21, 2018 6:20:55 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-06-21_11_19_34-10577389735803716763. Found 0 success, 0 failures out of 0
expected assertions.
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-hadoop-input-format:integrationTest FAILED
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat FAILED
java.lang.RuntimeException: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED:
Quota 'DISKS_TOTAL_GB' exceeded. Limit: 45000.0 in region us-central1.Workflow
failed.
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:348)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:329)
at
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT.readUsingHadoopInputFormat(HadoopInputFormatIOIT.java:146)
Finished generating test XML results (0.024 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.036 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest>
:beam-sdks-java-io-hadoop-input-format:integrationTest (Thread[Task worker for
':',5,main]) completed. Took 2 mins 5.079 secs.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
67 actionable tasks: 1 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/xtrnakszvuqzm
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-sdks-java-io-hadoop-input-format:integrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full
insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task
':beam-sdks-java-io-hadoop-input-format:integrationTest'.
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at
org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at
org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at
org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at
org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:66)
at
org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at
org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at
org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at
org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at
org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at
org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at
org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at
org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97)
at
org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at
org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at
org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$ExecuteTaskAction.execute(DefaultTaskExecutionGraph.java:262)
at
org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$ExecuteTaskAction.execute(DefaultTaskExecutionGraph.java:246)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:136)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.execute(DefaultTaskPlanExecutor.java:201)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.executeWithTask(DefaultTaskPlanExecutor.java:192)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the
report at:
file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest/index.html>
at
org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at
org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at
org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:794)
at
org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:761)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97)
at
org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 32 more
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 18s
2018-06-21 18:20:57,170 fa40ada5 MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 667, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 547, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-06-21 18:20:57,172 fa40ada5 MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2018-06-21 18:20:57,173 fa40ada5 MainThread beam_integration_benchmark(1/1)
INFO Running: kubectl
--kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-422>
delete -f
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
--ignore-not-found
2018-06-21 18:20:57,573 fa40ada5 MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 801, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 667, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 547, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-06-21 18:20:57,574 fa40ada5 MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2018-06-21 18:20:57,631 fa40ada5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-06-21 18:20:57,632 fa40ada5 MainThread INFO Complete logs can be found
at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/fa40ada5/pkb.log>
2018-06-21 18:20:57,633 fa40ada5 MainThread INFO Completion statuses can be
found at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/fa40ada5/completion_statuses.json>
Build step 'Execute shell' marked build as failure
