See
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/381/display/redirect>
------------------------------------------
[...truncated 369.62 KB...]
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:35.944Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:35.969Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:35.997Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.029Z: Fusing consumer
PAssert$0/CreateActual/RewindowActuals/Window.Assign into
PAssert$0/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.058Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into PAssert$0/CreateActual/ParDo(Anonymous)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.073Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.102Z: Fusing consumer
PAssert$0/CreateActual/ParDo(Anonymous) into
PAssert$0/CreateActual/RewindowActuals/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.130Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map into
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.154Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/GroupByWindow into
PAssert$0/CreateActual/GatherPanes/GroupByKey/Read
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.185Z: Fusing consumer
PAssert$0/CreateActual/ExtractPane/Map into
PAssert$0/CreateActual/GatherPanes/Values/Values/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.214Z: Fusing consumer
PAssert$0/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap into
PAssert$0/CreateActual/ExtractPane/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.240Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.268Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Values/Values/Map into
PAssert$0/CreateActual/GatherPanes/GroupByKey/GroupByWindow
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.291Z: Unzipping flatten s12-u54 for input
s13.output-c52
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.321Z: Fusing unzipped copy of
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through
flatten s12-u54, into producer
PAssert$0/CreateActual/FilterActuals/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.344Z: Unzipping flatten s12-u54-u61 for input
s15.org.apache.beam.sdk.values.PCollection.<init>:329#124db6a1b083556e-c59
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.373Z: Fusing unzipped copy of
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign, through flatten
s12-u54-u61, into producer
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.400Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/Write into
PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.430Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.456Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.483Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.508Z: Unzipping flatten s12-u54-u61-u66 for input
s16.output-c64
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.551Z: Fusing unzipped copy of
PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify, through flatten
s12-u54-u61-u66, into producer
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.576Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.602Z: Fusing consumer
PAssert$0/CreateActual/FilterActuals/Window.Assign into Calculate
hashcode/Values/Values/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.635Z: Fusing consumer Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate
hashcode/Values/Values/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.669Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify into
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.707Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into
PAssert$0/CreateActual/FilterActuals/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.737Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign into
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.758Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.816Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.856Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.900Z: Fusing consumer Values as string into Get
values only/Values/Map
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.940Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Values as string
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:36.978Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.008Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.036Z: Fusing consumer Get values only/Values/Map
into Read using HadoopInputFormat/Read(HadoopInputFormatBoundedSource)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.068Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.109Z: Fusing consumer
PAssert$0/WindowToken/Window.Assign into
PAssert$0/Create.Values/Read(CreateSource)
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.147Z: Fusing consumer PAssert$0/RunChecks into
PAssert$0/WindowToken/Window.Assign
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.189Z: Fusing consumer
PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.621Z: Executing operation
PAssert$0/CreateActual/GatherPanes/GroupByKey/Create
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.655Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.685Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.696Z: Starting 1 workers in us-central1-b...
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.709Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Jun 11, 2018 3:11:41 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:11:37.906Z: Executing operation Read using
HadoopInputFormat/Read(HadoopInputFormatBoundedSource)+Get values
only/Values/Map+Values as string+Calculate
hashcode/WithKeys/AddKeys/Map+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Jun 11, 2018 3:12:07 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:12:06.097Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-06-11T15:12:14.845Z: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. Please check for
errors in your job parameters, check quota and retry later, or please try in a
different zone/region.
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-06-11T15:12:14.878Z: Workflow failed.
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:12:15.024Z: Cleaning up.
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-11T15:12:15.106Z: Stopping worker pool...
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
INFO: Dataflow job 2018-06-11_08_11_25-14809774100889650019 threw
exception. Failure message was: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. Please check for
errors in your job parameters, check quota and retry later, or please try in a
different zone/region.
Jun 11, 2018 3:12:15 PM
org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
INFO: Dataflow job 2018-06-11_08_11_25-14809774100889650019 threw
exception. Failure message was: Workflow failed.
Jun 11, 2018 3:12:36 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-11_08_11_25-14809774100889650019 failed with status
FAILED.
Jun 11, 2018 3:12:36 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Dataflow job 2018-06-11_08_11_25-14809774100889650019 terminated in
failure state FAILED without reporting a failed assertion
Jun 11, 2018 3:12:36 PM org.apache.beam.runners.dataflow.TestDataflowRunner
run
WARNING: Dataflow job 2018-06-11_08_11_25-14809774100889650019 did not
output a success or failure metric.
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-hadoop-input-format:integrationTest FAILED
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT >
readUsingHadoopInputFormat FAILED
java.lang.RuntimeException: Startup of the worker pool in zone
us-central1-b failed to bring up any of the desired 1 workers. Please check for
errors in your job parameters, check quota and retry later, or please try in a
different zone/region.Workflow failed.
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at
org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:348)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:329)
at
org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT.readUsingHadoopInputFormat(HadoopInputFormatIOIT.java:149)
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest>
:beam-sdks-java-io-hadoop-input-format:integrationTest (Thread[Task worker for
':' Thread 3,5,main]) completed. Took 5 mins 31.314 secs.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 40s
67 actionable tasks: 1 executed, 66 up-to-date
Publishing build scan...
https://gradle.com/s/ssmi6ufyj3y7o
STDERR:
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-sdks-java-io-hadoop-input-format:integrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full
insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task
':beam-sdks-java-io-hadoop-input-format:integrationTest'.
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:103)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:73)
at
org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at
org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at
org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at
org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:66)
at
org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at
org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at
org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at
org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at
org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at
org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at
org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at
org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at
org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker$1.run(DefaultTaskGraphExecuter.java:256)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97)
at
org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at
org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker.execute(DefaultTaskGraphExecuter.java:249)
at
org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker.execute(DefaultTaskGraphExecuter.java:238)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:104)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:98)
at
org.gradle.execution.taskgraph.DefaultTaskExecutionPlan.execute(DefaultTaskExecutionPlan.java:663)
at
org.gradle.execution.taskgraph.DefaultTaskExecutionPlan.executeWithTask(DefaultTaskExecutionPlan.java:596)
at
org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.run(DefaultTaskPlanExecutor.java:98)
at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at
org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the
report at:
file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/java/io/hadoop-input-format/build/reports/tests/integrationTest/index.html>
at
org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at
org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:583)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at
org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at
org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:794)
at
org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:761)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:124)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185)
at
org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97)
at
org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:113)
at
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:95)
... 31 more
* Get more help at https://help.gradle.org
2018-06-11 15:12:38,114 0bbc3f8b MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 667, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 547, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-06-11 15:12:38,115 0bbc3f8b MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2018-06-11 15:12:38,115 0bbc3f8b MainThread beam_integration_benchmark(1/1)
INFO Running: kubectl
--kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-381>
delete -f
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
--ignore-not-found
2018-06-11 15:12:38,943 0bbc3f8b MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 801, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 667, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",>
line 547, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",>
line 159, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-06-11 15:12:38,943 0bbc3f8b MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2018-06-11 15:12:38,958 0bbc3f8b MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-06-11 15:12:38,959 0bbc3f8b MainThread INFO Complete logs can be found
at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/0bbc3f8b/pkb.log>
2018-06-11 15:12:38,959 0bbc3f8b MainThread INFO Completion statuses can be
found at:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/0bbc3f8b/completion_statuses.json>
Build step 'Execute shell' marked build as failure