See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/896/display/redirect?page=changes>
Changes: [github] Clarify in docstrings that we expect TFRecord values to be bytes [github] [BEAM-6050] Use correct type on @ProcessElement method for ------------------------------------------ [...truncated 304.83 KB...] INFO: 2018-11-13T06:28:07.235Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:07.337Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:07.603Z: Fusing consumer Calculate hashcode/WithKeys/AddKeys/Map into Map xml records to strings/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:07.849Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:07.950Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:08.198Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:08.434Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Values/Values/Map into Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:08.742Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:08.902Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:09.140Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Split into ranges into Read matched files/ParDo(ToReadableFile) Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:09.479Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Read ranges into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:09.701Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:10.051Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:10.330Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:10.740Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:10.931Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:11.208Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key into Read xml files/ReadAllViaFileBasedSource/Split into ranges Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:11.496Z: Fusing consumer Read matched files/ParDo(ToReadableFile) into Find files/Reshuffle.ViaRandomKey/Values/Values/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:11.786Z: Fusing consumer Map xml records to strings/Map into Read xml files/ReadAllViaFileBasedSource/Read ranges Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.010Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.173Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.314Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.430Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key into Write xml files/WriteFiles/GatherTempFileResults/Gather bundles Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.583Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign into Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.712Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Drop key/Values/Map into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:12.908Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate hashcode/WithKeys/AddKeys/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:13.204Z: Fusing consumer Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:13.411Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:13.579Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:13.793Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:14.048Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:14.243Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:14.382Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:14.544Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Find files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:14.785Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Pair with random key into Find files/Match filepatterns Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:15.075Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Gather bundles into Write xml files/WriteFiles/GatherTempFileResults/Drop key/Values/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:15.197Z: Unzipping flatten s7 for input s3.writtenRecords Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:15.530Z: Fusing unzipped copy of Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map, through flatten Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into producer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:15.704Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:15.980Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:16.138Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:16.309Z: Fusing consumer Create xml records/Map into Generate sequence/Read(BoundedCountingSource) Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:16.583Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:16.816Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into Create xml records/Map Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:17.037Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:17.214Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:17.396Z: Fusing consumer PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:17.588Z: Fusing consumer PAssert$0/WindowToken/Window.Assign into PAssert$0/Create.Values/Read(CreateSource) Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:17.713Z: Fusing consumer PAssert$0/RunChecks into PAssert$0/WindowToken/Window.Assign Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process SEVERE: 2018-11-13T06:28:48.602Z: Workflow failed. Causes: Workflow failed due to internal error. Please contact Google Cloud Support. Nov 13, 2018 6:28:52 AM org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler process INFO: Dataflow job 2018-11-12_22_27_38-5415908807958422668 threw exception. Failure message was: Workflow failed. Causes: Workflow failed due to internal error. Please contact Google Cloud Support. Nov 13, 2018 6:29:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:52.551Z: Cleaning up. Nov 13, 2018 6:29:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-11-13T06:28:59.130Z: Worker pool stopped. Nov 13, 2018 6:29:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-11-12_22_27_38-5415908807958422668 failed with status FAILED. Nov 13, 2018 6:29:11 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess INFO: Dataflow job 2018-11-12_22_27_38-5415908807958422668 terminated in failure state FAILED without reporting a failed assertion Nov 13, 2018 6:29:11 AM org.apache.beam.runners.dataflow.TestDataflowRunner run WARNING: Dataflow job 2018-11-12_22_27_38-5415908807958422668 did not output a success or failure metric. Gradle Test Executor 1 finished executing tests. > Task :beam-sdks-java-io-file-based-io-tests:integrationTest FAILED org.apache.beam.sdk.io.xml.XmlIOIT > writeThenReadAll FAILED java.lang.RuntimeException: Workflow failed. Causes: Workflow failed due to internal error. Please contact Google Cloud Support. at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55) at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331) at org.apache.beam.sdk.io.xml.XmlIOIT.writeThenReadAll(XmlIOIT.java:147) Finished generating test XML results (0.029 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.044 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest> :beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 1 mins 46.884 secs. Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings 85 actionable tasks: 18 executed, 67 up-to-date Publishing build scan... https://gradle.com/s/f7ypmpwzl3jmm STDERR: 1 test completed, 1 failed FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --debug option to get more log output. Run with --scan to get full insights. * Exception is: org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'. at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77) at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51) at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105) at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59) at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54) at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79) at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59) at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101) at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44) at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91) at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62) at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59) at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54) at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43) at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34) at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292) at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174) at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90) at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46) at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42) at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277) at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46) at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55) Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html> at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612) at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484) at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603) at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73) at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46) at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39) at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26) at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801) at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:300) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:292) at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:174) at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:90) at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99) ... 33 more * Get more help at https://help.gradle.org BUILD FAILED in 4m 25s 2018-11-13 06:29:13,420 a39b13fe MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-11-13 06:29:13,421 a39b13fe MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-11-13 06:29:13,422 a39b13fe MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/config-beam-performancetests-xmlioit-hdfs-896> delete -f <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found 2018-11-13 06:31:04,417 a39b13fe MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 860, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 719, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 580, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-11-13 06:31:04,418 a39b13fe MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-11-13 06:31:04,446 a39b13fe MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-11-13 06:31:04,447 a39b13fe MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/runs/a39b13fe/pkb.log> 2018-11-13 06:31:04,448 a39b13fe MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT_HDFS/ws/runs/a39b13fe/completion_statuses.json> Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org