See <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/141/display/redirect>
------------------------------------------ [...truncated 32.40 KB...] [INFO] Excluding io.netty:netty-codec-socks:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-handler:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-buffer:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-common:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-transport:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-resolver:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-codec:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-all:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-okhttp:jar:1.2.0 from the shaded jar. [INFO] Excluding com.squareup.okhttp:okhttp:jar:2.5.0 from the shaded jar. [INFO] Excluding com.squareup.okio:okio:jar:1.6.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.protobuf.nano:protobuf-javanano:jar:3.0.0-alpha-5 from the shaded jar. [INFO] Excluding com.google.cloud:google-cloud-core:jar:1.0.2 from the shaded jar. [INFO] Excluding org.json:json:jar:20160810 from the shaded jar. [INFO] Excluding com.google.cloud:google-cloud-spanner:jar:0.20.0-beta from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-longrunning-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-longrunning-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.cloud.bigtable:bigtable-protos:jar:1.0.0-pre3 from the shaded jar. [INFO] Excluding com.google.cloud.bigtable:bigtable-client-core:jar:1.0.0 from the shaded jar. [INFO] Excluding commons-logging:commons-logging:jar:1.2 from the shaded jar. [INFO] Excluding com.google.auth:google-auth-library-appengine:jar:0.7.0 from the shaded jar. [INFO] Excluding io.opencensus:opencensus-contrib-grpc-util:jar:0.7.0 from the shaded jar. [INFO] Excluding io.opencensus:opencensus-api:jar:0.7.0 from the shaded jar. [INFO] Excluding io.dropwizard.metrics:metrics-core:jar:3.1.2 from the shaded jar. [INFO] Excluding com.google.protobuf:protobuf-java:jar:3.2.0 from the shaded jar. [INFO] Excluding io.netty:netty-tcnative-boringssl-static:jar:1.1.33.Fork26 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:jar:0.1.9 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-common-protos:jar:0.1.9 from the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/beam-sdks-java-io-file-based-io-tests-2.4.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/beam-sdks-java-io-file-based-io-tests-2.4.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/beam-sdks-java-io-file-based-io-tests-2.4.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/beam-sdks-java-io-file-based-io-tests-2.4.0-SNAPSHOT-shaded-tests.jar> [INFO] [INFO] --- maven-failsafe-plugin:2.20.1:integration-test (default) @ beam-sdks-java-io-file-based-io-tests --- [INFO] Failsafe report directory: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/failsafe-reports> [INFO] parallel='all', perCoreThreadCount=true, threadCount=4, useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running org.apache.beam.sdk.io.text.TextIOIT [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 307.352 s <<< FAILURE! - in org.apache.beam.sdk.io.text.TextIOIT [ERROR] writeThenReadAll(org.apache.beam.sdk.io.text.TextIOIT) Time elapsed: 307.352 s <<< ERROR! java.lang.RuntimeException: (d5d5058e7cabd9a5): java.io.IOException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone { "code" : 503, "errors" : [ { "domain" : "global", "message" : "Backend Error", "reason" : "backendError" } ], "message" : "Backend Error" } at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(AbstractGoogleAsyncWriteChannel.java:431) at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.close(AbstractGoogleAsyncWriteChannel.java:289) at java.nio.channels.Channels$1.close(Channels.java:178) at com.google.cloud.dataflow.worker.repackaged.com.google.common.io.CountingOutputStream.close(CountingOutputStream.java:68) at com.google.cloud.dataflow.worker.IsmSink$IsmSinkWriter.close(IsmSink.java:296) at com.google.cloud.dataflow.worker.util.common.worker.WriteOperation.finish(WriteOperation.java:95) at com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:75) at com.google.cloud.dataflow.worker.DataflowWorker.executeWork(DataflowWorker.java:361) at com.google.cloud.dataflow.worker.DataflowWorker.doWork(DataflowWorker.java:333) at com.google.cloud.dataflow.worker.DataflowWorker.getAndPerformWork(DataflowWorker.java:264) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:133) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:113) at com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:100) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone { "code" : 503, "errors" : [ { "domain" : "global", "message" : "Backend Error", "reason" : "backendError" } ], "message" : "Backend Error" } at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113) at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352) at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469) at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357) ... 4 more at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:133) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:89) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:54) at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:353) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:335) at org.apache.beam.sdk.io.text.TextIOIT.writeThenReadAll(TextIOIT.java:113) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:324) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:410) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [INFO] [INFO] Results: [INFO] [ERROR] Errors: [ERROR] TextIOIT.writeThenReadAll:113 Runtime (d5d5058e7cabd9a5): java.io.IOExceptio... [INFO] [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 [INFO] [INFO] [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-sdks-java-io-file-based-io-tests --- [INFO] No dependency problems found [INFO] [INFO] --- maven-failsafe-plugin:2.20.1:verify (default) @ beam-sdks-java-io-file-based-io-tests --- [INFO] Failsafe report directory: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/failsafe-reports> [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 05:22 min [INFO] Finished at: 2018-02-14T12:06:55Z [INFO] Final Memory: 85M/1088M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.20.1:verify (default) on project beam-sdks-java-io-file-based-io-tests: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/failsafe-reports> for the individual test results. [ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.20.1:verify (default) on project beam-sdks-java-io-file-based-io-tests: There are test failures. Please refer to <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/failsafe-reports> for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/beam/sdks/java/io/file-based-io-tests/target/failsafe-reports> for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. at org.apache.maven.plugin.surefire.SurefireHelper.throwException (SurefireHelper.java:240) at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution (SurefireHelper.java:112) at org.apache.maven.plugin.failsafe.VerifyMojo.execute (VerifyMojo.java:188) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException STDERR: 2018-02-14 12:06:56,127 235a4c21 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-02-14 12:06:56,128 235a4c21 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-02-14 12:06:56,130 235a4c21 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 732, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-02-14 12:06:56,130 235a4c21 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-02-14 12:06:56,130 235a4c21 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-02-14 12:06:56,131 235a4c21 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/pkb.log> 2018-02-14 12:06:56,131 235a4c21 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Compressed_TextIOIT/ws/runs/235a4c21/completion_statuses.json> Build step 'Execute shell' marked build as failure