See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/129/display/redirect?page=changes>
Changes: [rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work [relax] Update python version. [relax] Update container version. [kirpichov] Cherrypick of #3995 to 2.2.0: Add custom tempLocation support to [jbonofre] [BEAM-1017] Add RedisIO [kenn] Use 2.2.0 container tag for Dataflow [chamikara] Sets user agent in BigTableIO.Read.getBigTableService(). [valentyn] Pin runner harness container image for Dataflow distributions of BEAM [valentyn] Make linter happy. [valentyn] [BEAM-2600] Add minimal python SDK harness container [valentyn] Use 2.2.0 version instead of 2.3.0 for container Maven project on the [valentyn] Use tox instead of detox. Looks like we reverted to tox on the master [valentyn] Pin runner harness also for official BEAM releases. [relax] [maven-release-plugin] prepare release [relax] [maven-release-plugin] prepare for next development iteration [relax] Revert "[maven-release-plugin] prepare for next development iteration" [relax] Revert "[maven-release-plugin] prepare release [relax] [maven-release-plugin] prepare release v2.2.0-RC1 [relax] [maven-release-plugin] rollback changes from release preparation of [altay] Add an element batching transform. [altay] Align names with those produced by the dataflow runner harness. [altay] Fix from any -> bytes transition. [altay] Add an option for dataflow job labels. [altay] Unit test for label pipeline option [altay] Update container version for python DataflowRunner for the 2.2.0 release [relax] [maven-release-plugin] prepare release v2.2.0-RC2 [relax] [maven-release-plugin] rollback changes from release preparation of [relax] [maven-release-plugin] prepare release v2.2.0-RC3 [relax] [maven-release-plugin] rollback changes from release preparation of [valentyn] Set save_main_session to True for csv module [valentyn] Set OnTimeBehavior in windowing strategy to FIRE_ALWAYS. [valentyn] Update urns.py [ccy] CP #4112, #4122: Properly handle side input exception when all reader [relax] Cherrypick WriteFiles fix. [relax] [maven-release-plugin] prepare release v2.2.0-RC4 [relax] [maven-release-plugin] rollback changes from release preparation of [rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work [rezarokni] [maven-release-plugin] prepare for next development iteration [rezarokni] Bump Python version for next release. [rezarokni] Only fail nightly release at end, for more detailed signal [rezarokni] Only fail Java postcommit at end [rezarokni] Move the Job Server into a Submodule [rezarokni] Add Artifact Staging Endpoint to PrepareJobResponse [rezarokni] Add model/ and submodules to Maven structure and gen_protos.py [rezarokni] Move sdk/common/runner-api protos into model/pipeline and [rezarokni] Move sdks/common/fn-api protos to model/fn-execution [rezarokni] Remove sdks/common [rezarokni] Re-namespace model/pipeline to model.pipeline [rezarokni] Re-namespace model/job-management to model.job_management [rezarokni] Re-namespace model/fn-execution to model.fn_execution [rezarokni] Improve error message when standard_coders.yaml not found [rezarokni] Dataflow runner: shade protobuf and beam model [rezarokni] PipelineOptionsFactory should prevent non PipelineOptions interfaces [rezarokni] [BEAM-3016] Fix blocking issue within run() when channel terminates [rezarokni] [BEAM-2576] Reflect portability proto changes in Go [rezarokni] Add licenses to generated code [rezarokni] Improve the documentation for CombineFn [rezarokni] Remove coders from DoFn's Remove extra space in hello.cc file Remove [rezarokni] Fix Bug if more than one external lib DoFn is used in same pipeline the [rezarokni] Removed more complex examples for later PR Added semaphore logic to [7542791+rezarokni] Added Assert for test pipeline. Added comments and new file names for [7542791+rezarokni] Added ability to read Binary output from files for use with Protobuf [7542791+rezarokni] Moved files from java8 to java [7542791+rezarokni] Correct checkstyle issues [amyrvold] [BEAM-4035] Fix spark validatesrunner [amyrvold] Change ver of zookeeper instead of removing mavenLocal [7542791+rezarokni] Fix findBugs issues [lcwik] [BEAM-3249, BEAM-4014] Automatically propagate shading configuration to [lcwik] [BEAM-3249] Add support for translating 'provided' scope dependencies to [kenn] Basic run task for nexmark with runner selection ------------------------------------------ [...truncated 81.05 KB...] [INFO] Excluding com.google.cloud.bigdataoss:gcsio:jar:1.4.5 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-cloudresourcemanager:jar:v1-rev6-1.22.0 from the shaded jar. [INFO] Excluding org.apache.beam:beam-sdks-java-io-google-cloud-platform:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-sdks-java-extensions-protobuf:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding io.grpc:grpc-core:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.errorprone:error_prone_annotations:jar:2.0.15 from the shaded jar. [INFO] Excluding io.grpc:grpc-context:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.instrumentation:instrumentation-api:jar:0.3.0 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-bigquery:jar:v2-rev374-1.22.0 from the shaded jar. [INFO] Excluding com.google.api:gax-grpc:jar:0.20.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.api:api-common:jar:1.0.0-rc2 from the shaded jar. [INFO] Excluding com.google.api:gax:jar:1.3.1 from the shaded jar. [INFO] Excluding org.threeten:threetenbp:jar:1.3.3 from the shaded jar. [INFO] Excluding com.google.cloud:google-cloud-core-grpc:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-pubsub:jar:v1-rev10-1.22.0 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-pubsub-v1:jar:0.1.18 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-pubsub-v1:jar:0.1.18 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-iam-v1:jar:0.1.18 from the shaded jar. [INFO] Excluding com.google.cloud.datastore:datastore-v1-proto-client:jar:1.4.0 from the shaded jar. [INFO] Excluding com.google.http-client:google-http-client-protobuf:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.http-client:google-http-client-jackson:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.cloud.datastore:datastore-v1-protos:jar:1.3.0 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-common-protos:jar:0.1.9 from the shaded jar. [INFO] Excluding io.grpc:grpc-auth:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-netty:jar:1.2.0 from the shaded jar. [INFO] Excluding io.netty:netty-codec-http2:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-handler-proxy:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.netty:netty-codec-socks:jar:4.1.8.Final from the shaded jar. [INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.cloud:google-cloud-core:jar:1.0.2 from the shaded jar. [INFO] Excluding org.json:json:jar:20160810 from the shaded jar. [INFO] Excluding com.google.cloud:google-cloud-spanner:jar:0.20.0b-beta from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-v1:jar:0.1.11b from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-v1:jar:0.1.11b from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-admin-database-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-cloud-spanner-admin-instance-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:grpc-google-longrunning-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-longrunning-v1:jar:0.1.11 from the shaded jar. [INFO] Excluding com.google.cloud.bigtable:bigtable-protos:jar:1.0.0-pre3 from the shaded jar. [INFO] Excluding com.google.cloud.bigtable:bigtable-client-core:jar:1.0.0 from the shaded jar. [INFO] Excluding com.google.auth:google-auth-library-appengine:jar:0.7.0 from the shaded jar. [INFO] Excluding io.opencensus:opencensus-contrib-grpc-util:jar:0.7.0 from the shaded jar. [INFO] Excluding io.opencensus:opencensus-api:jar:0.7.0 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:jar:0.1.9 from the shaded jar. [INFO] Excluding com.google.api.grpc:proto-google-common-protos:jar:0.1.9 from the shaded jar. [INFO] Excluding io.grpc:grpc-all:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-okhttp:jar:1.2.0 from the shaded jar. [INFO] Excluding com.squareup.okhttp:okhttp:jar:2.5.0 from the shaded jar. [INFO] Excluding com.squareup.okio:okio:jar:1.6.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.protobuf.nano:protobuf-javanano:jar:3.0.0-alpha-5 from the shaded jar. [INFO] Excluding io.netty:netty-tcnative-boringssl-static:jar:1.1.33.Fork26 from the shaded jar. [INFO] Excluding org.apache.beam:beam-runners-core-construction-java:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-model-job-management:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding com.google.protobuf:protobuf-java-util:jar:3.2.0 from the shaded jar. [INFO] Excluding com.google.api-client:google-api-client:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.oauth-client:google-oauth-client:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.http-client:google-http-client:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.http-client:google-http-client-jackson2:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-dataflow:jar:v1b3-rev221-1.22.0 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-clouddebugger:jar:v2-rev8-1.22.0 from the shaded jar. [INFO] Excluding com.google.apis:google-api-services-storage:jar:v1-rev71-1.22.0 from the shaded jar. [INFO] Excluding com.google.auth:google-auth-library-credentials:jar:0.7.1 from the shaded jar. [INFO] Excluding com.google.auth:google-auth-library-oauth2-http:jar:0.7.1 from the shaded jar. [INFO] Excluding com.google.cloud.bigdataoss:util:jar:1.4.5 from the shaded jar. [INFO] Excluding com.google.api-client:google-api-client-java6:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.api-client:google-api-client-jackson2:jar:1.22.0 from the shaded jar. [INFO] Excluding com.google.oauth-client:google-oauth-client-java6:jar:1.22.0 from the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-shaded.jar> [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/beam-sdks-java-io-hadoop-input-format-2.5.0-SNAPSHOT-shaded-tests.jar> [INFO] Dependency-reduced POM written at: <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/dependency-reduced-pom.xml> [INFO] [INFO] --- maven-failsafe-plugin:2.21.0:integration-test (default) @ beam-sdks-java-io-hadoop-input-format --- [INFO] Failsafe report directory: <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports> [INFO] parallel='all', perCoreThreadCount=true, threadCount=4, useUnlimitedThreads=false, threadCountSuites=0, threadCountClasses=0, threadCountMethods=0, parallelOptimized=true [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] Running org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.921 s <<< FAILURE! - in org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT [ERROR] readUsingHadoopInputFormat(org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT) Time elapsed: 1.921 s <<< ERROR! java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;Ljava/lang/Object;)V at org.apache.beam.runners.core.construction.PTransformReplacements.getSingletonMainInput(PTransformReplacements.java:50) at org.apache.beam.runners.core.construction.PTransformReplacements.getSingletonMainInput(PTransformReplacements.java:41) at org.apache.beam.runners.dataflow.ReshuffleOverrideFactory.getReplacementTransform(ReshuffleOverrideFactory.java:53) at org.apache.beam.sdk.Pipeline.applyReplacement(Pipeline.java:552) at org.apache.beam.sdk.Pipeline.replace(Pipeline.java:288) at org.apache.beam.sdk.Pipeline.replaceAll(Pipeline.java:209) at org.apache.beam.runners.dataflow.DataflowRunner.replaceTransforms(DataflowRunner.java:865) at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:656) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:98) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90) at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55) at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346) at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328) at org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT.readUsingHadoopInputFormat(HadoopInputFormatIOIT.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317) at org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:410) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [INFO] [INFO] Results: [INFO] [ERROR] Errors: [ERROR] HadoopInputFormatIOIT.readUsingHadoopInputFormat:134 NoSuchMethod com.google... [INFO] [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 [INFO] [INFO] [INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-sdks-java-io-hadoop-input-format --- [INFO] No dependency problems found [INFO] [INFO] --- maven-failsafe-plugin:2.21.0:verify (default) @ beam-sdks-java-io-hadoop-input-format --- [INFO] Failsafe report directory: <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports> [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 42.727 s [INFO] Finished at: 2018-04-11T18:28:17Z [INFO] Final Memory: 131M/1285M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.21.0:verify (default) on project beam-sdks-java-io-hadoop-input-format: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports> for the individual test results. [ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.21.0:verify (default) on project beam-sdks-java-io-hadoop-input-format: There are test failures. Please refer to <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports> for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:213) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/beam/sdks/java/io/hadoop-input-format/target/failsafe-reports> for the individual test results. Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream. at org.apache.maven.plugin.surefire.SurefireHelper.throwException (SurefireHelper.java:240) at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution (SurefireHelper.java:112) at org.apache.maven.plugin.failsafe.VerifyMojo.execute (VerifyMojo.java:192) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:154) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:146) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:309) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:194) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:107) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:955) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:290) at org.apache.maven.cli.MavenCli.main (MavenCli.java:194) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:356) [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException STDERR: 2018-04-11 18:28:18,098 ebb38b0d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 623, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-04-11 18:28:18,099 ebb38b0d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-04-11 18:28:18,099 ebb38b0d MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-hadoopinputformatioit-1523469450401> delete -f <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> 2018-04-11 18:28:18,613 ebb38b0d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 757, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 623, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 526, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-04-11 18:28:18,613 ebb38b0d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-04-11 18:28:18,662 ebb38b0d MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-04-11 18:28:18,663 ebb38b0d MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/pkb.log> 2018-04-11 18:28:18,663 ebb38b0d MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/runs/ebb38b0d/completion_statuses.json> Build step 'Execute shell' marked build as failure
