See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/182/display/redirect?page=changes>
Changes: [relax] Rename RowType -> Schema and move to new schemas package. [relax] Add classes for SchemaRegistry and SchemaProvider. [relax] Add SchemaCoder, some more detail in SchemaProvider/Registery, and [relax] Update to comment. [relax] Integrate Schemas into PCollection Coder inference. [relax] Add setSchema convenience method. [relax] Fix compilation errors. [relax] Refactor Schema: Schema now is a fully-specified based on primitive [relax] Implement SchemaCoder and fix up schema classes. [relax] Flesh out FieldAccessDescriptor. [relax] Start plumbing through DoFn. [relax] Start editing signatures [relax] Finish plumbing schemas through. [relax] Add test for schema PCollection. [relax] Add withSchema to Create.java [relax] Plumb schemas through OutputReceiver. [relax] Add an implementation of SchemaProvider. [relax] Add SchemaRegistry and a test for schema inference. Change schema [relax] Add unit test for SchemaRegistry. [relax] Add FieldAccessDescriptorTest [relax] Add test for Create changes. [relax] Plumb FieldAccess through. [relax] Make sure everything is marked experimental with Kind.SCHEMAS [relax] Add graph-construction time verification of schemas. [relax] Fix build and style failures. [relax] Address code-review comments. [relax] Fixup after merge. [relax] Apply spotless autoformat. [relax] Fix compilation error introduced by merge. [relax] Fix CheckStyle errors. [relax] Fix Apex runner. [relax] Fix more breakages. [relax] run spotless. [relax] Fix issues. [relax] Fix Spark issue. [relax] Address code-review comments and fix a failing test. [relax] Fix Apex runner. [relax] Change ParDoSchemaTest to ValidatesRunner, and exclude unsupported [relax] Make worker changes backwards compatible with DataflowRunner. Once [relax] Add another backwards-compatible method. [klk] Add integrationTest task for GCP IO module [klk] PubsubIO: Always use GCP project from PipelineOptions for subscriptions [klk] Use BagState in PubsubSignal since it doesn't use SetState methods [klk] Replace println with logging [klk] More logging when PubsubJsonIT fails [klk] Add start signal to TestPubsubSignal [klk] Use futures in PubsubJsonIT LIMIT test [klk] Integration test of Pubsub public dataset [klk] Use test PipelineOptions in PubsubJsonIT LIMIT test [klk] Sickbay PubsubReadIT on Dataflow ------------------------------------------ [...truncated 196.47 KB...] > Task :beam-sdks-java-io-parquet:classes UP-TO-DATE Skipping task ':beam-sdks-java-io-parquet:classes' as it has no actions. :beam-sdks-java-io-parquet:classes (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 0.0 secs. :beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-java-fn-execution:shadowJar UP-TO-DATE Build cache key for task ':beam-sdks-java-fn-execution:shadowJar' is dc7da355e167d9202d672bc31a6e703a Caching disabled for task ':beam-sdks-java-fn-execution:shadowJar': Caching has not been enabled for the task Skipping task ':beam-sdks-java-fn-execution:shadowJar' as it is up-to-date. :beam-sdks-java-fn-execution:shadowJar (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.009 secs. > Task :beam-runners-core-construction-java:shadowJar UP-TO-DATE Build cache key for task ':beam-runners-core-construction-java:shadowJar' is b10be77376c836c2c4a4d931fed5c492 Caching disabled for task ':beam-runners-core-construction-java:shadowJar': Caching has not been enabled for the task Skipping task ':beam-runners-core-construction-java:shadowJar' as it is up-to-date. :beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.009 secs. :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 11,5,main]) started. > Task :beam-sdks-java-io-parquet:shadowJar UP-TO-DATE Build cache key for task ':beam-sdks-java-io-parquet:shadowJar' is ef1178d999b87953cc0d02ee55a0a41b Caching disabled for task ':beam-sdks-java-io-parquet:shadowJar': Caching has not been enabled for the task Skipping task ':beam-sdks-java-io-parquet:shadowJar' as it is up-to-date. :beam-sdks-java-io-parquet:shadowJar (Thread[Task worker for ':',5,main]) completed. Took 0.01 secs. > Task :beam-sdks-java-io-google-cloud-platform:compileJava UP-TO-DATE Build cache key for task ':beam-sdks-java-io-google-cloud-platform:compileJava' is 907338ee270a2225e9650894a07ddf14 Skipping task ':beam-sdks-java-io-google-cloud-platform:compileJava' as it is up-to-date. :beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.076 secs. :beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-sdks-java-io-google-cloud-platform:classes UP-TO-DATE Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no actions. :beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs. :beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-sdks-java-core:compileTestJava UP-TO-DATE Build cache key for task ':beam-sdks-java-core:compileTestJava' is c3e46279110990ea9b80a119d1a39c85 Skipping task ':beam-sdks-java-core:compileTestJava' as it is up-to-date. :beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.645 secs. :beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 12,5,main]) started. > Task :beam-sdks-java-core:processTestResources NO-SOURCE file or directory '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/sdks/java/core/src/test/resources',> not found Skipping task ':beam-sdks-java-core:processTestResources' as it has no source files and no previous output files. :beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.001 secs. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 12,5,main]) started. > Task :beam-sdks-java-core:testClasses UP-TO-DATE Skipping task ':beam-sdks-java-core:testClasses' as it has no actions. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs. :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-io-google-cloud-platform:shadowJar Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is 0e5eba457aae4d9afba48a1b60ce11ad Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': Caching has not been enabled for the task Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 1 (includes project) Total Time: 0.0s [0ms] Average Time/Jar: 0.0s [0.0ms] ******************* :beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.829 secs. :beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-runners-core-java:compileJava Build cache key for task ':beam-runners-core-java:compileJava' is 125ae618bac63689d5ba25e16f5af8cb Task ':beam-runners-core-java:compileJava' is not up-to-date because: Task has failed previously. Custom actions are attached to task ':beam-runners-core-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-core-java:compileJava'. Compiling with error-prone compiler > Task :beam-runners-core-java:compileJava FAILED :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 5.14 secs. > Task :beam-sdks-java-core:shadowTestJar Build cache key for task ':beam-sdks-java-core:shadowTestJar' is d48a25d91c13a51cd62d72d57060a781 Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not been enabled for the task Task ':beam-sdks-java-core:shadowTestJar' is not up-to-date because: No history is available. > Task :beam-runners-google-cloud-dataflow-java:compileJava Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileJava' is 19c521bbf10100527a1f764b2052f6bf Task ':beam-runners-google-cloud-dataflow-java:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-runners-google-cloud-dataflow-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-google-cloud-dataflow-java:compileJava'. Compiling with error-prone compiler Packing task ':beam-runners-google-cloud-dataflow-java:compileJava' :beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 7.395 secs. > Task :beam-sdks-java-core:shadowTestJar ******************* GRADLE SHADOW STATS Total Jars: 6 (includes project) Total Time: 7.29s [7290ms] Average Time/Jar: 1.215s [1215.0ms] ******************* :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 10.349 secs. Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings 48 actionable tasks: 4 executed, 44 up-to-date Publishing build scan... https://gradle.com/s/ff6q2a2r3wzq4 STDERR: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/src/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java>:119: error: method simpleRunner in class DoFnRunners cannot be applied to given types; simpleRunner( ^ required: PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?> found: PipelineOptions,ProcessFn<InputT#2,OutputT#2,RestrictionT,CAP#1>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<CAP#2,CAP#3> reason: inference variable InputT#1 has incompatible equality constraints KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>,KeyedWorkItem<String,KV<InputT#2,RestrictionT>> where InputT#1,OutputT#1,InputT#2,OutputT#2,RestrictionT are type-variables: InputT#1 extends Object declared in method <InputT#1,OutputT#1>simpleRunner(PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) OutputT#1 extends Object declared in method <InputT#1,OutputT#1>simpleRunner(PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) InputT#2 extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) OutputT#2 extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) RestrictionT extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) where CAP#1,CAP#2,CAP#3 are fresh type-variables: CAP#1 extends RestrictionTracker<RestrictionT,?> from capture of ? CAP#2 extends Object from capture of ? CAP#3 extends BoundedWindow from capture of ? Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 error Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-runners-core-java:compileJava'. > Compilation failed with exit code 1; see the compiler error output for > details. * Try: Run with --debug option to get more log output. Run with --scan to get full insights. * Exception is: org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-runners-core-java:compileJava'. at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77) at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51) at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105) at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59) at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54) at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:66) at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59) at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101) at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44) at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91) at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62) at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59) at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54) at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43) at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34) at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309) at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185) at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97) at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46) at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$ExecuteTaskAction.execute(DefaultTaskExecutionGraph.java:262) at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$ExecuteTaskAction.execute(DefaultTaskExecutionGraph.java:246) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:136) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.execute(DefaultTaskPlanExecutor.java:201) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.executeWithTask(DefaultTaskPlanExecutor.java:192) at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.run(DefaultTaskPlanExecutor.java:130) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63) at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46) at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55) Caused by: org.gradle.api.internal.tasks.compile.CompilationFailedException: Compilation failed with exit code 1; see the compiler error output for details. at net.ltgt.gradle.errorprone.ErrorProneCompiler.execute(ErrorProneCompiler.java:74) at net.ltgt.gradle.errorprone.ErrorProneCompiler.execute(ErrorProneCompiler.java:23) at org.gradle.api.internal.tasks.compile.NormalizingJavaCompiler.delegateAndHandleErrors(NormalizingJavaCompiler.java:86) at org.gradle.api.internal.tasks.compile.NormalizingJavaCompiler.execute(NormalizingJavaCompiler.java:47) at org.gradle.api.internal.tasks.compile.NormalizingJavaCompiler.execute(NormalizingJavaCompiler.java:33) at org.gradle.api.internal.tasks.compile.CleaningJavaCompilerSupport.execute(CleaningJavaCompilerSupport.java:40) at org.gradle.api.internal.tasks.compile.CleaningJavaCompilerSupport.execute(CleaningJavaCompilerSupport.java:27) at org.gradle.api.tasks.compile.JavaCompile.performCompilation(JavaCompile.java:161) at org.gradle.api.tasks.compile.JavaCompile.compile(JavaCompile.java:146) at org.gradle.api.tasks.compile.JavaCompile.compile(JavaCompile.java:118) at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73) at org.gradle.api.internal.project.taskfactory.IncrementalTaskAction.doExecute(IncrementalTaskAction.java:50) at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39) at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:317) at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:309) at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:185) at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:97) at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120) at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99) ... 32 more * Get more help at https://help.gradle.org BUILD FAILED in 21s 2018-06-30 10:19:03,251 6449391d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 667, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 547, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-06-30 10:19:03,252 6449391d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-06-30 10:19:03,254 6449391d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 801, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 667, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 547, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-06-30 10:19:03,254 6449391d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-06-30 10:19:03,279 6449391d MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-06-30 10:19:03,280 6449391d MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/runs/6449391d/pkb.log> 2018-06-30 10:19:03,280 6449391d MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT/ws/runs/6449391d/completion_statuses.json> Build step 'Execute shell' marked build as failure