See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/922/display/redirect?page=changes>
Changes: [relax] Rename RowType -> Schema and move to new schemas package. [relax] Add classes for SchemaRegistry and SchemaProvider. [relax] Add SchemaCoder, some more detail in SchemaProvider/Registery, and [relax] Update to comment. [relax] Integrate Schemas into PCollection Coder inference. [relax] Add setSchema convenience method. [relax] Fix compilation errors. [relax] Refactor Schema: Schema now is a fully-specified based on primitive [relax] Implement SchemaCoder and fix up schema classes. [relax] Flesh out FieldAccessDescriptor. [relax] Start plumbing through DoFn. [relax] Start editing signatures [relax] Finish plumbing schemas through. [relax] Add test for schema PCollection. [relax] Add withSchema to Create.java [relax] Plumb schemas through OutputReceiver. [relax] Add an implementation of SchemaProvider. [relax] Add SchemaRegistry and a test for schema inference. Change schema [relax] Add unit test for SchemaRegistry. [relax] Add FieldAccessDescriptorTest [relax] Add test for Create changes. [relax] Plumb FieldAccess through. [relax] Make sure everything is marked experimental with Kind.SCHEMAS [relax] Add graph-construction time verification of schemas. [relax] Fix build and style failures. [relax] Address code-review comments. [relax] Fixup after merge. [relax] Apply spotless autoformat. [relax] Fix compilation error introduced by merge. [relax] Fix CheckStyle errors. [relax] Fix Apex runner. [relax] Fix more breakages. [relax] run spotless. [relax] Fix issues. [relax] Fix Spark issue. [relax] Address code-review comments and fix a failing test. [relax] Fix Apex runner. [relax] Change ParDoSchemaTest to ValidatesRunner, and exclude unsupported [relax] Make worker changes backwards compatible with DataflowRunner. Once [relax] Add another backwards-compatible method. [klk] Add integrationTest task for GCP IO module [klk] PubsubIO: Always use GCP project from PipelineOptions for subscriptions [klk] Use BagState in PubsubSignal since it doesn't use SetState methods [klk] Replace println with logging [klk] More logging when PubsubJsonIT fails [klk] Add start signal to TestPubsubSignal [klk] Use futures in PubsubJsonIT LIMIT test [klk] Integration test of Pubsub public dataset [klk] Use test PipelineOptions in PubsubJsonIT LIMIT test [klk] Sickbay PubsubReadIT on Dataflow [klk] Fix import order ------------------------------------------ [...truncated 56.18 KB...] Resolving artifact: [group:io.grpc, name:protoc-gen-grpc-java, version:1.2.0, classifier:linux-x86_64, ext:exe] Resolved artifact: /home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe Resolving artifact: [group:com.google.protobuf, name:protoc, version:3.2.0, classifier:linux-x86_64, ext:exe] Resolved artifact: /home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe [/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe, -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/src/main/proto,> -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/build/extracted-protos/main,> -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/build/extracted-include-protos/main,> --java_out=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/build/generated/source/proto/main/java,> --grpc_out=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/build/generated/source/proto/main/grpc,> --plugin=protoc-gen-grpc=/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe, <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/src/main/proto/beam_artifact_api.proto,> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/src/main/proto/beam_job_api.proto]> protoc: stdout: . stderr: :beam-model-job-management:generateProto (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.078 secs. :beam-model-job-management:compileJava (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-model-fn-execution:generateProto Build cache key for task ':beam-model-fn-execution:generateProto' is 4b93a63ee95b746c05afa252151750cf Caching disabled for task ':beam-model-fn-execution:generateProto': Caching has not been enabled for the task Task ':beam-model-fn-execution:generateProto' is not up-to-date because: No history is available. Resolving artifact: [group:io.grpc, name:protoc-gen-grpc-java, version:1.2.0, classifier:linux-x86_64, ext:exe] Resolved artifact: /home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe Resolving artifact: [group:com.google.protobuf, name:protoc, version:3.2.0, classifier:linux-x86_64, ext:exe] Resolved artifact: /home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe [/home/jenkins/.m2/repository/com/google/protobuf/protoc/3.2.0/protoc-3.2.0-linux-x86_64.exe, -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/src/main/proto,> -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/build/extracted-protos/main,> -I<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/build/extracted-include-protos/main,> --java_out=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/build/generated/source/proto/main/java,> --grpc_out=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/build/generated/source/proto/main/grpc,> --plugin=protoc-gen-grpc=/home/jenkins/.m2/repository/io/grpc/protoc-gen-grpc-java/1.2.0/protoc-gen-grpc-java-1.2.0-linux-x86_64.exe, <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/src/main/proto/beam_fn_api.proto,> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/src/main/proto/beam_provision_api.proto]> protoc: stdout: . stderr: :beam-model-fn-execution:generateProto (Thread[Task worker for ':',5,main]) completed. Took 0.166 secs. :beam-model-fn-execution:compileJava (Thread[Task worker for ':',5,main]) started. > Task :beam-model-job-management:compileJava FROM-CACHE file or directory '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/src/main/java',> not found file or directory '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/job-management/src/main/java',> not found Build cache key for task ':beam-model-job-management:compileJava' is b5ee5c6a0b460e6d9d0893963f757ec4 Task ':beam-model-job-management:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-model-job-management:compileJava'. Origin for task ':beam-model-job-management:compileJava': {executionTime=3912, hostName=apache-beam-jenkins-slave-group-q3x9, operatingSystem=Linux, buildInvocationId=upytv7fn5nb65fltwmrqv6mkoi, creationTime=1530198828519, type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, gradleVersion=4.8, rootPath=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src,> path=:beam-model-job-management:compileJava} Unpacked output for task ':beam-model-job-management:compileJava' from cache. :beam-model-job-management:compileJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.214 secs. :beam-model-job-management:classes (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-model-job-management:classes Skipping task ':beam-model-job-management:classes' as it has no actions. :beam-model-job-management:classes (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.0 secs. :beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-model-fn-execution:compileJava FROM-CACHE file or directory '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/src/main/java',> not found file or directory '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/model/fn-execution/src/main/java',> not found Build cache key for task ':beam-model-fn-execution:compileJava' is de10edcb1322c7b7ab6acf69a8aec536 Task ':beam-model-fn-execution:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-model-fn-execution:compileJava'. Origin for task ':beam-model-fn-execution:compileJava': {executionTime=6564, hostName=apache-beam-jenkins-slave-group-q3x9, operatingSystem=Linux, buildInvocationId=upytv7fn5nb65fltwmrqv6mkoi, creationTime=1530198831312, type=org.gradle.api.tasks.compile.JavaCompile_Decorated, userName=jenkins, gradleVersion=4.8, rootPath=<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src,> path=:beam-model-fn-execution:compileJava} Unpacked output for task ':beam-model-fn-execution:compileJava' from cache. :beam-model-fn-execution:compileJava (Thread[Task worker for ':',5,main]) completed. Took 0.155 secs. :beam-model-fn-execution:classes (Thread[Task worker for ':',5,main]) started. > Task :beam-model-fn-execution:classes Skipping task ':beam-model-fn-execution:classes' as it has no actions. :beam-model-fn-execution:classes (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs. :beam-model-fn-execution:shadowJar (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-java-core:shadowJar Build cache key for task ':beam-sdks-java-core:shadowJar' is 08450f4b2d3089064ee85d2e34ecc024 Caching disabled for task ':beam-sdks-java-core:shadowJar': Caching has not been enabled for the task Task ':beam-sdks-java-core:shadowJar' is not up-to-date because: No history is available. > Task :beam-model-job-management:shadowJar Build cache key for task ':beam-model-job-management:shadowJar' is b51fbf87117c1a9dc0b0916471308528 Caching disabled for task ':beam-model-job-management:shadowJar': Caching has not been enabled for the task Task ':beam-model-job-management:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 2.146s [2146ms] Average Time/Jar: 1.073s [1073.0ms] ******************* :beam-model-job-management:shadowJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2.537 secs. > Task :beam-model-fn-execution:shadowJar Build cache key for task ':beam-model-fn-execution:shadowJar' is 820862f304fcfa06837360f6a348c074 Caching disabled for task ':beam-model-fn-execution:shadowJar': Caching has not been enabled for the task Task ':beam-model-fn-execution:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 1.963s [1963ms] Average Time/Jar: 0.9815s [981.5ms] ******************* :beam-model-fn-execution:shadowJar (Thread[Task worker for ':',5,main]) completed. Took 2.82 secs. > Task :beam-sdks-java-core:shadowJar ******************* GRADLE SHADOW STATS Total Jars: 6 (includes project) Total Time: 5.524s [5524ms] Average Time/Jar: 0.9206666666667s [920.6666666667ms] ******************* :beam-sdks-java-core:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 7.605 secs. :beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) started. :beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-core:generateTestAvroProtocol NO-SOURCE Skipping task ':beam-sdks-java-core:generateTestAvroProtocol' as it has no source files and no previous output files. :beam-sdks-java-core:generateTestAvroProtocol (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.001 secs. :beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-core:generateTestAvroJava Build cache key for task ':beam-sdks-java-core:generateTestAvroJava' is a2f5615b1cfb2088c1f62008f9bf940b Caching disabled for task ':beam-sdks-java-core:generateTestAvroJava': Caching has not been enabled for the task Task ':beam-sdks-java-core:generateTestAvroJava' is not up-to-date because: No history is available. Found 1 files Processed src/test/avro/org/apache/beam/sdk/io/user.avsc :beam-sdks-java-core:generateTestAvroJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.406 secs. :beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-runners-core-construction-java:compileJava Build cache key for task ':beam-runners-core-construction-java:compileJava' is 9c6cbcac0a1ae880abe1acdd71e99478 Task ':beam-runners-core-construction-java:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-runners-core-construction-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-core-construction-java:compileJava'. Compiling with error-prone compiler Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Packing task ':beam-runners-core-construction-java:compileJava' :beam-runners-core-construction-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 8.251 secs. :beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-core-construction-java:classes Skipping task ':beam-runners-core-construction-java:classes' as it has no actions. :beam-runners-core-construction-java:classes (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs. :beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-sdks-java-core:compileTestJava Build cache key for task ':beam-sdks-java-core:compileTestJava' is 0f47aa797704932d7b32237af0f75a8a Task ':beam-sdks-java-core:compileTestJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-sdks-java-core:compileTestJava'. All input files are considered out-of-date for incremental task ':beam-sdks-java-core:compileTestJava'. Compiling with error-prone compiler > Task :beam-runners-core-construction-java:shadowJar Build cache key for task ':beam-runners-core-construction-java:shadowJar' is 41c43aca22e501e8487688c1605964bc Caching disabled for task ':beam-runners-core-construction-java:shadowJar': Caching has not been enabled for the task Task ':beam-runners-core-construction-java:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 2.1s [2100ms] Average Time/Jar: 1.05s [1050.0ms] ******************* :beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 2.432 secs. :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-core-java:compileJava Build cache key for task ':beam-runners-core-java:compileJava' is 490805f916a0116747f220c797fd7978 Task ':beam-runners-core-java:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-runners-core-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-core-java:compileJava'. Compiling with error-prone compiler <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/runners/core-java/src/main/java/org/apache/beam/runners/core/DoFnRunners.java>:119: error: method simpleRunner in class DoFnRunners cannot be applied to given types; simpleRunner( ^ required: PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?> found: PipelineOptions,ProcessFn<InputT#2,OutputT#2,RestrictionT,CAP#1>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<CAP#2,CAP#3> reason: inference variable InputT#1 has incompatible equality constraints KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>,KeyedWorkItem<String,KV<InputT#2,RestrictionT>> where InputT#1,OutputT#1,InputT#2,OutputT#2,RestrictionT are type-variables: InputT#1 extends Object declared in method <InputT#1,OutputT#1>simpleRunner(PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) OutputT#1 extends Object declared in method <InputT#1,OutputT#1>simpleRunner(PipelineOptions,DoFn<InputT#1,OutputT#1>,SideInputReader,OutputManager,TupleTag<OutputT#1>,List<TupleTag<?>>,StepContext,Coder<InputT#1>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) InputT#2 extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) OutputT#2 extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) RestrictionT extends Object declared in method <InputT#2,OutputT#2,RestrictionT>newProcessFnRunner(ProcessFn<InputT#2,OutputT#2,RestrictionT,?>,PipelineOptions,Collection<PCollectionView<?>>,ReadyCheckingSideInputReader,OutputManager,TupleTag<OutputT#2>,List<TupleTag<?>>,StepContext,Coder<KeyedWorkItem<byte[],KV<InputT#2,RestrictionT>>>,Map<TupleTag<?>,Coder<?>>,WindowingStrategy<?,?>) where CAP#1,CAP#2,CAP#3 are fresh type-variables: CAP#1 extends RestrictionTracker<RestrictionT,?> from capture of ? CAP#2 extends Object from capture of ? CAP#3 extends BoundedWindow from capture of ? Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 error > Task :beam-runners-core-java:compileJava FAILED :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 3.781 secs. > Task :beam-sdks-java-core:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Packing task ':beam-sdks-java-core:compileTestJava' :beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 19.424 secs. :beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-core:processTestResources NO-SOURCE file or directory '<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/sdks/java/core/src/test/resources',> not found Skipping task ':beam-sdks-java-core:processTestResources' as it has no source files and no previous output files. :beam-sdks-java-core:processTestResources (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.001 secs. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-core:testClasses Skipping task ':beam-sdks-java-core:testClasses' as it has no actions. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 0.0 secs. :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) started. > Task :beam-sdks-java-core:shadowTestJar Build cache key for task ':beam-sdks-java-core:shadowTestJar' is dfe8773f90d2146753d0fe545904bb24 Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not been enabled for the task Task ':beam-sdks-java-core:shadowTestJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 6 (includes project) Total Time: 5.682s [5682ms] Average Time/Jar: 0.947s [947.0ms] ******************* :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 7.242 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-runners-core-java:compileJava'. > Compilation failed with exit code 1; see the compiler error output for > details. * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 48s 28 actionable tasks: 24 executed, 4 from cache Publishing build scan... https://gradle.com/s/gnhc6k4gyn2fi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure
