See <https://builds.apache.org/job/beam_PerformanceTests_Python/990/display/redirect?page=changes>
Changes: [samuel.waggoner] [BEAM-3777] allow UDAFs to be indirect subclasses of CombineFn ------------------------------------------ [...truncated 540.65 KB...] [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ beam-sdks-java-extensions-sql --- [INFO] Deleting <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql> (includes = [**/*.pyc, **/*.egg-info/, **/sdks/python/LICENSE, **/sdks/python/NOTICE, **/sdks/python/README.md, **/sdks/python/apache_beam/portability/api/*pb2*.*, **/sdks/python/apache_beam/portability/common_urns.py, **/sdks/python/**/*.c, **/sdks/python/**/*.so, **/sdks/python/**/*.egg], excludes = []) [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-maven-version) @ beam-sdks-java-extensions-sql --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce) @ beam-sdks-java-extensions-sql --- [INFO] Adding ignore: module-info [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-sdks-java-extensions-sql --- [INFO] [INFO] --- maven-dependency-plugin:3.0.2:unpack (unpack-parser-template) @ beam-sdks-java-extensions-sql --- [INFO] Configured Artifact: org.apache.calcite:calcite-core:?:jar [INFO] Unpacking /home/jenkins/.m2/repository/org/apache/calcite/calcite-core/1.15.0/calcite-core-1.15.0.jar to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target> with includes "**/Parser.jj" and excludes "" [INFO] [INFO] --- maven-resources-plugin:3.0.2:copy-resources (copy-fmpp-resources) @ beam-sdks-java-extensions-sql --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 4 resources [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ beam-sdks-java-extensions-sql --- [INFO] argLine set to -javaagent:/home/jenkins/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/jacoco.exec,excludes=**/AutoValue_*.class,dumponexit=true,output=file> [INFO] [INFO] --- fmpp-maven-plugin:1.0:generate (generate-fmpp-sources) @ beam-sdks-java-extensions-sql --- - Executing: Parser.jj [INFO] Done [INFO] [INFO] --- javacc-maven-plugin:2.4:javacc (javacc) @ beam-sdks-java-extensions-sql --- Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/generated-sources/fmpp/javacc/Parser.jj> . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding. File "TokenMgrError.java" does not exist. Will create one. File "ParseException.java" does not exist. Will create one. File "Token.java" does not exist. Will create one. File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. [INFO] Processed 1 grammar [INFO] [INFO] --- build-helper-maven-plugin:3.0.0:add-source (add-generated-sources) @ beam-sdks-java-extensions-sql --- [INFO] Source directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/generated-sources/java> added. [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-java-extensions-sql --- [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-sdks-java-extensions-sql --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ beam-sdks-java-extensions-sql --- [INFO] Compiling 201 source files to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/classes> [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/parser/SqlDDLKeywords.java>: Some input files use or override a deprecated API. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/parser/SqlDDLKeywords.java>: Recompile with -Xlint:deprecation for details. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/generated-sources/java/org/apache/beam/sdk/extensions/sql/impl/parser/impl/BeamSqlParserImpl.java>: Some input files use unchecked or unsafe operations. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/generated-sources/java/org/apache/beam/sdk/extensions/sql/impl/parser/impl/BeamSqlParserImpl.java>: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:3.0.2:testResources (default-testResources) @ beam-sdks-java-extensions-sql --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/test/resources> [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ beam-sdks-java-extensions-sql --- [INFO] Compiling 91 source files to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/test-classes> [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/interpreter/operator/date/BeamSqlTimestampMinusTimestampExpressionTest.java>: Some input files use or override a deprecated API. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/interpreter/operator/date/BeamSqlTimestampMinusTimestampExpressionTest.java>: Recompile with -Xlint:deprecation for details. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/interpreter/operator/reinterpret/ReinterpretConversionTest.java>: Some input files use unchecked or unsafe operations. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/interpreter/operator/reinterpret/ReinterpretConversionTest.java>: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-java-extensions-sql --- [INFO] [INFO] --- maven-surefire-plugin:2.20.1:test (default-test) @ beam-sdks-java-extensions-sql --- [INFO] Tests are skipped. [INFO] [INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-extensions-sql --- [INFO] [INFO] --- jacoco-maven-plugin:0.7.9:report (report) @ beam-sdks-java-extensions-sql --- [INFO] Skipping JaCoCo execution due to missing execution data file. [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-extensions-sql --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/beam-sdks-java-extensions-sql-2.5.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-site-plugin:3.7:attach-descriptor (attach-descriptor) @ beam-sdks-java-extensions-sql --- [INFO] Skipping because packaging 'jar' is not pom. [INFO] [INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-extensions-sql --- [INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/java/extensions/sql/target/beam-sdks-java-extensions-sql-2.5.0-SNAPSHOT-tests.jar> [INFO] [INFO] --- maven-shade-plugin:3.1.0:shade (bundle-and-repackage) @ beam-sdks-java-extensions-sql --- [INFO] Including org.apache.calcite:calcite-core:jar:1.15.0 in the shaded jar. [INFO] Excluding commons-dbcp:commons-dbcp:jar:1.4 from the shaded jar. [INFO] Excluding commons-pool:commons-pool:jar:1.5.4 from the shaded jar. [INFO] Excluding org.apache.commons:commons-lang3:jar:3.6 from the shaded jar. [INFO] Excluding com.esri.geometry:esri-geometry-api:jar:2.0.0 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.8.9 from the shaded jar. [INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.8.9 from the shaded jar. [INFO] Excluding com.yahoo.datasketches:sketches-core:jar:0.9.0 from the shaded jar. [INFO] Excluding com.yahoo.datasketches:memory:jar:0.9.0 from the shaded jar. [INFO] Excluding net.hydromatic:aggdesigner-algorithm:jar:6.0 from the shaded jar. [INFO] Excluding commons-lang:commons-lang:jar:2.4 from the shaded jar. [INFO] Excluding commons-logging:commons-logging:jar:1.1.3 from the shaded jar. [INFO] Including org.codehaus.janino:janino:jar:2.7.6 in the shaded jar. [INFO] Including org.codehaus.janino:commons-compiler:jar:2.7.6 in the shaded jar. [INFO] Including org.apache.calcite:calcite-linq4j:jar:1.15.0 in the shaded jar. [INFO] Including org.apache.calcite.avatica:avatica-core:jar:1.10.0 in the shaded jar. [INFO] Including org.apache.calcite.avatica:avatica-metrics:jar:1.10.0 in the shaded jar. [INFO] Including com.google.protobuf:protobuf-java:jar:3.2.0 in the shaded jar. [INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.5.2 from the shaded jar. [INFO] Excluding commons-codec:commons-codec:jar:1.9 from the shaded jar. [INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.4.4 from the shaded jar. [INFO] Excluding org.apache.beam:beam-sdks-java-core:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding net.bytebuddy:byte-buddy:jar:1.7.10 from the shaded jar. [INFO] Excluding org.apache.avro:avro:jar:1.8.2 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 from the shaded jar. [INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.7 from the shaded jar. [INFO] Excluding org.tukaani:xz:jar:1.5 from the shaded jar. [INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.4 from the shaded jar. [INFO] Excluding org.apache.commons:commons-compress:jar:1.14 from the shaded jar. [INFO] Excluding com.google.code.findbugs:jsr305:jar:3.0.1 from the shaded jar. [INFO] Excluding com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1 from the shaded jar. [INFO] Including com.google.guava:guava:jar:20.0 in the shaded jar. [INFO] Excluding org.slf4j:slf4j-api:jar:1.7.25 from the shaded jar. [INFO] Excluding org.apache.commons:commons-csv:jar:1.4 from the shaded jar. [INFO] Excluding joda-time:joda-time:jar:2.4 from the shaded jar. [INFO] Excluding org.apache.beam:beam-sdks-java-extensions-join-library:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding com.alibaba:fastjson:jar:1.2.12 from the shaded jar. [INFO] Excluding org.apache.beam:beam-runners-direct-java:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-model-pipeline:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-runners-local-java-core:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-runners-core-construction-java:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-model-job-management:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf:jar:1.2.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar. [INFO] Including com.google.protobuf:protobuf-java-util:jar:3.2.0 in the shaded jar. [INFO] Excluding com.google.code.gson:gson:jar:2.7 from the shaded jar. [INFO] Excluding io.grpc:grpc-core:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.errorprone:error_prone_annotations:jar:2.0.15 from the shaded jar. [INFO] Excluding io.grpc:grpc-context:jar:1.2.0 from the shaded jar. [INFO] Excluding com.google.instrumentation:instrumentation-api:jar:0.3.0 from the shaded jar. [INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the shaded jar. [INFO] Excluding org.apache.beam:beam-runners-core-java:jar:2.5.0-SNAPSHOT from the shaded jar. [INFO] Excluding org.apache.beam:beam-model-fn-execution:jar:2.5.0-SNAPSHOT from the shaded jar. STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache). log4j:WARN Please initialize the log4j system properly. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. 2018-03-06 06:54:29,077 5d25125e MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-03-06 06:54:29,227 5d25125e MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/python/target> 2018-03-06 06:54:29,303 5d25125e MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-03-06 06:54:29,306 5d25125e MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 732, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 87, in SubmitJob self.spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 175, in BuildBeamCommand cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 265, in _BuildPythonCommand 'apache-beam*.tar.gz') File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py";,> line 290, in _FindFiles raise RuntimeError('No such directory: %s' % base_path) RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/beam/sdks/python/target> 2018-03-06 06:54:29,306 5d25125e MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-03-06 06:54:29,307 5d25125e MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-03-06 06:54:29,307 5d25125e MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/pkb.log> 2018-03-06 06:54:29,308 5d25125e MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/5d25125e/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
