See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/5440/display/redirect?page=changes>
Changes: [kcweaver] [BEAM-9199] Require Dataflow --region in Python SDK. [kcweaver] Add --region to tests where needed. [kcweaver] [BEAM-9199] Require --region option for Dataflow in Java SDK. [kcweaver] Add --region to Java GCP tests. [kcweaver] Fix DataflowRunnerTest. [kcweaver] Fix more Java unit tests missing --region. [kcweaver] Add --region to DF streaming example tests. [kcweaver] Add unit tests for get_default_gcp_region [kcweaver] Add --region to Dataflow runner webpage. [kcweaver] lint [kcweaver] Add --region to more Java tests and examples. [kcweaver] Add --region to more Python tests and examples. [kcweaver] format [kcweaver] Remove unrecognized --region option from non-DF tests. ------------------------------------------ Started by timer Started by GitHub push by ibzib Started by GitHub push by ibzib Started by GitHub push by ibzib Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-16 (beam-perf) in workspace <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 64e69d68f85903d94170fa2efc5a1633d82da589 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 64e69d68f85903d94170fa2efc5a1633d82da589 Commit message: "Merge pull request #11281 from ibzib/beam-9199-java" > git rev-list --no-walk 08335d6acb544b674d5d47365c1fc0772399f7ec # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PostCommit_Java_Nexmark_Flink] $ /bin/bash -xe /tmp/jenkins2609895428219574833.sh + echo src RUN NEXMARK IN BATCH MODE USING FLINK RUNNER src src RUN NEXMARK IN BATCH MODE USING FLINK RUNNER src [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g "-Pnexmark.args=--bigQueryTable=nexmark --bigQueryDataset=nexmark --project=apache-beam-testing --resourceNameMode=QUERY_RUNNER_AND_MODE --exportSummaryToBigQuery=true --tempLocation=gs://temp-storage-for-perf-tests/nexmark --runner=FlinkRunner --shutdownSourcesOnFinalWatermark=true --streaming=false --suite=SMOKE --streamTimeout=60 --manageResources=false --monitorJobs=true" :sdks:java:testing:nexmark:run Starting a Gradle Daemon (subsequent builds will be faster) > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy > Task :buildSrc:spotlessGroovyCheck > Task :buildSrc:spotlessGroovyGradle > Task :buildSrc:spotlessGroovyGradleCheck > Task :buildSrc:spotlessCheck > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties FROM-CACHE > Task :buildSrc:check > Task :buildSrc:build Configuration on demand is an incubating feature. > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :sdks:java:harness:processResources NO-SOURCE > Task :runners:core-java:processResources NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:processResources NO-SOURCE > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :runners:core-construction-java:processResources NO-SOURCE > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :runners:direct-java:processResources NO-SOURCE > Task :runners:local-java:processResources NO-SOURCE > Task :model:fn-execution:extractProto > Task :model:job-management:extractProto > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:testing:test-utils:processResources NO-SOURCE > Task :sdks:java:io:mongodb:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:io:parquet:processResources NO-SOURCE > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:extensions:join-library:processResources NO-SOURCE > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :model:job-management:processResources > Task :sdks:java:testing:nexmark:processResources > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :model:fn-execution:processResources > Task :sdks:java:core:processResources > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore > Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc > Task :model:pipeline:generateProto > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :sdks:java:extensions:sql:generateFmppSources > Task :model:pipeline:jar > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:extractIncludeProto > Task :model:job-management:generateProto > Task :model:fn-execution:generateProto > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :sdks:java:extensions:sql:compileJavacc Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/ws/src/sdks/java/extensions/sql/build/generated/fmpp/javacc/Parser.jj> . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. File "TokenMgrError.java" does not exist. Will create one. File "ParseException.java" does not exist. Will create one. File "Token.java" does not exist. Will create one. File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. > Task :sdks:java:extensions:sql:processResources > Task :model:pipeline:shadowJar > Task :model:job-management:shadowJar > Task :model:fn-execution:shadowJar > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:extensions:join-library:compileJava FROM-CACHE > Task :sdks:java:extensions:join-library:classes UP-TO-DATE > Task :runners:local-java:compileJava FROM-CACHE > Task :runners:local-java:classes UP-TO-DATE > Task :sdks:java:io:mongodb:compileJava FROM-CACHE > Task :sdks:java:io:mongodb:classes UP-TO-DATE > Task :runners:local-java:jar > Task :sdks:java:extensions:join-library:jar > Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE > Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE > Task :sdks:java:io:mongodb:jar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar > Task :vendor:sdks-java-extensions-protobuf:shadowJar > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :runners:core-construction-java:jar > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:io:parquet:compileJava FROM-CACHE > Task :sdks:java:io:parquet:classes UP-TO-DATE > Task :sdks:java:core:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:io:parquet:jar > Task :sdks:java:expansion-service:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:core-java:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:harness:shadowJar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:direct-java:jar > Task :runners:direct-java:shadowJar > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :sdks:java:testing:nexmark:compileJava FROM-CACHE > Task :sdks:java:testing:nexmark:classes > Task :sdks:java:testing:nexmark:jar > Task :sdks:java:testing:nexmark:run FAILED Exception in thread "main" java.lang.IllegalArgumentException: Unknown 'runner' specified 'FlinkRunner', supported pipeline runners [DirectRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1664) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:115) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:298) at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:98) at org.apache.beam.sdk.nexmark.Main.main(Main.java:415) Caused by: java.lang.ClassNotFoundException: FlinkRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:419) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:352) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1650) ... 4 more FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:nexmark:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 41s 73 actionable tasks: 49 executed, 24 from cache Publishing build scan... https://gradle.com/s/vsnkkha6kgjew Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
