See <https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/2818/display/redirect?page=changes>
Changes: [rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip [rsl4] re-generate requirements.txt [Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew. [noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5) [noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc [noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308) [noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples' [noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run code [noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries to [noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement [noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR [noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258) ------------------------------------------ [...truncated 288.72 KB...] > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar > FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is 468d2a0acb8836887e6e6903c5ca201b Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' with cache key 468d2a0acb8836887e6e6903c5ca201b :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 0.21 secs. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.373 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker for ':' Thread 2,5,main]) started. This JVM does not support getting OS memory, so no OS memory status updates will be broadcast > Task :sdks:java:io:thrift:compileJava Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 8aae88269eba6f0b0f2b29684aadcada Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 8aae88269eba6f0b0f2b29684aadcada :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.317 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':' Thread 9,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':' Thread 9,5,main]) completed. Took 0.045 secs. > Task :sdks:java:io:mongodb:compileTestJava Custom actions are attached to task ':sdks:java:io:mongodb:compileTestJava'. Build cache key for task ':sdks:java:io:mongodb:compileTestJava' is fde0c43dded29d87da0adfec00d032b4 Task ':sdks:java:io:mongodb:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:mongodb:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Starting process 'Gradle Worker Daemon 2'. Working directory: /home/jenkins/.gradle/workers Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/6.9.1/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Worker Daemon 2' Successfully started process 'Gradle Worker Daemon 2' Started Gradle worker daemon (0.5 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}. Compiling with JDK Java compiler API. > Task :sdks:java:io:thrift:compileJava Created classpath snapshot for incremental compilation in 1.574 secs. 16 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:thrift:compileJava' with cache key ff28f2b24948a4a2e769269a28a06491 :sdks:java:io:thrift:compileJava (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 6.32 secs. :sdks:java:io:thrift:classes (Thread[Execution worker for ':' Thread 6,5,main]) started. > Task :sdks:java:io:thrift:classes Skipping task ':sdks:java:io:thrift:classes' as it has no actions. :sdks:java:io:thrift:classes (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.0 secs. :sdks:java:io:thrift:jar (Thread[Execution worker for ':' Thread 6,5,main]) started. > Task :sdks:java:io:thrift:jar Caching disabled for task ':sdks:java:io:thrift:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:thrift:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/thrift/build/resources/main',> not found :sdks:java:io:thrift:jar (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.014 secs. :sdks:java:io:thrift:compileTestJava (Thread[Execution worker for ':' Thread 6,5,main]) started. > Task :sdks:java:io:thrift:compileTestJava Custom actions are attached to task ':sdks:java:io:thrift:compileTestJava'. Build cache key for task ':sdks:java:io:thrift:compileTestJava' is cdc221bad5e87feccf27740ba3fa5cdd Task ':sdks:java:io:thrift:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:thrift:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.015 secs. 16 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:thrift:compileTestJava' with cache key cdc221bad5e87feccf27740ba3fa5cdd :sdks:java:io:thrift:compileTestJava (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 3.073 secs. :sdks:java:io:thrift:testClasses (Thread[Execution worker for ':' Thread 6,5,main]) started. > Task :sdks:java:io:thrift:testClasses Skipping task ':sdks:java:io:thrift:testClasses' as it has no actions. :sdks:java:io:thrift:testClasses (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.0 secs. :sdks:java:io:thrift:testJar (Thread[Execution worker for ':' Thread 6,5,main]) started. > Task :sdks:java:io:mongodb:compileTestJava Note: <https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/mongodb/src/test/java/org/apache/beam/sdk/io/mongodb/MongoDBGridFSIOTest.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :sdks:java:io:thrift:testJar Caching disabled for task ':sdks:java:io:thrift:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:thrift:testJar' is not up-to-date because: No history is available. :sdks:java:io:thrift:testJar (Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.025 secs. > Task :sdks:java:io:mongodb:compileTestJava Created classpath snapshot for incremental compilation in 1.097 secs. 1895 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:mongodb:compileTestJava' with cache key fde0c43dded29d87da0adfec00d032b4 :sdks:java:io:mongodb:compileTestJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 5.932 secs. :sdks:java:io:mongodb:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) started. > Task :sdks:java:io:mongodb:testClasses Skipping task ':sdks:java:io:mongodb:testClasses' as it has no actions. :sdks:java:io:mongodb:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs. :sdks:java:io:mongodb:testJar (Thread[Execution worker for ':' Thread 8,5,main]) started. > Task :sdks:java:io:mongodb:testJar Caching disabled for task ':sdks:java:io:mongodb:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:mongodb:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/io/mongodb/build/resources/test',> not found :sdks:java:io:mongodb:testJar (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.009 secs. :sdks:java:extensions:sql:compileTestJava (Thread[Execution worker for ':' Thread 8,5,main]) started. > Task :sdks:java:extensions:sql:compileTestJava Custom actions are attached to task ':sdks:java:extensions:sql:compileTestJava'. Build cache key for task ':sdks:java:extensions:sql:compileTestJava' is 2c8cd22ff138ef9a6d75436d28195ffa Task ':sdks:java:extensions:sql:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:extensions:sql:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 1.459 secs. 6915 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:extensions:sql:compileTestJava' with cache key 2c8cd22ff138ef9a6d75436d28195ffa :sdks:java:extensions:sql:compileTestJava (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 14.55 secs. :sdks:java:extensions:sql:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) started. > Task :sdks:java:extensions:sql:testClasses Skipping task ':sdks:java:extensions:sql:testClasses' as it has no actions. :sdks:java:extensions:sql:testClasses (Thread[Execution worker for ':' Thread 8,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:sql:testJar (Thread[Execution worker for ':' Thread 11,5,main]) started. > Task :sdks:java:extensions:sql:testJar Caching disabled for task ':sdks:java:extensions:sql:testJar' because: Caching has not been enabled for the task Task ':sdks:java:extensions:sql:testJar' is not up-to-date because: No history is available. :sdks:java:extensions:sql:testJar (Thread[Execution worker for ':' Thread 11,5,main]) completed. Took 0.149 secs. :sdks:java:extensions:sql:perf-tests:compileTestJava (Thread[Execution worker for ':' Thread 11,5,main]) started. > Task :sdks:java:extensions:sql:perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:extensions:sql:perf-tests:compileTestJava'. Build cache key for task ':sdks:java:extensions:sql:perf-tests:compileTestJava' is 5cf2102054dfa8da61412706e70b482f Task ':sdks:java:extensions:sql:perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:extensions:sql:perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.148 secs. 6926 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:extensions:sql:perf-tests:compileTestJava' with cache key 5cf2102054dfa8da61412706e70b482f :sdks:java:extensions:sql:perf-tests:compileTestJava (Thread[Execution worker for ':' Thread 11,5,main]) completed. Took 2.014 secs. :sdks:java:extensions:sql:perf-tests:testClasses (Thread[Execution worker for ':' Thread 11,5,main]) started. > Task :sdks:java:extensions:sql:perf-tests:testClasses Skipping task ':sdks:java:extensions:sql:perf-tests:testClasses' as it has no actions. :sdks:java:extensions:sql:perf-tests:testClasses (Thread[Execution worker for ':' Thread 11,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:sql:perf-tests:integrationTest (Thread[Execution worker for ':' Thread 4,5,main]) started. Gradle Test Executor 3 started executing tests. > Task :sdks:java:extensions:sql:perf-tests:integrationTest Custom actions are attached to task ':sdks:java:extensions:sql:perf-tests:integrationTest'. Build cache key for task ':sdks:java:extensions:sql:perf-tests:integrationTest' is 5f5f513f5eafedec3cd0dbee9f3333e9 Task ':sdks:java:extensions:sql:perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 3'. Working directory: <https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/extensions/sql/perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=sql_bqio_read_java_batch","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--workerHarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/build/libs/beam-runners-google-cloud-dataflow-java-legacy-worker-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/workerMain/gradle-worker.jar worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test Executor 3' Successfully started process 'Gradle Test Executor 3' org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BigQueryIOPushDownIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/build/libs/beam-runners-google-cloud-dataflow-java-legacy-worker-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 3 finished executing tests. > Task :sdks:java:extensions:sql:perf-tests:integrationTest FAILED org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BigQueryIOPushDownIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BigQueryIOPushDownIT.setUp(BigQueryIOPushDownIT.java:103) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more 1 test completed, 1 failed Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/extensions/sql/perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/extensions/sql/perf-tests/build/reports/tests/integrationTest> :sdks:java:extensions:sql:perf-tests:integrationTest (Thread[Execution worker for ':' Thread 4,5,main]) completed. Took 3.177 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:extensions:sql:perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_SQLBigQueryIO_Batch_Performance_Test_Java/ws/src/sdks/java/extensions/sql/perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 57s 122 actionable tasks: 70 executed, 52 from cache Publishing build scan... https://gradle.com/s/h7okhyxoyfbvo Stopped 2 worker daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
