See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/2934/display/redirect?page=changes>
Changes: [rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip [rsl4] re-generate requirements.txt [Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew. [noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5) [noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc [noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308) [noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples' [noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run code [noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries to [noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement [noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR [noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258) ------------------------------------------ [...truncated 238.27 KB...] > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 0a51986e7329d7549c78a074870e496a Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Starting process 'Gradle Worker Daemon 329'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 329' Successfully started process 'Gradle Worker Daemon 329' Started Gradle **** daemon (0.731 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}. Compiling with JDK Java compiler API. > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Created classpath snapshot for incremental compilation in 0.89 secs. 1075 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:extensions:google-cloud-platform-core:compileTestJava' with cache key 2442fdd8f1904818f17adb0e83d9808a :sdks:java:extensions:google-cloud-platform-core:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 10.32 secs. :sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:extensions:google-cloud-platform-core:testClasses Skipping task ':sdks:java:extensions:google-cloud-platform-core:testClasses' as it has no actions. :sdks:java:extensions:google-cloud-platform-core:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:extensions:google-cloud-platform-core:testJar Caching disabled for task ':sdks:java:extensions:google-cloud-platform-core:testJar' because: Caching has not been enabled for the task Task ':sdks:java:extensions:google-cloud-platform-core:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/extensions/google-cloud-platform-core/build/resources/test',> not found :sdks:java:extensions:google-cloud-platform-core:testJar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.016 secs. > Task :sdks:java:extensions:protobuf:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.052 secs. 1075 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key d327f3cae4d6da94372a620aaea6d9b6 :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 10.83 secs. :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:extensions:protobuf:testClasses Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions. :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:extensions:protobuf:testJar Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because: Caching has not been enabled for the task Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because: No history is available. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.076 secs. :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:io:google-cloud-platform:compileTestJava Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'. Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 53b9920bae02d7214e26fedfd00eda59 Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:google-cloud-platform:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.304 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 0a51986e7329d7549c78a074870e496a :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon **** Thread 6,5,main]) completed. Took 19.945 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon **** Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon **** Thread 6,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 468d2a0acb8836887e6e6903c5ca201b Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found ******************* GRADLE SHADOW STATS Total Jars: 15 (includes project) Total Time: 3.011s [3011ms] Average Time/Jar: 0.2007333333333s [200.7333333333ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 468d2a0acb8836887e6e6903c5ca201b :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 4.355 secs. > Task :sdks:java:io:google-cloud-platform:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.289 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 53b9920bae02d7214e26fedfd00eda59 :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 15.508 secs. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.243 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is cee0f3c652e3f3b6489d6152f6baa2ca Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.183 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key cee0f3c652e3f3b6489d6152f6baa2ca :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.858 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs. > Task :runners:google-cloud-dataflow-java:compileTestJava Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 8aae88269eba6f0b0f2b29684aadcada Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.1 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 8aae88269eba6f0b0f2b29684aadcada :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 6.168 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.03 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) started. Gradle Test Executor 330 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is 8b73f650732200ffc23595e996314b38 Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 330'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_json_1222001435","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_json","--influxMeasurement=bqio_10GB_results_java_batch_json","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 330' Successfully started process 'Gradle Test Executor 330' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 330 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.001 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.002 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 2.685 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 45s 95 actionable tasks: 58 executed, 37 from cache Publishing build scan... https://gradle.com/s/dbwizaxrgmhr2 Stopped 6 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
