See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/2941/display/redirect?page=changes>
Changes: [mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v2) [mmack] [BEAM-7559] Add integration test for DynamoDBIO (SDK v1) [noreply] [BEAM-13399] Disable expansion service integration test on Samza and [noreply] [BEAM-13430] Upgrade beam to gradle 7.3.2 (#16319) ------------------------------------------ [...truncated 236.50 KB...] > Task :sdks:java:io:synthetic:compileJava Note: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/src/main/java/org/apache/beam/sdk/io/synthetic/SyntheticBoundedSource.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Class dependency analysis for incremental compilation took 0.063 secs. Created classpath snapshot for incremental compilation in 0.267 secs. Stored cache entry for task ':sdks:java:io:synthetic:compileJava' with cache key 9b3919a610d2479fb945ce1001e87942 :sdks:java:io:synthetic:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 7.057 secs. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 9,5,main]) started. > Task :sdks:java:io:synthetic:classes Skipping task ':sdks:java:io:synthetic:classes' as it has no actions. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs. :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 9,5,main]) started. > Task :sdks:java:io:synthetic:jar Caching disabled for task ':sdks:java:io:synthetic:jar' because: Not worth caching Task ':sdks:java:io:synthetic:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/build/resources/main',> not found :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.019 secs. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:compileJava Class dependency analysis for incremental compilation took 0.315 secs. Created classpath snapshot for incremental compilation in 0.046 secs. This JVM does not support getting OS memory, so no OS memory status updates will be broadcast > Task :runners:google-cloud-dataflow-java:****:windmill:compileJava Stored cache entry for task ':runners:google-cloud-dataflow-java:****:windmill:compileJava' with cache key 93941f91d08670e1699fa2ddddb9ea82 :runners:google-cloud-dataflow-java:****:windmill:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 10.018 secs. :runners:google-cloud-dataflow-java:****:windmill:processResources (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:processResources file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/windmill/src/main/resources',> not found Caching disabled for task ':runners:google-cloud-dataflow-java:****:windmill:processResources' because: Not worth caching Task ':runners:google-cloud-dataflow-java:****:windmill:processResources' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/windmill/src/main/resources',> not found :runners:google-cloud-dataflow-java:****:windmill:processResources (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.004 secs. :runners:google-cloud-dataflow-java:****:windmill:classes (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:classes Skipping task ':runners:google-cloud-dataflow-java:****:windmill:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:windmill:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:windmill:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:compileTestJava Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 9f32834befae7f2be107dcc7479c8976 Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'. Starting process 'Gradle Worker Daemon 3'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 3' Successfully started process 'Gradle Worker Daemon 3' Started Gradle **** daemon (0.539 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}. Compiling with JDK Java compiler API. > Task :runners:google-cloud-dataflow-java:****:windmill:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' is 8b09bd329d34cb4c7333ff42a86e2e39 Task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 1 (includes project) Total Time: 0.0s [0ms] Average Time/Jar: 0.0s [0.0ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' with cache key 8b09bd329d34cb4c7333ff42a86e2e39 :runners:google-cloud-dataflow-java:****:windmill:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 1.507 secs. :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is 78d6490967e20e272362113581d5a71a Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'. Compiling with JDK Java compiler API. Class dependency analysis for incremental compilation took 0.009 secs. Created classpath snapshot for incremental compilation in 0.236 secs. Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key 78d6490967e20e272362113581d5a71a :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 2.54 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87d6bff36f2dc0ca75da68bda9290362 Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Compiling with JDK Java compiler API. > Task :runners:google-cloud-dataflow-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Class dependency analysis for incremental compilation took 0.085 secs. Created classpath snapshot for incremental compilation in 0.318 secs. Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 9f32834befae7f2be107dcc7479c8976 :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 11.489 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Not worth caching Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.032 secs. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Class dependency analysis for incremental compilation took 0.212 secs. Created classpath snapshot for incremental compilation in 0.034 secs. Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87d6bff36f2dc0ca75da68bda9290362 :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 14.297 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 9cd95100921ed478bf26b1f1c7e68892 Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found ******************* GRADLE SHADOW STATS Total Jars: 15 (includes project) Total Time: 2.591s [2591ms] Average Time/Jar: 0.17273333333330002s [172.7333333333ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 9cd95100921ed478bf26b1f1c7e68892 :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 3.553 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started. Gradle Test Executor 4 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is cd713ba9943bff37f263fe3a91bab025 Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 4'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_json_1223174954","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_json","--influxMeasurement=bqio_10GB_results_java_batch_json","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.3.2/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 4' Successfully started process 'Gradle Test Executor 4' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 4 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.015 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 2.84 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 50s 105 actionable tasks: 59 executed, 44 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/3fa6mdtzwfrd2 Stopped 3 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
