See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/2941/display/redirect?page=changes>
Changes: [noreply] [BEAM-12830] Avoid flock and prepare task once. (OSX fix.) (#16333) [noreply] Bump Python beam-master containers (#16332) ------------------------------------------ [...truncated 253.97 KB...] Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions. :runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:jar Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because: No history is available. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':',5,main]) completed. Took 0.096 secs. :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) started. > Task :runners:direct-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.193 secs. 1075 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:direct-java:compileTestJava' with cache key a3b9b5a09dd7e6597fec98a53cf194da :runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 24.529 secs. :runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:direct-java:testClasses Skipping task ':runners:direct-java:testClasses' as it has no actions. :runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs. :runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 87780064fc222818085fb6c3a53f72d4 Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Compiling with JDK Java compiler API. > Task :runners:direct-java:shadowTestJar Build cache key for task ':runners:direct-java:shadowTestJar' is c1f2bfb424f71bc66a01900585e92bf5 Task ':runners:direct-java:shadowTestJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/direct-java/build/resources/test',> not found ******************* GRADLE SHADOW STATS Total Jars: 7 (includes project) Total Time: 1.378s [1378ms] Average Time/Jar: 0.19685714285710001s [196.8571428571ms] ******************* Stored cache entry for task ':runners:direct-java:shadowTestJar' with cache key c1f2bfb424f71bc66a01900585e92bf5 :runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 1.953 secs. :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :sdks:java:io:google-cloud-platform:compileTestJava Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'. Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 0ec4c286f7067b022c03c18204af302c Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:google-cloud-platform:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.168 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 87780064fc222818085fb6c3a53f72d4 :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':',5,main]) completed. Took 17.491 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 26f18e02ed025a048b03909735145035 Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found > Task :sdks:java:io:google-cloud-platform:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.409 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 0ec4c286f7067b022c03c18204af302c :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 18.412 secs. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.26 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar ******************* GRADLE SHADOW STATS Total Jars: 15 (includes project) Total Time: 3.116s [3116ms] Average Time/Jar: 0.20773333333330002s [207.7333333333ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 26f18e02ed025a048b03909735145035 :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 4.139 secs. > Task :runners:google-cloud-dataflow-java:compileTestJava Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 4235bd1c0302f25ee3667798a35a2205 Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is 3cd07c5a5fd49c3784839965b6438316 Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.233 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key 3cd07c5a5fd49c3784839965b6438316 :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 3.014 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs. > Task :runners:google-cloud-dataflow-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.096 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 4235bd1c0302f25ee3667798a35a2205 :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 7.141 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.032 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) started. Gradle Test Executor 9 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is ba898130081ef6628590bab0e5a8f7fc Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 9'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=AVRO","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_avro_1223050434","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_avro","--influxMeasurement=bqio_10GB_results_java_batch_avro","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 9' Successfully started process 'Gradle Test Executor 9' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 9 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 3.073 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Avro/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 29s 95 actionable tasks: 65 executed, 30 from cache Publishing build scan... https://gradle.com/s/fftjhh72ifu7k Stopped 8 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
