See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/2937/display/redirect?page=changes>
Changes: [mmack] [BEAM-13494] Avoid draining Kinesis API limits & CPU when reading from [arietis27] [BEAM-13517] Unable to write nulls to columns with logical types [noreply] Make S3 streaming more efficient (#15931) ------------------------------------------ [...truncated 223.24 KB...] Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions. :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) started. > Task :runners:direct-java:compileTestJava FROM-CACHE Custom actions are attached to task ':runners:direct-java:compileTestJava'. Build cache key for task ':runners:direct-java:compileTestJava' is ef3698e506dac6de110e43cdff3fc1ca Task ':runners:direct-java:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key ef3698e506dac6de110e43cdff3fc1ca :runners:direct-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.129 secs. :runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) started. > Task :runners:direct-java:testClasses UP-TO-DATE Skipping task ':runners:direct-java:testClasses' as it has no actions. :runners:direct-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. :runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) started. > Task :sdks:java:extensions:protobuf:testJar Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because: Caching has not been enabled for the task Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because: No history is available. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.073 secs. > Task :sdks:java:io:google-cloud-platform:jar Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found :sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.285 secs. :runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) started. > Task :runners:direct-java:shadowTestJar FROM-CACHE Build cache key for task ':runners:direct-java:shadowTestJar' is 8bc5179883888868356942c5d30f6d80 Task ':runners:direct-java:shadowTestJar' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 8bc5179883888868356942c5d30f6d80 :runners:direct-java:shadowTestJar (Thread[Execution **** for ':',5,main]) completed. Took 0.249 secs. :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 13f3a3ea4086f0386bcab3a536db39a8 Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 13f3a3ea4086f0386bcab3a536db39a8 :runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.207 secs. :runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) started. > Task :runners:google-cloud-dataflow-java:classes Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions. :runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) started. > Task :runners:google-cloud-dataflow-java:jar Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because: No history is available. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 0.088 secs. :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava > FROM-CACHE file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 0a51986e7329d7549c78a074870e496a Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 0a51986e7329d7549c78a074870e496a :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.321 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'. Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 53b9920bae02d7214e26fedfd00eda59 Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 53b9920bae02d7214e26fedfd00eda59 :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.642 secs. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) started. > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 468d2a0acb8836887e6e6903c5ca201b Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 468d2a0acb8836887e6e6903c5ca201b :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.176 secs. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':',5,main]) completed. Took 0.255 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 8aae88269eba6f0b0f2b29684aadcada Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 8aae88269eba6f0b0f2b29684aadcada :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':',5,main]) completed. Took 0.207 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.037 secs. > Task :sdks:java:io:synthetic:compileJava Note: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/src/main/java/org/apache/beam/sdk/io/synthetic/SyntheticBoundedSource.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Created classpath snapshot for incremental compilation in 0.948 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:synthetic:compileJava' with cache key 76853b5a39001a768e6117facb41f094 :sdks:java:io:synthetic:compileJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 5.394 secs. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:synthetic:classes Skipping task ':sdks:java:io:synthetic:classes' as it has no actions. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs. :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:synthetic:jar Caching disabled for task ':sdks:java:io:synthetic:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:synthetic:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/build/resources/main',> not found :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.011 secs. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is cee0f3c652e3f3b6489d6152f6baa2ca Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.812 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key cee0f3c652e3f3b6489d6152f6baa2ca :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 2.19 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) started. Gradle Test Executor 2 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is 8b73f650732200ffc23595e996314b38 Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_json_1222150432","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_json","--influxMeasurement=bqio_10GB_results_java_batch_json","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2' Successfully started process 'Gradle Test Executor 2' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 2 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.016 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.02 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 2.912 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 31s 95 actionable tasks: 49 executed, 46 from cache Publishing build scan... https://gradle.com/s/lvdqhm3e7tx5u Stopped 1 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
