See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/2936/display/redirect?page=changes>
Changes: [Robert Bradshaw] Add microbenchmark for row coder. [Robert Bradshaw] Compile RowCoderImpl with Cython. [Robert Bradshaw] RowCoder optimizations. [Robert Bradshaw] Further optimizations for common case of components in order. [Robert Bradshaw] Optimize rows with null fields. [Robert Bradshaw] RowCoder lint. ------------------------------------------ [...truncated 223.08 KB...] Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions. :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started. > Task :sdks:java:extensions:protobuf:testJar Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because: Caching has not been enabled for the task Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because: No history is available. :sdks:java:extensions:protobuf:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.079 secs. > Task :runners:direct-java:compileTestJava FROM-CACHE Custom actions are attached to task ':runners:direct-java:compileTestJava'. Build cache key for task ':runners:direct-java:compileTestJava' is ef3698e506dac6de110e43cdff3fc1ca Task ':runners:direct-java:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:direct-java:compileTestJava' with cache key ef3698e506dac6de110e43cdff3fc1ca :runners:direct-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.145 secs. :runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:direct-java:testClasses UP-TO-DATE Skipping task ':runners:direct-java:testClasses' as it has no actions. :runners:direct-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs. :runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:google-cloud-platform:jar Caching disabled for task ':sdks:java:io:google-cloud-platform:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/google-cloud-platform/build/resources/main',> not found :sdks:java:io:google-cloud-platform:jar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.297 secs. :runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:direct-java:shadowTestJar FROM-CACHE Build cache key for task ':runners:direct-java:shadowTestJar' is 8bc5179883888868356942c5d30f6d80 Task ':runners:direct-java:shadowTestJar' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:direct-java:shadowTestJar' with cache key 8bc5179883888868356942c5d30f6d80 :runners:direct-java:shadowTestJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.259 secs. :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileJava' is 13f3a3ea4086f0386bcab3a536db39a8 Task ':runners:google-cloud-dataflow-java:compileJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileJava' with cache key 13f3a3ea4086f0386bcab3a536db39a8 :runners:google-cloud-dataflow-java:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.177 secs. :runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:classes Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions. :runners:google-cloud-dataflow-java:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:jar Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because: No history is available. :runners:google-cloud-dataflow-java:jar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.088 secs. :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava > FROM-CACHE file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 0a51986e7329d7549c78a074870e496a Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 0a51986e7329d7549c78a074870e496a :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.303 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 468d2a0acb8836887e6e6903c5ca201b Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 468d2a0acb8836887e6e6903c5ca201b :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 11,5,main]) completed. Took 0.19 secs. > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'. Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 53b9920bae02d7214e26fedfd00eda59 Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 53b9920bae02d7214e26fedfd00eda59 :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.621 secs. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.269 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 8aae88269eba6f0b0f2b29684aadcada Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 8aae88269eba6f0b0f2b29684aadcada :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.196 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 3,5,main]) completed. Took 0.03 secs. > Task :sdks:java:io:synthetic:compileJava Note: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/src/main/java/org/apache/beam/sdk/io/synthetic/SyntheticBoundedSource.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Created classpath snapshot for incremental compilation in 1.07 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:synthetic:compileJava' with cache key 76853b5a39001a768e6117facb41f094 :sdks:java:io:synthetic:compileJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 5.883 secs. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:io:synthetic:classes Skipping task ':sdks:java:io:synthetic:classes' as it has no actions. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs. :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:io:synthetic:jar Caching disabled for task ':sdks:java:io:synthetic:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:synthetic:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/synthetic/build/resources/main',> not found :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.016 secs. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is cee0f3c652e3f3b6489d6152f6baa2ca Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 0.794 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key cee0f3c652e3f3b6489d6152f6baa2ca :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 2.238 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 0.0 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) started. Gradle Test Executor 2 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is 8b73f650732200ffc23595e996314b38 Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=FILE_LOADS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_json_1222100426","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_batch_json","--influxMeasurement=bqio_10GB_results_java_batch_json","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2' Successfully started process 'Gradle Test Executor 2' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 2 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 4,5,main]) completed. Took 2.949 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Batch_Performance_Test_Java_Json/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 32s 95 actionable tasks: 49 executed, 46 from cache Publishing build scan... https://gradle.com/s/t26ssuznrvas6 Stopped 1 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
