See <https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/3210/display/redirect?page=changes>
Changes: [rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip [rsl4] re-generate requirements.txt [Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew. [noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5) [noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc [noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308) [noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples' [noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run code [noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries to [noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement [noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR [noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258) ------------------------------------------ [...truncated 233.52 KB...] > Task :sdks:java:io:google-cloud-platform:testClasses Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions. :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testJar Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.366 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) started. This JVM does not support getting OS memory, so no OS memory status updates will be broadcast > Task :sdks:java:io:synthetic:compileJava Note: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/synthetic/src/main/java/org/apache/beam/sdk/io/synthetic/SyntheticBoundedSource.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :runners:google-cloud-dataflow-java:****:windmill:compileJava Created classpath snapshot for incremental compilation in 0.038 secs. Stored cache entry for task ':runners:google-cloud-dataflow-java:****:windmill:compileJava' with cache key fe714d12fe0e56cd44115add0a80cf84 :runners:google-cloud-dataflow-java:****:windmill:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 10.373 secs. :runners:google-cloud-dataflow-java:****:windmill:processResources (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:processResources file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/windmill/src/main/resources',> not found Caching disabled for task ':runners:google-cloud-dataflow-java:****:windmill:processResources' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:****:windmill:processResources' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/windmill/src/main/resources',> not found :runners:google-cloud-dataflow-java:****:windmill:processResources (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.006 secs. :runners:google-cloud-dataflow-java:****:windmill:classes (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:classes Skipping task ':runners:google-cloud-dataflow-java:****:windmill:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:windmill:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:windmill:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:compileTestJava Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 8aae88269eba6f0b0f2b29684aadcada Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Starting process 'Gradle Worker Daemon 3'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 3' Successfully started process 'Gradle Worker Daemon 3' Started Gradle **** daemon (0.508 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}. Compiling with JDK Java compiler API. > Task :sdks:java:io:synthetic:compileJava Created classpath snapshot for incremental compilation in 2.124 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:synthetic:compileJava' with cache key 76853b5a39001a768e6117facb41f094 :sdks:java:io:synthetic:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 8.896 secs. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:io:synthetic:classes Skipping task ':sdks:java:io:synthetic:classes' as it has no actions. :sdks:java:io:synthetic:classes (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:io:synthetic:jar Caching disabled for task ':sdks:java:io:synthetic:jar' because: Caching has not been enabled for the task Task ':sdks:java:io:synthetic:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/synthetic/build/resources/main',> not found :sdks:java:io:synthetic:jar (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.021 secs. :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:windmill:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' is 84ffc6f4853712e1586b0ceeb3b54b7a Task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 1 (includes project) Total Time: 0.0s [0ms] Average Time/Jar: 0.0s [0.0ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:windmill:shadowJar' with cache key 84ffc6f4853712e1586b0ceeb3b54b7a :runners:google-cloud-dataflow-java:****:windmill:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 1.883 secs. :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:compileTestJava Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is cee0f3c652e3f3b6489d6152f6baa2ca Task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with JDK Java compiler API. Created classpath snapshot for incremental compilation in 2.278 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':sdks:java:io:bigquery-io-perf-tests:compileTestJava' with cache key cee0f3c652e3f3b6489d6152f6baa2ca :sdks:java:io:bigquery-io-perf-tests:compileTestJava (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 4.895 secs. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) started. > Task :sdks:java:io:bigquery-io-perf-tests:testClasses Skipping task ':sdks:java:io:bigquery-io-perf-tests:testClasses' as it has no actions. :sdks:java:io:bigquery-io-perf-tests:testClasses (Thread[Execution **** for ':' Thread 6,5,main]) completed. Took 0.0 secs. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 0a51986e7329d7549c78a074870e496a Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/src/main/java',> not found Compiling with JDK Java compiler API. > Task :runners:google-cloud-dataflow-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.418 secs. 1898 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 8aae88269eba6f0b0f2b29684aadcada :runners:google-cloud-dataflow-java:compileTestJava (Thread[Daemon ****,5,main]) completed. Took 13.008 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Daemon ****,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found :runners:google-cloud-dataflow-java:testJar (Thread[Daemon ****,5,main]) completed. Took 0.049 secs. > Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Created classpath snapshot for incremental compilation in 0.146 secs. 1 duplicate classes found in classpath (see all with --debug). Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 0a51986e7329d7549c78a074870e496a :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 15.787 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 468d2a0acb8836887e6e6903c5ca201b Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found file or directory '<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found ******************* GRADLE SHADOW STATS Total Jars: 15 (includes project) Total Time: 3.224s [3224ms] Average Time/Jar: 0.2149333333333s [214.9333333333ms] ******************* Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 468d2a0acb8836887e6e6903c5ca201b :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 4.233 secs. :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) started. Gradle Test Executor 4 started executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest Custom actions are attached to task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. Build cache key for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is 8b73f650732200ffc23595e996314b38 Task ':sdks:java:io:bigquery-io-perf-tests:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 4'. Working directory: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--project=apache-beam-testing","--tempLocation=gs://temp-storage-for-perf-tests/loadtests","--tempRoot=gs://temp-storage-for-perf-tests/loadtests","--writeMethod=STREAMING_INSERTS","--writeFormat=JSON","--testBigQueryDataset=beam_performance","--testBigQueryTable=bqio_write_10GB_java_stream_1222001435","--metricsBigQueryDataset=beam_performance","--metricsBigQueryTable=bqio_10GB_results_java_stream","--influxMeasurement=bqio_10GB_results_java_stream","--sourceOptions={\"numRecords\":\"10485760\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"1024\"}","--runner=DataflowRunner","--maxNumWorkers=5","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.9.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 4' Successfully started process 'Gradle Test Executor 4' org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.36.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 4 finished executing tests. > Task :sdks:java:io:bigquery-io-perf-tests:integrationTest FAILED org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner, RegisteredTestRunner] at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1913) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:144) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:327) at org.apache.beam.sdk.testing.TestPipeline.testingPipelineOptions(TestPipeline.java:500) at org.apache.beam.sdk.io.common.IOITHelper.readIOTestPipelineOptions(IOITHelper.java:48) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.setup(BigQueryIOIT.java:99) Caused by: java.lang.ClassNotFoundException: DataflowRunner at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1899) ... 5 more org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT > classMethod FAILED java.lang.IllegalArgumentException: Provided dataset is null or empty at com.google.common.base.Preconditions.checkArgument(Preconditions.java:145) at com.google.cloud.bigquery.TableId.<init>(TableId.java:73) at com.google.cloud.bigquery.TableId.of(TableId.java:82) at org.apache.beam.sdk.bigqueryioperftests.BigQueryIOIT.tearDown(BigQueryIOIT.java:122) 2 tests completed, 2 failed Finished generating test XML results (0.017 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest> :sdks:java:io:bigquery-io-perf-tests:integrationTest (Thread[Execution **** for ':' Thread 8,5,main]) completed. Took 3.011 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:bigquery-io-perf-tests:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_BiqQueryIO_Streaming_Performance_Test_Java/ws/src/sdks/java/io/bigquery-io-perf-tests/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 55s 95 actionable tasks: 55 executed, 40 from cache Publishing build scan... https://gradle.com/s/kv2s7dofsho3s Stopped 3 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
