See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2793/display/redirect?page=changes>
Changes: [bulat.safiullin] [Website] add refresh to page-nav.js [noreply] Propogate error messages from GcsUtil (#22079) [noreply] Reenable Jenkins comment triggers (#22169) [noreply] Add `schema_options` and `field_options` on RowTypeConstraint (#22133) ------------------------------------------ [...truncated 1.12 MB...] Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/container/java8/build/docker> Command: docker build --no-cache --build-arg pull_licenses=true --build-arg java_version=8 -t apache/beam_java8_sdk:2.41.0.dev . Successfully started process 'command 'docker'' Sending build context to Docker daemon 222.3MB Step 1/21 : ARG java_version Step 2/21 : FROM openjdk:${java_version}-bullseye ---> 2a8331246713 Step 3/21 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in 036a047c6103 Removing intermediate container 036a047c6103 ---> b5c958825be1 Step 4/21 : ARG pull_licenses ---> Running in 98559f3f124d Removing intermediate container 98559f3f124d ---> 818abcdaa544 Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> 905c42d7fbec Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> d10eccdadafd Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> 5405b861d6fa Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> 36575f2249d6 Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 1d4178cbd263 Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/ ---> c198d5f92f79 Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 716c3a5f4458 Step 12/21 : COPY target/LICENSE /opt/apache/beam/ ---> 92c626502cb5 Step 13/21 : COPY target/NOTICE /opt/apache/beam/ ---> f733f6562d42 Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> ec509e61c2f9 Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/ ---> 479ff613ecb4 Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE ---> Running in e484b046e1b2 Removing intermediate container e484b046e1b2 ---> 85fabe54e165 Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> ea4712c7855e Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 62c311f83c43 Removing intermediate container 62c311f83c43 ---> f376721066d3 Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 5d877836b07e Removing intermediate container 5d877836b07e ---> c2e0089e675d Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> b8bbc4d7a009 Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 998a12b39896 Removing intermediate container 998a12b39896 ---> 6f4110802bd1 Successfully built 6f4110802bd1 Successfully tagged apache/beam_java8_sdk:2.41.0.dev :sdks:java:container:java8:docker (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 19.406 secs. :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 7,5,main]) started. > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer Custom actions are attached to task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer'. Caching disabled for task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' because: Gradle would require more information to cache this task Task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker tag apache/beam_java8_sdk:2.41.0.dev us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129 Successfully started process 'command 'docker'' Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud docker -- push us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129 Successfully started process 'command 'gcloud'' WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] 738391b73149: Preparing 61c851dc1c4d: Preparing 5daced3d5774: Preparing 4ef504ba8393: Preparing cc956d2017e1: Preparing d40163cad970: Preparing 596c13cdfa47: Preparing f1a00f503751: Preparing c2f965859184: Preparing 28cde5973f7e: Preparing 68d3cf9a81b8: Preparing 855ebed82db9: Preparing 4955111d9bfb: Preparing 1cd8ed967077: Preparing 7459b6316aa7: Preparing 89f3c2569d89: Preparing cc63c81d3b06: Preparing 369123a7ed65: Preparing 5afd661c6106: Preparing 66183893ba24: Preparing 6840c8ff46bd: Preparing 97d5fec864d8: Preparing d40163cad970: Waiting 596c13cdfa47: Waiting f1a00f503751: Waiting c2f965859184: Waiting 28cde5973f7e: Waiting 68d3cf9a81b8: Waiting 855ebed82db9: Waiting 4955111d9bfb: Waiting 1cd8ed967077: Waiting cc63c81d3b06: Waiting 7459b6316aa7: Waiting 5afd661c6106: Waiting 89f3c2569d89: Waiting 369123a7ed65: Waiting 97d5fec864d8: Waiting 66183893ba24: Waiting 6840c8ff46bd: Waiting cc956d2017e1: Pushed 61c851dc1c4d: Pushed 4ef504ba8393: Pushed 5daced3d5774: Pushed 738391b73149: Pushed f1a00f503751: Pushed 596c13cdfa47: Pushed d40163cad970: Pushed 28cde5973f7e: Pushed c2f965859184: Pushed 68d3cf9a81b8: Pushed 855ebed82db9: Pushed 89f3c2569d89: Layer already exists cc63c81d3b06: Layer already exists 369123a7ed65: Layer already exists 5afd661c6106: Layer already exists 66183893ba24: Layer already exists 6840c8ff46bd: Layer already exists 97d5fec864d8: Layer already exists 1cd8ed967077: Pushed 7459b6316aa7: Pushed 4955111d9bfb: Pushed 20220707191129: digest: sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc size: 4935 :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 14.494 secs. :sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) started. producer locations for task group 0 (Thread[Execution **** for ':' Thread 5,5,main]) started. producer locations for task group 0 (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs. Gradle Test Executor 2 started executing tests. > Task :sdks:java:io:kafka:integrationTest Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'. Build cache key for task ':sdks:java:io:kafka:integrationTest' is f45a71bf56df102095197b470e341004 Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=35.225.227.56:32401,35.222.178.165:32403,104.154.63.14:32404","--kafkaTopic=beam-runnerv2","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=use_runner_v2,shuffle_mode=appliance,use_unified_****","--sdkContainerImage=us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129","--region=us-central1";] -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.4/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2' Successfully started process 'Gradle Test Executor 2' org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.41.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 2 finished executing tests. > Task :sdks:java:io:kafka:integrationTest org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED java.lang.IllegalStateException: withTopic() is required at org.apache.beam.sdk.util.Preconditions.checkStateNotNull(Preconditions.java:471) at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2906) at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2699) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499) at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:376) at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:173) 1 test completed, 1 failed Finished generating test XML results (0.006 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.006 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest> > Task :sdks:java:io:kafka:integrationTest FAILED :sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 7,5,main]) completed. Took 4.983 secs. :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 5,5,main]) started. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because: Gradle would require more information to cache this task Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129 Successfully started process 'command 'docker'' Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129 Successfully started process 'command 'gcloud'' Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707191129] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc])]. Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh'' Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0a83906ff3fe6cfc2f7b102a7defc41f1811bb930fdfaf63d632529c74103edc]. :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 9.088 secs. :sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 5,5,main]) started. > Task :sdks:java:io:kafka:cleanUp Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions. :sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.0 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:kafka:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1m 48s 156 actionable tasks: 18 executed, 1 from cache, 137 up-to-date Publishing build scan... https://gradle.com/s/lz3oltnjj64du Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
