See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2791/display/redirect>
Changes: ------------------------------------------ [...truncated 1.12 MB...] Caching disabled for task ':sdks:java:container:java8:docker' because: Gradle would require more information to cache this task Task ':sdks:java:container:java8:docker' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/container/java8/build/docker> Command: docker build --no-cache --build-arg pull_licenses=true --build-arg java_version=8 -t apache/beam_java8_sdk:2.41.0.dev . Successfully started process 'command 'docker'' Sending build context to Docker daemon 222.3MB Step 1/21 : ARG java_version Step 2/21 : FROM openjdk:${java_version}-bullseye ---> 2a8331246713 Step 3/21 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in 4bc26501327a Removing intermediate container 4bc26501327a ---> 8b05e70770d0 Step 4/21 : ARG pull_licenses ---> Running in e7916b42587c Removing intermediate container e7916b42587c ---> 77f76e9a7b21 Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> 634b08f16cd1 Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> 11f7de1d773f Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> 1eb11f4239a7 Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> 556b66e2745c Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 096c32081461 Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/ ---> d946560538b8 Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 3d4fe20c409e Step 12/21 : COPY target/LICENSE /opt/apache/beam/ ---> 068a5867b3e7 Step 13/21 : COPY target/NOTICE /opt/apache/beam/ ---> 41c557362e8a Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 87015de700ce Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/ ---> 007018a55398 Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE ---> Running in 94dc540f2b6c Removing intermediate container 94dc540f2b6c ---> 3c64afc1e4cc Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> c463cb4d4ecd Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in a2d04cb290d1 Removing intermediate container a2d04cb290d1 ---> d9f7eadee9ba Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in da09c3b4588a Removing intermediate container da09c3b4588a ---> 817dd4eec1b3 Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 44e7fab17350 Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 9b28c5ecb399 Removing intermediate container 9b28c5ecb399 ---> fb1e68754801 Successfully built fb1e68754801 Successfully tagged apache/beam_java8_sdk:2.41.0.dev :sdks:java:container:java8:docker (Thread[Execution **** for ':',5,main]) completed. Took 14.051 secs. :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer Custom actions are attached to task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer'. Caching disabled for task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' because: Gradle would require more information to cache this task Task ':runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker tag apache/beam_java8_sdk:2.41.0.dev us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924 Successfully started process 'command 'docker'' Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud docker -- push us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924 Successfully started process 'command 'gcloud'' WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java] cf6e6c589177: Preparing b3728ed6f7bd: Preparing 491aa47a3e58: Preparing 67a538331751: Preparing 9c2de4a9fcae: Preparing f3cc9eca9fc2: Preparing abdbae15a503: Preparing ec54c80c5064: Preparing 85386615e908: Preparing 272db8b29edf: Preparing 8ad85841093a: Preparing ae9ff0ceef39: Preparing 335e97acfb96: Preparing d2d8b76fde69: Preparing 6e15222c5ef1: Preparing 89f3c2569d89: Preparing cc63c81d3b06: Preparing 369123a7ed65: Preparing 8ad85841093a: Waiting abdbae15a503: Waiting 5afd661c6106: Preparing 66183893ba24: Preparing 85386615e908: Waiting 6840c8ff46bd: Preparing 97d5fec864d8: Preparing 89f3c2569d89: Waiting ae9ff0ceef39: Waiting 335e97acfb96: Waiting 6e15222c5ef1: Waiting d2d8b76fde69: Waiting 369123a7ed65: Waiting 97d5fec864d8: Waiting cc63c81d3b06: Waiting 6840c8ff46bd: Waiting 66183893ba24: Waiting 272db8b29edf: Waiting 5afd661c6106: Waiting ec54c80c5064: Waiting 9c2de4a9fcae: Pushed b3728ed6f7bd: Pushed 491aa47a3e58: Pushed 67a538331751: Pushed cf6e6c589177: Pushed ec54c80c5064: Pushed abdbae15a503: Pushed 272db8b29edf: Pushed f3cc9eca9fc2: Pushed 8ad85841093a: Pushed 85386615e908: Pushed 89f3c2569d89: Layer already exists ae9ff0ceef39: Pushed cc63c81d3b06: Layer already exists 369123a7ed65: Layer already exists 5afd661c6106: Layer already exists 66183893ba24: Layer already exists 6840c8ff46bd: Layer already exists 97d5fec864d8: Layer already exists d2d8b76fde69: Pushed 6e15222c5ef1: Pushed 335e97acfb96: Pushed 20220707070924: digest: sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330 size: 4935 :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer (Thread[Execution **** for ':',5,main]) completed. Took 12.004 secs. :sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':',5,main]) started. producer locations for task group 0 (Thread[Execution **** for ':' Thread 2,5,main]) started. producer locations for task group 0 (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. Gradle Test Executor 2 started executing tests. > Task :sdks:java:io:kafka:integrationTest Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'. Build cache key for task ':sdks:java:io:kafka:integrationTest' is e6165017453708c90acedc4195d1bcc0 Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=34.71.160.241:32401,35.188.60.81:32403,35.238.233.84:32404","--kafkaTopic=beam-runnerv2","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=use_runner_v2,shuffle_mode=appliance,use_unified_****","--sdkContainerImage=us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924","--region=us-central1";] -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.4/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2' Successfully started process 'Gradle Test Executor 2' org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.41.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Gradle Test Executor 2 finished executing tests. > Task :sdks:java:io:kafka:integrationTest FAILED org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED java.lang.IllegalStateException: withTopic() is required at org.apache.beam.sdk.util.Preconditions.checkStateNotNull(Preconditions.java:471) at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2906) at org.apache.beam.sdk.io.kafka.KafkaIO$Write.expand(KafkaIO.java:2699) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:548) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:499) at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:376) at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:173) 1 test completed, 1 failed Finished generating test XML results (0.004 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.004 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest> :sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':',5,main]) completed. Took 3.827 secs. :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':',5,main]) started. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'. Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because: Gradle would require more information to cache this task Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924 Successfully started process 'command 'docker'' Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330 Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924 Successfully started process 'command 'gcloud'' Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220707070924] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330])]. Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh'' Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e3809c44b8bcacbd2b52f3f80a5963acec52899239206e8ee56d4f0bf4dab330]. :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** for ':',5,main]) completed. Took 8.118 secs. :sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':',5,main]) started. > Task :sdks:java:io:kafka:cleanUp Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions. :sdks:java:io:kafka:cleanUp (Thread[Execution **** for ':',5,main]) completed. Took 0.0 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:kafka:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1m 16s 156 actionable tasks: 18 executed, 1 from cache, 137 up-to-date Publishing build scan... https://gradle.com/s/me5n3ydpf4qxi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
