See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2125/display/redirect?page=changes>
Changes: [rohde.samuel] Update V1Beta3 API and add DebugOptions [83289+avalanche123] [BEAM-12081] Fix AwsOptions Jackson (de)serialization of integer values [noreply] [BEAM-12069] Remove mock from base_image_requirements.txt (#14389) [noreply] [BEAM-5537] Allow google-cloud-bigquery 2.x (#14391) [noreply] Merge pull request #14274 from [BEAM-9547] Initial implementation for ------------------------------------------ [...truncated 12.13 KB...] + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 7 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 8 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 9 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 10 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.225.12.228 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.225.12.228 ]] + echo 35.225.12.228 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins5063411402179335474.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 + sed 's/^/KAFKA_BROKER_1=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2125 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125' + loadBalancerIP outside-1 + local name=outside-1 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.226.61.174 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.226.61.174 ]] + echo 35.226.61.174 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins191507352810163654.sh + set -eo pipefail + sed 's/^/KAFKA_BROKER_2=/' + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2125 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125' + loadBalancerIP outside-2 + local name=outside-2 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2125> --namespace=beam-performancetests-kafka-io-2125 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.224.77.68 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.224.77.68 ]] + echo 35.224.77.68 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses --info -DintegrationTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results","--influxMeasurement=kafkaioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=35.225.12.228:32400,35.226.61.174:32401,35.224.77.68:32402","--kafkaTopic=beam","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE";] -DintegrationTestRunner=dataflow :sdks:java:io:kafka:integrationTest --tests org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInBatch Initialized native services in: /home/jenkins/.gradle/native Removing 0 daemon stop events from registry Previous Daemon (26031) stopped at Thu Apr 01 18:23:34 UTC 2021 other compatible daemons were started and after being idle for 0 minutes and not recently used Starting a Gradle Daemon, 5 busy and 1 stopped Daemons could not be reused, use --status for details Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/6.8 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xmx4g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-6.8-bin/1jblhjyydfkclfzx1agp92nyl/gradle-6.8/lib/gradle-launcher-6.8.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 6.8 Successfully started process 'Gradle build daemon' An attempt to start the daemon took 3.42 secs. The client will now receive all logging from the daemon (pid: 1319). The daemon log file: /home/jenkins/.gradle/daemon/6.8/daemon-1319.out.log Starting build in new daemon [memory: 3.5 GiB] Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using 12 **** leases. Watching the file system is enabled Now considering [<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src]> as hierarchies to watch Starting Build FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Gradle could not start your build. > Could not create service of type ExecutionHistoryStore using > DependencyManagementGradleUserHomeScopeServices.createExecutionHistoryStore(). > Timeout waiting to lock execution history cache (/home/jenkins/.gradle/caches/6.8/executionHistory). It is currently in use by another Gradle instance. Owner PID: 2796 Our PID: 1319 Owner Operation: Our operation: Lock file: /home/jenkins/.gradle/caches/6.8/executionHistory/executionHistory.lock * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Timeout waiting to lock artifact cache (/home/jenkins/.gradle/caches/modules-2). It is currently in use by another Gradle instance. Owner PID: 2796 Our PID: 1319 Owner Operation: Our operation: Lock file: /home/jenkins/.gradle/caches/modules-2/modules-2.lock * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 2m 10s Watching 0 directories to track changes Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
