See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3160/display/redirect?page=changes>
Changes: [Robert Bradshaw] Require time-bound flag for non-UW streaming Python jobs for new SDKs. [noreply] Fix JdbcIOIT, which seems to have never worked (#21796) [noreply] Support DECIMAL logical type in python SDK (#23014) ------------------------------------------ [...truncated 12.87 KB...] + usedPorts='32401 32402 32403 30374 32025 31996 30383 31620 30382 30763 30658 31888 30146 30114 31977' + local availablePort=32406 ++ seq 32406 32767 + for i in $(seq $lowRangePort $highRangePort) + IFS= + read -r usedPort + '[' 32406 = 32401 ']' + IFS= + read -r usedPort + '[' 32406 = 32402 ']' + IFS= + read -r usedPort + '[' 32406 = 32403 ']' + IFS= + read -r usedPort + '[' 32406 = 30374 ']' + IFS= + read -r usedPort + '[' 32406 = 32025 ']' + IFS= + read -r usedPort + '[' 32406 = 31996 ']' + IFS= + read -r usedPort + '[' 32406 = 30383 ']' + IFS= + read -r usedPort + '[' 32406 = 31620 ']' + IFS= + read -r usedPort + '[' 32406 = 30382 ']' + IFS= + read -r usedPort + '[' 32406 = 30763 ']' + IFS= + read -r usedPort + '[' 32406 = 30658 ']' + IFS= + read -r usedPort + '[' 32406 = 31888 ']' + IFS= + read -r usedPort + '[' 32406 = 30146 ']' + IFS= + read -r usedPort + '[' 32406 = 30114 ']' + IFS= + read -r usedPort + '[' 32406 = 31977 ']' + IFS= + read -r usedPort + false + echo 32406 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins3668154965217668664.sh + sed -i -e s/32400/32404/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins9058530217474807811.sh + sed -i -e s/32401/32405/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins6745419354439854466.sh + sed -i -e s/32402/32406/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins2079472017924693782.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3160 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> storageclass.storage.k8s.io/kafka-broker unchanged storageclass.storage.k8s.io/kafka-zookeeper unchanged clusterrole.rbac.authorization.k8s.io/node-reader unchanged clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured role.rbac.authorization.k8s.io/pod-labler created rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created configmap/zookeeper-config created service/pzoo created service/zookeeper created statefulset.apps/pzoo created service/outside-0 created service/outside-1 created service/outside-2 created configmap/broker-config created service/broker created service/bootstrap created statefulset.apps/kafka created configmap/kafka-config created job.batch/kafka-config-eff079ec created [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4069014603459158619.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0 + sed 's/^/KAFKA_BROKER_0=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3160 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160' + loadBalancerIP outside-0 + local name=outside-0 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.173.12.144 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.173.12.144 ]] + echo 34.173.12.144 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins376139004637933572.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 + sed 's/^/KAFKA_BROKER_1=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3160 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160' + loadBalancerIP outside-1 + local name=outside-1 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.68.22.166 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.68.22.166 ]] + echo 34.68.22.166 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4845869514037602996.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 + sed 's/^/KAFKA_BROKER_2=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3160 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160' + loadBalancerIP outside-2 + local name=outside-2 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.133.206.105 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.133.206.105 ]] + echo 34.133.206.105 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4773386923272267878.sh + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3160 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160' + waitForJob job.batch/kafka-config-eff079ec 40m + echo 'Waiting for job completion...' Waiting for job completion... + jobName=job.batch/kafka-config-eff079ec + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3160> --namespace=beam-performancetests-kafka-io-3160 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec error: timed out waiting for the condition on jobs/kafka-config-eff079ec Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
