See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3283/display/redirect?page=changes>
Changes: [ahmedabualsaud] emit load job IDs as soon as they come up [ahmedabualsaud] style fix [noreply] Concept guide on orchestrating Beam preprocessing (#23094) [noreply] Initial draft of Batched DoFn user guide (#23909) [noreply] WIP: Dataframe API ML preprocessing notebook (#22587) ------------------------------------------ [...truncated 13.97 KB...] 32603 31035 32436 31977 31165 30556 31374 31000 30306' + local availablePort=32406 ++ seq 32406 32767 + for i in $(seq $lowRangePort $highRangePort) + IFS= + read -r usedPort + '[' 32406 = 32357 ']' + IFS= + read -r usedPort + '[' 32406 = 32401 ']' + IFS= + read -r usedPort + '[' 32406 = 32402 ']' + IFS= + read -r usedPort + '[' 32406 = 32403 ']' + IFS= + read -r usedPort + '[' 32406 = 31620 ']' + IFS= + read -r usedPort + '[' 32406 = 32323 ']' + IFS= + read -r usedPort + '[' 32406 = 31287 ']' + IFS= + read -r usedPort + '[' 32406 = 31209 ']' + IFS= + read -r usedPort + '[' 32406 = 32603 ']' + IFS= + read -r usedPort + '[' 32406 = 31035 ']' + IFS= + read -r usedPort + '[' 32406 = 32436 ']' + IFS= + read -r usedPort + '[' 32406 = 31977 ']' + IFS= + read -r usedPort + '[' 32406 = 31165 ']' + IFS= + read -r usedPort + '[' 32406 = 30556 ']' + IFS= + read -r usedPort + '[' 32406 = 31374 ']' + IFS= + read -r usedPort + '[' 32406 = 31000 ']' + IFS= + read -r usedPort + '[' 32406 = 30306 ']' + IFS= + read -r usedPort + false + echo 32406 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4043075182999221752.sh + sed -i -e s/32400/32404/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins5470533000658056826.sh + sed -i -e s/32401/32405/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins7830934460189262527.sh + sed -i -e s/32402/32406/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins1335259021001636922.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3283 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> storageclass.storage.k8s.io/kafka-broker unchanged storageclass.storage.k8s.io/kafka-zookeeper unchanged clusterrole.rbac.authorization.k8s.io/node-reader unchanged clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured role.rbac.authorization.k8s.io/pod-labler created rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created configmap/zookeeper-config created service/pzoo created service/zookeeper created statefulset.apps/pzoo created service/outside-0 created service/outside-1 created service/outside-2 created configmap/broker-config created service/broker created service/bootstrap created statefulset.apps/kafka created configmap/kafka-config created job.batch/kafka-config-eff079ec created [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4817941528529100829.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-0 + sed 's/^/KAFKA_BROKER_0=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3283 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283' + loadBalancerIP outside-0 + local name=outside-0 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-0 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.69.69.160 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.69.69.160 ]] + echo 34.69.69.160 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins7963762672575803741.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-1 + sed 's/^/KAFKA_BROKER_1=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3283 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283' + loadBalancerIP outside-1 + local name=outside-1 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-1 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-1 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.232.72.213 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.232.72.213 ]] + echo 35.232.72.213 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins7050778170724658354.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP outside-2 + sed 's/^/KAFKA_BROKER_2=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3283 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283' + loadBalancerIP outside-2 + local name=outside-2 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-2 -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 get svc outside-2 '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.171.115.135 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.171.115.135 ]] + echo 34.171.115.135 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins242988516408890617.sh + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> waitForJob job.batch/kafka-config-eff079ec 40m + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3283 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283' + waitForJob job.batch/kafka-config-eff079ec 40m + echo 'Waiting for job completion...' Waiting for job completion... + jobName=job.batch/kafka-config-eff079ec + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3283> --namespace=beam-performancetests-kafka-io-3283 wait --for=condition=complete --timeout=40m job.batch/kafka-config-eff079ec error: timed out waiting for the condition on jobs/kafka-config-eff079ec Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
