See 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3233/display/redirect?page=changes>

Changes:

[noreply] Revert "Update BQIO to a single scheduled executor service reduce

[noreply] Updates Python test expansion service to use Cloud Pickle (#23786)


------------------------------------------
[...truncated 11.32 KB...]
+ getAvailablePort 32402 32767
+ local lowRangePort=32403
+ local highRangePort=32767
+ local used=false
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc --all-namespaces -o   
go-template='\''{{range .items}}{{range.spec.ports}}{{if 
.nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\'''
+ local usedPorts
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc --all-namespaces -o   
go-template='\''{{range .items}}{{range.spec.ports}}{{if 
.nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc --all-namespaces -o 
'go-template={{range .items}}{{range.spec.ports}}{{if 
.nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'
+ usedPorts='31620
32323
31287
31209
32603
31035
32436
31977
31673
30673
31374
31000
30306'
+ local availablePort=32403
++ seq 32403 32767
+ for i in $(seq $lowRangePort $highRangePort)
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31620 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 32323 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31287 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31209 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 32603 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31035 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 32436 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31977 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31673 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 30673 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31374 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 31000 ']'
+ IFS=
+ read -r usedPort
+ '[' 32403 = 30306 ']'
+ IFS=
+ read -r usedPort
+ false
+ echo 32403
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 
'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins4587365336309102736.sh
+ sed -i -e s/32400/32401/ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins6576052971214167682.sh
+ sed -i -e s/32401/32402/ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins2409495545306258673.sh
+ sed -i -e s/32402/32403/ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml>
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins8416257081044173807.sh
+ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 apply 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
+ 
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3233
+ KUBECTL='kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233'
+ apply 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
+ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 apply -R -f 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'>
++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 apply -R -f 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster>
storageclass.storage.k8s.io/kafka-broker unchanged
storageclass.storage.k8s.io/kafka-zookeeper unchanged
clusterrole.rbac.authorization.k8s.io/node-reader unchanged
clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured
role.rbac.authorization.k8s.io/pod-labler created
rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created
configmap/zookeeper-config created
service/pzoo created
service/zookeeper created
statefulset.apps/pzoo created
service/outside-0 created
service/outside-1 created
service/outside-2 created
configmap/broker-config created
service/broker created
service/bootstrap created
statefulset.apps/kafka created
configmap/kafka-config created
job.batch/kafka-config-eff079ec created
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins6329467670158199621.sh
+ set -eo pipefail
+ eval 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-0
++ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-0
+ sed 's/^/KAFKA_BROKER_0=/'
+ 
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3233
+ KUBECTL='kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233'
+ loadBalancerIP outside-0
+ local name=outside-0
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 1 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 2 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 3 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-0 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=34.132.153.166
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 34.132.153.166 ]]
+ echo 34.132.153.166
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 
'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins6284288485035417815.sh
+ set -eo pipefail
+ eval 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-1
++ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-1
+ sed 's/^/KAFKA_BROKER_1=/'
+ 
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3233
+ KUBECTL='kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233'
+ loadBalancerIP outside-1
+ local name=outside-1
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-1 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-1 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-1 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-1 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-1 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=34.170.29.191
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 34.170.29.191 ]]
+ echo 34.170.29.191
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 
'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins8848238823379376139.sh
+ set -eo pipefail
+ eval 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-2
++ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 loadBalancerIP outside-2
+ sed 's/^/KAFKA_BROKER_2=/'
+ 
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3233
+ KUBECTL='kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233'
+ loadBalancerIP outside-2
+ local name=outside-2
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 1 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
-ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 get svc outside-2 
'-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=35.223.58.172
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 35.223.58.172 ]]
+ echo 35.223.58.172
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 
'job.properties'
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe 
/tmp/jenkins1123080400106516800.sh
+ eval 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 waitForJob job.batch/kafka-config-eff079ec 40m
++ 
<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh>
 waitForJob job.batch/kafka-config-eff079ec 40m
+ 
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
+ KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3233
+ KUBECTL='kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233'
+ waitForJob job.batch/kafka-config-eff079ec 40m
+ echo 'Waiting for job completion...'
Waiting for job completion...
+ jobName=job.batch/kafka-config-eff079ec
+ eval 'kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 wait --for=condition=complete 
--timeout=40m job.batch/kafka-config-eff079ec'
++ kubectl 
--kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3233>
 --namespace=beam-performancetests-kafka-io-3233 wait --for=condition=complete 
--timeout=40m job.batch/kafka-config-eff079ec
error: timed out waiting for the condition on jobs/kafka-config-eff079ec
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to