See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3761/display/redirect>
Changes: ------------------------------------------ GitHub pull request #26327 of commit cb9ead19de5f929d741d025cc1ff2bba05afe9f2, no merge conflicts. Running as SYSTEM Setting status of cb9ead19de5f929d741d025cc1ff2bba05afe9f2 to PENDING with url https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3761/ and message: 'Build started for merge commit.' Using context: Java KafkaIO Performance Test [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-4 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Using shallow clone with depth 1 Avoid fetching tags Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --no-tags --force --progress --depth=1 -- > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Using shallow fetch with depth 1 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --no-tags --force --progress --depth=1 -- > https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* > +refs/pull/26327/*:refs/remotes/origin/pr/26327/* # timeout=10 > git rev-parse refs/remotes/origin/pr/26327/merge^{commit} # timeout=10 Checking out Revision 21363fcd31a9695a88e827241f511605fbfb92dd (refs/remotes/origin/pr/26327/merge) > git config core.sparsecheckout # timeout=10 > git checkout -f 21363fcd31a9695a88e827241f511605fbfb92dd # timeout=10 Commit message: "Merge cb9ead19de5f929d741d025cc1ff2bba05afe9f2 into d7f387fbe84b9672899de05f3613c445542d0307" > git rev-list --no-walk 463a805498d6b2fbf3e4b754c0b2379d5e4ed089 # timeout=10 First time build. Skipping changelog. No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SETUPTOOLS_USE_DISTUTILS=stdlib SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins6453180980749688030.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a Fetching cluster endpoint and auth data. CRITICAL: ACTION REQUIRED: gke-gcloud-auth-plugin, which is needed for continued use of kubectl, was not found or is not executable. Install gke-gcloud-auth-plugin for use with kubectl by following https://cloud.google.com/blog/products/containers-kubernetes/kubectl-auth-changes-in-gke kubeconfig entry generated for io-datastores. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins2966862028779603643.sh + cp /home/jenkins/.kube/config <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins8936910104772004034.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-kafka-io-3761 + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=default' + createNamespace beam-performancetests-kafka-io-3761 + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> create namespace beam-performancetests-kafka-io-3761' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> create namespace beam-performancetests-kafka-io-3761 namespace/beam-performancetests-kafka-io-3761 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3761 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins2199765791055298155.sh + set -xo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32400 32767 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32400 32767 + sed 's/^/KAFKA_SERVICE_PORT_0=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3761 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761' + getAvailablePort 32400 32767 + local lowRangePort=32401 + local highRangePort=32767 + local used=false + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' + local usedPorts ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o 'go-template={{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}' + usedPorts=31977 + local availablePort=32401 ++ seq 32401 32767 + for i in $(seq $lowRangePort $highRangePort) + IFS= + read -r usedPort + '[' 32401 = 31977 ']' + IFS= + read -r usedPort + false + echo 32401 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins5175713740905782774.sh + set -xo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32401 32767 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32401 32767 + sed 's/^/KAFKA_SERVICE_PORT_1=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3761 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761' + getAvailablePort 32401 32767 + local lowRangePort=32402 + local highRangePort=32767 + local used=false + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' + local usedPorts ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o 'go-template={{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}' + usedPorts=31977 + local availablePort=32402 ++ seq 32402 32767 + for i in $(seq $lowRangePort $highRangePort) + IFS= + read -r usedPort + '[' 32402 = 31977 ']' + IFS= + read -r usedPort + false + echo 32402 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins28078887028566154.sh + set -xo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32402 32767 ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> getAvailablePort 32402 32767 + sed 's/^/KAFKA_SERVICE_PORT_2=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3761 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761' + getAvailablePort 32402 32767 + local lowRangePort=32403 + local highRangePort=32767 + local used=false + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' + local usedPorts ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o go-template='\''{{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 get svc --all-namespaces -o 'go-template={{range .items}}{{range.spec.ports}}{{if .nodePort}}{{.nodePort}}{{"\n"}}{{end}}{{end}}{{end}}' + usedPorts=31977 + local availablePort=32403 ++ seq 32403 32767 + for i in $(seq $lowRangePort $highRangePort) + IFS= + read -r usedPort + '[' 32403 = 31977 ']' + IFS= + read -r usedPort + false + echo 32403 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins2072364199488149292.sh + sed -i -e s/32400/32401/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins7347331843779993378.sh + sed -i -e s/32401/32402/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins4614625202644307443.sh + sed -i -e s/32402/32403/ <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml> [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins3701239508339011647.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-3761 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-3761> --namespace=beam-performancetests-kafka-io-3761 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> storageclass.storage.k8s.io/kafka-broker unchanged storageclass.storage.k8s.io/kafka-zookeeper unchanged clusterrole.rbac.authorization.k8s.io/node-reader unchanged clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured role.rbac.authorization.k8s.io/pod-labler created rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created configmap/zookeeper-config created service/pzoo created service/zookeeper created statefulset.apps/pzoo created configmap/broker-config created service/broker created service/bootstrap created statefulset.apps/kafka created configmap/kafka-config created job.batch/kafka-config-eff079ec created Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml";>: Service "outside-0" is invalid: spec.ports[0].nodePort: Invalid value: 32401: provided port is already allocated Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml";>: Service "outside-1" is invalid: spec.ports[0].nodePort: Invalid value: 32402: provided port is already allocated Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml";>: Service "outside-2" is invalid: spec.ports[0].nodePort: Invalid value: 32403: provided port is already allocated Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
