See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/2640/display/redirect?page=changes>
Changes: [Etienne Chauchot] [BEAM-12591] Put Spark Structured Streaming runner sources back to main [Etienne Chauchot] [BEAM-12629] As spark DataSourceV2 is only available for spark 2, [Etienne Chauchot] [BEAM-12627] Deal with spark Encoders braking change between spark 2 and [Etienne Chauchot] [BEAM-12591] move SchemaHelpers to correct package [Etienne Chauchot] [BEAM-8470] Disable wait for termination in a streaming pipeline because [Etienne Chauchot] [BEAM-12630] Deal with breaking change in streaming pipelines start by [Etienne Chauchot] [BEAM-12629] Make source tests spark version agnostic and move them back [Etienne Chauchot] [BEAM-12629] Make a spark 3 source impl [Etienne Chauchot] [BEAM-12591] Fix checkstyle and spotless [Etienne Chauchot] [BEAM-12629] Reduce serializable to only needed classes and Fix schema [Etienne Chauchot] [BEAM-12591] Add checkstyle exceptions for version specific classes [Etienne Chauchot] [BEAM-12629] Fix sources javadocs and improve impl [Etienne Chauchot] [BEAM-12591] Add spark 3 to structured streaming validates runner tests [noreply] [BEAM-6516] Fixes race condition in RabbitMqIO causing duplicate acks ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.7.4' > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 291aa6c98004d3157658205dfbacd6352bf909a4 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 291aa6c98004d3157658205dfbacd6352bf909a4 # timeout=10 Commit message: "[BEAM-6516] Fixes race condition in RabbitMqIO causing duplicate acks (#15157)" > git rev-list --no-walk 39cf3fccbb3950b9fd0c8938301d192c3ca85cce # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins681990489553994439.sh + cp /home/jenkins/.kube/config <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins3060749608667627630.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a Fetching cluster endpoint and auth data. kubeconfig entry generated for io-datastores. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins685342980581262547.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-kafka-io-2640 + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> --namespace=default' + createNamespace beam-performancetests-kafka-io-2640 + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> create namespace beam-performancetests-kafka-io-2640' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> create namespace beam-performancetests-kafka-io-2640 namespace/beam-performancetests-kafka-io-2640 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2640 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Kafka_IO] $ /bin/bash -xe /tmp/jenkins5511735933583113010.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> + KUBERNETES_NAMESPACE=beam-performancetests-kafka-io-2640 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> --namespace=beam-performancetests-kafka-io-2640' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> --namespace=beam-performancetests-kafka-io-2640 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/config-beam-performancetests-kafka-io-2640> --namespace=beam-performancetests-kafka-io-2640 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster> storageclass.storage.k8s.io/kafka-broker unchanged storageclass.storage.k8s.io/kafka-zookeeper unchanged clusterrole.rbac.authorization.k8s.io/node-reader unchanged clusterrolebinding.rbac.authorization.k8s.io/kafka-node-reader configured role.rbac.authorization.k8s.io/pod-labler created rolebinding.rbac.authorization.k8s.io/kafka-pod-labler created configmap/zookeeper-config created service/pzoo created service/zookeeper created statefulset.apps/pzoo created configmap/broker-config created service/broker created service/bootstrap created statefulset.apps/kafka created configmap/kafka-config created job.batch/kafka-config-eff079ec created Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-0.yml";>: Service "outside-0" is invalid: spec.ports[0].nodePort: Invalid value: 32400: provided port is already allocated Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-1.yml";>: Service "outside-1" is invalid: spec.ports[0].nodePort: Invalid value: 32401: provided port is already allocated Error from server (Invalid): error when creating "<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/.test-infra/kubernetes/kafka-cluster/04-outside-services/outside-2.yml";>: Service "outside-2" is invalid: spec.ports[0].nodePort: Invalid value: 32402: provided port is already allocated Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
