See <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/2047/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-10670] Update Samza to be opt-out for SplittableDoFn. [noreply] [BEAM-10616] Add missing ParDo test cases for streaming/Flink (#12848) [noreply] Bump versions of protobuf, shadow, other gradle plugins. (#12821) [Luke Cwik] [BEAM-10670] Update Jet runner to be opt-out for splittable DoFn [Luke Cwik] Update runners/jet/build.gradle [noreply] [BEAM-7523] Fix starting Kafka container twice in KafkaCSVTableIT ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-14 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision c8991ba9b65af2f547bad68a0ac327ce720eb00b (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f c8991ba9b65af2f547bad68a0ac327ce720eb00b # timeout=10 Commit message: "Merge pull request #12616 from lukecwik/beam10670.4" > git rev-list --no-walk 0f9d0020aaaa338c1916cba55b7877f4ae897e46 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins4443420361749061441.sh + cp /home/jenkins/.kube/config <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> [EnvInject] - Variables injected successfully. [beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins940902910230049523.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a Fetching cluster endpoint and auth data. kubeconfig entry generated for io-datastores. [beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins262338821748937933.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-hadoopformat-2047 + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=default' + createNamespace beam-performancetests-hadoopformat-2047 + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> create namespace beam-performancetests-hadoopformat-2047' ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> create namespace beam-performancetests-hadoopformat-2047 namespace/beam-performancetests-hadoopformat-2047 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins1696025858819687992.sh + <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> + KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047' + apply <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> + eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml'> ++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml> service/postgres-for-dev created replicationcontroller/postgres created [beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins7332536145322083374.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP postgres-for-dev ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP postgres-for-dev + sed 's/^/LOAD_BALANCER_IP=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> + KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047' + loadBalancerIP postgres-for-dev + local name=postgres-for-dev + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.222.222.106 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.222.222.106 ]] + echo 35.222.222.106 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses --info -DintegrationTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--numberOfRecords=600000","--bigQueryDataset=beam_performance","--bigQueryTable=hadoopformatioit_results","--influxMeasurement=hadoopformatioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--postgresUsername=postgres","--postgresPassword=uuinkks","--postgresDatabaseName=postgres","--postgresServerName=35.222.222.106","--postgresSsl=false","--postgresPort=5432","--numWorkers=5","--autoscalingAlgorithm=NONE";] -DintegrationTestRunner=dataflow :sdks:java:io:hadoop-format:integrationTest --tests org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT Initialized native services in: /home/jenkins/.gradle/native Removing 0 daemon stop events from registry Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/6.6.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xmx4g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-6.6.1-all/ejrtlte9hlw8v6ii20a9584rs/gradle-6.6.1/lib/gradle-launcher-6.6.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 6.6.1 Successfully started process 'Gradle build daemon' An attempt to start the daemon took 1.051 secs. The client will now receive all logging from the daemon (pid: 23781). The daemon log file: /home/jenkins/.gradle/daemon/6.6.1/daemon-23781.out.log Starting build in new daemon [memory: 3.8 GB] Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using 12 **** leases. Starting Build Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download6195273482182382305bin Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download1182227911377372185bin Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download1281300065043774653bin FAILURE: Build failed with an exception. * What went wrong: Could not resolve all artifacts for configuration 'classpath'. > Could not download gradle-enterprise-gradle-plugin-3.4.1.jar > (com.gradle:gradle-enterprise-gradle-plugin:3.4.1) > Could not get resource 'https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar'. > Read timed out * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 5m 23s Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
