See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/2755/display/redirect>
Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 Commit message: "[BEAM-9344] Add support for bundle finalization execution to the Beam Java SDK. (#10910)" > git rev-list --no-walk a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5640531336798630998.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4649943646253722195.sh + <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-avroioit-hdfs-2755 + KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";'> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=default' + createNamespace beam-performancetests-avroioit-hdfs-2755 + eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> create namespace beam-performancetests-avroioit-hdfs-2755' ++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> create namespace beam-performancetests-avroioit-hdfs-2755 namespace/beam-performancetests-avroioit-hdfs-2755 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7477709740863292226.sh + <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> + KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";'> + KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755 + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755' + apply <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> + eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 apply -R -f <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml'> ++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 apply -R -f <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> service/hadoop created service/hadoop-datanodes created statefulset.apps/datanode created pod/namenode-0 created [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3397484549467956695.sh + set -eo pipefail + eval <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop ++ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop + sed 's/^/LOAD_BALANCER_IP=/' + KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";'> + KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755 + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755' + loadBalancerIP hadoop + local name=hadoop + local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755";> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=35.223.38.101 + local status=0 + [[ 0 == 0 ]] + [[ -n 35.223.38.101 ]] + echo 35.223.38.101 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g --info -DintegrationTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=avroioit_hdfs_results","--numberOfRecords=225000000","--expectedHash=2f9f5ca33ea464b25109c0297eb6aecb","--datasetSize=1089730000","--numWorkers=5","--autoscalingAlgorithm=NONE","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.223.38.101:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.223.38.101:9000/TEXTIO_IT_"] -Dfilesystem=hdfs -DintegrationTestRunner=dataflow :sdks:java:io:file-based-io-tests:integrationTest --tests org.apache.beam.sdk.io.avro.AvroIOIT Initialized native services in: /home/jenkins/.gradle/native The client will now receive all logging from the daemon (pid: 32021). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-32021.out.log Starting 2nd build in daemon [uptime: 4 mins 32.247 secs, performance: 100%] Using 12 worker leases. Starting Build Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days). > Configure project :buildSrc Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/build.gradle'.> Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Selected primary task 'build' from project : file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found :buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:compileJava NO-SOURCE file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/java',> not found Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files. :buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs. :buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:compileGroovy FROM-CACHE Build cache key for task ':buildSrc:compileGroovy' is c9d6a614e8994d7607cb326e2478af42 Task ':buildSrc:compileGroovy' is not up-to-date because: No history is available. Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@7ebb7210: {executionTime=3736, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=ro26qu3pczaz3nuvzxdqlp3kti, creationTime=1582330916584, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src/buildSrc} Unpacked trees for task ':buildSrc:compileGroovy' from cache. :buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.05 secs. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:pluginDescriptors Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710 Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task Task ':buildSrc:pluginDescriptors' is not up-to-date because: No history is available. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs. :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:processResources file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816 Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task Task ':buildSrc:processResources' is not up-to-date because: No history is available. file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:classes Skipping task ':buildSrc:classes' as it has no actions. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs. :buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started. The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=4b3f3d9f-4674-4bcc-b169-983aba6897a0, currentDir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 32021 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-32021.out.log ----- Last 20 lines from daemon log file - daemon-32021.out.log ----- :buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.05 secs. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started. Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710 Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task Task ':buildSrc:pluginDescriptors' is not up-to-date because: No history is available. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs. :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started. file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816 Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task Task ':buildSrc:processResources' is not up-to-date because: No history is available. file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started. Skipping task ':buildSrc:classes' as it has no actions. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs. :buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started. Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :buildSrc:jar Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
