See <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/3351/display/redirect?page=changes>
Changes: [noreply] Improving BQ IO documentation (#12280) ------------------------------------------ [...truncated 5.91 KB...] pod/namenode-0 created [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8985753573926027899.sh + set -eo pipefail + eval <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop ++ <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop + sed 's/^/LOAD_BALANCER_IP=/' + KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> + KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-3351 + KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351' + loadBalancerIP hadoop + local name=hadoop + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-3351> --namespace=beam-performancetests-avroioit-hdfs-3351 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=23.251.144.128 + local status=0 + [[ 0 == 0 ]] + [[ -n 23.251.144.128 ]] + echo 23.251.144.128 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses --info -DintegrationTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=avroioit_hdfs_results","--influxMeasurement=avroioit_hdfs_results","--numberOfRecords=225000000","--expectedHash=2f9f5ca33ea464b25109c0297eb6aecb","--datasetSize=1089730000","--numWorkers=5","--autoscalingAlgorithm=NONE","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:23.251.144.128:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://23.251.144.128:9000/TEXTIO_IT_";] -Dfilesystem=hdfs -DintegrationTestRunner=dataflow :sdks:java:io:file-based-io-tests:integrationTest --tests org.apache.beam.sdk.io.avro.AvroIOIT Initialized native services in: /home/jenkins/.gradle/native Removing 0 daemon stop events from registry Starting a Gradle Daemon, 2 busy Daemons could not be reused, use --status for details Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/5.2.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xmx4g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-5.2.1-all/bviwmvmbexq6idcscbicws5me/gradle-5.2.1/lib/gradle-launcher-5.2.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 5.2.1 Successfully started process 'Gradle build daemon' An attempt to start the daemon took 4.489 secs. The client will now receive all logging from the daemon (pid: 31116). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-31116.out.log Starting build in new daemon [memory: 3.8 GB] Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using 12 **** leases. Starting Build Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days). > Configure project :buildSrc Evaluating project ':buildSrc' using build file '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/build.gradle'.> Selected primary task 'build' from project : file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found :buildSrc:compileJava (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:compileJava NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/java',> not found Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files. :buildSrc:compileJava (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.174 secs. :buildSrc:compileGroovy (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:compileGroovy FROM-CACHE Build cache key for task ':buildSrc:compileGroovy' is 4e5a6fc7c8673cec55607918cc906210 Task ':buildSrc:compileGroovy' is not up-to-date because: No history is available. Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@33dcb958: {executionTime=2521, hostName=apache-ci-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=6e2ut5wavfafjkzsv2t25k3use, creationTime=1595484257024, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_Prober_CommunityMetrics/src/buildSrc} Unpacked trees for task ':buildSrc:compileGroovy' from cache. :buildSrc:compileGroovy (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.872 secs. :buildSrc:pluginDescriptors (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:pluginDescriptors Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710 Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task Task ':buildSrc:pluginDescriptors' is not up-to-date because: No history is available. :buildSrc:pluginDescriptors (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.073 secs. :buildSrc:processResources (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:processResources file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816 Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task Task ':buildSrc:processResources' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found :buildSrc:processResources (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.081 secs. :buildSrc:classes (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:classes Skipping task ':buildSrc:classes' as it has no actions. :buildSrc:classes (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.0 secs. :buildSrc:jar (Thread[Execution **** for ':buildSrc',5,main]) started. > Task :buildSrc:jar Build cache key for task ':buildSrc:jar' is bb800c4aa81e154af3651733c14a2965 Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the task Task ':buildSrc:jar' is not up-to-date because: No history is available. :buildSrc:jar (Thread[Execution **** for ':buildSrc',5,main]) completed. Took 0.783 secs. :buildSrc:assemble (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:assemble Skipping task ':buildSrc:assemble' as it has no actions. :buildSrc:assemble (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.0 secs. :buildSrc:spotlessGroovy (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:spotlessGroovy file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been enabled for the task Task ':buildSrc:spotlessGroovy' is not up-to-date because: No history is available. All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovy'. :buildSrc:spotlessGroovy (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 11.116 secs. :buildSrc:spotlessGroovyCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:spotlessGroovyCheck Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions. :buildSrc:spotlessGroovyCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.0 secs. :buildSrc:spotlessGroovyGradle (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:spotlessGroovyGradle Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not been enabled for the task Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because: No history is available. All input files are considered out-of-date for incremental task ':buildSrc:spotlessGroovyGradle'. :buildSrc:spotlessGroovyGradle (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.212 secs. :buildSrc:spotlessGroovyGradleCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:spotlessGroovyGradleCheck Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions. :buildSrc:spotlessGroovyGradleCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.0 secs. :buildSrc:spotlessCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) started. > Task :buildSrc:spotlessCheck Skipping task ':buildSrc:spotlessCheck' as it has no actions. :buildSrc:spotlessCheck (Thread[Execution **** for ':buildSrc' Thread 10,5,main]) completed. Took 0.0 secs. :buildSrc:pluginUnderTestMetadata (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) started. > Task :buildSrc:pluginUnderTestMetadata Build cache key for task ':buildSrc:pluginUnderTestMetadata' is 2d36a8dc4587eb463493956b794af53d Caching disabled for task ':buildSrc:pluginUnderTestMetadata': Caching has not been enabled for the task Task ':buildSrc:pluginUnderTestMetadata' is not up-to-date because: No history is available. :buildSrc:pluginUnderTestMetadata (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) completed. Took 2.921 secs. :buildSrc:compileTestJava (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) started. > Task :buildSrc:compileTestJava NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/java',> not found Skipping task ':buildSrc:compileTestJava' as it has no source files and no previous output files. :buildSrc:compileTestJava (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) completed. Took 0.008 secs. :buildSrc:compileTestGroovy (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) started. > Task :buildSrc:compileTestGroovy NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no previous output files. :buildSrc:compileTestGroovy (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) completed. Took 0.004 secs. :buildSrc:processTestResources (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) started. > Task :buildSrc:processTestResources NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/resources',> not found Skipping task ':buildSrc:processTestResources' as it has no source files and no previous output files. :buildSrc:processTestResources (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) completed. Took 0.002 secs. :buildSrc:testClasses (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) started. > Task :buildSrc:testClasses UP-TO-DATE Skipping task ':buildSrc:testClasses' as it has no actions. :buildSrc:testClasses (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) completed. Took 0.0 secs. :buildSrc:test (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) started. > Task :buildSrc:test NO-SOURCE Skipping task ':buildSrc:test' as it has no source files and no previous output files. :buildSrc:test (Thread[Execution **** for ':buildSrc' Thread 11,5,main]) completed. Took 0.015 secs. :buildSrc:validateTaskProperties (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) started. > Task :buildSrc:validateTaskProperties FROM-CACHE Build cache key for task ':buildSrc:validateTaskProperties' is c2cf0e0d19920d4df83f84a4542b21e8 Task ':buildSrc:validateTaskProperties' is not up-to-date because: No history is available. Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@7f27b88: {executionTime=278, hostName=apache-ci-beam-jenkins-3, operatingSystem=Linux, buildInvocationId=6e2ut5wavfafjkzsv2t25k3use, creationTime=1595484260298, identity=:validateTaskProperties, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_Prober_CommunityMetrics/src/buildSrc} Unpacked trees for task ':buildSrc:validateTaskProperties' from cache. :buildSrc:validateTaskProperties (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) completed. Took 0.06 secs. :buildSrc:check (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) started. > Task :buildSrc:check Skipping task ':buildSrc:check' as it has no actions. :buildSrc:check (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) completed. Took 0.0 secs. :buildSrc:build (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) started. > Task :buildSrc:build Skipping task ':buildSrc:build' as it has no actions. :buildSrc:build (Thread[Execution **** for ':buildSrc' Thread 7,5,main]) completed. Took 0.0 secs. FAILURE: Build failed with an exception. * What went wrong: Could not add entry ':jar' to cache executionHistory.bin (<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/.gradle/5.2.1/executionHistory/executionHistory.bin).> > java.io.IOException: No space left on device * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 46s Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
