See <https://builds.apache.org/job/beam_python_mongoio_load_test/8/display/redirect?page=changes>
Changes: [dcavazos] [BEAM-7390] Add code snippet for Mean [nielm] Add limit on number of mutated rows to batching/sorting stages. [heejong] [BEAM-8903] handling --jar_packages experimental flag in PortableRunner [michal.walenia] [BEAM-8895] Add BigQuery table name sanitization to BigQueryIOIT [michal.walenia] [BEAM-8918] Split batch BQIOIT into avro and json using tests [github] Changing RowAsDictJsonCoder implementation for efficiency (#10300) [github] Merge pull request #10151: [BEAM-7116] Remove use of KV in Schema ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-15 (beam) in workspace <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 166c6de33f2491c4c9bd27511cc71e33f8d2a894 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 166c6de33f2491c4c9bd27511cc71e33f8d2a894 Commit message: "Merge pull request #10307: [BEAM-8903] handling --jar_packages experimental flag in PortableRunner" > git rev-list --no-walk 8066d78f0fd2237b718859d4a776511203880df0 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_python_mongoio_load_test] $ /bin/bash -xe /tmp/jenkins7856813917040731314.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBECONFIG="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> [EnvInject] - Variables injected successfully. [beam_python_mongoio_load_test] $ /bin/bash -xe /tmp/jenkins7588169706643577302.sh + <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-python-mongoio-load-test-8 + KUBECONFIG='"<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"'> + KUBERNETES_NAMESPACE=default + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=default' + createNamespace beam-python-mongoio-load-test-8 + eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> create namespace beam-python-mongoio-load-test-8' ++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> create namespace beam-python-mongoio-load-test-8 namespace/beam-python-mongoio-load-test-8 created [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content KUBERNETES_NAMESPACE=beam-python-mongoio-load-test-8 [EnvInject] - Variables injected successfully. [beam_python_mongoio_load_test] $ /bin/bash -xe /tmp/jenkins2965484789128200965.sh + <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/mongodb/load-balancer/mongo.yml> + KUBECONFIG='"<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"'> + KUBERNETES_NAMESPACE=beam-python-mongoio-load-test-8 + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8' + apply <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/mongodb/load-balancer/mongo.yml> + eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 apply -R -f <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/mongodb/load-balancer/mongo.yml'> ++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 apply -R -f <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/mongodb/load-balancer/mongo.yml> service/mongo-load-balancer-service created replicationcontroller/mongo created [beam_python_mongoio_load_test] $ /bin/bash -xe /tmp/jenkins8600709519167009704.sh + set -eo pipefail + eval <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP mongo-load-balancer-service + sed 's/^/LOAD_BALANCER_IP=/' ++ <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP mongo-load-balancer-service + KUBECONFIG='"<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"'> + KUBERNETES_NAMESPACE=beam-python-mongoio-load-test-8 + KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8' + loadBalancerIP mongo-load-balancer-service + local name=mongo-load-balancer-service + local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + retry 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10 + local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' + local max_retries=36 + local sleep_time=10 + (( i = 1 )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 1 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 2 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 3 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output= + local status=0 + [[ 0 == 0 ]] + [[ -n '' ]] + [[ 4 == \3\6 ]] + sleep 10 + (( i++ )) + (( i <= max_retries )) + local output ++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8"> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' +++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_python_mongoio_load_test/ws/config-beam-python-mongoio-load-test-8> --namespace=beam-python-mongoio-load-test-8 get svc mongo-load-balancer-service '-ojsonpath={.status.loadBalancer.ingress[0].ip}' + output=34.66.22.249 + local status=0 + [[ 0 == 0 ]] + [[ -n 34.66.22.249 ]] + echo 34.66.22.249 + return 0 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'job.properties' [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_python_mongoio_load_test/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g "-Popts=--temp_location=gs://temp-storage-for-perf-tests/loadtests --project=apache-beam-testing --mongo_uri=mongodb://34.66.22.249:27017 --num_documents=1000000 --batch_size=10000 --runner=DataflowRunner --num_workers=5" :sdks:python:test-suites:dataflow:py35:mongodbioIT Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy > Task :buildSrc:spotlessGroovyCheck > Task :buildSrc:spotlessGroovyGradle > Task :buildSrc:spotlessGroovyGradleCheck > Task :buildSrc:spotlessCheck > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties FROM-CACHE > Task :buildSrc:check > Task :buildSrc:build Configuration on demand is an incubating feature. FAILURE: Build failed with an exception. * What went wrong: Task 'mongodbioIT' not found in project ':sdks:python:test-suites:dataflow:py35'. * Try: Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 11s Publishing build scan... https://scans.gradle.com/s/x2niaxo7eizea Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
