See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/1506/display/redirect?page=changes>
Changes: [amaliujia] [BEAM-7051] Support LIMIT OFFSET. [kcweaver] [BEAM-7052] add optional environmentType and environmentConfig [pabloem] [BEAM-3072] Python command error handling improvements (#8158) [github] [BEAM-7063] Enable passing in the worker jar for all tests. (#8313) ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/> No credentials specified Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision e390d3c4fc7b71cedb36fc473d25221a9bb854d7 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f e390d3c4fc7b71cedb36fc473d25221a9bb854d7 Commit message: "[BEAM-7063] Enable passing in the worker jar for all tests. (#8313)" > git rev-list --no-walk 2581565fe96f2a1b4be01993831898afefb3e4c7 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1667561612948668953.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"] Fetching cluster endpoint and auth data. DEBUG: Saved kubeconfig to /home/jenkins/.kube/config kubeconfig entry generated for io-datastores. INFO: Display format: "default" DEBUG: SDK update checks are disabled. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4154169160977153220.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-1506> [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4470722921449535970.sh + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-1506> create namespace beam-performancetests-avroioit-hdfs-1506 namespace/beam-performancetests-avroioit-hdfs-1506 created [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1759788587613685879.sh ++ kubectl config current-context + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-1506> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-1506 Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1687499733449321130.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker> [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8623288955755095319.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins949206734247944958.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> Using base prefix '/usr' New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python3> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python> Installing setuptools, pip, wheel... done. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3305872440288396120.sh + <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3) [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4469906588087083014.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...> [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5196107713888333399.sh + <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14)) Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15)) Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0) Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17)) Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18)) Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19)) Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20)) Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21)) Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22)) Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23)) Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz Complete output from command python setup.py egg_info: This backport is for Python 2.7 only. ---------------------------------------- Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-zh0_0nhn/functools32/ Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org