See <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/1505/display/redirect?page=changes>
Changes: [michal.walenia] BEAM-6627 Move IOITMetrics to a common test package, move BQ options to [michal.walenia] [BEAM-6627] Add metric reporting to JdbcIOIT [michal.walenia] [BEAM-6627] Add metrics gathering and reporting to MongoDBIOIT. Modify [michal.walenia] [BEAM-6627] Add metrics gathering and reporting to ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 59dc930e2dc114cf379da1512eedd900aa185a05 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 59dc930e2dc114cf379da1512eedd900aa185a05 Commit message: "Merge pull request #8159: [Beam-6627] Metric gathering and reporting in JDBC, MongoDB and HadoopInputFormat IOITs." > git rev-list --no-walk c8a8c12fb2dd92ef8ebc47f0cd4038039298ce76 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins104015926382797034.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"] Fetching cluster endpoint and auth data. DEBUG: Saved kubeconfig to /home/jenkins/.kube/config kubeconfig entry generated for io-datastores. INFO: Display format: "default" DEBUG: SDK update checks are disabled. [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins743437587604166885.sh + cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/config-beam-performancetests-mongodbio-it-1505> [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins1330101340295561222.sh + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/config-beam-performancetests-mongodbio-it-1505> create namespace beam-performancetests-mongodbio-it-1505 namespace/beam-performancetests-mongodbio-it-1505 created [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins1682002998677898399.sh ++ kubectl config current-context + kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/config-beam-performancetests-mongodbio-it-1505> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-mongodbio-it-1505 Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified. [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins369206178173780801.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker> [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins588467929717336316.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env> [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins1384172769204019302.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env> Using base prefix '/usr' New python executable in <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env/bin/python3> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env/bin/python> Installing setuptools, pip, wheel... done. [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins6419957453312022339.sh + <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3) [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins736025180328052651.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker'...> [beam_PerformanceTests_MongoDBIO_IT] $ /bin/bash -xe /tmp/jenkins8858625306817764033.sh + <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 14)) Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 15)) Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0) Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 17)) Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 18)) Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 19)) Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 20)) Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 21)) Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 22)) Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_MongoDBIO_IT/ws/PerfKitBenchmarker/requirements.txt> (line 23)) Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz Complete output from command python setup.py egg_info: This backport is for Python 2.7 only. ---------------------------------------- Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-2m006vsk/functools32/ Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
