See <https://builds.apache.org/job/beam_PerformanceTests_Analysis/468/display/redirect?page=changes>
Changes: [ankurgoenka] [BEAM-7856] Suppress error on table bigquery table already exists [heejong] [BEAM-7667] report GCS throttling time to Dataflow autoscaler [kedin] Refactor release guide. [mxm] [BEAM-7420]: Allow including the flink runner without flink on the [chamikara] [BEAM-7866] Fix python ReadFromMongoDB potential data loss issue ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision b7bca84e8250bb7fc7d3245af55c8b671fab4736 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f b7bca84e8250bb7fc7d3245af55c8b671fab4736 Commit message: "Merge pull request #9319 from akedin/refactor-release-guide" > git rev-list --no-walk 946596b32c06419209ef157dcc742d6189b1c4f4 # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins5382784024886618479.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7275865536335571037.sh + rm -rf .env [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins3673958400413876649.sh + virtualenv .env --python=python2.7 --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins484845002099519031.sh + .env/bin/pip install --upgrade setuptools pip DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (41.1.0.post1) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (19.2.2) [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7600380963938432907.sh + .env/bin/pip install requests google.cloud.bigquery mock google.cloud.bigtable google.cloud DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (2.9.1) Collecting google.cloud.bigquery Using cached https://files.pythonhosted.org/packages/35/ef/a926bcbd1aaff3ea15b0a116ae56af524a969388a46e3343d7d5fd528cc9/google_cloud_bigquery-1.18.0-py2.py3-none-any.whl Collecting mock Using cached https://files.pythonhosted.org/packages/05/d2/f94e68be6b17f46d2c353564da56e6fb89ef09faeeff3313a046cb810ca9/mock-3.0.5-py2.py3-none-any.whl Collecting google.cloud.bigtable Using cached https://files.pythonhosted.org/packages/24/a7/8025eefc5b9b43c656bb1fd9df9ee8da2c849107515e68fae425e8c01036/google_cloud_bigtable-0.34.0-py2.py3-none-any.whl Collecting google.cloud Using cached https://files.pythonhosted.org/packages/ba/b1/7c54d1950e7808df06642274e677dbcedba57f75307adf2e5ad8d39e5e0e/google_cloud-0.34.0-py2.py3-none-any.whl Collecting google-resumable-media>=0.3.1 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl Collecting google-cloud-core<2.0dev,>=1.0.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/ee/f0/084f598629db8e6ec3627688723875cdb03637acb6d86999bb105a71df64/google_cloud_core-1.0.3-py2.py3-none-any.whl Collecting protobuf>=3.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c7/60/19c2c3b563c8a5ebbc5f17982fd794f415cfc4633a8248ab3e23a47662bc/protobuf-3.9.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting enum34; python_version < "3.4" (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl Collecting funcsigs>=1; python_version < "3.3" (from mock) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Requirement already satisfied: six in /usr/lib/python2.7/dist-packages (from mock) (1.10.0) Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0 (from google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/71/e5/7059475b3013a3c75abe35015c5761735ab224eb1b129fee7c8e376e7805/google_api_core-1.14.2-py2.py3-none-any.whl Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 (from google.cloud.bigtable) Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf>=3.6.0->google.cloud.bigquery) (41.1.0.post1) Collecting googleapis-common-protos<2.0dev,>=1.6.0 (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl Collecting pytz (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/87/76/46d697698a143e05f77bec5a526bf4e56a0be61d63425b68f4ba553b51f2/pytz-2019.2-py2.py3-none-any.whl Collecting futures>=3.2.0; python_version < "3.2" (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl Collecting grpcio<2.0dev,>=1.8.2; extra == "grpc" (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/a5/46/5d08b6e26748ed6f3b5e93d980ea5daa63c3a8200b2ad270645b0e2f9566/grpcio-1.22.0-cp27-cp27mu-manylinux1_x86_64.whl Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/2f/a6/30b0a0bef12283e83e58c1d6e7b5aabc7acfc4110df81a4471655d33e704/cachetools-3.1.1-py2.py3-none-any.whl Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/be/70/e5ea8afd6d08a4b99ebfc77bd1845248d56cfcf43d11f9dc324b9580a35c/pyasn1_modules-0.2.6-py2.py3-none-any.whl Collecting pyasn1>=0.1.3 (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/6a/6e/209351ec34b7d7807342e2bb6ff8a96eef1fd5dcac13bdbadf065c2bb55c/pyasn1-0.4.6-py2.py3-none-any.whl ERROR: google-api-core 1.14.2 has requirement requests<3.0.0dev,>=2.18.0, but you'll have requests 2.9.1 which is incompatible. Installing collected packages: google-resumable-media, protobuf, googleapis-common-protos, pyasn1, rsa, cachetools, pyasn1-modules, google-auth, pytz, futures, enum34, grpcio, google-api-core, google-cloud-core, google.cloud.bigquery, funcsigs, mock, grpc-google-iam-v1, google.cloud.bigtable, google.cloud Successfully installed cachetools-3.1.1 enum34-1.1.6 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.14.2 google-auth-1.6.3 google-cloud-core-1.0.3 google-resumable-media-0.3.2 google.cloud google.cloud.bigquery google.cloud.bigtable googleapis-common-protos-1.6.0 grpc-google-iam-v1-0.12.3 grpcio-1.22.0 mock-3.0.5 protobuf-3.9.1 pyasn1-0.4.6 pyasn1-modules-0.2.6 pytz-2019.2 rsa-4.0 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins8471010087583390513.sh + .env/bin/python src/.test-infra/jenkins/verify_performance_test_results_test.py Traceback (most recent call last): File "src/.test-infra/jenkins/verify_performance_test_results_test.py", line 26, in <module> from verify_performance_test_results import create_report File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src/.test-infra/jenkins/verify_performance_test_results.py";,> line 43, in <module> from google.cloud import bigquery File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/__init__.py";,> line 35, in <module> from google.cloud.bigquery.client import Client File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/client.py";,> line 40, in <module> from google.resumable_media.requests import MultipartUpload File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/resumable_media/requests/__init__.py";,> line 673, in <module> six.raise_from(new_exc, caught_exc) File "/usr/lib/python2.7/dist-packages/six.py", line 718, in raise_from raise value ImportError: ``requests >= 2.18.0`` is required by the ``google.resumable_media.requests`` subpackage. It can be installed via pip install google-resumable-media[requests]. Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org
