See <https://builds.apache.org/job/beam_PerformanceTests_Analysis/481/display/redirect?page=changes>
Changes: [kmj] Use consistent names for auto-generated GCP client artifacts. [kmj] Alphabetize imports of GCP library entries [kmj] Depend on proto- instead of grpc- package for google_cloud_bigtable [github] Update beam_fn_api.proto [katarzyna.kucharczyk] [BEAM-7528] Save metrics according to distribution name. [katarzyna.kucharczyk] [BEAM-7528] Refactor of load test utils and added documentation [kcweaver] [BEAM-7973] py: shut down Flink job server automatically [alex] [BEAM-7999] Fix BigQuery timestamp handling for Schema Aware PCollection [github] Update beam_fn_api.proto [zyichi] Add mongodbio to beam website io links [kamil.wasilewski] [BEAM-7872] Implement Flink class which takes responsibility of creating [kamil.wasilewski] [BEAM-7872] Rewrite create_flink_cluster.sh so that it supports other [heejong] [BEAM-8008] show error message from expansion service in Java External [je.ik] [BEAM-6127] upgrade junit dependency [markliu] [BEAM-8079] Move release build verification to Jenkins [kcweaver] [BEAM-8015] Get logs from Docker containers [dcavazos] [BEAM-7389] Update to use util.Regex transform [markliu] [BEAM-8079] Move release Gradle build to a Jenkins job (Part - 2) [altay] Removed unused arg from ToString.Element [kamil.wasilewski] [BEAM-7872] Create a class for publishing docker images [36090911+boyuanzz] Integrating ZetaSketch's HLL++ algorithm with Beam (#9144) [kcweaver] [BEAM-7864] Simplify/generalize Spark reshuffle translation [github] Revert #9319 - Changes to release guide (#9436) [chamikara] [BEAM-8023] Add value provider interfaces for BigQueryIO.Read using ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 5a62f948129f09d21461a527c1d8709e34fabbb5 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 5a62f948129f09d21461a527c1d8709e34fabbb5 Commit message: "Merge pull request #9369 from alexvanboxel/feature/BEAM-7999-bq-timestamp" > git rev-list --no-walk 842942ea499229dbe3e45653df9073955b4287f7 # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7257267816457896865.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins3025638784964486905.sh + rm -rf .env [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7703982831462690045.sh + virtualenv .env --python=python2.7 --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins1232159353934081751.sh + .env/bin/pip install --upgrade setuptools pip DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (41.2.0) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (19.2.3) [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins1084875756209214411.sh + .env/bin/pip install requests google.cloud.bigquery mock google.cloud.bigtable google.cloud DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (2.9.1) Collecting google.cloud.bigquery Using cached https://files.pythonhosted.org/packages/35/ef/a926bcbd1aaff3ea15b0a116ae56af524a969388a46e3343d7d5fd528cc9/google_cloud_bigquery-1.18.0-py2.py3-none-any.whl Collecting mock Using cached https://files.pythonhosted.org/packages/05/d2/f94e68be6b17f46d2c353564da56e6fb89ef09faeeff3313a046cb810ca9/mock-3.0.5-py2.py3-none-any.whl Collecting google.cloud.bigtable Using cached https://files.pythonhosted.org/packages/24/a7/8025eefc5b9b43c656bb1fd9df9ee8da2c849107515e68fae425e8c01036/google_cloud_bigtable-0.34.0-py2.py3-none-any.whl Collecting google.cloud Using cached https://files.pythonhosted.org/packages/ba/b1/7c54d1950e7808df06642274e677dbcedba57f75307adf2e5ad8d39e5e0e/google_cloud-0.34.0-py2.py3-none-any.whl Collecting google-resumable-media>=0.3.1 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/43/37/aa0cea2507f3a0ac5b3a0557272e07b1ec2802571408c4bd98699b08da09/google_resumable_media-0.3.3-py2.py3-none-any.whl Collecting google-cloud-core<2.0dev,>=1.0.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/ee/f0/084f598629db8e6ec3627688723875cdb03637acb6d86999bb105a71df64/google_cloud_core-1.0.3-py2.py3-none-any.whl Collecting protobuf>=3.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c7/60/19c2c3b563c8a5ebbc5f17982fd794f415cfc4633a8248ab3e23a47662bc/protobuf-3.9.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting enum34; python_version < "3.4" (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl Collecting funcsigs>=1; python_version < "3.3" (from mock) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Requirement already satisfied: six in /usr/lib/python2.7/dist-packages (from mock) (1.10.0) Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0 (from google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/71/e5/7059475b3013a3c75abe35015c5761735ab224eb1b129fee7c8e376e7805/google_api_core-1.14.2-py2.py3-none-any.whl Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 (from google.cloud.bigtable) Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf>=3.6.0->google.cloud.bigquery) (41.2.0) Collecting googleapis-common-protos<2.0dev,>=1.6.0 (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl Collecting pytz (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/87/76/46d697698a143e05f77bec5a526bf4e56a0be61d63425b68f4ba553b51f2/pytz-2019.2-py2.py3-none-any.whl Collecting futures>=3.2.0; python_version < "3.2" (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl Collecting grpcio<2.0dev,>=1.8.2; extra == "grpc" (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/d6/c3/65db90ec27181edf491c26aa998ae631e50cd1f04ee8d8d513a95e3937f3/grpcio-1.23.0-cp27-cp27mu-manylinux1_x86_64.whl Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/2f/a6/30b0a0bef12283e83e58c1d6e7b5aabc7acfc4110df81a4471655d33e704/cachetools-3.1.1-py2.py3-none-any.whl Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/be/70/e5ea8afd6d08a4b99ebfc77bd1845248d56cfcf43d11f9dc324b9580a35c/pyasn1_modules-0.2.6-py2.py3-none-any.whl Collecting pyasn1>=0.1.3 (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core[grpc]<2.0.0dev,>=1.14.0->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/6a/6e/209351ec34b7d7807342e2bb6ff8a96eef1fd5dcac13bdbadf065c2bb55c/pyasn1-0.4.6-py2.py3-none-any.whl ERROR: google-api-core 1.14.2 has requirement requests<3.0.0dev,>=2.18.0, but you'll have requests 2.9.1 which is incompatible. Installing collected packages: google-resumable-media, protobuf, googleapis-common-protos, pyasn1, rsa, cachetools, pyasn1-modules, google-auth, pytz, futures, enum34, grpcio, google-api-core, google-cloud-core, google.cloud.bigquery, funcsigs, mock, grpc-google-iam-v1, google.cloud.bigtable, google.cloud Successfully installed cachetools-3.1.1 enum34-1.1.6 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.14.2 google-auth-1.6.3 google-cloud-core-1.0.3 google-resumable-media-0.3.3 google.cloud google.cloud.bigquery google.cloud.bigtable googleapis-common-protos-1.6.0 grpc-google-iam-v1-0.12.3 grpcio-1.23.0 mock-3.0.5 protobuf-3.9.1 pyasn1-0.4.6 pyasn1-modules-0.2.6 pytz-2019.2 rsa-4.0 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins4875826985292036612.sh + .env/bin/python src/.test-infra/jenkins/verify_performance_test_results_test.py Traceback (most recent call last): File "src/.test-infra/jenkins/verify_performance_test_results_test.py", line 26, in <module> from verify_performance_test_results import create_report File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src/.test-infra/jenkins/verify_performance_test_results.py";,> line 43, in <module> from google.cloud import bigquery File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/__init__.py";,> line 35, in <module> from google.cloud.bigquery.client import Client File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/client.py";,> line 40, in <module> from google.resumable_media.requests import MultipartUpload File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/resumable_media/requests/__init__.py";,> line 663, in <module> pkg_resources.require('google-resumable-media[requests]') # noqa: E402 File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/pkg_resources/__init__.py";,> line 900, in require needed = self.resolve(parse_requirements(requirements)) File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/pkg_resources/__init__.py";,> line 791, in resolve raise VersionConflict(dist, req).with_context(dependent_req) pkg_resources.ContextualVersionConflict: (requests 2.9.1 (/usr/lib/python2.7/dist-packages), Requirement.parse('requests<3.0.0dev,>=2.18.0; extra == "requests"'), set(['google-resumable-media'])) Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
