See <https://builds.apache.org/job/beam_PerformanceTests_Analysis/376/display/redirect?page=changes>
Changes: [robinyqiu] Use a singleton PIPELINE_OPTION_PARAMETER in DoFnSignature.Parameter [michal.walenia] [BEAM-7028] Change ParDo load test according to the proposal, add a [juta.staes] [BEAM-7181][BEAM-7243] add streaming it tests python 3.6 [iemejia] [BEAM-7239] Do not close DataSource on Teardown on JdbcIO [kcweaver] [BEAM-7282] portable Spark: don't fuse already optimized graph [altay] [BEAM-562] Add DoFn.setup and DoFn.teardown to Python SDK (#7994) [tweise] Beam community update blogpost (#8559) [iemejia] Fix trigger paths filters to execute precommit tests only if needed [mxm] [BEAM-7126] Remove LengthPrefixCoder from Flink's key Coder [mxm] [website] Update Flink Runner page for version 1.8 [mxm] Update references Dataflow to Beam in Flink Runner [mxm] Add Coder components for BufferedElement Coder [mxm] Remove UnboundedSocketSource from Flink Runner [mxm] [BEAM-7271] adding UTF8 String coder to Java SDK ModelCoder [ehudm] [BEAM-7251] Increase timeout for test BQ queries. [kenn] Fix project dependencies in pom.xml outputs [jozsi] Add first version of Hazelcast Jet based Java Runner [ehudm] Add missing javadoc to BigqueryClient.java [pabloem] [BEAM-6493] : Add cookbook and snippets examples in Kotlin (#8439) [relax] Merge pull request #8358: Beam Kata for Java and Python SDKs [25622840+adude3141] [BEAM-4046] revert test infra to be compatible with pending PRs [25622840+adude3141] fix syntax errors in groovy files ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-3 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 31785ccaa87d5c47b3e4505201120821b48c09d0 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 31785ccaa87d5c47b3e4505201120821b48c09d0 Commit message: "Merge pull request #8536 from udim/bq-test-client" > git rev-list --no-walk 2527817739a898e05897e96e6f2088283582a600 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins4777740696985111012.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins650479905774104157.sh + rm -rf .env [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins5291938488156688552.sh + virtualenv .env --python=python2.7 --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins8542075658364103885.sh + .env/bin/pip install --upgrade setuptools pip DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (41.0.1) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (19.1.1) [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins1684353797999326141.sh + .env/bin/pip install requests google.cloud.bigquery mock google.cloud.bigtable google.cloud DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (2.9.1) Collecting google.cloud.bigquery Using cached https://files.pythonhosted.org/packages/b3/33/236bdc6f5204bed8f69aecbabbe1a9b3a5be51f959fb51eba0545181ffa0/google_cloud_bigquery-1.11.2-py2.py3-none-any.whl Collecting mock Using cached https://files.pythonhosted.org/packages/05/d2/f94e68be6b17f46d2c353564da56e6fb89ef09faeeff3313a046cb810ca9/mock-3.0.5-py2.py3-none-any.whl Collecting google.cloud.bigtable Using cached https://files.pythonhosted.org/packages/15/81/df8ec275ea39885744ec058f2bbcf393669a423eac18cc6a7707dc4b77d9/google_cloud_bigtable-0.32.1-py2.py3-none-any.whl Collecting google.cloud Using cached https://files.pythonhosted.org/packages/ba/b1/7c54d1950e7808df06642274e677dbcedba57f75307adf2e5ad8d39e5e0e/google_cloud-0.34.0-py2.py3-none-any.whl Collecting google-resumable-media>=0.3.1 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl Collecting enum34; python_version < "3.4" (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl Collecting google-api-core<2.0.0dev,>=1.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/3d/3d/328de10db1b3ec788faa65419727b223b720e9812c9c8660a390b3d56ee9/google_api_core-1.10.0-py2.py3-none-any.whl Collecting protobuf>=3.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/ea/72/5eadea03b06ca1320be2433ef2236155da17806b700efc92677ee99ae119/protobuf-3.7.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting google-cloud-core<0.30dev,>=0.29.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/0c/f2/3c225e7a69cb27d283b68bff867722bd066bc1858611180197f711815ea5/google_cloud_core-0.29.1-py2.py3-none-any.whl Collecting funcsigs>=1; python_version < "3.3" (from mock) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Requirement already satisfied: six in /usr/lib/python2.7/dist-packages (from mock) (1.10.0) Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google.cloud.bigtable) Collecting googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl Requirement already satisfied: setuptools>=34.0.0 in ./.env/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) (41.0.1) Collecting pytz (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl Collecting futures>=3.2.0; python_version < "3.2" (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl Collecting grpcio<2.0.0dev,>=1.0.0 (from grpc-google-iam-v1<0.12dev,>=0.11.4->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/71/f4/175dc28565a59860912c11d859d15d829b8f0e6fe0c8dc7405c6560d52e1/grpcio-1.20.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/39/2b/d87fc2369242bd743883232c463f28205902b8579cb68dcf5b11eee1652f/cachetools-3.1.0-py2.py3-none-any.whl Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl Collecting pyasn1>=0.1.3 (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl ERROR: google-api-core 1.10.0 has requirement requests<3.0.0dev,>=2.18.0, but you'll have requests 2.9.1 which is incompatible. Installing collected packages: google-resumable-media, enum34, protobuf, googleapis-common-protos, pyasn1, rsa, cachetools, pyasn1-modules, google-auth, pytz, futures, google-api-core, google-cloud-core, google.cloud.bigquery, funcsigs, mock, grpcio, grpc-google-iam-v1, google.cloud.bigtable, google.cloud Successfully installed cachetools-3.1.0 enum34-1.1.6 funcsigs-1.0.2 futures-3.2.0 google-api-core-1.10.0 google-auth-1.6.3 google-cloud-core-0.29.1 google-resumable-media-0.3.2 google.cloud google.cloud.bigquery google.cloud.bigtable googleapis-common-protos-1.5.10 grpc-google-iam-v1-0.11.4 grpcio-1.20.1 mock-3.0.5 protobuf-3.7.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 rsa-4.0 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins3862309921339330840.sh + .env/bin/python src/.test-infra/jenkins/verify_performance_test_results_test.py Traceback (most recent call last): File "src/.test-infra/jenkins/verify_performance_test_results_test.py", line 26, in <module> from verify_performance_test_results import create_report File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src/.test-infra/jenkins/verify_performance_test_results.py";,> line 43, in <module> from google.cloud import bigquery File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/__init__.py";,> line 35, in <module> from google.cloud.bigquery.client import Client File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/client.py";,> line 33, in <module> from google.resumable_media.requests import MultipartUpload File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/resumable_media/requests/__init__.py";,> line 673, in <module> six.raise_from(new_exc, caught_exc) File "/usr/lib/python2.7/dist-packages/six.py", line 718, in raise_from raise value ImportError: ``requests >= 2.18.0`` is required by the ``google.resumable_media.requests`` subpackage. It can be installed via pip install google-resumable-media[requests]. Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
