See <https://builds.apache.org/job/beam_PerformanceTests_Analysis/358/display/redirect?page=changes>
Changes: [kcweaver] [BEAM-7110] Add Spark master option to SparkJobServerDriver [kcweaver] [BEAM-7133] make Spark job server Gradle task pass along system [mxm] Increase Flink parallelism for ValidatesRunner tests [mxm] [BEAM-7029] Add KafkaIO.Write as an external transform [pabloem] [BEAM-7139] Blogpost for Kotlin Samples (#8391) [pabloem] Add some pydoc for runner classes in Python [iemejia] [BEAM-7162] Add ValueProvider to CassandraIO Write ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-12 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 516cdb6401d9fb7adb004de472771fb1fb3a92af (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 516cdb6401d9fb7adb004de472771fb1fb3a92af Commit message: "Merge pull request #8415 from pabloem/doc-fn" > git rev-list --no-walk f1330e75ef28bb18a9c9613d39009ada36c329a6 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins4700292927658647357.sh + rm -rf PerfKitBenchmarker [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins3927957575366734885.sh + rm -rf .env [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins4094031394835171893.sh + virtualenv .env --python=python2.7 --system-site-packages New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins7756511276076942918.sh + .env/bin/pip install --upgrade setuptools pip DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages (41.0.1) Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages (19.1) [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins568579032852846891.sh + .env/bin/pip install requests google.cloud.bigquery mock google.cloud.bigtable google.cloud DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. Requirement already satisfied: requests in /usr/lib/python2.7/dist-packages (2.9.1) Collecting google.cloud.bigquery Using cached https://files.pythonhosted.org/packages/b3/33/236bdc6f5204bed8f69aecbabbe1a9b3a5be51f959fb51eba0545181ffa0/google_cloud_bigquery-1.11.2-py2.py3-none-any.whl Collecting mock Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl Collecting google.cloud.bigtable Using cached https://files.pythonhosted.org/packages/15/81/df8ec275ea39885744ec058f2bbcf393669a423eac18cc6a7707dc4b77d9/google_cloud_bigtable-0.32.1-py2.py3-none-any.whl Collecting google.cloud Using cached https://files.pythonhosted.org/packages/ba/b1/7c54d1950e7808df06642274e677dbcedba57f75307adf2e5ad8d39e5e0e/google_cloud-0.34.0-py2.py3-none-any.whl Collecting google-resumable-media>=0.3.1 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/e2/5d/4bc5c28c252a62efe69ed1a1561da92bd5af8eca0cdcdf8e60354fae9b29/google_resumable_media-0.3.2-py2.py3-none-any.whl Collecting enum34; python_version < "3.4" (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl Collecting google-api-core<2.0.0dev,>=1.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/bf/e4/b22222bb714947eb459dc91ebf95131812126a0b29d62e444be3f76dad64/google_api_core-1.9.0-py2.py3-none-any.whl Collecting protobuf>=3.6.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/ea/72/5eadea03b06ca1320be2433ef2236155da17806b700efc92677ee99ae119/protobuf-3.7.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting google-cloud-core<0.30dev,>=0.29.0 (from google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/0c/f2/3c225e7a69cb27d283b68bff867722bd066bc1858611180197f711815ea5/google_cloud_core-0.29.1-py2.py3-none-any.whl Collecting pbr>=0.11 (from mock) Using cached https://files.pythonhosted.org/packages/07/3e/22d1d35a4b51706ca3590c54359aeb5fa7ea60df46180143a3ea13d45f29/pbr-5.2.0-py2.py3-none-any.whl Collecting funcsigs>=1; python_version < "3.3" (from mock) Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl Requirement already satisfied: six>=1.9 in /usr/lib/python2.7/dist-packages (from mock) (1.10.0) Collecting grpc-google-iam-v1<0.12dev,>=0.11.4 (from google.cloud.bigtable) Collecting googleapis-common-protos!=1.5.4,<2.0dev,>=1.5.3 (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Collecting google-auth<2.0dev,>=0.4.0 (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/c5/9b/ed0516cc1f7609fb0217e3057ff4f0f9f3e3ce79a369c6af4a6c5ca25664/google_auth-1.6.3-py2.py3-none-any.whl Requirement already satisfied: setuptools>=34.0.0 in ./.env/lib/python2.7/site-packages (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) (41.0.1) Collecting pytz (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/3d/73/fe30c2daaaa0713420d0382b16fbb761409f532c56bdcc514bf7b6262bb6/pytz-2019.1-py2.py3-none-any.whl Collecting futures>=3.2.0; python_version < "3.2" (from google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl Collecting grpcio<2.0.0dev,>=1.0.0 (from grpc-google-iam-v1<0.12dev,>=0.11.4->google.cloud.bigtable) Using cached https://files.pythonhosted.org/packages/71/f4/175dc28565a59860912c11d859d15d829b8f0e6fe0c8dc7405c6560d52e1/grpcio-1.20.1-cp27-cp27mu-manylinux1_x86_64.whl Collecting rsa>=3.1.4 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl Collecting cachetools>=2.0.0 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/39/2b/d87fc2369242bd743883232c463f28205902b8579cb68dcf5b11eee1652f/cachetools-3.1.0-py2.py3-none-any.whl Collecting pyasn1-modules>=0.2.1 (from google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/91/f0/b03e00ce9fddf4827c42df1c3ce10c74eadebfb706231e8d6d1c356a4062/pyasn1_modules-0.2.5-py2.py3-none-any.whl Collecting pyasn1>=0.1.3 (from rsa>=3.1.4->google-auth<2.0dev,>=0.4.0->google-api-core<2.0.0dev,>=1.6.0->google.cloud.bigquery) Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl ERROR: google-api-core 1.9.0 has requirement requests<3.0.0dev,>=2.18.0, but you'll have requests 2.9.1 which is incompatible. Installing collected packages: google-resumable-media, enum34, protobuf, googleapis-common-protos, pyasn1, rsa, cachetools, pyasn1-modules, google-auth, pytz, futures, google-api-core, google-cloud-core, google.cloud.bigquery, pbr, funcsigs, mock, grpcio, grpc-google-iam-v1, google.cloud.bigtable, google.cloud Successfully installed cachetools-3.1.0 enum34-1.1.6 funcsigs-1.0.2 futures-3.2.0 google-api-core-1.9.0 google-auth-1.6.3 google-cloud-core-0.29.1 google-resumable-media-0.3.2 google.cloud google.cloud.bigquery google.cloud.bigtable googleapis-common-protos-1.5.9 grpc-google-iam-v1-0.11.4 grpcio-1.20.1 mock-2.0.0 pbr-5.2.0 protobuf-3.7.1 pyasn1-0.4.5 pyasn1-modules-0.2.5 pytz-2019.1 rsa-4.0 [beam_PerformanceTests_Analysis] $ /bin/bash -xe /tmp/jenkins2328158761381628042.sh + .env/bin/python src/.test-infra/jenkins/verify_performance_test_results_test.py Traceback (most recent call last): File "src/.test-infra/jenkins/verify_performance_test_results_test.py", line 26, in <module> from verify_performance_test_results import create_report File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/src/.test-infra/jenkins/verify_performance_test_results.py";,> line 43, in <module> from google.cloud import bigquery File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/__init__.py";,> line 35, in <module> from google.cloud.bigquery.client import Client File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/cloud/bigquery/client.py";,> line 33, in <module> from google.resumable_media.requests import MultipartUpload File "<https://builds.apache.org/job/beam_PerformanceTests_Analysis/ws/.env/local/lib/python2.7/site-packages/google/resumable_media/requests/__init__.py";,> line 673, in <module> six.raise_from(new_exc, caught_exc) File "/usr/lib/python2.7/dist-packages/six.py", line 718, in raise_from raise value ImportError: ``requests >= 2.18.0`` is required by the ``google.resumable_media.requests`` subpackage. It can be installed via pip install google-resumable-media[requests]. Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
