See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/1049/display/redirect?page=changes>
Changes: [kamil.wasilewski] Generate 100kB records in GroupByKey Load test 3 [kenn] Clarify exceptions in SQL modules [kamil.wasilewski] Remove some tests in Python GBK on Flink suite ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 646f596988be9d6a739090f48d2fed07c8dfc17c (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 646f596988be9d6a739090f48d2fed07c8dfc17c Commit message: "Merge pull request #10699: [BEAM-9203] Clarify exceptions in SQL modules" > git rev-list --no-walk 2bd3c5c0860846d47218b2d8715dc84e2161bdcc # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins8308840268495384572.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins2712571701016310877.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins4492543114611795351.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env> --python=python2.7 New python executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins1663647285441827170.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.0.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.0.2) [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins4255239274567063908.sh + git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker'...> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins8018184213867933024.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt> DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Processing /home/jenkins/.cache/pip/wheels/8e/28/49/fad4e7f0b9a1227708cbbee4487ac8558a7334849cb81c813d/absl_py-0.9.0-cp27-none-any.whl Collecting jinja2>=2.7 Using cached Jinja2-2.11.1-py2.py3-none-any.whl (126 kB) Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (44.0.0) Collecting colorlog[windows]==2.6.0 Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB) Processing /home/jenkins/.cache/pip/wheels/92/a0/00/8690a57883956a301d91cf4ec999cc0b258b01e3f548f86e89/blinker-1.4-cp27-none-any.whl Collecting futures>=3.0.3 Using cached futures-3.3.0-py2-none-any.whl (16 kB) Processing /home/jenkins/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl Collecting pint>=0.7 Using cached Pint-0.9-py2.py3-none-any.whl (138 kB) Collecting numpy==1.16.4 Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB) Collecting contextlib2>=0.5.1 Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB) Processing /home/jenkins/.cache/pip/wheels/8f/db/f3/3028984b926c1c0165d7be4ead1092d219bee6ef71e9219578/pywinrm-0.4.1-py2.py3-none-any.whl Processing /home/jenkins/.cache/pip/wheels/f1/e6/ea/7387e3629cb46ba65140141f972745b823f4486c6fe884ccb8/timeout_decorator-0.4.1-cp27-none-any.whl Collecting google-cloud-monitoring Using cached google_cloud_monitoring-0.34.0-py2.py3-none-any.whl (220 kB) Collecting six Using cached six-1.14.0-py2.py3-none-any.whl (10 kB) Collecting enum34; python_version < "3.4" Using cached enum34-1.1.6-py2-none-any.whl (12 kB) Collecting MarkupSafe>=0.23 Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB) Collecting colorama; extra == "windows" Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB) Collecting funcsigs; python_version == "2.7" Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB) Collecting requests-ntlm>=0.3.0 Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB) Collecting requests>=2.9.1 Using cached requests-2.22.0-py2.py3-none-any.whl (57 kB) Collecting xmltodict Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB) Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0 Using cached google_api_core-1.16.0-py2.py3-none-any.whl (70 kB) Collecting cryptography>=1.3 Using cached cryptography-2.8-cp27-cp27mu-manylinux2010_x86_64.whl (2.3 MB) Collecting ntlm-auth>=1.0.2 Using cached ntlm_auth-1.4.0-py2.py3-none-any.whl (29 kB) Collecting certifi>=2017.4.17 Using cached certifi-2019.11.28-py2.py3-none-any.whl (156 kB) Collecting chardet<3.1.0,>=3.0.2 Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting idna<2.9,>=2.5 Using cached idna-2.8-py2.py3-none-any.whl (58 kB) Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Using cached urllib3-1.25.8-py2.py3-none-any.whl (125 kB) Collecting google-auth<2.0dev,>=0.4.0 Using cached google_auth-1.11.0-py2.py3-none-any.whl (76 kB) Collecting protobuf>=3.4.0 Using cached protobuf-3.11.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB) Processing /home/jenkins/.cache/pip/wheels/2c/f9/7f/6eb87e636072bf467e25348bbeb96849333e6a080dca78f706/googleapis_common_protos-1.51.0-cp27-none-any.whl Collecting pytz Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting grpcio<2.0dev,>=1.8.2; extra == "grpc" Using cached grpcio-1.26.0-cp27-cp27mu-manylinux2010_x86_64.whl (2.4 MB) Collecting cffi!=1.11.3,>=1.8 Using cached cffi-1.13.2-cp27-cp27mu-manylinux1_x86_64.whl (384 kB) Collecting ipaddress; python_version < "3" Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting cachetools<5.0,>=2.0.0 Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB) Collecting rsa<4.1,>=3.1.4 Using cached rsa-4.0-py2.py3-none-any.whl (38 kB) Processing /home/jenkins/.cache/pip/wheels/f2/9a/90/de94f8556265ddc9d9c8b271b0f63e57b26fb1d67a45564511/pycparser-2.19-py2.py3-none-any.whl Collecting pyasn1<0.5.0,>=0.4.6 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Installing collected packages: six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, chardet, idna, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1, pyasn1-modules, cachetools, rsa, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-monitoring Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2019.11.28 cffi-1.13.2 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.8 enum34-1.1.6 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.16.0 google-auth-1.11.0 google-cloud-monitoring-0.34.0 googleapis-common-protos-1.51.0 grpcio-1.26.0 idna-2.8 ipaddress-1.0.23 jinja2-2.11.1 ntlm-auth-1.4.0 numpy-1.16.4 pint-0.9 protobuf-3.11.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.19 pytz-2019.3 pywinrm-0.4.1 requests-2.22.0 requests-ntlm-1.1.0 rsa-4.0 six-1.14.0 timeout-decorator-0.4.1 urllib3-1.25.8 xmltodict-0.12.0 [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins2281512915786797165.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python> <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py35_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/> --beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py35 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE' Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py";,> line 19, in <module> from perfkitbenchmarker.pkb import Main File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 75, in <module> from perfkitbenchmarker import archive File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py";,> line 24, in <module> from perfkitbenchmarker.providers.aws.util import AWS_PATH File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py";,> line 19, in <module> from perfkitbenchmarker import events File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py";,> line 26, in <module> from perfkitbenchmarker import data File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py";,> line 34, in <module> from perfkitbenchmarker import temp_dir File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py";,> line 29, in <module> import functools32 as functools ImportError: No module named functools32 Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
