See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/1120/display/redirect?page=changes>
Changes: [github] [BEAM-9344] Add support for bundle finalization execution to the Beam ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 Commit message: "[BEAM-9344] Add support for bundle finalization execution to the Beam Java SDK. (#10910)" > git rev-list --no-walk 1117508136ac5d0d66141c0e8f1c0830fb223a3a # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins7334121164392667242.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins9050648380984883120.sh + rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins5517889920092329207.sh + virtualenv <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env> --python=python2.7 New python executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python2.7> Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python2.7 [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins3664568825374308577.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.0.0) Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.0.2) [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins7779141028458825591.sh + git clone --single-branch --branch=v1.14.0 https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker> Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker'...> Note: checking out '07441b9fe89f39189c3fca93aa0d70c3ae923869'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b <new-branch-name> [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins1984323256940594812.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt> DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Processing /home/jenkins/.cache/pip/wheels/8e/28/49/fad4e7f0b9a1227708cbbee4487ac8558a7334849cb81c813d/absl_py-0.9.0-cp27-none-any.whl Collecting jinja2>=2.7 Using cached Jinja2-2.11.1-py2.py3-none-any.whl (126 kB) Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (44.0.0) Collecting colorlog[windows]==2.6.0 Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB) Processing /home/jenkins/.cache/pip/wheels/92/a0/00/8690a57883956a301d91cf4ec999cc0b258b01e3f548f86e89/blinker-1.4-cp27-none-any.whl Collecting futures>=3.0.3 Using cached futures-3.3.0-py2-none-any.whl (16 kB) Processing /home/jenkins/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl Collecting pint>=0.7 Using cached Pint-0.9-py2.py3-none-any.whl (138 kB) Collecting numpy==1.16.4 Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB) Processing /home/jenkins/.cache/pip/wheels/b5/18/32/77a1030457155606ba5e3ec3a8a57132b1a04b1c4f765177b2/functools32-3.2.3.post2-cp27-none-any.whl Collecting contextlib2>=0.5.1 Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB) Processing /home/jenkins/.cache/pip/wheels/8f/db/f3/3028984b926c1c0165d7be4ead1092d219bee6ef71e9219578/pywinrm-0.4.1-py2.py3-none-any.whl Processing /home/jenkins/.cache/pip/wheels/f1/e6/ea/7387e3629cb46ba65140141f972745b823f4486c6fe884ccb8/timeout_decorator-0.4.1-cp27-none-any.whl Collecting google-cloud-monitoring Using cached google_cloud_monitoring-0.34.0-py2.py3-none-any.whl (220 kB) Collecting six Using cached six-1.14.0-py2.py3-none-any.whl (10 kB) Collecting enum34; python_version < "3.4" Downloading enum34-1.1.8-py2-none-any.whl (1.5 kB) Collecting MarkupSafe>=0.23 Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB) Collecting colorama; extra == "windows" Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB) Collecting funcsigs; python_version == "2.7" Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB) Collecting requests-ntlm>=0.3.0 Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB) Collecting requests>=2.9.1 Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB) Collecting xmltodict Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB) Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0 Using cached google_api_core-1.16.0-py2.py3-none-any.whl (70 kB) Collecting cryptography>=1.3 Using cached cryptography-2.8-cp27-cp27mu-manylinux2010_x86_64.whl (2.3 MB) Collecting ntlm-auth>=1.0.2 Using cached ntlm_auth-1.4.0-py2.py3-none-any.whl (29 kB) Collecting certifi>=2017.4.17 Using cached certifi-2019.11.28-py2.py3-none-any.whl (156 kB) Collecting idna<3,>=2.5 Using cached idna-2.9-py2.py3-none-any.whl (58 kB) Collecting chardet<4,>=3.0.2 Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Using cached urllib3-1.25.8-py2.py3-none-any.whl (125 kB) Collecting google-auth<2.0dev,>=0.4.0 Using cached google_auth-1.11.2-py2.py3-none-any.whl (76 kB) Collecting protobuf>=3.4.0 Using cached protobuf-3.11.3-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB) Processing /home/jenkins/.cache/pip/wheels/2c/f9/7f/6eb87e636072bf467e25348bbeb96849333e6a080dca78f706/googleapis_common_protos-1.51.0-cp27-none-any.whl Collecting pytz Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting grpcio<2.0dev,>=1.8.2; extra == "grpc" Using cached grpcio-1.27.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.6 MB) Collecting cffi!=1.11.3,>=1.8 Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB) Collecting ipaddress; python_version < "3" Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting cachetools<5.0,>=2.0.0 Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB) Collecting rsa<4.1,>=3.1.4 Using cached rsa-4.0-py2.py3-none-any.whl (38 kB) Processing /home/jenkins/.cache/pip/wheels/f2/9a/90/de94f8556265ddc9d9c8b271b0f63e57b26fb1d67a45564511/pycparser-2.19-py2.py3-none-any.whl Collecting pyasn1<0.5.0,>=0.4.6 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Installing collected packages: six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, functools32, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1, pyasn1-modules, cachetools, rsa, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-monitoring Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2019.11.28 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.8 enum34-1.1.8 funcsigs-1.0.2 functools32-3.2.3.post2 futures-3.3.0 google-api-core-1.16.0 google-auth-1.11.2 google-cloud-monitoring-0.34.0 googleapis-common-protos-1.51.0 grpcio-1.27.2 idna-2.9 ipaddress-1.0.23 jinja2-2.11.1 ntlm-auth-1.4.0 numpy-1.16.4 pint-0.9 protobuf-3.11.3 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.19 pytz-2019.3 pywinrm-0.4.1 requests-2.23.0 requests-ntlm-1.1.0 rsa-4.0 six-1.14.0 timeout-decorator-0.4.1 urllib3-1.25.8 xmltodict-0.12.0 [beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins2308130373514064450.sh + <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python> <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py35_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/> --beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py35 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE' Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py";,> line 19, in <module> from perfkitbenchmarker.pkb import Main File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 78, in <module> from perfkitbenchmarker import benchmark_sets File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/benchmark_sets.py";,> line 27, in <module> from perfkitbenchmarker import linux_benchmarks File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/__init__.py";,> line 26, in <module> BENCHMARKS = _LoadBenchmarks() File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/__init__.py";,> line 24, in _LoadBenchmarks return list(import_util.LoadModulesForPath(__path__, __name__)) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/import_util.py";,> line 43, in LoadModulesForPath yield importlib.import_module(prefix + modname) File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py";,> line 41, in <module> from perfkitbenchmarker.providers.aws import aws_dpb_emr File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/aws/aws_dpb_emr.py";,> line 29, in <module> from perfkitbenchmarker.providers.aws import aws_network File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/aws/aws_network.py";,> line 31, in <module> from perfkitbenchmarker import network File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/network.py";,> line 23, in <module> from enum import Enum ImportError: No module named enum Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
