See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/3268/display/redirect?page=changes>
Changes: [github] [BEAM-9951] Adding integration tests for synthetic pipelines in Go [github] [BEAM-9217] Update DoFn javadoc for schema type translation (#11984) ------------------------------------------ [...truncated 50.30 KB...] > Task :sdks:python:test-suites:portable:py2:createProcessWorker DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python> Processing /home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl Processing /home/jenkins/.cache/pip/wheels/54/6e/1d/172ed90bc541c925faff97e03c7a110b8ce876ab13e10b0c77/dill-0.3.1.1-py2-none-any.whl Collecting fastavro<0.24,>=0.21.4 Using cached fastavro-0.23.4-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB) Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.18.2) Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.29.0) Processing /home/jenkins/.cache/pip/wheels/3a/18/11/31dfb768f5d55108760cdd028ad7026173f7c0e847cb71fe4b/hdfs-2.5.8-py2-none-any.whl Processing /home/jenkins/.cache/pip/wheels/ce/98/d0/7cbebe9de22c986e85e2561069d25c9752b43523240f803199/httplib2-0.17.4-py2-none-any.whl Collecting mock<3.0.0,>=1.0.1 Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting numpy<2,>=1.14.3 Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB) Collecting pymongo<4.0.0,>=3.8.0 Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB) Processing /home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.12.2) Collecting pydot<2,>=1.2.0 Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting python-dateutil<3,>=2.8.0 Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) Collecting pytz>=2018.3 Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB) Collecting typing-extensions<3.8.0,>=3.7.0 Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB) Processing /home/jenkins/.cache/pip/wheels/28/a0/fc/a3d4892b81eedc9e027323c08e9890bee1ec2d35edd1c1ac96/avro-1.9.2-py2-none-any.whl Collecting funcsigs<2,>=1.0.2 Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB) Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.3.0) Processing /home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl Requirement already satisfied: typing<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.7.4.1) Collecting pyarrow<0.18.0,>=0.15.1 Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB) Collecting freezegun>=0.3.12 Using cached freezegun-0.3.15-py2.py3-none-any.whl (14 kB) Collecting nose>=1.3.7 Using cached nose-1.3.7-py2-none-any.whl (154 kB) Processing /home/jenkins/.cache/pip/wheels/d5/c6/06/f237242ae0d6742cda23895f8741980762b0c1fb5a7f70bbea/nose_xunitmp-0.4.1-py2-none-any.whl Collecting pandas<0.25,>=0.23.4 Using cached pandas-0.24.2-cp27-cp27mu-manylinux1_x86_64.whl (10.1 MB) Collecting parameterized<0.8.0,>=0.7.1 Using cached parameterized-0.7.4-py2.py3-none-any.whl (25 kB) Processing /home/jenkins/.cache/pip/wheels/f5/8c/e2/f0cea19d340270166bbfd4a2e9d8b8c132e26ef7e1376a0890/PyHamcrest-1.10.1-py2-none-any.whl Processing /home/jenkins/.cache/pip/wheels/d1/d5/a0/3c27cdc8b0209c5fc1385afeee936cf8a71e13d885388b4be2/PyYAML-5.3.1-cp27-cp27mu-linux_x86_64.whl Collecting requests_mock<2.0,>=1.7 Using cached requests_mock-1.8.0-py2.py3-none-any.whl (23 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting pytest<5.0,>=4.4.0 Using cached pytest-4.6.11-py2.py3-none-any.whl (231 kB) Collecting pytest-xdist<2,>=1.29.0 Using cached pytest_xdist-1.32.0-py2.py3-none-any.whl (36 kB) Collecting pytest-timeout<2,>=1.3.3 Using cached pytest_timeout-1.3.4-py2.py3-none-any.whl (10 kB) Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.23.0.dev0) (1.15.0) Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.23.0.dev0) (1.1.10) Processing /home/jenkins/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e/docopt-0.6.2-py2.py3-none-any.whl Collecting requests>=2.7.0 Using cached requests-2.23.0-py2.py3-none-any.whl (58 kB) Collecting pbr>=0.11 Using cached pbr-5.4.5-py2.py3-none-any.whl (110 kB) Processing /home/jenkins/.cache/pip/wheels/b0/d0/93/bfbd178f634c8e9fc85708894ac3a0c757902520424854f86b/rsa-4.2-py2.py3-none-any.whl Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.0.5 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.23.0.dev0) (44.1.1) Collecting pyparsing>=2.1.4 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting monotonic>=0.6; python_version == "2.7" Using cached monotonic-1.5-py2.py3-none-any.whl (5.3 kB) Collecting atomicwrites>=1.0 Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB) Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (0.13.1) Collecting packaging Using cached packaging-20.4-py2.py3-none-any.whl (37 kB) Collecting attrs>=17.4.0 Using cached attrs-19.3.0-py2.py3-none-any.whl (39 kB) Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.6.1) Collecting wcwidth Using cached wcwidth-0.2.4-py2.py3-none-any.whl (30 kB) Collecting more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" Using cached more_itertools-5.0.0-py2-none-any.whl (52 kB) Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (2.3.5) Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.8.1) Collecting pytest-forked Using cached pytest_forked-1.1.3-py2.py3-none-any.whl (4.5 kB) Collecting execnet>=1.1 Using cached execnet-1.7.1-py2.py3-none-any.whl (39 kB) Collecting certifi>=2017.4.17 Using cached certifi-2020.4.5.2-py2.py3-none-any.whl (157 kB) Collecting idna<3,>=2.5 Using cached idna-2.9-py2.py3-none-any.whl (58 kB) Collecting chardet<4,>=3.0.2 Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB) Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.2.0) Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (4.0.2) Collecting backports.functools-lru-cache>=1.2.1; python_version < "3.2" Using cached backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl (5.7 kB) Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.10.0) Collecting apipkg>=1.4 Using cached apipkg-1.5-py2.py3-none-any.whl (4.9 kB) Installing collected packages: crcmod, dill, pytz, fastavro, docopt, certifi, idna, chardet, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, numpy, pymongo, pyasn1, rsa, pyasn1-modules, oauth2client, pyparsing, pydot, python-dateutil, typing-extensions, avro, pyvcf, pyarrow, freezegun, nose, nose-xunitmp, pandas, parameterized, pyhamcrest, pyyaml, requests-mock, monotonic, tenacity, atomicwrites, packaging, attrs, backports.functools-lru-cache, wcwidth, more-itertools, pytest, pytest-forked, apipkg, execnet, pytest-xdist, pytest-timeout, apache-beam Running setup.py develop for apache-beam Successfully installed apache-beam apipkg-1.5 atomicwrites-1.4.0 attrs-19.3.0 avro-1.9.2 backports.functools-lru-cache-1.6.1 certifi-2020.4.5.2 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 execnet-1.7.1 fastavro-0.23.4 freezegun-0.3.15 funcsigs-1.0.2 hdfs-2.5.8 httplib2-0.17.4 idna-2.9 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.4 pandas-0.24.2 parameterized-0.7.4 pbr-5.4.5 pyarrow-0.16.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.1.3 pytest-timeout-1.3.4 pytest-xdist-1.32.0 python-dateutil-2.8.1 pytz-2020.1 pyvcf-0.6.8 pyyaml-5.3.1 requests-2.23.0 requests-mock-1.8.0 rsa-4.2 tenacity-5.1.5 typing-extensions-3.7.4.2 urllib3-1.25.9 wcwidth-0.2.4 > Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python> Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.7) Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.3.1.1) Requirement already satisfied: fastavro<0.24,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.23.4) Requirement already satisfied: future<1.0.0,>=0.18.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.18.2) Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.29.0) Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (2.5.8) Requirement already satisfied: httplib2<0.18.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.17.4) Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (2.0.0) Requirement already satisfied: numpy<2,>=1.14.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.16.6) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.10.1) Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.0.0) Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.12.2) Requirement already satisfied: pydot<2,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.4.1) Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (2.8.1) Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (2020.1) Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.7.4.2) Requirement already satisfied: avro<1.10.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.9.2) Requirement already satisfied: funcsigs<2,>=1.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.0.2) Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.3.0) Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.6.8) Requirement already satisfied: typing<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (3.7.4.1) Requirement already satisfied: pyarrow<0.18.0,>=0.15.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.16.0) Requirement already satisfied: freezegun>=0.3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.3.15) Requirement already satisfied: nose>=1.3.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.3.7) Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.4.1) Requirement already satisfied: pandas<0.25,>=0.23.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.24.2) Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (0.7.4) Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.10.1) Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (5.3.1) Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.8.0) Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (5.1.5) Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (4.6.11) Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.32.0) Requirement already satisfied: pytest-timeout<2,>=1.3.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from apache-beam==2.23.0.dev0) (1.3.4) Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.23.0.dev0) (1.15.0) Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.23.0.dev0) (1.1.10) Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (0.6.2) Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (2.23.0) Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.23.0.dev0) (5.4.5) Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.23.0.dev0) (4.2) Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.23.0.dev0) (0.4.8) Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.23.0.dev0) (0.2.8) Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.23.0.dev0) (44.1.1) Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pydot<2,>=1.2.0->apache-beam==2.23.0.dev0) (2.4.7) Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from tenacity<6.0,>=5.0.2->apache-beam==2.23.0.dev0) (1.5) Requirement already satisfied: atomicwrites>=1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.4.0) Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (0.13.1) Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (20.4) Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (19.3.0) Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.6.1) Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (0.2.4) Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (5.0.0) Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (2.3.5) Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.8.1) Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.23.0.dev0) (1.1.3) Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.23.0.dev0) (1.7.1) Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (2020.4.5.2) Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (2.9) Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (3.0.4) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.23.0.dev0) (1.25.9) Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.2.0) Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (4.0.2) Requirement already satisfied: backports.functools-lru-cache>=1.2.1; python_version < "3.2" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from wcwidth->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.6.1) Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.23.0.dev0) (1.10.0) Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.23.0.dev0) (1.5) Installing collected packages: apache-beam Attempting uninstall: apache-beam Found existing installation: apache-beam 2.23.0.dev0 Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813> Can't uninstall 'apache-beam'. No files were found to uninstall. Running setup.py develop for apache-beam Successfully installed apache-beam apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 163, in _run_module_as_main mod_name, _Error) File "/usr/lib/python2.7/runpy.py", line 102, in _get_module_details loader = get_loader(mod_name) File "/usr/lib/python2.7/pkgutil.py", line 464, in get_loader return find_loader(fullname) File "/usr/lib/python2.7/pkgutil.py", line 474, in find_loader for importer in iter_importers(fullname): File "/usr/lib/python2.7/pkgutil.py", line 430, in iter_importers __import__(pkg) File "apache_beam/__init__.py", line 96, in <module> from apache_beam import io File "apache_beam/io/__init__.py", line 38, in <module> from apache_beam.io.gcp.bigquery import * File "apache_beam/io/gcp/bigquery.py", line 256, in <module> from apache_beam.io.gcp import bigquery_tools File "apache_beam/io/gcp/bigquery_tools.py", line 49, in <module> from apache_beam.internal.gcp import auth File "apache_beam/internal/gcp/auth.py", line 28, in <module> from oauth2client.client import GoogleCredentials File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/oauth2client/client.py";,> line 47, in <module> from oauth2client import crypt File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/oauth2client/crypt.py";,> line 23, in <module> from oauth2client import _pure_python_crypt File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/oauth2client/_pure_python_crypt.py";,> line 26, in <module> import rsa File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/rsa/__init__.py";,> line 24, in <module> from rsa.key import newkeys, PrivateKey, PublicKey File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/rsa/key.py";,> line 1 SyntaxError: Non-ASCII character '\xc3' in file <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/rsa/key.py> on line 1, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details > Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 176 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py2:sparkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2m 32s 64 actionable tasks: 49 executed, 15 from cache Publishing build scan... https://gradle.com/s/ckuvdlb3aa2vw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
