See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/122/display/redirect?page=changes>
Changes: [piotr.szczepanik] [BEAM-8819] Fix AvroCoder serialisation by introduction of [piotr.szczepanik] Added missing license header for AvroGenericCoder [piotr.szczepanik] Fixed code style violations [mxm] [BEAM-8656] Update documentation for flink_master parameter [piotr.szczepanik] Fixed missing AvroCoder -> AvroGenericCoder in python tests [github] Bump python precommit timeout to 3hrs [amyrvold] [BEAM-8832] Allow GCS staging upload chunk size to be increased >1M when [github] [BEAM-8840][BEAM-3713] Remove setup_requires, tests_require from [ehudm] [BEAM-8842] Temporarily disable test [coheigea] A fix for some TLS issues in the MongoDB IO ------------------------------------------ [...truncated 51.32 KB...] Using cached https://files.pythonhosted.org/packages/65/e0/eb35e762802015cab1ccee04e8a277b03f1d8e53da3ec3106882ec42558b/Jinja2-2.10.3-py2.py3-none-any.whl Collecting jupyter-client>=5.2.0 Downloading https://files.pythonhosted.org/packages/13/81/fe0eee1bcf949851a120254b1f530ae1e01bdde2d3ab9710c6ff81525061/jupyter_client-5.3.4-py2.py3-none-any.whl (92kB) Processing /home/jenkins/.cache/pip/wheels/f1/ca/e5/bdd5eae705cf50a483257e6ff9dd34911dda3570f0e1340dda/Send2Trash-1.5.0-cp27-none-any.whl Collecting pyzmq>=17 Downloading https://files.pythonhosted.org/packages/c8/f8/73c259238e6ec5afbede83a3f4e75f57228171109aafa4aa1b8c33e09778/pyzmq-18.1.1-cp27-cp27mu-manylinux1_x86_64.whl (1.0MB) Collecting traitlets>=4.2.1 Using cached https://files.pythonhosted.org/packages/ca/ab/872a23e29cec3cf2594af7e857f18b687ad21039c1f9b922fac5b9b142d5/traitlets-4.3.3-py2.py3-none-any.whl Collecting terminado>=0.8.1 Downloading https://files.pythonhosted.org/packages/ff/96/1d9a2c23990aea8f8e0b5c3b6627d03196a73771a17a2d9860bbe9823ab6/terminado-0.8.3-py2.py3-none-any.whl Collecting jupyter-core>=4.4.0 Downloading https://files.pythonhosted.org/packages/fb/82/86437f661875e30682e99d04c13ba6c216f86f5f6ca6ef212d3ee8b6ca11/jupyter_core-4.6.1-py2.py3-none-any.whl (82kB) Processing /home/jenkins/.cache/pip/wheels/1c/54/34/fd47cd9b308826cc4292b54449c1899a30251ef3b506bc91ea/prometheus_client-0.7.1-cp27-none-any.whl Collecting ipaddress; python_version == "2.7" Using cached https://files.pythonhosted.org/packages/c2/f8/49697181b1651d8347d24c095ce46c7346c37335ddc7d255833e7cde674d/ipaddress-1.0.23-py2.py3-none-any.whl Collecting nbformat Using cached https://files.pythonhosted.org/packages/da/27/9a654d2b6cc1eaa517d1c5a4405166c7f6d72f04f6e7eea41855fe808a46/nbformat-4.4.0-py2.py3-none-any.whl Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from protobuf<3.8.0,>=3.7.0->-r requirements.txt (line 19)) (42.0.1) Requirement already satisfied: six>=1.9 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from protobuf<3.8.0,>=3.7.0->-r requirements.txt (line 19)) (1.13.0) Processing /home/jenkins/.cache/pip/wheels/a7/15/a0/0a0561549ad11cdc1bc8fa1191a353efd30facf6bfb507aefc/absl_py-0.8.1-cp27-none-any.whl Processing /home/jenkins/.cache/pip/wheels/d7/de/2e/efa132238792efb6459a96e85916ef8597fcb3d2ae51590dfd/wrapt-1.11.2-cp27-cp27mu-linux_x86_64.whl Collecting keras-preprocessing>=1.0.5 Using cached https://files.pythonhosted.org/packages/28/6a/8c1f62c37212d9fc441a7e26736df51ce6f0e38455816445471f10da4f0a/Keras_Preprocessing-1.1.0-py2.py3-none-any.whl Requirement already satisfied: wheel in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow>=1.13.1->-r requirements.txt (line 20)) (0.33.6) Processing /home/jenkins/.cache/pip/wheels/b5/18/32/77a1030457155606ba5e3ec3a8a57132b1a04b1c4f765177b2/functools32-3.2.3.post2-cp27-none-any.whl Requirement already satisfied: enum34>=1.1.6; python_version < "3.4" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.1.6) Collecting backports.weakref>=1.0rc1; python_version < "3.4" Using cached https://files.pythonhosted.org/packages/88/ec/f598b633c3d5ffe267aaada57d961c94fdfa183c5c3ebda2b6d151943db6/backports.weakref-1.0.post1-py2.py3-none-any.whl Collecting astor>=0.6.0 Using cached https://files.pythonhosted.org/packages/d1/4f/950dfae467b384fc96bc6469de25d832534f6b4441033c39f914efd13418/astor-0.8.0-py2.py3-none-any.whl Requirement already satisfied: grpcio>=1.8.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.25.0) Processing /home/jenkins/.cache/pip/wheels/dd/f2/5d/2689b5547f32c4e258c3b7ccbe7f1d0f2afbb84fb01e830792/Keras_Applications-1.0.8-cp27-none-any.whl Processing /home/jenkins/.cache/pip/wheels/7c/06/54/bc84598ba1daf8f970247f550b175aaaee85f68b4b0c5ab2c6/termcolor-1.1.0-cp27-none-any.whl Collecting tensorflow-estimator<2.1.0,>=2.0.0 Downloading https://files.pythonhosted.org/packages/fc/08/8b927337b7019c374719145d1dceba21a8bb909b93b1ad6f8fb7d22c1ca1/tensorflow_estimator-2.0.1-py2.py3-none-any.whl (449kB) Collecting google-pasta>=0.1.6 Downloading https://files.pythonhosted.org/packages/2d/68/eed71ec8e8383a43987e0a58492b0aa043dc29971cac59b8b1d1e7951123/google_pasta-0.1.8-py2-none-any.whl (57kB) Collecting opt-einsum>=2.3.2 Downloading https://files.pythonhosted.org/packages/f6/d6/44792ec668bcda7d91913c75237314e688f70415ab2acd7172c845f0b24f/opt_einsum-2.3.2.tar.gz (59kB) Processing /home/jenkins/.cache/pip/wheels/5c/2e/7e/a1d4d4fcebe6c381f378ce7743a3ced3699feb89bcfbdadadd/gast-0.2.2-cp27-none-any.whl Collecting tensorboard<2.1.0,>=2.0.0 Downloading https://files.pythonhosted.org/packages/a7/3d/993131c622ae34f9401a81526853f2310a4834bd042420a7982fb5bc5fd0/tensorboard-2.0.2-py2-none-any.whl (3.8MB) Requirement already satisfied: numpy<2.0,>=1.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.16.5) Requirement already satisfied: mock>=2.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow>=1.13.1->-r requirements.txt (line 20)) (2.0.0) Requirement already satisfied: apache-beam[gcp]<3,>=2.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (2.18.0.dev0) Collecting joblib<1,>=0.12 Downloading https://files.pythonhosted.org/packages/8f/42/155696f85f344c066e17af287359c9786b436b1bf86029bb3411283274f3/joblib-0.14.0-py2.py3-none-any.whl (294kB) Collecting scikit-learn<1,>=0.18 Using cached https://files.pythonhosted.org/packages/31/9f/042db462417451e81035c3d43b722e88450c628a33dfda69777a801b0d40/scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl Collecting IPython>=5.0 Using cached https://files.pythonhosted.org/packages/b0/88/d996ab8be22cea1eaa18baee3678a11265e18cf09974728d683c51102148/ipython-5.8.0-py2-none-any.whl Requirement already satisfied: pandas<1,>=0.18 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.24.2) Requirement already satisfied: googleapis-common-protos in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-metadata<0.14,>=0.13.0->-r requirements.txt (line 22)) (1.6.0) Collecting scipy==1.1.0 Using cached https://files.pythonhosted.org/packages/2a/f3/de9c1bd16311982711209edaa8c6caa962db30ebb6a8cc6f1dcd2d3ef616/scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl Processing /home/jenkins/.cache/pip/wheels/6a/a5/14/25541ebcdeaf97a37b6d05c7ff15f5bd20f5e91b99d313e5b4/pydot-1.2.4-cp27-none-any.whl Collecting bleach Using cached https://files.pythonhosted.org/packages/ab/05/27e1466475e816d3001efb6e0a85a819be17411420494a1e602c36f8299d/bleach-3.1.0-py2.py3-none-any.whl Collecting entrypoints>=0.2.2 Using cached https://files.pythonhosted.org/packages/ac/c6/44694103f8c221443ee6b0041f69e2740d89a25641e62fb4f2ee568f2f9c/entrypoints-0.3-py2.py3-none-any.whl Collecting defusedxml Using cached https://files.pythonhosted.org/packages/06/74/9b387472866358ebc08732de3da6dc48e44b0aacd2ddaa5cb85ab7e986a2/defusedxml-0.6.0-py2.py3-none-any.whl Collecting mistune<2,>=0.8.1 Using cached https://files.pythonhosted.org/packages/09/ec/4b43dae793655b7d8a25f76119624350b4d65eb663459eb9603d7f1f0345/mistune-0.8.4-py2.py3-none-any.whl Processing /home/jenkins/.cache/pip/wheels/39/01/56/f1b08a6275acc59e846fa4c1e1b65dbc1919f20157d9e66c20/pandocfilters-1.4.2-cp27-none-any.whl Collecting pygments Using cached https://files.pythonhosted.org/packages/01/ac/379f879a40547843581403a23fa947162ce3aeb7c8e541ec8b4e42b5054e/Pygments-2.5.1-py2.py3-none-any.whl Collecting testpath Downloading https://files.pythonhosted.org/packages/1b/9e/1a170feaa54f22aeb5a5d16c9015e82234275a3c8ab630b552493f9cb8a9/testpath-0.4.4-py2.py3-none-any.whl (163kB) Collecting widgetsnbextension~=3.5.0 Using cached https://files.pythonhosted.org/packages/6c/7b/7ac231c20d2d33c445eaacf8a433f4e22c60677eb9776c7c5262d7ddee2d/widgetsnbextension-3.5.1-py2.py3-none-any.whl Collecting prompt-toolkit<2.0.0,>=1.0.0 Using cached https://files.pythonhosted.org/packages/9d/d2/2f099b5cd62dab819ce7a9f1431c09a9032fbfbb6474f442722e88935376/prompt_toolkit-1.0.18-py2-none-any.whl Collecting backports-abc>=0.4 Using cached https://files.pythonhosted.org/packages/7d/56/6f3ac1b816d0cd8994e83d0c4e55bc64567532f7dc543378bd87f81cebc7/backports_abc-0.5-py2.py3-none-any.whl Requirement already satisfied: futures in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.3.0) Collecting singledispatch Using cached https://files.pythonhosted.org/packages/c5/10/369f50bcd4621b263927b0a1519987a04383d4a98fb10438042ad410cf88/singledispatch-3.4.0.3-py2.py3-none-any.whl Collecting MarkupSafe>=0.23 Using cached https://files.pythonhosted.org/packages/fb/40/f3adb7cf24a8012813c5edb20329eb22d5d8e2a0ecf73d21d6b85865da11/MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl Requirement already satisfied: python-dateutil>=2.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jupyter-client>=5.2.0->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (2.8.1) Collecting decorator Using cached https://files.pythonhosted.org/packages/8f/b7/f329cfdc75f3d28d12c65980e4469e2fa373f1953f5df6e370e84ea2e875/decorator-4.4.1-py2.py3-none-any.whl Collecting ptyprocess; os_name != "nt" Using cached https://files.pythonhosted.org/packages/d1/29/605c2cc68a9992d18dada28206eeada56ea4bd07a239669da41674648b6f/ptyprocess-0.6.0-py2.py3-none-any.whl Collecting jsonschema!=2.5.0,>=2.4 Downloading https://files.pythonhosted.org/packages/c5/8f/51e89ce52a085483359217bc72cdbf6e75ee595d5b1d4b5ade40c7e018b8/jsonschema-3.2.0-py2.py3-none-any.whl (56kB) Collecting h5py Downloading https://files.pythonhosted.org/packages/12/90/3216b8f6d69905a320352a9ca6802a8e39fdb1cd93133c3d4163db8d5f19/h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8MB) Requirement already satisfied: google-auth<2,>=1.6.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.7.1) Collecting markdown>=2.6.8 Using cached https://files.pythonhosted.org/packages/c0/4e/fd492e91abdc2d2fcb70ef453064d980688762079397f779758e055f6575/Markdown-3.1.1-py2.py3-none-any.whl Requirement already satisfied: requests<3,>=2.21.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (2.22.0) Collecting google-auth-oauthlib<0.5,>=0.4.1 Downloading https://files.pythonhosted.org/packages/7b/b8/88def36e74bee9fce511c9519571f4e485e890093ab7442284f4ffaef60b/google_auth_oauthlib-0.4.1-py2.py3-none-any.whl Collecting werkzeug>=0.11.15 Downloading https://files.pythonhosted.org/packages/ce/42/3aeda98f96e85fd26180534d36570e4d18108d62ae36f87694b476b83d6f/Werkzeug-0.16.0-py2.py3-none-any.whl (327kB) Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (5.4.4) Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.0.2) Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.7) Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.3.1.1) Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.21.24) Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.18.2) Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (2.5.8) Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.12.0) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (3.9.0) Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (3.0.0) Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (2019.3) Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.9.1) Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.6.8) Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (3.6.6) Requirement already satisfied: pyarrow<0.16.0,>=0.15.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.15.1) Requirement already satisfied: cachetools<4,>=3.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (3.1.1) Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.5.28) Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.7.4) Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.0.2) Requirement already satisfied: google-cloud-bigquery<1.18.0,>=1.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.17.1) Requirement already satisfied: google-cloud-core<2,>=0.28.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.0.3) Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.0.0) Requirement already satisfied: googledatastore<7.1,>=7.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (7.0.2) Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.90.4) Collecting pexpect; sys_platform != "win32" Using cached https://files.pythonhosted.org/packages/0e/3e/377007e3f36ec42f1b84ec322ee12141a9e10d808312e5738f52f80a232c/pexpect-4.7.0-py2.py3-none-any.whl Collecting backports.shutil-get-terminal-size; python_version == "2.7" Using cached https://files.pythonhosted.org/packages/7d/cd/1750d6c35fe86d35f8562091737907f234b78fdffab42b29c72b1dd861f4/backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl Requirement already satisfied: pathlib2; python_version == "2.7" or python_version == "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (2.3.5) Processing /home/jenkins/.cache/pip/wheels/a9/28/53/f24776b4c5bcbe91aaf1f1e247bd6fadd17191aa12fac63902/simplegeneric-0.8.1-cp27-none-any.whl Collecting pickleshare Using cached https://files.pythonhosted.org/packages/9a/41/220f49aaea88bc6fa6cba8d05ecf24676326156c23b991e80b3f2fc24c77/pickleshare-0.7.5-py2.py3-none-any.whl Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->tensorflow-transform<0.14,>=0.13.0->-r requirements.txt (line 25)) (2.4.5) Collecting webencodings Using cached https://files.pythonhosted.org/packages/f4/24/2a3e3df732393fed8b3ebf2ec078f05546de641fe1b667ee316ec1dcf3b7/webencodings-0.5.1-py2.py3-none-any.whl Requirement already satisfied: configparser>=3.5; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from entrypoints>=0.2.2->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (4.0.2) Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (0.1.7) Requirement already satisfied: importlib-metadata; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.23) Collecting pyrsistent>=0.14.0 Downloading https://files.pythonhosted.org/packages/6c/6f/c1a2e8da80a0029f6b618d7e20e1a6f2a61dd04e2e54225309c2cc4268f7/pyrsistent-0.15.6.tar.gz (107kB) Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (19.3.0) Requirement already satisfied: rsa<4.1,>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-auth<2,>=1.6.3->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (4.0) Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-auth<2,>=1.6.3->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (0.2.7) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests<3,>=2.21.0->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (1.25.7) Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests<3,>=2.21.0->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (2019.11.28) Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests<3,>=2.21.0->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (3.0.4) Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests<3,>=2.21.0->tensorboard<2.1.0,>=2.0.0->tensorflow>=1.13.1->-r requirements.txt (line 20)) (2.8) Collecting requests-oauthlib>=0.7.0 Downloading https://files.pythonhosted.org/packages/a3/12/b92740d845ab62ea4edf04d2f4164d82532b5a0b03836d4d4e71c6f3d379/requests_oauthlib-1.3.0-py2.py3-none-any.whl Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.6.2) Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.4.8) Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.15) Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.14.3) Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.12.3) Requirement already satisfied: google-resumable-media<0.5.0dev,>=0.3.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<1.18.0,>=1.6.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (0.4.1) Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pathlib2; python_version == "2.7" or python_version == "3.3"->IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.10.0) Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0) Collecting oauthlib>=3.0.0 Downloading https://files.pythonhosted.org/packages/05/57/ce2e7a8fa7c0afb54a0581b14a65b56e62b5759dbc98e80627142b8a3704/oauthlib-3.1.0-py2.py3-none-any.whl (147kB) Requirement already satisfied: monotonic>=0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from fasteners>=0.14->google-apitools<0.5.29,>=0.5.28->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 21)) (1.5) Requirement already satisfied: more-itertools in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from zipp>=0.5->importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (5.0.0) Building wheels for collected packages: opt-einsum, pyrsistent Building wheel for opt-einsum (setup.py): started Building wheel for opt-einsum (setup.py): finished with status 'done' Created wheel for opt-einsum: filename=opt_einsum-2.3.2-cp27-none-any.whl size=49884 sha256=17cf0ff252d9843b0525fc85fdbd241d14a8798f21981a07408ce76ebd4d8866 Stored in directory: /home/jenkins/.cache/pip/wheels/51/3e/a3/b351fae0cbf15373c2136a54a70f43fea5fe91d8168a5faaa4 Building wheel for pyrsistent (setup.py): started Building wheel for pyrsistent (setup.py): finished with status 'done' Created wheel for pyrsistent: filename=pyrsistent-0.15.6-cp27-cp27mu-linux_x86_64.whl size=93201 sha256=0ed562953cb1a29afdd13451aeded6f1af0a0067eed32e75f0978af721e1179d Stored in directory: /home/jenkins/.cache/pip/wheels/83/89/d3/1712b9c33c9b9c0911b188a86aeff2a9a05e113f986cf79d92 Successfully built opt-einsum pyrsistent ERROR: tensorflow-serving-api 1.13.1 has requirement tensorflow<2,>=1.2.0, but you'll have tensorflow 2.0.0 which is incompatible. Installing collected packages: webencodings, bleach, entrypoints, defusedxml, mistune, ipython-genutils, decorator, traitlets, jupyter-core, functools32, pyrsistent, jsonschema, nbformat, pandocfilters, pygments, testpath, MarkupSafe, jinja2, nbconvert, prompt-toolkit, ptyprocess, pexpect, backports.shutil-get-terminal-size, simplegeneric, pickleshare, IPython, backports-abc, singledispatch, tornado, pyzmq, jupyter-client, Send2Trash, terminado, ipykernel, prometheus-client, ipaddress, notebook, widgetsnbextension, ipywidgets, qtconsole, jupyter-console, jupyter, protobuf, absl-py, wrapt, keras-preprocessing, backports.weakref, astor, h5py, keras-applications, termcolor, tensorflow-estimator, google-pasta, opt-einsum, gast, markdown, oauthlib, requests-oauthlib, google-auth-oauthlib, werkzeug, tensorboard, tensorflow, joblib, tensorflow-metadata, scipy, scikit-learn, pydot, tensorflow-transform, tensorflow-data-validation, tensorflow-model-analysis, tensorflow-serving-api Found existing installation: protobuf 3.11.0 Uninstalling protobuf-3.11.0: Successfully uninstalled protobuf-3.11.0 Found existing installation: pydot 1.4.1 Uninstalling pydot-1.4.1: Successfully uninstalled pydot-1.4.1 Successfully installed IPython-5.8.0 MarkupSafe-1.1.1 Send2Trash-1.5.0 absl-py-0.8.1 astor-0.8.0 backports-abc-0.5 backports.shutil-get-terminal-size-1.0.0 backports.weakref-1.0.post1 bleach-3.1.0 decorator-4.4.1 defusedxml-0.6.0 entrypoints-0.3 functools32-3.2.3.post2 gast-0.2.2 google-auth-oauthlib-0.4.1 google-pasta-0.1.8 h5py-2.10.0 ipaddress-1.0.23 ipykernel-4.10.1 ipython-genutils-0.2.0 ipywidgets-7.5.1 jinja2-2.10.3 joblib-0.14.0 jsonschema-3.2.0 jupyter-1.0.0 jupyter-client-5.3.4 jupyter-console-5.2.0 jupyter-core-4.6.1 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 mistune-0.8.4 nbconvert-5.6.1 nbformat-4.4.0 notebook-5.7.8 oauthlib-3.1.0 opt-einsum-2.3.2 pandocfilters-1.4.2 pexpect-4.7.0 pickleshare-0.7.5 prometheus-client-0.7.1 prompt-toolkit-1.0.18 protobuf-3.7.1 ptyprocess-0.6.0 pydot-1.2.4 pygments-2.5.1 pyrsistent-0.15.6 pyzmq-18.1.1 qtconsole-4.6.0 requests-oauthlib-1.3.0 scikit-learn-0.20.4 scipy-1.1.0 simplegeneric-0.8.1 singledispatch-3.4.0.3 tensorboard-2.0.2 tensorflow-2.0.0 tensorflow-data-validation-0.13.1 tensorflow-estimator-2.0.1 tensorflow-metadata-0.13.0 tensorflow-model-analysis-0.13.2 tensorflow-serving-api-1.13.1 tensorflow-transform-0.13.0 termcolor-1.1.0 terminado-0.8.3 testpath-0.4.4 tornado-5.1.1 traitlets-4.3.3 webencodings-0.5.1 werkzeug-0.16.0 widgetsnbextension-3.5.1 wrapt-1.11.2 Starting distributed TFDV stats computation and schema generation... Using GCP project: apache-beam-testing Job output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20191128-143522/chicago_taxi_output TFDV output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20191128-143522/chicago_taxi_output/tfdv_output <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/apache_beam/__init__.py>:84: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' Traceback (most recent call last): File "tfdv_analyze_and_validate.py", line 24, in <module> import tensorflow_data_validation as tfdv File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/__init__.py";,> line 18, in <module> from tensorflow_data_validation.api.stats_api import GenerateStatistics File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/api/stats_api.py";,> line 51, in <module> from tensorflow_data_validation.statistics import stats_impl File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/statistics/stats_impl.py";,> line 27, in <module> from tensorflow_data_validation.statistics.generators import basic_stats_generator File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/statistics/generators/basic_stats_generator.py";,> line 55, in <module> from tensorflow_data_validation.utils import quantiles_util File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_data_validation/utils/quantiles_util.py";,> line 26, in <module> from tensorflow_transform import analyzers File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/__init__.py";,> line 19, in <module> from tensorflow_transform.analyzers import * File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/analyzers.py";,> line 39, in <module> from tensorflow_transform import tf_utils File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_utils.py";,> line 24, in <module> from tensorflow.contrib.proto.python.ops import encode_proto_op ImportError: No module named contrib.proto.python.ops > Task :sdks:python:test-suites:dataflow:py2:dataflowChicagoTaxiExample FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 151 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py2:dataflowChicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 35s 5 actionable tasks: 5 executed Publishing build scan... Publishing failed. The response from https://scans-in.gradle.com/in/5.2.1/2.3 was not from the build scan server. Your network environment may be interfering, or the service may be unavailable. If you believe this to be in error, please report this problem via https://gradle.com/scans/help/plugin and include the following via copy/paste: ---------- Gradle version: 5.2.1 Plugin version: 2.3 Request URL: https://scans-in.gradle.com/in/5.2.1/2.3 Request ID: 4ca42ca3-38c9-45f4-9bdb-51b24ff43b9d Response status code: 503 Response content type: text/html; charset=utf-8 Response server type: cloudflare ---------- Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
