See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/208/display/redirect?page=changes>
Changes: [iemejia] [BEAM-9162] Upgrade Jackson to version 2.10.2 [iemejia] Mark Test categories as internal and improve categorization [robertwb] Update go beam runner generated protos. [robertwb] Add standard protocol capabilities to protos. [kcweaver] [BEAM-9225] Fix Flink uberjar job termination bug. [kcweaver] Reuse get_state method. [robertwb] [BEAM-9339] Declare capabilities for Go SDK. [lcwik] [BEAM-5605] Eagerly close the BoundedReader once we have read everything [lcwik] fixup! Fix SpotBugs failure [kcweaver] [BEAM-9022] publish Spark job server Docker image [github] Revert "[BEAM-9085] Fix performance regression in SyntheticSource [github] [BEAM-8537] Provide WatermarkEstimator to track watermark (#10375) [github] Make sure calling try_claim(0) more than once also trows exception. [robertwb] [BEAM-9339] Declare capabilities for Python SDK. [github] [BEAM-9063] migrate docker images to apache (#10612) [github] [BEAM-9252] Exclude jboss's Main and module-info.java (#10930) [github] [BEAM-9359] Switch to Data Catalog client (#10917) [github] [BEAM-9344] Add support for bundle finalization execution to the Beam ------------------------------------------ [...truncated 40.31 KB...] Stored in directory: /home/jenkins/.cache/pip/wheels/d9/1b/42/0870d76f68b8c3eafed6db30a07e8c438a2517c2844d4657b5 Successfully built apache-beam Installing collected packages: crcmod, dill, fastavro, docopt, certifi, idna, chardet, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, numpy, pymongo, pyasn1, rsa, pyasn1-modules, oauth2client, pyparsing, pydot, python-dateutil, pytz, avro, pyvcf, pyarrow, typing-extensions, cachetools, monotonic, fasteners, google-apitools, google-auth, googleapis-common-protos, google-api-core, google-cloud-core, google-cloud-datastore, grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, google-cloud-dlp, google-cloud-spanner, grpcio-gcp, google-cloud-videointelligence, proto-google-cloud-datastore-v1, googledatastore, freezegun, nose, nose-xunitmp, pandas, parameterized, pyhamcrest, pyyaml, requests-mock, tenacity, atomicwrites, packaging, attrs, wcwidth, more-itertools, pytest, pytest-forked, apipkg, execnet, pytest-xdist, pytest-timeout, apache-beam Successfully installed apache-beam-2.20.0.dev0 apipkg-1.5 atomicwrites-1.3.0 attrs-19.3.0 avro-1.9.2 cachetools-3.1.1 certifi-2019.11.28 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 execnet-1.7.1 fastavro-0.21.24 fasteners-0.15 freezegun-0.3.15 funcsigs-1.0.2 google-api-core-1.16.0 google-apitools-0.5.28 google-auth-1.11.2 google-cloud-bigquery-1.17.1 google-cloud-bigtable-1.0.0 google-cloud-core-1.3.0 google-cloud-datastore-1.7.4 google-cloud-dlp-0.13.0 google-cloud-pubsub-1.0.2 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0 google-resumable-media-0.4.1 googleapis-common-protos-1.51.0 googledatastore-7.0.2 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.12.0 idna-2.9 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.1 pandas-0.24.2 parameterized-0.7.1 pbr-5.4.4 proto-google-cloud-datastore-v1-0.90.4 pyarrow-0.15.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.6 pytest-4.6.9 pytest-forked-1.1.3 pytest-timeout-1.3.4 pytest-xdist-1.31.0 python-dateutil-2.8.1 pytz-2019.3 pyvcf-0.6.8 pyyaml-5.3 requests-2.23.0 requests-mock-1.7.0 rsa-4.0 tenacity-5.1.5 typing-extensions-3.7.4.1 urllib3-1.25.8 wcwidth-0.1.8 > Task > :sdks:python:test-suites:dataflow:py2:installChicagoTaxiExampleRequirements DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Collecting jupyter<2,>=1.0 Using cached jupyter-1.0.0-py2.py3-none-any.whl (2.7 kB) Collecting notebook<5.8,>=5.7.8 Using cached notebook-5.7.8-py2.py3-none-any.whl (9.0 MB) Collecting tensorflow==1.14.0 Using cached tensorflow-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (109.2 MB) Collecting tensorflow-data-validation<0.14,>=0.13.1 Using cached tensorflow_data_validation-0.13.1-cp27-cp27mu-manylinux1_x86_64.whl (2.7 MB) Collecting tensorflow-metadata<0.14,>=0.13.0 Using cached tensorflow_metadata-0.13.0-py2-none-any.whl (25 kB) Collecting tensorflow-model-analysis<0.14,>=0.13.2 Using cached tensorflow_model_analysis-0.13.2-py2-none-any.whl (973 kB) Collecting tensorflow-serving-api<1.14,>=1.13.0 Using cached tensorflow_serving_api-1.13.1-py2.py3-none-any.whl (38 kB) Processing /home/jenkins/.cache/pip/wheels/fa/8e/22/bf6c72aa7a68be71b39e7a2b7b08dfcde282dc58fa2481047f/tensorflow_transform-0.13.0-cp27-none-any.whl Collecting ipykernel Using cached ipykernel-4.10.1-py2-none-any.whl (109 kB) Collecting qtconsole Using cached qtconsole-4.6.0-py2.py3-none-any.whl (121 kB) Collecting ipywidgets Using cached ipywidgets-7.5.1-py2.py3-none-any.whl (121 kB) Collecting jupyter-console Using cached jupyter_console-5.2.0-py2.py3-none-any.whl (20 kB) Collecting nbconvert Using cached nbconvert-5.6.1-py2.py3-none-any.whl (455 kB) Collecting jupyter-core>=4.4.0 Using cached jupyter_core-4.6.3-py2.py3-none-any.whl (83 kB) Processing /home/jenkins/.cache/pip/wheels/1c/54/34/fd47cd9b308826cc4292b54449c1899a30251ef3b506bc91ea/prometheus_client-0.7.1-cp27-none-any.whl Collecting nbformat Using cached nbformat-4.4.0-py2.py3-none-any.whl (155 kB) Collecting ipaddress; python_version == "2.7" Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB) Processing /home/jenkins/.cache/pip/wheels/f1/ca/e5/bdd5eae705cf50a483257e6ff9dd34911dda3570f0e1340dda/Send2Trash-1.5.0-cp27-none-any.whl Collecting traitlets>=4.2.1 Using cached traitlets-4.3.3-py2.py3-none-any.whl (75 kB) Collecting jinja2 Using cached Jinja2-2.11.1-py2.py3-none-any.whl (126 kB) Collecting pyzmq>=17 Using cached pyzmq-18.1.1-cp27-cp27mu-manylinux1_x86_64.whl (1.0 MB) Collecting jupyter-client>=5.2.0 Using cached jupyter_client-5.3.4-py2.py3-none-any.whl (92 kB) Processing /home/jenkins/.cache/pip/wheels/6d/e1/ce/f4ee2fa420cc6b940123c64992b81047816d0a9fad6b879325/tornado-5.1.1-cp27-cp27mu-linux_x86_64.whl Collecting terminado>=0.8.1 Using cached terminado-0.8.3-py2.py3-none-any.whl (33 kB) Collecting ipython-genutils Using cached ipython_genutils-0.2.0-py2.py3-none-any.whl (26 kB) Processing /home/jenkins/.cache/pip/wheels/8e/28/49/fad4e7f0b9a1227708cbbee4487ac8558a7334849cb81c813d/absl_py-0.9.0-cp27-none-any.whl Collecting backports.weakref>=1.0rc1 Using cached backports.weakref-1.0.post1-py2.py3-none-any.whl (5.2 kB) Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 Using cached tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488 kB) Requirement already satisfied: grpcio>=1.8.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.27.2) Collecting tensorboard<1.15.0,>=1.14.0 Using cached tensorboard-1.14.0-py2-none-any.whl (3.1 MB) Processing /home/jenkins/.cache/pip/wheels/dd/f2/5d/2689b5547f32c4e258c3b7ccbe7f1d0f2afbb84fb01e830792/Keras_Applications-1.0.8-cp27-none-any.whl Processing /home/jenkins/.cache/pip/wheels/c0/72/78/e8f740a4658a7d7324515b608f758e861cbbbfb3b54c9dd481/wrapt-1.12.0-cp27-cp27mu-linux_x86_64.whl Requirement already satisfied: protobuf>=3.6.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (3.11.3) Collecting google-pasta>=0.1.6 Using cached google_pasta-0.1.8-py2-none-any.whl (57 kB) Collecting keras-preprocessing>=1.0.5 Using cached Keras_Preprocessing-1.1.0-py2.py3-none-any.whl (41 kB) Requirement already satisfied: mock>=2.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (2.0.0) Requirement already satisfied: numpy<2.0,>=1.14.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.16.6) Requirement already satisfied: six>=1.10.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.14.0) Requirement already satisfied: wheel in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (0.34.2) Collecting astor>=0.6.0 Using cached astor-0.8.1-py2.py3-none-any.whl (27 kB) Requirement already satisfied: enum34>=1.1.6 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow==1.14.0->-r requirements.txt (line 19)) (1.1.8) Processing /home/jenkins/.cache/pip/wheels/7c/06/54/bc84598ba1daf8f970247f550b175aaaee85f68b4b0c5ab2c6/termcolor-1.1.0-cp27-none-any.whl Collecting gast>=0.2.0 Using cached gast-0.3.3-py2.py3-none-any.whl (9.7 kB) Collecting scikit-learn<1,>=0.18 Using cached scikit_learn-0.20.4-cp27-cp27mu-manylinux1_x86_64.whl (5.5 MB) Requirement already satisfied: apache-beam[gcp]<3,>=2.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.20.0.dev0) Collecting joblib<1,>=0.12 Using cached joblib-0.14.1-py2.py3-none-any.whl (294 kB) Collecting IPython>=5.0 Using cached ipython-5.9.0-py2-none-any.whl (760 kB) Requirement already satisfied: pandas<1,>=0.18 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.24.2) Requirement already satisfied: googleapis-common-protos in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorflow-metadata<0.14,>=0.13.0->-r requirements.txt (line 21)) (1.51.0) Collecting scipy==1.1.0 Using cached scipy-1.1.0-cp27-cp27mu-manylinux1_x86_64.whl (30.8 MB) Processing /home/jenkins/.cache/pip/wheels/6a/a5/14/25541ebcdeaf97a37b6d05c7ff15f5bd20f5e91b99d313e5b4/pydot-1.2.4-cp27-none-any.whl Collecting pygments Using cached Pygments-2.5.2-py2.py3-none-any.whl (896 kB) Collecting widgetsnbextension~=3.5.0 Using cached widgetsnbextension-3.5.1-py2.py3-none-any.whl (2.2 MB) Collecting prompt-toolkit<2.0.0,>=1.0.0 Using cached prompt_toolkit-1.0.18-py2-none-any.whl (245 kB) Collecting mistune<2,>=0.8.1 Using cached mistune-0.8.4-py2.py3-none-any.whl (16 kB) Collecting defusedxml Using cached defusedxml-0.6.0-py2.py3-none-any.whl (23 kB) Collecting entrypoints>=0.2.2 Using cached entrypoints-0.3-py2.py3-none-any.whl (11 kB) Collecting bleach Downloading bleach-3.1.1-py2.py3-none-any.whl (150 kB) Processing /home/jenkins/.cache/pip/wheels/39/01/56/f1b08a6275acc59e846fa4c1e1b65dbc1919f20157d9e66c20/pandocfilters-1.4.2-cp27-none-any.whl Collecting testpath Using cached testpath-0.4.4-py2.py3-none-any.whl (163 kB) Collecting jsonschema!=2.5.0,>=2.4 Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB) Collecting decorator Using cached decorator-4.4.1-py2.py3-none-any.whl (9.2 kB) Collecting MarkupSafe>=0.23 Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB) Requirement already satisfied: python-dateutil>=2.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jupyter-client>=5.2.0->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (2.8.1) Collecting backports-abc>=0.4 Using cached backports_abc-0.5-py2.py3-none-any.whl (5.2 kB) Collecting singledispatch Using cached singledispatch-3.4.0.3-py2.py3-none-any.whl (12 kB) Requirement already satisfied: futures in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tornado<7,>=4.1->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (3.3.0) Collecting ptyprocess; os_name != "nt" Using cached ptyprocess-0.6.0-py2.py3-none-any.whl (39 kB) Collecting markdown>=2.6.8 Using cached Markdown-3.1.1-py2.py3-none-any.whl (87 kB) Requirement already satisfied: setuptools>=41.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from tensorboard<1.15.0,>=1.14.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (44.0.0) Collecting werkzeug>=0.11.15 Using cached Werkzeug-1.0.0-py2.py3-none-any.whl (298 kB) Collecting h5py Using cached h5py-2.10.0-cp27-cp27mu-manylinux1_x86_64.whl (2.8 MB) Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (5.4.4) Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from mock>=2.0.0->tensorflow==1.14.0->-r requirements.txt (line 19)) (1.0.2) Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.5.8) Requirement already satisfied: avro<1.10.0,>=1.8.1; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.9.2) Requirement already satisfied: typing<3.8.0,>=3.7.0; python_version < "3.8.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1) Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.0) Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7) Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0; python_version < "3.8.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.7.4.1) Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.0) Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.21.24) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.10.1) Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.16.0) Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2019.3) Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.3.1.1) Requirement already satisfied: pyarrow<0.16.0,>=0.15.1; python_version >= "3.0" or platform_system != "Windows" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.15.1) Requirement already satisfied: pyvcf<0.7.0,>=0.6.8; python_version < "3.0" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.8) Requirement already satisfied: cachetools<4,>=3.1.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.1.1) Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.13.0) Requirement already satisfied: google-cloud-core<2,>=0.28.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.3.0) Requirement already satisfied: google-apitools<0.5.29,>=0.5.28; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.5.28) Requirement already satisfied: grpcio-gcp<1,>=0.2.2; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.2) Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.2) Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0; python_version < "3.0" and extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.90.4) Requirement already satisfied: googledatastore<7.1,>=7.0.1; python_version < "3.0" and extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (7.0.2) Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0) Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.0.0) Requirement already satisfied: google-cloud-bigquery<1.18.0,>=1.6.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.17.1) Requirement already satisfied: google-cloud-videointelligence>=1.8.0<1.14.0; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.13.0) Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1; extra == "gcp" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.7.4) Collecting backports.shutil-get-terminal-size; python_version == "2.7" Using cached backports.shutil_get_terminal_size-1.0.0-py2.py3-none-any.whl (6.5 kB) Requirement already satisfied: pathlib2; python_version == "2.7" or python_version == "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.3.5) Collecting pexpect; sys_platform != "win32" Using cached pexpect-4.8.0-py2.py3-none-any.whl (59 kB) Processing /home/jenkins/.cache/pip/wheels/a9/28/53/f24776b4c5bcbe91aaf1f1e247bd6fadd17191aa12fac63902/simplegeneric-0.8.1-cp27-none-any.whl Collecting pickleshare Using cached pickleshare-0.7.5-py2.py3-none-any.whl (6.9 kB) Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->tensorflow-transform<0.14,>=0.13.0->-r requirements.txt (line 24)) (2.4.6) Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from prompt-toolkit<2.0.0,>=1.0.0->jupyter-console->jupyter<2,>=1.0->-r requirements.txt (line 17)) (0.1.8) Requirement already satisfied: configparser>=3.5; python_version == "2.7" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from entrypoints>=0.2.2->nbconvert->jupyter<2,>=1.0->-r requirements.txt (line 17)) (4.0.2) Collecting webencodings Using cached webencodings-0.5.1-py2.py3-none-any.whl (11 kB) Processing /home/jenkins/.cache/pip/wheels/b5/18/32/77a1030457155606ba5e3ec3a8a57132b1a04b1c4f765177b2/functools32-3.2.3.post2-cp27-none-any.whl Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (19.3.0) Processing /home/jenkins/.cache/pip/wheels/b5/78/ac/f26a78a989cd97f90981d96a560d7e1da5e1307284301d94e8/pyrsistent-0.15.7-cp27-cp27mu-linux_x86_64.whl Requirement already satisfied: importlib-metadata; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.5.0) Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.6.2) Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.23.0) Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (4.0) Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.4.8) Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.2.8) Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.14.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.16.0) Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.15) Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.12.3) Requirement already satisfied: google-resumable-media<0.5.0dev,>=0.3.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-cloud-bigquery<1.18.0,>=1.6.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (0.4.1) Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from pathlib2; python_version == "2.7" or python_version == "3.3"->IPython>=5.0->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.10.0) Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from importlib-metadata; python_version < "3.8"->jsonschema!=2.5.0,>=2.4->nbformat->notebook<5.8,>=5.7.8->-r requirements.txt (line 18)) (1.2.0) Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2019.11.28) Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (2.9) Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (3.0.4) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.25.8) Requirement already satisfied: google-auth<2.0dev,>=0.4.0 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from google-api-core[grpc]<2.0.0dev,>=1.14.0->google-cloud-dlp<=0.13.0,>=0.12.0; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.11.2) Requirement already satisfied: monotonic>=0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/lib/python2.7/site-packages> (from fasteners>=0.14->google-apitools<0.5.29,>=0.5.28; extra == "gcp"->apache-beam[gcp]<3,>=2.11->tensorflow-data-validation<0.14,>=0.13.1->-r requirements.txt (line 20)) (1.5) Installing collected packages: decorator, ipython-genutils, traitlets, backports.shutil-get-terminal-size, ptyprocess, pexpect, prompt-toolkit, simplegeneric, pickleshare, pygments, IPython, backports-abc, singledispatch, tornado, pyzmq, jupyter-core, jupyter-client, ipykernel, qtconsole, mistune, defusedxml, entrypoints, MarkupSafe, jinja2, webencodings, bleach, pandocfilters, functools32, pyrsistent, jsonschema, nbformat, testpath, nbconvert, prometheus-client, ipaddress, Send2Trash, terminado, notebook, widgetsnbextension, ipywidgets, jupyter-console, jupyter, absl-py, backports.weakref, tensorflow-estimator, markdown, werkzeug, tensorboard, h5py, keras-applications, wrapt, google-pasta, keras-preprocessing, astor, termcolor, gast, tensorflow, scipy, scikit-learn, tensorflow-metadata, joblib, pydot, tensorflow-transform, tensorflow-data-validation, tensorflow-model-analysis, tensorflow-serving-api Attempting uninstall: pydot Found existing installation: pydot 1.4.1 Uninstalling pydot-1.4.1: Successfully uninstalled pydot-1.4.1 Successfully installed IPython-5.9.0 MarkupSafe-1.1.1 Send2Trash-1.5.0 absl-py-0.9.0 astor-0.8.1 backports-abc-0.5 backports.shutil-get-terminal-size-1.0.0 backports.weakref-1.0.post1 bleach-3.1.1 decorator-4.4.1 defusedxml-0.6.0 entrypoints-0.3 functools32-3.2.3.post2 gast-0.3.3 google-pasta-0.1.8 h5py-2.10.0 ipaddress-1.0.23 ipykernel-4.10.1 ipython-genutils-0.2.0 ipywidgets-7.5.1 jinja2-2.11.1 joblib-0.14.1 jsonschema-3.2.0 jupyter-1.0.0 jupyter-client-5.3.4 jupyter-console-5.2.0 jupyter-core-4.6.3 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 mistune-0.8.4 nbconvert-5.6.1 nbformat-4.4.0 notebook-5.7.8 pandocfilters-1.4.2 pexpect-4.8.0 pickleshare-0.7.5 prometheus-client-0.7.1 prompt-toolkit-1.0.18 ptyprocess-0.6.0 pydot-1.2.4 pygments-2.5.2 pyrsistent-0.15.7 pyzmq-18.1.1 qtconsole-4.6.0 scikit-learn-0.20.4 scipy-1.1.0 simplegeneric-0.8.1 singledispatch-3.4.0.3 tensorboard-1.14.0 tensorflow-1.14.0 tensorflow-data-validation-0.13.1 tensorflow-estimator-1.14.0 tensorflow-metadata-0.13.0 tensorflow-model-analysis-0.13.2 tensorflow-serving-api-1.13.1 tensorflow-transform-0.13.0 termcolor-1.1.0 terminado-0.8.3 testpath-0.4.4 tornado-5.1.1 traitlets-4.3.3 webencodings-0.5.1 werkzeug-1.0.0 widgetsnbextension-3.5.1 wrapt-1.12.0 > Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED Using GCP project: apache-beam-testing Job output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200222-142817/chicago_taxi_output TFDV output path: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200222-142817/chicago_taxi_output/tfdv_output Starting distributed TFDV stats computation and schema generation... Traceback (most recent call last): File "tfdv_analyze_and_validate.py", line 25, in <module> import tensorflow as tf File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/__init__.py";,> line 28, in <module> from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/__init__.py";,> line 63, in <module> from tensorflow.python.framework.framework_lib import * # pylint: disable=redefined-builtin File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/framework/framework_lib.py";,> line 52, in <module> from tensorflow.python.framework.importer import import_graph_def File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/framework/importer.py";,> line 28, in <module> from tensorflow.python.framework import function File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/framework/function.py";,> line 37, in <module> from tensorflow.python.ops import resource_variable_ops File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/ops/resource_variable_ops.py";,> line 41, in <module> from tensorflow.python.ops import variables File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow/python/ops/variables.py";,> line 21, in <module> import enum # pylint: disable=g-bad-import-order ImportError: No module named enum FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 163 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 56s 6 actionable tasks: 6 executed Publishing build scan... https://gradle.com/s/zp7ot3b6un3j4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
