See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6526/display/redirect?page=changes>
Changes: [jozo.vilcek] [BEAM-10284] Add option to pass configuration into ParquetIO.Sink [jozo.vilcek] [BEAM-10284] Remove hadoop from ParquetIO.Sink public API [ajamato] [BEAM-10381] Increase retries in pull_licenses_java.py from 3 to 9. [noreply] [BEAM-10220] Add support for REQUIRE_MISSING in RowJsonDeserializer, [daniel.o.programmer] [BEAM-10312] Sub-element progress accounted for during splitting. ------------------------------------------ [...truncated 2.06 MB...] Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB) [91mWARNING: The candidate selected for download or install is a yanked version: 'google-api-core' candidate (version 1.20.0 at https://files.pythonhosted.org/packages/5c/ca/e172037b74fe39535731319e7c936160194204e07ba11222a5366ee0c346/google_api_core-1.20.0-py2.py3-none-any.whl#sha256=65ca5396393b3e592c49cba968380b6d2534d9c78b25fedbedea9dd1c6c50249 (from https://pypi.org/simple/google-api-core/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*)) Reason for being yanked: Pinned protobuf version was too low. See https://github.com/googleapis/python-api-core/issues/48 [0mCollecting google-api-core==1.20.0 Downloading google_api_core-1.20.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.24.0 Downloading google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp37-cp37m-manylinux1_x86_64.whl (2.1 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9-cp37-cp37m-manylinux1_x86_64.whl (614 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp37-cp37m-manylinux1_x86_64.whl (20.0 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB) Collecting pandas==0.25.2 Downloading pandas-0.25.2-cp37-cp37m-manylinux1_x86_64.whl (10.4 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.2.0 Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB) Collecting pymongo==3.9.0 Downloading pymongo-3.9.0-cp37-cp37m-manylinux1_x86_64.whl (447 kB) Collecting tenacity>=5.0.2 Downloading tenacity-6.2.0-py2.py3-none-any.whl (24 kB) Collecting pyhamcrest<2.0,>=1.9 Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB) Collecting nose==1.3.7 Downloading nose-1.3.7-py3-none-any.whl (154 kB) Collecting six>=1.5.2 Downloading six-1.15.0-py2.py3-none-any.whl (10 kB) Collecting docopt Downloading docopt-0.6.2.tar.gz (25 kB) Collecting requests>=2.7.0 Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB) Collecting pbr>=0.11 Downloading pbr-5.4.5-py2.py3-none-any.whl (110 kB) Collecting pyasn1>=0.1.7 Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.0.5 Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa>=3.1.4 Downloading rsa-4.6-py3-none-any.whl (47 kB) Requirement already satisfied: setuptools in /usr/local/lib/python3.7/site-packages (from protobuf==3.12.0->-r /tmp/base_image_requirements.txt (line 38)) (47.1.1) Collecting pyparsing>=2.1.4 Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB) Collecting google-auth<2.0dev,>=1.14.0 Downloading google_auth-1.18.0-py2.py3-none-any.whl (90 kB) Collecting fasteners>=0.14 Downloading fasteners-0.15-py2.py3-none-any.whl (23 kB) Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB) Collecting google-resumable-media<0.6dev,>=0.5.0 Downloading google_resumable_media-0.5.1-py2.py3-none-any.whl (38 kB) Collecting python-dateutil>=2.6.1 Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) Collecting keras-preprocessing>=1.1.0 Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB) Collecting gast==0.3.3 Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB) Collecting astunparse==1.6.3 Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) Collecting termcolor>=1.1.0 Downloading termcolor-1.1.0.tar.gz (3.9 kB) Collecting h5py<2.11.0,>=2.10.0 Downloading h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB) Collecting opt-einsum>=2.3.2 Downloading opt_einsum-3.2.1-py3-none-any.whl (63 kB) Collecting tensorflow-estimator<2.3.0,>=2.2.0 Downloading tensorflow_estimator-2.2.0-py2.py3-none-any.whl (454 kB) Collecting wrapt>=1.11.1 Downloading wrapt-1.12.1.tar.gz (27 kB) Requirement already satisfied: wheel>=0.26; python_version >= "3" in /usr/local/lib/python3.7/site-packages (from tensorflow==2.2.0->-r /tmp/base_image_requirements.txt (line 71)) (0.34.2) Collecting tensorboard<2.3.0,>=2.2.0 Downloading tensorboard-2.2.2-py3-none-any.whl (3.0 MB) Collecting google-pasta>=0.1.8 Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) Collecting absl-py>=0.7.0 Downloading absl-py-0.9.0.tar.gz (104 kB) Collecting idna<3,>=2.5 Downloading idna-2.10-py2.py3-none-any.whl (58 kB) Collecting certifi>=2017.4.17 Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB) Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Downloading urllib3-1.25.9-py2.py3-none-any.whl (126 kB) Collecting chardet<4,>=3.0.2 Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting cachetools<5.0,>=2.0.0 Downloading cachetools-4.1.1-py3-none-any.whl (10 kB) Collecting monotonic>=0.1 Downloading monotonic-1.5-py2.py3-none-any.whl (5.3 kB) Collecting tensorboard-plugin-wit>=1.6.0 Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB) Collecting werkzeug>=0.11.15 Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB) Collecting google-auth-oauthlib<0.5,>=0.4.1 Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB) Collecting markdown>=2.6.8 Downloading Markdown-3.2.2-py3-none-any.whl (88 kB) Collecting requests-oauthlib>=0.7.0 Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting importlib-metadata; python_version < "3.8" Downloading importlib_metadata-1.7.0-py2.py3-none-any.whl (31 kB) Collecting oauthlib>=3.0.0 Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB) Collecting zipp>=0.5 Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB) Building wheels for collected packages: avro-python3, crcmod, dill, future, hdfs, httplib2, oauth2client, pyyaml, google-apitools, protorpc, python-gflags, docopt, grpc-google-iam-v1, termcolor, wrapt, absl-py Building wheel for avro-python3 (setup.py): started Building wheel for avro-python3 (setup.py): finished with status 'done' Created wheel for avro-python3: filename=avro_python3-1.8.2-py3-none-any.whl size=43249 sha256=84428d85a21c431a9c4e8ef828346cb767266ce337ec5f07c31cd1c227ab9b9d Stored in directory: /root/.cache/pip/wheels/21/13/6f/cb2fe781dd05d05084356d29f660cd669fffc0bbfd87a9a613 Building wheel for crcmod (setup.py): started Building wheel for crcmod (setup.py): finished with status 'done' Created wheel for crcmod: filename=crcmod-1.7-cp37-cp37m-linux_x86_64.whl size=36931 sha256=f396b912cd9c10a2676fd0b399c8d300d5d18a648fe1d93deae8cb1ea841d254 Stored in directory: /root/.cache/pip/wheels/dc/9a/e9/49e627353476cec8484343c4ab656f1e0d783ee77b9dde2d1f Building wheel for dill (setup.py): started Building wheel for dill (setup.py): finished with status 'done' Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78530 sha256=5d559ca89852aa39a81df803027f29dec46fdb9223bb457be25eac6bd1612dc2 Stored in directory: /root/.cache/pip/wheels/a4/61/fd/c57e374e580aa78a45ed78d5859b3a44436af17e22ca53284f Building wheel for future (setup.py): started Building wheel for future (setup.py): finished with status 'done' Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491058 sha256=ef543b8b452bd8df5aff57331383a0d6e0029a154cac5c39f7478e8d0c2bd358 Stored in directory: /root/.cache/pip/wheels/56/b0/fe/4410d17b32f1f0c3cf54cdfb2bc04d7b4b8f4ae377e2229ba0 Building wheel for hdfs (setup.py): started Building wheel for hdfs (setup.py): finished with status 'done' Created wheel for hdfs: filename=hdfs-2.5.8-py3-none-any.whl size=33213 sha256=a6205acfd12916e08316c9c5a38e871ddbff5f71b87e7d5435a57b3a00eed305 Stored in directory: /root/.cache/pip/wheels/0a/7d/38/ea4eaf831518e6cd867b515b88919a9785eb66f11def5ab859 Building wheel for httplib2 (setup.py): started Building wheel for httplib2 (setup.py): finished with status 'done' Created wheel for httplib2: filename=httplib2-0.12.0-py3-none-any.whl size=93464 sha256=526683a8d90b4e3573721a770d61e11902dba5a7044d30c31c1cbda5dfd74ca9 Stored in directory: /root/.cache/pip/wheels/0d/e7/b6/0dd30343ceca921cfbd91f355041bd9c69e0f40b49f25b7b8a Building wheel for oauth2client (setup.py): started Building wheel for oauth2client (setup.py): finished with status 'done' Created wheel for oauth2client: filename=oauth2client-3.0.0-py3-none-any.whl size=106383 sha256=a185a19f6501dd45d9de2b22ca97f021ea4eec491ef4d18d882dbbb19fea4faa Stored in directory: /root/.cache/pip/wheels/86/73/7a/3b3f76a2142176605ff38fbca574327962c71e25a43197a4c1 Building wheel for pyyaml (setup.py): started Building wheel for pyyaml (setup.py): finished with status 'done' Created wheel for pyyaml: filename=PyYAML-5.1-cp37-cp37m-linux_x86_64.whl size=468848 sha256=a5771a1bfaf647bc0c9843624b2755c0ce1ede98dc972ce00bd14d9f130c4284 Stored in directory: /root/.cache/pip/wheels/77/f5/10/d00a2bd30928b972790053b5de0c703ca87324f3fead0f2fd9 Building wheel for google-apitools (setup.py): started Building wheel for google-apitools (setup.py): finished with status 'done' Created wheel for google-apitools: filename=google_apitools-0.5.28-py3-none-any.whl size=130110 sha256=a0b686dadd27e126d78b2f42b8e83b74c6d0e48a8d2d5fc43a9fea1061876975 Stored in directory: /root/.cache/pip/wheels/34/3b/69/ecd8e6ae89d9d71102a58962c29faa7a9467ba45f99f205920 Building wheel for protorpc (setup.py): started Building wheel for protorpc (setup.py): finished with status 'done' Created wheel for protorpc: filename=protorpc-0.12.0-py3-none-any.whl size=137671 sha256=b8056e86a514c89546056f196417e5cc251fbaaea31efeab9a8188a93e34cbf7 Stored in directory: /root/.cache/pip/wheels/fc/86/a3/44e716af12921112b03d56484f6864de427cd09d658827a903 Building wheel for python-gflags (setup.py): started Building wheel for python-gflags (setup.py): finished with status 'done' Created wheel for python-gflags: filename=python_gflags-3.0.6-py3-none-any.whl size=54291 sha256=0cb2b6dcf091ebcd0719694631a70ec3352bf3b0a00811ead1822ee1491f8992 Stored in directory: /root/.cache/pip/wheels/86/80/f0/25d8fdfc7735e5cd17d9b26738d19dfbb6cae9042ba89e7c02 Building wheel for docopt (setup.py): started Building wheel for docopt (setup.py): finished with status 'done' Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=50e734c415a3611e7b2e3b79c7851835a270781509a2a48f4df24a9e3722ec25 Stored in directory: /root/.cache/pip/wheels/72/b0/3f/1d95f96ff986c7dfffe46ce2be4062f38ebd04b506c77c81b9 Building wheel for grpc-google-iam-v1 (setup.py): started Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done' Created wheel for grpc-google-iam-v1: filename=grpc_google_iam_v1-0.12.3-py3-none-any.whl size=18499 sha256=622ee3afcf46874776d1d53917a5de2fce7a474f0f9eb2b560056758760f75fd Stored in directory: /root/.cache/pip/wheels/b9/ee/67/2e444183030cb8d31ce8b34cee34a7afdbd3ba5959ea846380 Building wheel for termcolor (setup.py): started Building wheel for termcolor (setup.py): finished with status 'done' Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4830 sha256=d9b5176248755e36f800edd2d56670576040e7f83292c487c6ce0812d277b07b Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2 Building wheel for wrapt (setup.py): started Building wheel for wrapt (setup.py): finished with status 'done' Created wheel for wrapt: filename=wrapt-1.12.1-cp37-cp37m-linux_x86_64.whl size=76415 sha256=13e72ab1c8be1197508cd3f6b47324f51201961c547a57978a78371d3509ee6c Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6 Building wheel for absl-py (setup.py): started Building wheel for absl-py (setup.py): finished with status 'done' Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=121931 sha256=b21c2643be21665c9fd877d957d4f761f0b8a6b3f28f7c5d62c1aed82ed09ab9 Stored in directory: /root/.cache/pip/wheels/cc/af/1a/498a24d0730ef484019e007bb9e8cef3ac00311a672c049a3e Successfully built avro-python3 crcmod dill future hdfs httplib2 oauth2client pyyaml google-apitools protorpc python-gflags docopt grpc-google-iam-v1 termcolor wrapt absl-py Installing collected packages: avro-python3, pytz, fastavro, crcmod, dill, future, six, grpcio, docopt, idna, certifi, urllib3, chardet, requests, hdfs, httplib2, pbr, mock, pyasn1, pyasn1-modules, rsa, oauth2client, protobuf, numpy, pyarrow, pyparsing, pydot, pyyaml, typing-extensions, googleapis-common-protos, cachetools, google-auth, google-api-core, monotonic, fasteners, google-apitools, grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-core, google-cloud-bigquery, google-cloud-bigtable, google-cloud-datastore, cython, guppy3, scipy, python-dateutil, pandas, protorpc, python-gflags, keras-preprocessing, gast, astunparse, termcolor, h5py, opt-einsum, tensorflow-estimator, wrapt, tensorboard-plugin-wit, absl-py, werkzeug, oauthlib, requests-oauthlib, google-auth-oauthlib, zipp, importlib-metadata, markdown, tensorboard, google-pasta, tensorflow, pymongo, tenacity, pyhamcrest, nose > Task :sdks:python:container:py37:docker FAILED :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 39.049 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 46s 20 actionable tasks: 14 executed, 6 up-to-date The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=01706b87-23be-466a-9bf5-d02fd3022af3, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 25635 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-25635.out.log ----- Last 20 lines from daemon log file - daemon-25635.out.log ----- :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 39.049 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 46s 20 actionable tasks: 14 executed, 6 up-to-date Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org