See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6583/display/redirect?page=changes>
Changes: [Kenneth Knowles] Throw exception when file to stage is not found, instead of logging a [noreply] Make tracking/cleanup of cache and in-environment states per pipeline [noreply] [BEAM-9198] BeamSQL aggregation analytics functionality (#11975) ------------------------------------------ [...truncated 2.08 MB...] Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB) [91mWARNING: The candidate selected for download or install is a yanked version: 'google-api-core' candidate (version 1.20.0 at https://files.pythonhosted.org/packages/5c/ca/e172037b74fe39535731319e7c936160194204e07ba11222a5366ee0c346/google_api_core-1.20.0-py2.py3-none-any.whl#sha256=65ca5396393b3e592c49cba968380b6d2534d9c78b25fedbedea9dd1c6c50249 (from https://pypi.org/simple/google-api-core/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*)) Reason for being yanked: Pinned protobuf version was too low. See https://github.com/googleapis/python-api-core/issues/48 [0mCollecting google-api-core==1.20.0 Downloading google_api_core-1.20.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.24.0 Downloading google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp37-cp37m-manylinux1_x86_64.whl (2.1 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9-cp37-cp37m-manylinux1_x86_64.whl (614 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp37-cp37m-manylinux1_x86_64.whl (20.0 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB) Collecting pandas==0.25.2 Downloading pandas-0.25.2-cp37-cp37m-manylinux1_x86_64.whl (10.4 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.2.0 Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB) Collecting pymongo==3.9.0 Downloading pymongo-3.9.0-cp37-cp37m-manylinux1_x86_64.whl (447 kB) Collecting tenacity>=5.0.2 Downloading tenacity-6.2.0-py2.py3-none-any.whl (24 kB) Collecting pyhamcrest<2.0,>=1.9 Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB) Collecting nose==1.3.7 Downloading nose-1.3.7-py3-none-any.whl (154 kB) Collecting six>=1.5.2 Downloading six-1.15.0-py2.py3-none-any.whl (10 kB) Collecting docopt Downloading docopt-0.6.2.tar.gz (25 kB) Collecting requests>=2.7.0 Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB) Collecting pbr>=0.11 Downloading pbr-5.4.5-py2.py3-none-any.whl (110 kB) Collecting pyasn1>=0.1.7 Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pyasn1-modules>=0.0.5 Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa>=3.1.4 Downloading rsa-4.6-py3-none-any.whl (47 kB) Requirement already satisfied: setuptools in /usr/local/lib/python3.7/site-packages (from protobuf==3.12.0->-r /tmp/base_image_requirements.txt (line 38)) (47.3.1) Collecting pyparsing>=2.1.4 Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB) Collecting google-auth<2.0dev,>=1.14.0 Downloading google_auth-1.19.0-py2.py3-none-any.whl (91 kB) Collecting fasteners>=0.14 Downloading fasteners-0.15-py2.py3-none-any.whl (23 kB) Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB) Collecting google-resumable-media<0.6dev,>=0.5.0 Downloading google_resumable_media-0.5.1-py2.py3-none-any.whl (38 kB) Collecting python-dateutil>=2.6.1 Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) Collecting tensorboard<2.3.0,>=2.2.0 Downloading tensorboard-2.2.2-py3-none-any.whl (3.0 MB) Collecting termcolor>=1.1.0 Downloading termcolor-1.1.0.tar.gz (3.9 kB) Collecting wrapt>=1.11.1 Downloading wrapt-1.12.1.tar.gz (27 kB) Collecting opt-einsum>=2.3.2 Downloading opt_einsum-3.2.1-py3-none-any.whl (63 kB) Collecting astunparse==1.6.3 Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) Requirement already satisfied: wheel>=0.26; python_version >= "3" in /usr/local/lib/python3.7/site-packages (from tensorflow==2.2.0->-r /tmp/base_image_requirements.txt (line 71)) (0.34.2) Collecting google-pasta>=0.1.8 Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) Collecting tensorflow-estimator<2.3.0,>=2.2.0 Downloading tensorflow_estimator-2.2.0-py2.py3-none-any.whl (454 kB) Collecting gast==0.3.3 Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB) Collecting keras-preprocessing>=1.1.0 Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB) Collecting absl-py>=0.7.0 Downloading absl-py-0.9.0.tar.gz (104 kB) Collecting h5py<2.11.0,>=2.10.0 Downloading h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB) Collecting chardet<4,>=3.0.2 Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB) Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Downloading urllib3-1.25.9-py2.py3-none-any.whl (126 kB) Collecting idna<3,>=2.5 Downloading idna-2.10-py2.py3-none-any.whl (58 kB) Collecting certifi>=2017.4.17 Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB) Collecting cachetools<5.0,>=2.0.0 Downloading cachetools-4.1.1-py3-none-any.whl (10 kB) Collecting monotonic>=0.1 Downloading monotonic-1.5-py2.py3-none-any.whl (5.3 kB) Collecting tensorboard-plugin-wit>=1.6.0 Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB) Collecting google-auth-oauthlib<0.5,>=0.4.1 Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB) Collecting werkzeug>=0.11.15 Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB) Collecting markdown>=2.6.8 Downloading Markdown-3.2.2-py3-none-any.whl (88 kB) Collecting requests-oauthlib>=0.7.0 Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting importlib-metadata; python_version < "3.8" Downloading importlib_metadata-1.7.0-py2.py3-none-any.whl (31 kB) Collecting oauthlib>=3.0.0 Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB) Collecting zipp>=0.5 Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB) Building wheels for collected packages: avro-python3, crcmod, dill, future, hdfs, httplib2, oauth2client, pyyaml, google-apitools, protorpc, python-gflags, docopt, grpc-google-iam-v1, termcolor, wrapt, absl-py Building wheel for avro-python3 (setup.py): started Building wheel for avro-python3 (setup.py): finished with status 'done' Created wheel for avro-python3: filename=avro_python3-1.8.2-py3-none-any.whl size=43249 sha256=100c186e373e079a8b3782a63507ebb5b8f7c69df2756c88c3f5d666f3ba2948 Stored in directory: /root/.cache/pip/wheels/21/13/6f/cb2fe781dd05d05084356d29f660cd669fffc0bbfd87a9a613 Building wheel for crcmod (setup.py): started Building wheel for crcmod (setup.py): finished with status 'done' Created wheel for crcmod: filename=crcmod-1.7-cp37-cp37m-linux_x86_64.whl size=36925 sha256=0ecc020d60832ed7dd3a3ac3d0dc710b3986dc5d63730c18d77ec2d6f3aff489 Stored in directory: /root/.cache/pip/wheels/dc/9a/e9/49e627353476cec8484343c4ab656f1e0d783ee77b9dde2d1f Building wheel for dill (setup.py): started Building wheel for dill (setup.py): finished with status 'done' Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78530 sha256=5003f646d314efac88e833302262bc55d2e0043c2179d5d2215e0fe104604331 Stored in directory: /root/.cache/pip/wheels/a4/61/fd/c57e374e580aa78a45ed78d5859b3a44436af17e22ca53284f Building wheel for future (setup.py): started Building wheel for future (setup.py): finished with status 'done' Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491058 sha256=f52f189ebd4598b3fa38dd2b94fc717ed2830f9851ca88fd8d28e97ab8e7aaac Stored in directory: /root/.cache/pip/wheels/56/b0/fe/4410d17b32f1f0c3cf54cdfb2bc04d7b4b8f4ae377e2229ba0 Building wheel for hdfs (setup.py): started Building wheel for hdfs (setup.py): finished with status 'done' Created wheel for hdfs: filename=hdfs-2.5.8-py3-none-any.whl size=33213 sha256=728a02ca4aa865cb7df2d46f8f94587a93220dfd3a3195474d75797d6d302b4c Stored in directory: /root/.cache/pip/wheels/0a/7d/38/ea4eaf831518e6cd867b515b88919a9785eb66f11def5ab859 Building wheel for httplib2 (setup.py): started Building wheel for httplib2 (setup.py): finished with status 'done' Created wheel for httplib2: filename=httplib2-0.12.0-py3-none-any.whl size=93464 sha256=7e0ef2244dc636b61fc604fa861642cdce37602dd7aaad0711d5547529e79cb9 Stored in directory: /root/.cache/pip/wheels/0d/e7/b6/0dd30343ceca921cfbd91f355041bd9c69e0f40b49f25b7b8a Building wheel for oauth2client (setup.py): started Building wheel for oauth2client (setup.py): finished with status 'done' Created wheel for oauth2client: filename=oauth2client-3.0.0-py3-none-any.whl size=106383 sha256=4fcdef974d9bd24eb165be4fa7365c2cdaedaffec72288636721846a38c7217f Stored in directory: /root/.cache/pip/wheels/86/73/7a/3b3f76a2142176605ff38fbca574327962c71e25a43197a4c1 Building wheel for pyyaml (setup.py): started Building wheel for pyyaml (setup.py): finished with status 'done' Created wheel for pyyaml: filename=PyYAML-5.1-cp37-cp37m-linux_x86_64.whl size=468865 sha256=1451bf0b789558a15640245f83fe400da656e9615a9e2201c74922473430f3e5 Stored in directory: /root/.cache/pip/wheels/77/f5/10/d00a2bd30928b972790053b5de0c703ca87324f3fead0f2fd9 Building wheel for google-apitools (setup.py): started Building wheel for google-apitools (setup.py): finished with status 'done' Created wheel for google-apitools: filename=google_apitools-0.5.28-py3-none-any.whl size=130110 sha256=89242b16fabeef047e8f1356c3b20608c18fb489a19bb6dafa0c5386d82dbf53 Stored in directory: /root/.cache/pip/wheels/34/3b/69/ecd8e6ae89d9d71102a58962c29faa7a9467ba45f99f205920 Building wheel for protorpc (setup.py): started Building wheel for protorpc (setup.py): finished with status 'done' Created wheel for protorpc: filename=protorpc-0.12.0-py3-none-any.whl size=137671 sha256=57256ecc76f3b3b0836d1d09c8d0e0445ecab687038f80336d57acfbb0e5f290 Stored in directory: /root/.cache/pip/wheels/fc/86/a3/44e716af12921112b03d56484f6864de427cd09d658827a903 Building wheel for python-gflags (setup.py): started Building wheel for python-gflags (setup.py): finished with status 'done' Created wheel for python-gflags: filename=python_gflags-3.0.6-py3-none-any.whl size=54291 sha256=e692db820cafe2d9779e5be046a20a16d7428049510aca89099df42bf81fde57 Stored in directory: /root/.cache/pip/wheels/86/80/f0/25d8fdfc7735e5cd17d9b26738d19dfbb6cae9042ba89e7c02 Building wheel for docopt (setup.py): started Building wheel for docopt (setup.py): finished with status 'done' Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=33f49b969ff41fbbfb7d45d842c649a95af4318f2117996ad17559a15e519068 Stored in directory: /root/.cache/pip/wheels/72/b0/3f/1d95f96ff986c7dfffe46ce2be4062f38ebd04b506c77c81b9 Building wheel for grpc-google-iam-v1 (setup.py): started Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done' Created wheel for grpc-google-iam-v1: filename=grpc_google_iam_v1-0.12.3-py3-none-any.whl size=18499 sha256=3b3aacaefe360d5d4a5e82a75cff64e492e56cc62208eaa3b6a4e0dfbc75016f Stored in directory: /root/.cache/pip/wheels/b9/ee/67/2e444183030cb8d31ce8b34cee34a7afdbd3ba5959ea846380 Building wheel for termcolor (setup.py): started Building wheel for termcolor (setup.py): finished with status 'done' Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4830 sha256=8cad11652f74b2198092b363f82e43a95db2fb165ca9eee2bf5468102cd6c9b6 Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2 Building wheel for wrapt (setup.py): started Building wheel for wrapt (setup.py): finished with status 'done' Created wheel for wrapt: filename=wrapt-1.12.1-cp37-cp37m-linux_x86_64.whl size=76425 sha256=0afdb5c9146d4c997a640e519af1b32e720249d41fc0e077712eddb35556e0a0 Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6 Building wheel for absl-py (setup.py): started Building wheel for absl-py (setup.py): finished with status 'done' Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=121931 sha256=ac354cb09badb63931e21dac4146ec57b20bb4466aa5b90fb69e484dc59e8eed Stored in directory: /root/.cache/pip/wheels/cc/af/1a/498a24d0730ef484019e007bb9e8cef3ac00311a672c049a3e Successfully built avro-python3 crcmod dill future hdfs httplib2 oauth2client pyyaml google-apitools protorpc python-gflags docopt grpc-google-iam-v1 termcolor wrapt absl-py Installing collected packages: avro-python3, pytz, fastavro, crcmod, dill, future, six, grpcio, docopt, chardet, urllib3, idna, certifi, requests, hdfs, httplib2, pbr, mock, pyasn1, pyasn1-modules, rsa, oauth2client, protobuf, numpy, pyarrow, pyparsing, pydot, pyyaml, typing-extensions, googleapis-common-protos, cachetools, google-auth, google-api-core, monotonic, fasteners, google-apitools, grpc-google-iam-v1, google-cloud-pubsub, google-cloud-core, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, google-cloud-datastore, cython, guppy3, scipy, python-dateutil, pandas, protorpc, python-gflags, tensorboard-plugin-wit, absl-py, oauthlib, requests-oauthlib, google-auth-oauthlib, werkzeug, zipp, importlib-metadata, markdown, tensorboard, termcolor, wrapt, opt-einsum, astunparse, google-pasta, tensorflow-estimator, gast, keras-preprocessing, h5py, tensorflow, pymongo, tenacity, pyhamcrest, nose > Task :sdks:python:container:py37:docker FAILED :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 46.001 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 55s 20 actionable tasks: 14 executed, 6 up-to-date The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=d46e71b7-cae3-46eb-a5a7-ac7a04a86b92, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 12654 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-12654.out.log ----- Last 20 lines from daemon log file - daemon-12654.out.log ----- :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 46.001 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 55s 20 actionable tasks: 14 executed, 6 up-to-date Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
