See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6616/display/redirect?page=changes>
Changes: [Maximilian Michels] [BEAM-10558] Flushing of buffered elements during checkpoint can stall ------------------------------------------ [...truncated 2.08 MB...] > Task :sdks:python:container:buildLinuxAmd64 UP-TO-DATE Build cache key for task ':sdks:python:container:buildLinuxAmd64' is 3c8a183182073b415a4c5a9a675e0389 Caching disabled for task ':sdks:python:container:buildLinuxAmd64': Caching has not been enabled for the task Skipping task ':sdks:python:container:buildLinuxAmd64' as it is up-to-date. :sdks:python:container:buildLinuxAmd64 (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.669 secs. :sdks:python:container:goBuild (Thread[Execution worker for ':' Thread 2,5,main]) started. > Task :sdks:python:container:goBuild Caching disabled for task ':sdks:python:container:goBuild': Caching has not been enabled for the task Task ':sdks:python:container:goBuild' is not up-to-date because: Task has not declared any outputs despite executing actions. :sdks:python:container:goBuild (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.001 secs. :sdks:python:container:py37:copyLauncherDependencies (Thread[Execution worker for ':' Thread 2,5,main]) started. > Task :sdks:python:container:py37:copyLauncherDependencies Build cache key for task ':sdks:python:container:py37:copyLauncherDependencies' is ea6b88e8950cf203ee4ece3e10b2f98f Caching disabled for task ':sdks:python:container:py37:copyLauncherDependencies': Caching has not been enabled for the task Task ':sdks:python:container:py37:copyLauncherDependencies' is not up-to-date because: No history is available. :sdks:python:container:py37:copyLauncherDependencies (Thread[Execution worker for ':' Thread 2,5,main]) completed. Took 0.192 secs. > Task :sdks:python:sdist Create distribution tar file apache-beam.tar.gz in <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/build> :sdks:python:sdist (Thread[Execution worker for ':',5,main]) completed. Took 4.732 secs. :sdks:python:container:py37:copyDockerfileDependencies (Thread[Execution worker for ':',5,main]) started. > Task :sdks:python:container:py37:copyDockerfileDependencies Build cache key for task ':sdks:python:container:py37:copyDockerfileDependencies' is 356caf25761057f0e6b50f86431ea9fe Caching disabled for task ':sdks:python:container:py37:copyDockerfileDependencies': Caching has not been enabled for the task Task ':sdks:python:container:py37:copyDockerfileDependencies' is not up-to-date because: No history is available. :sdks:python:container:py37:copyDockerfileDependencies (Thread[Execution worker for ':',5,main]) completed. Took 0.058 secs. :sdks:python:container:py37:dockerPrepare (Thread[Execution worker for ':',5,main]) started. > Task :sdks:python:container:py37:dockerPrepare Build cache key for task ':sdks:python:container:py37:dockerPrepare' is 5ab143f80c7f08b1020bffa238bbcdee Caching disabled for task ':sdks:python:container:py37:dockerPrepare': Caching has not been enabled for the task Task ':sdks:python:container:py37:dockerPrepare' is not up-to-date because: No history is available. :sdks:python:container:py37:dockerPrepare (Thread[Execution worker for ':',5,main]) completed. Took 0.185 secs. :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) started. > Task :sdks:python:container:py37:docker Caching disabled for task ':sdks:python:container:py37:docker': Caching has not been enabled for the task Task ':sdks:python:container:py37:docker' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/py37/build/docker> Command: docker build --no-cache --build-arg py_version=3.7 --build-arg pull_licenses=false -t us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20200723-130656 . Successfully started process 'command 'docker'' Sending build context to Docker daemon 35.34MB Step 1/18 : ARG py_version Step 2/18 : FROM python:"${py_version}"-buster ---> 22c70bba8283 Step 3/18 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in d1f1c40551fb Removing intermediate container d1f1c40551fb ---> dddbb8ca8585 Step 4/18 : ARG pull_licenses ---> Running in e463099803a1 Removing intermediate container e463099803a1 ---> ae3ddecd4759 Step 5/18 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* ---> Running in 1f18e16571e4 Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB] Get:2 http://deb.debian.org/debian buster InRelease [121 kB] Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB] Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [213 kB] Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7905 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [7868 B] Fetched 8364 kB in 2s (4780 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2694 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24603 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container 1f18e16571e4 ---> 65eddf2d9525 Step 6/18 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> d163698995b1 Step 7/18 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip ---> Running in 2973dcae6487 Ignoring avro: markers 'python_version <= "2.7"' don't match your environment Ignoring futures: markers 'python_version < "3.0"' don't match your environment Ignoring pyvcf: markers 'python_version < "3.0"' don't match your environment Ignoring typing: markers 'python_full_version < "3.5.3"' don't match your environment Ignoring guppy: markers 'python_version <= "2.7"' don't match your environment Ignoring numpy: markers 'python_version <= "2.7"' don't match your environment Ignoring scipy: markers 'python_version <= "2.7"' don't match your environment Ignoring pandas: markers 'python_version <= "2.7"' don't match your environment Ignoring tensorflow: markers 'python_version <= "2.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==0.23.3 Downloading fastavro-0.23.3-cp37-cp37m-manylinux2010_x86_64.whl (1.4 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==3.0.0 Downloading oauth2client-3.0.0.tar.gz (77 kB) Collecting protobuf==3.12.0 Downloading protobuf-3.12.0-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp37-cp37m-manylinux2014_x86_64.whl (63.1 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB) [91mWARNING: The candidate selected for download or install is a yanked version: 'google-api-core' candidate (version 1.20.0 at https://files.pythonhosted.org/packages/5c/ca/e172037b74fe39535731319e7c936160194204e07ba11222a5366ee0c346/google_api_core-1.20.0-py2.py3-none-any.whl#sha256=65ca5396393b3e592c49cba968380b6d2534d9c78b25fedbedea9dd1c6c50249 (from https://pypi.org/simple/google-api-core/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*)) Reason for being yanked: Pinned protobuf version was too low. See https://github.com/googleapis/python-api-core/issues/48 [0mCollecting google-api-core==1.20.0 Downloading google_api_core-1.20.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google-apitools-0.5.28.tar.gz (172 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.24.0 Downloading google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp37-cp37m-manylinux1_x86_64.whl (2.1 MB) Collecting guppy3==3.0.9 Downloading guppy3-3.0.9-cp37-cp37m-manylinux1_x86_64.whl (614 kB) Collecting numpy==1.17.3 Downloading numpy-1.17.3-cp37-cp37m-manylinux1_x86_64.whl (20.0 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB) Collecting pandas==0.25.2 Downloading pandas-0.25.2-cp37-cp37m-manylinux1_x86_64.whl (10.4 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.2.0 Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB) > Task :sdks:python:container:py37:docker FAILED :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 30.599 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 37s 20 actionable tasks: 14 executed, 6 up-to-date The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=e4d0ec5e-987d-4b9c-ae5c-cc00e61943ee, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 18062 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-18062.out.log ----- Last 20 lines from daemon log file - daemon-18062.out.log ----- :sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 30.599 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 37s 20 actionable tasks: 14 executed, 6 up-to-date Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
