See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/10982/display/redirect>
Changes:
------------------------------------------
[...truncated 326.38 KB...]
#9 84.91 for chunk in chunks:
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_internal/cli/progress_bars.py",
line 53, in _rich_progress_bar
#9 84.91 for chunk in iterable:
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_internal/network/utils.py", line
63, in response_chunks
#9 84.91 for chunk in response.raw.stream(
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_vendor/urllib3/response.py", line
622, in stream
#9 84.91 data = self.read(amt=amt, decode_content=decode_content)
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_vendor/urllib3/response.py", line
587, in read
#9 84.91 raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
#9 84.91 File "/usr/local/lib/python3.9/contextlib.py", line 137, in __exit__
#9 84.91 self.gen.throw(typ, value, traceback)
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_vendor/urllib3/response.py", line
455, in _error_catcher
#9 84.91 raise ProtocolError("Connection broken: %r" % e, e)
#9 84.91 pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken:
OSError(28, 'No space left on device')", OSError(28, 'No space left on device'))
#9 84.95
#9 84.95 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 84.95 [notice] To update, run: pip install --upgrade pip
#9 87.49 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
> Task :sdks:python:container:py38:docker
#9 137.3 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 524.1/524.1 MB ? eta
0:00:00
#9 139.3 Collecting tensorflow-estimator==2.13.0
#9 139.3 Downloading tensorflow_estimator-2.13.0-py2.py3-none-any.whl (440 kB)
#9 139.4 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 440.8/440.8 kB 31.7 MB/s
eta 0:00:00
#9 139.4 Collecting tensorflow-io-gcs-filesystem==0.32.0
#9 139.5 Downloading
tensorflow_io_gcs_filesystem-0.32.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl
(2.4 MB)
#9 139.5 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 39.1 MB/s eta
0:00:00
#9 139.6 Collecting termcolor==2.3.0
#9 139.6 Downloading termcolor-2.3.0-py3-none-any.whl (6.9 kB)
#9 139.7 Collecting testcontainers==3.7.1
#9 139.7 Downloading testcontainers-3.7.1-py2.py3-none-any.whl (45 kB)
#9 139.7 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 45.3/45.3 kB 5.2 MB/s
eta 0:00:00
#9 139.7 Collecting threadpoolctl==3.2.0
#9 139.7 Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
#9 139.8 Collecting tomli==2.0.1
#9 139.8 Downloading tomli-2.0.1-py3-none-any.whl (12 kB)
#9 139.9 Collecting tqdm==4.65.0
#9 139.9 Downloading tqdm-4.65.0-py3-none-any.whl (77 kB)
#9 140.0 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 kB 9.9 MB/s
eta 0:00:00
#9 140.0 Collecting typing_extensions==4.5.0
#9 140.0 Downloading typing_extensions-4.5.0-py3-none-any.whl (27 kB)
#9 140.1 Collecting uritemplate==4.1.1
#9 140.1 Downloading uritemplate-4.1.1-py2.py3-none-any.whl (10 kB)
#9 140.2 Collecting urllib3==1.26.16
#9 140.2 Downloading urllib3-1.26.16-py2.py3-none-any.whl (143 kB)
#9 140.2 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.1/143.1 kB 16.6 MB/s
eta 0:00:00
#9 140.3 Collecting websocket-client==1.6.1
#9 140.3 Downloading websocket_client-1.6.1-py3-none-any.whl (56 kB)
#9 140.3 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.9/56.9 kB 7.2 MB/s
eta 0:00:00
#9 140.4 Collecting Werkzeug==2.3.6
#9 140.4 Downloading Werkzeug-2.3.6-py3-none-any.whl (242 kB)
#9 140.4 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 242.5/242.5 kB 23.5 MB/s
eta 0:00:00
#9 140.6 Collecting wrapt==1.15.0
#9 140.7 Downloading
wrapt-1.15.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(81 kB)
#9 140.7 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 81.5/81.5 kB 8.3 MB/s
eta 0:00:00
#9 140.7 Collecting zipp==3.16.2
#9 140.8 Downloading zipp-3.16.2-py3-none-any.whl (7.2 kB)
#9 141.0 Collecting zstandard==0.21.0
#9 141.0 Downloading
zstandard-0.21.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7
MB)
#9 141.1 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 37.0 MB/s eta
0:00:00
#9 142.9 Building wheels for collected packages: bs4, crcmod, dill, docopt,
future, google-apitools, google-cloud-profiler
#9 142.9 Building wheel for bs4 (setup.py): started
#9 143.3 Building wheel for bs4 (setup.py): finished with status 'done'
#9 143.3 Created wheel for bs4: filename=bs4-0.0.1-py3-none-any.whl size=1256
sha256=82c4f542e9600333c6dd499143ecc8bd6f728f28cf3ec796717d5723105ffd27
#9 143.3 Stored in directory:
/root/.cache/pip/wheels/75/78/21/68b124549c9bdc94f822c02fb9aa3578a669843f9767776bca
#9 143.3 Building wheel for crcmod (setup.py): started
#9 143.9 Building wheel for crcmod (setup.py): finished with status 'done'
#9 143.9 Created wheel for crcmod:
filename=crcmod-1.7-cp38-cp38-linux_x86_64.whl size=30633
sha256=cd41b72ad87fa7728a5a9a16901d2abb0d92fa7781040d1720288686049866b0
#9 143.9 Stored in directory:
/root/.cache/pip/wheels/ca/5a/02/f3acf982a026f3319fb3e798a8dca2d48fafee7761788562e9
#9 143.9 Building wheel for dill (setup.py): started
#9 144.3 Building wheel for dill (setup.py): finished with status 'done'
#9 144.3 Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl
size=78543
sha256=94cb882b926970e51f56cf4feef64b73ee4b9ae069371dcbf81a5c719eef42e9
#9 144.3 Stored in directory:
/root/.cache/pip/wheels/07/35/78/e9004fa30578734db7f10e7a211605f3f0778d2bdde38a239d
#9 144.3 Building wheel for docopt (setup.py): started
#9 144.6 Building wheel for docopt (setup.py): finished with status 'done'
#9 144.6 Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl
size=13705
sha256=6479c220e1cb47c97721a0042c1ede89ba45f2ab8420b2bb400e16a2bd69349a
#9 144.6 Stored in directory:
/root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c
#9 144.6 Building wheel for future (setup.py): started
#9 145.2 Building wheel for future (setup.py): finished with status 'done'
#9 145.2 Created wheel for future: filename=future-0.18.3-py3-none-any.whl
size=492023
sha256=d83dcb2cba86339ffba57eb6b618d5249c2df2646486e163b284dbd575c6ac1c
#9 145.2 Stored in directory:
/root/.cache/pip/wheels/a0/0b/ee/e6994fadb42c1354dcccb139b0bf2795271bddfe6253ccdf11
#9 145.2 Building wheel for google-apitools (setup.py): started
#9 145.6 Building wheel for google-apitools (setup.py): finished with status
'done'
#9 145.6 Created wheel for google-apitools:
filename=google_apitools-0.5.31-py3-none-any.whl size=131021
sha256=fdd7c1fb3b51e9fd78a3ac51726555bfd22207d2165793e82a27ec9f04881c63
#9 145.6 Stored in directory:
/root/.cache/pip/wheels/d7/54/79/85de1824f2f4175fb4960c72afb10045d86700c3941dc73685
#9 145.6 Building wheel for google-cloud-profiler (setup.py): started
#9 149.5 Building wheel for google-cloud-profiler (setup.py): finished with
status 'done'
#9 149.6 Created wheel for google-cloud-profiler:
filename=google_cloud_profiler-4.0.0-cp38-cp38-linux_x86_64.whl size=732024
sha256=54531febb218129ae84d5d025e8b90e739c675071c6c592034f778bbe9b34c15
#9 149.6 Stored in directory:
/root/.cache/pip/wheels/68/54/f6/578612279c3d939f61486f5f337a2ce9a542c58c2610de0529
#9 149.6 Successfully built bs4 crcmod dill docopt future google-apitools
google-cloud-profiler
#9 149.6 Installing collected packages: sortedcontainers, requests-mock, pytz,
python-snappy, oauth2client, nose, mmh3, libclang, hdfs, google-pasta,
google-cloud-profiler, google-auth-httplib2, flatbuffers, docopt, deprecation,
crcmod, cffi, bs4, astunparse, zstandard, zipp, wrapt, Werkzeug,
websocket-client, urllib3, uritemplate, typing_extensions, tqdm, tomli,
threadpoolctl, testcontainers, termcolor, tensorflow-io-gcs-filesystem,
tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard,
tenacity, sqlparse, SQLAlchemy, soupsieve, six, Shapely, scipy, scikit-learn,
rsa, requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot,
pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary, protobuf,
proto-plus, pluggy, parameterized, pandas, packaging, overrides, orjson,
opt-einsum, objsize, oauthlib, numpy, nltk, mock, MarkupSafe, Markdown, keras,
joblib, iniconfig, importlib-metadata, idna, hypothesis, httplib2, h5py,
guppy3, grpcio-status, grpcio, grpc-google-iam-v1, greenlet,
googleapis-common-protos, google-resumable-media, google-crc32c,
google-cloud-vision, google-cloud-videointelligence, google-cloud-storage,
google-cloud-spanner, google-cloud-resource-manager,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-cloud-aiplatform, google-auth-oauthlib,
google-auth, google-apitools, google-api-python-client, google-api-core, gast,
future, freezegun, fasteners, fastavro, execnet, exceptiongroup, docker,
dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer,
certifi, cachetools, beautifulsoup4, attrs, absl-py
#9 165.7 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 165.7
#9 165.7
#9 165.7 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 165.7 [notice] To update, run: pip install --upgrade pip
> Task :sdks:python:container:py310:docker
#9 165.7 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 165.7
#9 165.7
#9 165.7 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 165.7 [notice] To update, run: pip install --upgrade pip
#9 167.1 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
> Task :sdks:python:container:py38:docker
#9 167.1 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache &&
rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache && rm -rf
> /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
> install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
> /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 149.6 Created wheel for google-cloud-profiler:
filename=google_cloud_profiler-4.0.0-cp38-cp38-linux_x86_64.whl size=732024
sha256=54531febb218129ae84d5d025e8b90e739c675071c6c592034f778bbe9b34c15
#9 149.6 Stored in directory:
/root/.cache/pip/wheels/68/54/f6/578612279c3d939f61486f5f337a2ce9a542c58c2610de0529
#9 149.6 Successfully built bs4 crcmod dill docopt future google-apitools
google-cloud-profiler
#9 149.6 Installing collected packages: sortedcontainers, requests-mock, pytz,
python-snappy, oauth2client, nose, mmh3, libclang, hdfs, google-pasta,
google-cloud-profiler, google-auth-httplib2, flatbuffers, docopt, deprecation,
crcmod, cffi, bs4, astunparse, zstandard, zipp, wrapt, Werkzeug,
websocket-client, urllib3, uritemplate, typing_extensions, tqdm, tomli,
threadpoolctl, testcontainers, termcolor, tensorflow-io-gcs-filesystem,
tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard,
tenacity, sqlparse, SQLAlchemy, soupsieve, six, Shapely, scipy, scikit-learn,
rsa, requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot,
pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary, protobuf,
proto-plus, pluggy, parameterized, pandas, packaging, overrides, orjson,
opt-einsum, objsize, oauthlib, numpy, nltk, mock, MarkupSafe, Markdown, keras,
joblib, iniconfig, importlib-metadata, idna, hypothesis, httplib2, h5py,
guppy3, grpcio-status, grpcio, grpc-google-iam-v1, greenlet,
googleapis-common-protos, google-resumable-media, google-crc32c,
google-cloud-vision, google-cloud-videointelligence, google-cloud-storage,
google-cloud-spanner, google-cloud-resource-manager,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-cloud-aiplatform, google-auth-oauthlib,
google-auth, google-apitools, google-api-python-client, google-api-core, gast,
future, freezegun, fasteners, fastavro, execnet, exceptiongroup, docker,
dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer,
certifi, cachetools, beautifulsoup4, attrs, absl-py
#9 165.7 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 165.7
#9 165.7
#9 165.7 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 165.7 [notice] To update, run: pip install --upgrade pip
#9 167.1 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
&& rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools &&
pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py38:docker FAILED
> Task :sdks:python:container:py311:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache &&
rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache && rm -rf
> /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
> install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
> /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 81.50 Created wheel for google-apitools:
filename=google_apitools-0.5.31-py3-none-any.whl size=131021
sha256=285f5dfdfe5315f62fb131771d6da4e02f908edcd930b463062f6fc6b94919f5
#9 81.51 Stored in directory:
/root/.cache/pip/wheels/b4/7b/c5/b3dc55a0d70c63727a2fd1332b3cc14193d6d12219aa1372c4
#9 81.51 Successfully built bs4 crcmod dill docopt future google-apitools
#9 81.51 Installing collected packages: sortedcontainers, requests-mock, pytz,
oauth2client, nose, mmh3, libclang, hdfs, google-pasta, google-auth-httplib2,
flatbuffers, docopt, deprecation, crcmod, cffi, bs4, astunparse, zstandard,
wrapt, Werkzeug, websocket-client, urllib3, typing_extensions, tqdm,
threadpoolctl, testcontainers, termcolor, tensorflow-io-gcs-filesystem,
tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard,
tenacity, sqlparse, SQLAlchemy, soupsieve, six, Shapely, scipy, scikit-learn,
rsa, requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot,
pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary, protobuf,
proto-plus, pluggy, parameterized, pandas, packaging, overrides, orjson,
opt-einsum, objsize, oauthlib, numpy, nltk, mock, MarkupSafe, Markdown, keras,
joblib, iniconfig, idna, hypothesis, httplib2, h5py, guppy3, grpcio-status,
grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos,
google-resumable-media, google-crc32c, google-cloud-vision,
google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner,
google-cloud-resource-manager, google-cloud-recommendations-ai,
google-cloud-pubsublite, google-cloud-pubsub, google-cloud-language,
google-cloud-dlp, google-cloud-datastore, google-cloud-core,
google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery,
google-cloud-aiplatform, google-auth-oauthlib, google-auth, google-apitools,
google-api-core, gast, future, freezegun, fasteners, fastavro, execnet, docker,
dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer,
certifi, cachetools, beautifulsoup4, attrs, absl-py
#9 84.91 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 84.91
#9 84.93
#9 84.93 [notice] A new release of pip is available: 23.1.2 -> 23.2.1
#9 84.93 [notice] To update, run: pip install --upgrade pip
#9 86.68 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
&& rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools &&
pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py310:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache &&
rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache && rm -rf
> /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
> install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
> /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 91.26 Stored in directory:
/root/.cache/pip/wheels/51/1a/10/a666f21cab39a4be0c1e9047f2f379c470e85027c24ff57e71
#9 91.26 Successfully built bs4 crcmod dill docopt google-apitools
google-cloud-profiler
#9 91.26 Failed to build future
#9 91.26 Installing collected packages: sortedcontainers, requests-mock, pytz,
python-snappy, oauth2client, nose, mmh3, libclang, hdfs, google-pasta,
google-cloud-profiler, google-auth-httplib2, flatbuffers, docopt, deprecation,
crcmod, cffi, bs4, astunparse, zstandard, wrapt, Werkzeug, websocket-client,
urllib3, uritemplate, typing_extensions, tqdm, tomli, threadpoolctl,
testcontainers, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator,
tensorflow, tensorboard-data-server, tensorboard, tenacity, sqlparse,
SQLAlchemy, soupsieve, six, Shapely, scipy, scikit-learn, rsa,
requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot,
pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary, protobuf,
proto-plus, pluggy, parameterized, pandas, packaging, overrides, orjson,
opt-einsum, objsize, oauthlib, numpy, nltk, mock, MarkupSafe, Markdown, keras,
joblib, iniconfig, idna, hypothesis, httplib2, h5py, guppy3, grpcio-status,
grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos,
google-resumable-media, google-crc32c, google-cloud-vision,
google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner,
google-cloud-resource-manager, google-cloud-recommendations-ai,
google-cloud-pubsublite, google-cloud-pubsub, google-cloud-language,
google-cloud-dlp, google-cloud-datastore, google-cloud-core,
google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery,
google-cloud-aiplatform, google-auth-oauthlib, google-auth, google-apitools,
google-api-python-client, google-api-core, gast, future, freezegun, fasteners,
fastavro, execnet, exceptiongroup, docker, dnspython, dill, Cython,
cryptography, cloudpickle, click, charset-normalizer, certifi, cachetools,
beautifulsoup4, attrs, absl-py
#9 165.7 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 165.7
#9 165.7
#9 165.7 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 165.7 [notice] To update, run: pip install --upgrade pip
#9 167.1 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
&& rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools &&
pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py39:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache &&
rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache && rm -rf
> /var/lib/apt/lists/* && pip install --upgrade setuptools && pip
> install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
> /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 84.91 raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
#9 84.91 File "/usr/local/lib/python3.9/contextlib.py", line 137, in __exit__
#9 84.91 self.gen.throw(typ, value, traceback)
#9 84.91 File
"/usr/local/lib/python3.9/site-packages/pip/_vendor/urllib3/response.py", line
455, in _error_catcher
#9 84.91 raise ProtocolError("Connection broken: %r" % e, e)
#9 84.91 pip._vendor.urllib3.exceptions.ProtocolError: ("Connection broken:
OSError(28, 'No space left on device')", OSError(28, 'No space left on device'))
#9 84.95
#9 84.95 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#9 84.95 [notice] To update, run: pip install --upgrade pip
#9 87.49 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
&& rm -rf /var/lib/apt/lists/* && pip install --upgrade setuptools &&
pip install --no-deps -r /tmp/base_image_requirements.txt && rm -rf
/tmp/base_image_requirements.txt && python -c "import nltk;
nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip &&
python -c "from google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
FAILURE: Build completed with 5 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py310:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py311:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 58s
58 actionable tasks: 47 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://ge.apache.org/s/tmxuzhgmg5gra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
