See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/11314/display/redirect>
Changes:
------------------------------------------
[...truncated 1.11 MB...]
78910 | static PyMethodDef __pyx_mdef___pyx_array_1__reduce_cython__ =
{"__reduce_cython__", (PyCFunction)__pyx_pw___pyx_array_1__reduce_cython__,
METH_NOARGS, 0};
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
apache_beam/coders/coder_impl.c:6817:20: warning:
‘__pyx_mdef_11apache_beam_6coders_10coder_impl_5lambda1’ defined but not used
[-Wunused-variable]
6817 | static PyMethodDef
__pyx_mdef_11apache_beam_6coders_10coder_impl_5lambda1 = {"lambda1",
(PyCFunction)(void*)(PyCFunctionWithKeywords)__pyx_pw_11apache_beam_6coders_10coder_impl_5lambda1,
METH_VARARGS|METH_KEYWORDS, 0};
|
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
apache_beam/coders/coder_impl.c: In function
‘__pyx_f_11apache_beam_6coders_10coder_impl_12RowCoderImpl_encode_batch_to_stream’:
apache_beam/coders/coder_impl.c:59337:7: warning: ‘__pyx_v_null_bits_len’
may be used uninitialized in this function [-Wmaybe-uninitialized]
59337 | for (__pyx_t_5 = 0; __pyx_t_5 < __pyx_t_21; __pyx_t_5+=1) {
| ^~~
apache_beam/coders/coder_impl.c: In function
‘__pyx_f_11apache_beam_6coders_10coder_impl_12RowCoderImpl_decode_batch_from_stream’:
apache_beam/coders/coder_impl.c:60639:42: warning: ‘__pyx_v_null_mask_c’
may be used uninitialized in this function [-Wmaybe-uninitialized]
60639 | __pyx_t_17 = (((__pyx_v_null_mask_c[(__pyx_v_i >> 3)]) &
(0x01 << (__pyx_v_i & 0x07))) != 0);
| ^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions
-Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions
-Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2
build/temp.linux-x86_64-3.8/apache_beam/coders/coder_impl.o -o
build/lib.linux-x86_64-3.8/apache_beam/coders/coder_impl.cpython-38-x86_64-linux-gnu.so
building 'apache_beam.metrics.cells' extension
creating build/temp.linux-x86_64-3.8/apache_beam/metrics
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG
-g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat
-Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC
-I/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/numpy/core/include
-I<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/include>
-I/usr/include/python3.8 -c apache_beam/metrics/cells.c -o
build/temp.linux-x86_64-3.8/apache_beam/metrics/cells.o
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions
-Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions
-Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2
build/temp.linux-x86_64-3.8/apache_beam/metrics/cells.o -o
build/lib.linux-x86_64-3.8/apache_beam/metrics/cells.cpython-38-x86_64-linux-gnu.so
building 'apache_beam.metrics.execution' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG
-g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat
-Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC
-I/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/numpy/core/include
-I<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/include>
-I/usr/include/python3.8 -c apache_beam/metrics/execution.c -o
build/temp.linux-x86_64-3.8/apache_beam/metrics/execution.o
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions
-Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions
-Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2
build/temp.linux-x86_64-3.8/apache_beam/metrics/execution.o -o
build/lib.linux-x86_64-3.8/apache_beam/metrics/execution.cpython-38-x86_64-linux-gnu.so
building 'apache_beam.runners.common' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG
-g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat
-Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat
-Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC
-I/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/numpy/core/include
-I<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/include>
-I/usr/include/python3.8 -c apache_beam/runners/common.c -o
build/temp.linux-x86_64-3.8/apache_beam/runners/common.o
apache_beam/runners/common.c:66495:1: fatal error: error writing to
/tmp/cccObxUq.s: No space left on device
66495 | }
| ^
compilation terminated.
<string>:32: DeprecationWarning: pkg_resources is deprecated as an API.
See https://setuptools.pypa.io/en/latest/pkg_resources.html
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/coders/coder_impl.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/coders/coder_impl_row_encoders.pyx
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/coders/stream.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/metrics/cells.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/metrics/execution.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/runners/common.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/runners/worker/opcounters.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/runners/worker/operations.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/runners/worker/statesampler_fast.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/testing/fast_test_utils.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/transforms/cy_combiners.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/transforms/cy_dataflow_distribution_counter.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/transforms/stats.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/utils/counters.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/Cython/Compiler/Main.py:369:
FutureWarning: Cython directive 'language_level' not set, using 2 for now
(Py2). This will change in a later release! File:
/tmp/pip-req-build-a025n6yh/apache_beam/utils/windowed_value.pxd
tree = Parsing.p_module(s, pxd, full_module_name)
/tmp/pip-build-env-_71me8pa/overlay/lib/python3.8/site-packages/setuptools/dist.py:314:
InformationOnly: Normalizing '2.52.0.dev' to '2.52.0.dev0'
self.metadata.version = self._normalize_version(
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
[end of output]
note: This error originates from a subprocess, and is likely not a problem
with pip.
ERROR: Failed building wheel for apache-beam
ERROR: Could not build wheels for apache-beam, which is required to install
pyproject.toml-based projects
> Task :sdks:python:test-suites:dataflow:py38:installGcpTest FAILED
> Task :sdks:python:container:py310:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache libgeos-dev &&
> rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools
> wheel && pip install --no-deps -r /tmp/base_image_requirements.txt &&
> rm -rf /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 58.31 Stored in directory:
/root/.cache/pip/wheels/e5/8d/b6/99c1c0a3ac5788c866b0ecd3f48b0134a5910e6ed26011800b
#9 58.31 Building wheel for pyjsparser (setup.py): started
#9 58.59 Building wheel for pyjsparser (setup.py): finished with status 'done'
#9 58.59 Created wheel for pyjsparser:
filename=pyjsparser-2.7.1-py3-none-any.whl size=25982
sha256=e9f635b385751c4024355a203e5e28240973a93b671bf725b1e1f653294ba4c5
#9 58.59 Stored in directory:
/root/.cache/pip/wheels/5e/81/26/5956478df303e2bf5a85a5df595bb307bd25948a4bab69f7c7
#9 58.60 Successfully built bs4 crcmod dill docopt future google-apitools
google-cloud-profiler hdfs pyjsparser
#9 58.60 Installing collected packages: sortedcontainers, requests-mock, pytz,
python-snappy, pyjsparser, oauth2client, nose, mmh3, Js2Py, hdfs,
google-cloud-profiler, google-auth-httplib2, docopt, deprecation, crcmod, bs4,
zstandard, wrapt, websocket-client, urllib3, uritemplate, tzlocal,
typing_extensions, tqdm, tomli, threadpoolctl, testcontainers, tenacity,
sqlparse, SQLAlchemy, soupsieve, six, shapely, scipy, scikit-learn, rsa,
rpds-py, requests, regex, referencing, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyproject_hooks, pyparsing, PyMySQL, pymongo,
PyHamcrest, pydot, pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary,
protobuf, proto-plus, pluggy, parameterized, pandas, packaging, overrides,
orjson, objsize, numpy, nltk, mock, jsonschema-specifications, jsonschema,
joblib, iniconfig, idna, hypothesis, httplib2, guppy3, grpcio-status, grpcio,
grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media,
google-crc32c, google-cloud-vision, google-cloud-videointelligence,
google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-cloud-aiplatform, google-auth, google-apitools,
google-api-python-client, google-api-core, future, freezegun, fasteners,
fastavro, execnet, exceptiongroup, docker, dnspython, dill, Cython,
cryptography, cloudpickle, click, charset-normalizer, cffi, certifi,
cachetools, build, beautifulsoup4, attrs
#9 88.46 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 88.46
#9 90.44 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py311:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache libgeos-dev &&
> rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools
> wheel && pip install --no-deps -r /tmp/base_image_requirements.txt &&
> rm -rf /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 42.42 Stored in directory:
/root/.cache/pip/wheels/b9/1d/dc/eb0833be25464c359903d356c4204721c6a672c26ff164cdc3
#9 42.43 Building wheel for pyjsparser (setup.py): started
#9 42.74 Building wheel for pyjsparser (setup.py): finished with status 'done'
#9 42.74 Created wheel for pyjsparser:
filename=pyjsparser-2.7.1-py3-none-any.whl size=25982
sha256=9bf0ff7f6779baebde51a40bc812b4915be4e7ad4fb81c7f95ab0ff05b626684
#9 42.74 Stored in directory:
/root/.cache/pip/wheels/a5/9a/30/1003e89ab4555b81840ca46d361bf184f1e6ad880cae3b62a9
#9 42.74 Successfully built bs4 crcmod dill docopt future google-apitools hdfs
pyjsparser
#9 42.75 Installing collected packages: sortedcontainers, requests-mock, pytz,
pyjsparser, oauth2client, nose, mmh3, Js2Py, hdfs, google-auth-httplib2,
docopt, deprecation, crcmod, bs4, zstandard, wrapt, websocket-client, urllib3,
tzlocal, typing_extensions, tqdm, threadpoolctl, testcontainers, tenacity,
sqlparse, SQLAlchemy, soupsieve, six, shapely, scipy, scikit-learn, rsa,
rpds-py, requests, regex, referencing, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyproject_hooks, pyparsing, PyMySQL, pymongo,
PyHamcrest, pydot, pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary,
protobuf, proto-plus, pluggy, parameterized, pandas, packaging, overrides,
orjson, objsize, numpy, nltk, mock, jsonschema-specifications, jsonschema,
joblib, iniconfig, idna, hypothesis, httplib2, guppy3, grpcio-status, grpcio,
grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media,
google-crc32c, google-cloud-vision, google-cloud-videointelligence,
google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-cloud-aiplatform, google-auth, google-apitools,
google-api-core, future, freezegun, fasteners, fastavro, execnet, docker,
dnspython, dill, Cython, cryptography, cloudpickle, click, charset-normalizer,
cffi, certifi, cachetools, build, beautifulsoup4, attrs
#9 88.56 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device:
'/usr/local/lib/python3.11/site-packages/google/cloud/aiplatform_v1beta1/services/model_service'
#9 88.56
#9 90.59 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py39:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache libgeos-dev &&
> rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools
> wheel && pip install --no-deps -r /tmp/base_image_requirements.txt &&
> rm -rf /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin: Cannot
mkdir: No space left on device
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin/v1beta4/__init__.py:
Cannot open: No such file or directory
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin: Cannot
mkdir: No space left on device
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin/v1beta4/resources.py:
Cannot open: No such file or directory
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin: Cannot
mkdir: No space left on device
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin/v1beta4/sqladmin_v1beta4_client.py:
Cannot open: No such file or directory
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin: Cannot
mkdir: No space left on device
#9 140.2 tar:
google-cloud-sdk/lib/googlecloudsdk/generated_clients/apis/sqladmin/v1beta4/sqladmin_v1beta4_messages.py:
Cannot open: No such file or directory
#9 146.2 tar: Exiting with failure status due to previous errors
#9 146.2 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
> Task :sdks:python:container:py38:docker FAILED
#9 ERROR: executor failed running [/bin/sh -c apt-get update && apt-get
install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
------
> [beam 5/5] RUN apt-get update && apt-get install -y
> libsnappy-dev libyaml-dev ccache libgeos-dev &&
> rm -rf /var/lib/apt/lists/* && pip install --upgrade pip setuptools
> wheel && pip install --no-deps -r /tmp/base_image_requirements.txt &&
> rm -rf /tmp/base_image_requirements.txt && python -c "import nltk;
> nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip
> && python -c "from google.protobuf.internal import api_implementation;
> assert api_implementation._implementation_type == 'upb'; print ('Verified
> fast protobuf used.')" && mkdir -p /usr/local/gcloud && cd
> /usr/local/gcloud && curl -s -O
> https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
> -xf google-cloud-sdk.tar.gz &&
> /usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
> /usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
> google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
> ccache --set-config=sloppiness=file_macro && ccache
> --set-config=hash_dir=false && pip install --no-deps -v
> /opt/apache/beam/tars/apache-beam.tar.gz[gcp] && pip check || (echo
> "Container does not include required Beam dependencies or has conflicting
> dependencies. If Beam dependencies have changed, you need to regenerate
> base_image_requirements.txt files. See:
> https://s.apache.org/beam-python-requirements-generate"; && exit 1) &&
> pip freeze --all && rm -rf /root/.cache/pip:
#9 62.72 Stored in directory:
/root/.cache/pip/wheels/68/dd/29/c1a590238f9ebbe4f7ee9b3583f5185d0b9577e23f05c990eb
#9 62.73 Building wheel for pyjsparser (setup.py): started
#9 63.05 Building wheel for pyjsparser (setup.py): finished with status 'done'
#9 63.05 Created wheel for pyjsparser:
filename=pyjsparser-2.7.1-py3-none-any.whl size=25982
sha256=1176f20b3d577c0f26f4e24c798bf946c930549b23542e498643887953968dbd
#9 63.05 Stored in directory:
/root/.cache/pip/wheels/d5/88/34/ccb5bb40eb3178a134eb293e6c363928c5bcfba0b91031db76
#9 63.06 Successfully built bs4 crcmod dill docopt future google-apitools
google-cloud-profiler hdfs pyjsparser
#9 63.06 Installing collected packages: sortedcontainers, requests-mock, pytz,
python-snappy, pyjsparser, oauth2client, nose, mmh3, Js2Py, hdfs,
google-cloud-profiler, google-auth-httplib2, docopt, deprecation, crcmod, bs4,
zstandard, zipp, wrapt, websocket-client, urllib3, uritemplate, tzlocal,
typing_extensions, tqdm, tomli, threadpoolctl, testcontainers, tenacity,
sqlparse, SQLAlchemy, soupsieve, six, shapely, scipy, scikit-learn, rsa,
rpds-py, requests, regex, referencing, PyYAML, python-dateutil, pytest-xdist,
pytest-timeout, pytest, pyproject_hooks, pyparsing, PyMySQL, pymongo,
PyHamcrest, pydot, pycparser, pyasn1-modules, pyasn1, pyarrow, psycopg2-binary,
protobuf, proto-plus, pluggy, pkgutil_resolve_name, parameterized, pandas,
packaging, overrides, orjson, objsize, numpy, nltk, mock,
jsonschema-specifications, jsonschema, joblib, iniconfig, importlib-resources,
importlib-metadata, idna, hypothesis, httplib2, guppy3, grpcio-status, grpcio,
grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media,
google-crc32c, google-cloud-vision, google-cloud-videointelligence,
google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager,
google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub,
google-cloud-language, google-cloud-dlp, google-cloud-datastore,
google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage,
google-cloud-bigquery, google-cloud-aiplatform, google-auth, google-apitools,
google-api-python-client, google-api-core, future, freezegun, fasteners,
fastavro, execnet, exceptiongroup, docker, dnspython, dill, Cython,
cryptography, cloudpickle, click, charset-normalizer, cffi, certifi,
cachetools, build, beautifulsoup4, backports.zoneinfo, attrs
#9 140.2 ERROR: Could not install packages due to an OSError: [Errno 28] No
space left on device
#9 140.2
#9 142.0 Container does not include required Beam dependencies or has
conflicting dependencies. If Beam dependencies have changed, you need to
regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate
------
ERROR: failed to solve: executor failed running [/bin/sh -c apt-get update &&
apt-get install -y libsnappy-dev libyaml-dev ccache
libgeos-dev && rm -rf /var/lib/apt/lists/* && pip install
--upgrade pip setuptools wheel && pip install --no-deps -r
/tmp/base_image_requirements.txt && rm -rf /tmp/base_image_requirements.txt
&& python -c "import nltk; nltk.download('stopwords')" && rm
/root/nltk_data/corpora/stopwords.zip && python -c "from
google.protobuf.internal import api_implementation; assert
api_implementation._implementation_type == 'upb'; print ('Verified fast
protobuf used.')" && mkdir -p /usr/local/gcloud && cd /usr/local/gcloud
&& curl -s -O
https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar
-xf google-cloud-sdk.tar.gz &&
/usr/local/gcloud/google-cloud-sdk/install.sh && rm -rf
/usr/local/gcloud/google-cloud-sdk/.install/.backup && rm
google-cloud-sdk.tar.gz && ln -s /usr/bin/ccache /usr/local/bin/gcc &&
ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false
&& pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]
&& pip check || (echo "Container does not include required Beam
dependencies or has conflicting dependencies. If Beam dependencies have
changed, you need to regenerate base_image_requirements.txt files. See:
https://s.apache.org/beam-python-requirements-generate"; && exit 1) && pip
freeze --all && rm -rf /root/.cache/pip]: exit code: 1
FAILURE: Build completed with 8 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py311:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py310:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py311:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
8: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 4m 23s
52 actionable tasks: 46 executed, 1 from cache, 5 up-to-date
Publishing build scan...
https://ge.apache.org/s/e3elktxytbsnc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
