See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/5531/display/redirect>
Changes: ------------------------------------------ [...truncated 64.86 KB...] Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2 Successfully built bs4 crcmod dill docopt future google-apitools google-cloud-profiler termcolor Installing collected packages: termcolor, tensorboard-plugin-wit, tenacity, requests-mock, pytz, python-snappy, pyasn1-modules, pyasn1, parameterized, oauth2client, nose, mock, mmh3, libclang, Keras-Preprocessing, keras, iniconfig, hdfs, grpcio-gcp, google-python-cloud-debugger, google-pasta, google-cloud-profiler, google-auth-httplib2, flatbuffers, docopt, deprecation, crcmod, cffi, bs4, astunparse, zstandard, zipp, wrapt, Werkzeug, websocket-client, urllib3, uritemplate, typing-utils, typing_extensions, tqdm, tomli, threadpoolctl, testcontainers, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorflow, tensorboard-data-server, tensorboard, SQLAlchemy, soupsieve, six, scipy, scikit-learn, rsa, requests-oauthlib, requests, regex, PyYAML, python-dateutil, pytest-xdist, pytest-timeout, pytest-forked, pytest, pyparsing, PyMySQL, pymongo, PyHamcrest, pydot, pycparser, pyarrow, py, psycopg2-binary, protobuf, proto-plus, pluggy, pbr, pandas, packaging, overrides, orjson, opt-einsum, objsize, oauthlib, numpy, nltk, MarkupSafe, Markdown, joblib, importlib-metadata, idna, httplib2, h5py, guppy3, grpcio-status, grpcio, grpc-google-iam-v1, greenlet, googleapis-common-protos, google-resumable-media, google-crc32c, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsublite, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-core, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-auth-oauthlib, google-auth, google-apitools, google-api-python-client, google-api-core, gast, future, freezegun, fasteners, fastavro, execnet, docker, dill, Cython, cryptography, cloudpickle, click, charset-normalizer, certifi, cachetools, beautifulsoup4, attrs, absl-py Successfully installed Cython-0.29.32 Keras-Preprocessing-1.1.2 Markdown-3.4.1 MarkupSafe-2.1.1 PyHamcrest-1.10.1 PyMySQL-1.0.2 PyYAML-6.0 SQLAlchemy-1.4.39 Werkzeug-2.2.1 absl-py-1.2.0 astunparse-1.6.3 attrs-22.1.0 beautifulsoup4-4.11.1 bs4-0.0.1 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.0 click-8.1.3 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.4 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.5.4 fasteners-0.17.3 flatbuffers-1.12 freezegun-1.2.1 future-0.18.2 gast-0.4.0 google-api-core-2.8.1 google-api-python-client-2.55.0 google-apitools-0.5.31 google-auth-2.9.1 google-auth-httplib2-0.1.0 google-auth-oauthlib-0.4.6 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-2.3.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.8.0 google-cloud-language-1.3.2 google-cloud-profiler-4.0.0 google-cloud-pubsub-2.13.4 google-cloud-pubsublite-1.4.2 google-cloud-recommendations-ai-0.7.0 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-pasta-0.2.0 google-python-cloud-debugger-2.19 google-resumable-media-2.3.3 googleapis-common-protos-1.56.4 greenlet-1.1.2 grpc-google-iam-v1-0.12.4 grpcio-1.47.0 grpcio-gcp-0.2.2 grpcio-status-1.47.0 guppy3-3.1.2 h5py-3.7.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 importlib-metadata-4.12.0 iniconfig-1.1.1 joblib-1.1.0 keras-2.9.0 libclang-14.0.6 mmh3-3.0.0 mock-2.0.0 nltk-3.7 nose-1.3.7 numpy-1.21.6 oauth2client-4.1.3 oauthlib-3.2.0 objsize-0.5.2 opt-einsum-3.3.0 orjson-3.7.11 overrides-6.1.0 packaging-21.3 pandas-1.3.5 parameterized-0.8.1 pbr-5.9.0 pluggy-1.0.0 proto-plus-1.20.6 protobuf-3.19.4 psycopg2-binary-2.9.3 py-1.11.0 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pymongo-3.12.3 pyparsing-3.0.9 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 python-snappy-0.6.1 pytz-2022.1 regex-2022.7.25 requests-2.28.1 requests-mock-1.9.3 requests-oauthlib-1.3.1 rsa-4.9 scikit-learn-1.0.2 scipy-1.7.3 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5 tensorboard-2.9.1 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.9.1 tensorflow-estimator-2.9.0 tensorflow-io-gcs-filesystem-0.26.0 termcolor-1.1.0 testcontainers-3.6.0 threadpoolctl-3.1.0 tomli-2.0.1 tqdm-4.64.0 typing-utils-0.1.0 typing_extensions-4.3.0 uritemplate-4.1.1 urllib3-1.26.11 websocket-client-1.3.3 wrapt-1.14.1 zipp-3.8.1 zstandard-0.18.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0m[91mWARNING: You are using pip version 22.0.4; however, version 22.2.2 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0m[91m[nltk_data] Downloading package stopwords to /root/nltk_data... [nltk_data] Unzipping corpora/stopwords.zip. [0mVerified fast protobuf used. Removing intermediate container 4a16e125d524 ---> 0b20d3a8972f Step 7/32 : RUN pip install --upgrade pip setuptools ---> Running in 669de3f22eb5 Requirement already satisfied: pip in /usr/local/lib/python3.7/site-packages (22.0.4) Collecting pip Downloading pip-22.2.2-py3-none-any.whl (2.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 28.8 MB/s eta 0:00:00 Requirement already satisfied: setuptools in /usr/local/lib/python3.7/site-packages (57.5.0) Collecting setuptools Downloading setuptools-65.3.0-py3-none-any.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 63.4 MB/s eta 0:00:00 Installing collected packages: setuptools, pip Attempting uninstall: setuptools Found existing installation: setuptools 57.5.0 Uninstalling setuptools-57.5.0: Successfully uninstalled setuptools-57.5.0 Attempting uninstall: pip Found existing installation: pip 22.0.4 Uninstalling pip-22.0.4: Successfully uninstalled pip-22.0.4 Successfully installed pip-22.2.2 setuptools-65.3.0 [91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [0mRemoving intermediate container 669de3f22eb5 ---> d785fc125bf8 Step 8/32 : ENV CLOUDSDK_CORE_DISABLE_PROMPTS yes ---> Running in 63cff7cd0a73 Removing intermediate container 63cff7cd0a73 ---> 0f8985bb937d Step 9/32 : ENV PATH $PATH:/usr/local/gcloud/google-cloud-sdk/bin ---> Running in c1f49cef5a81 Removing intermediate container c1f49cef5a81 ---> e3feaa597be6 Step 10/32 : RUN mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm google-cloud-sdk.tar.gz ---> Running in d94f5b19d68c Welcome to the Google Cloud CLI! WARNING: You appear to be running this script as root. This may cause the installation to be inaccessible to users other than the root user. [91mBeginning update. This process may take several minutes. [0m[91m [0m[91m Your current Google Cloud CLI version is: 402.0.0 [0m[91mInstalling components from version: 402.0.0 [0m[91m [0m[91m┌─────────────────────────────────────────────────────────────────────────────┐[0m[91m [0m[91m│ These components will be installed. │[0m[91m [0m[91m├─────────────────────────────────────────────────────┬────────────┬──────────┤[0m[91m [0m[91m│ Name │ Version │ Size │[0m[91m [0m[91m├─────────────────────────────────────────────────────┼────────────┼──────────┤[0m[91m [0m[91m│ [0m[91mBigQuery Command Line Tool [0m[91m [0m[91m│ [0m[91m 2.0.75[0m[91m [0m[91m│ [0m[91m 1.6 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91mBigQuery Command Line Tool (Platform Specific) [0m[91m [0m[91m│ [0m[91m 2.0.75[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91mCloud Storage Command Line Tool [0m[91m [0m[91m│ [0m[91m 5.13[0m[91m [0m[91m│ [0m[91m15.5 MiB[0m[91m │[0m[91m [0m[91m│ [0m[91mCloud Storage Command Line Tool (Platform Specific)[0m[91m [0m[91m│ [0m[91m 5.11[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91mGoogle Cloud CLI Core Libraries (Platform Specific)[0m[91m [0m[91m│ [0m[91m2022.08.05[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91mGoogle Cloud CRC32C Hash Tool [0m[91m │ [0m[91m 1.0.0[0m[91m [0m[91m│ [0m[91m 1.2 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91manthoscli [0m[91m [0m[91m│ [0m[91m 0.2.29 [0m[91m│ [0m[91m37.6 MiB[0m[91m [0m[91m│[0m[91m [0m[91m│ [0m[91mgcloud cli dependencies [0m[91m [0m[91m│ [0m[91m2021.04.16[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m [0m[91m└─────────────────────────────────────────────────────┴────────────┴──────────┘[0m[91m [0m[91m [0m[91mFor the latest full release notes, please visit: https://cloud.google.com/sdk/release_notes [0m[91m╔════════════════════════════════════════════════════════════╗ [0m[91m╠═ Creating update staging area ═╣ [0m[91m╚[0m[91m══════[0m[91m══════[0m[91m══════[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: BigQuery Command Line Tool ═╣ [0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: BigQuery Command Line Tool (Platform Spec... ═╣ [0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: Cloud Storage Command Line Tool ═╣ [0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: Cloud Storage Command Line Tool (Platform... ═╣ [0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: Default set of gcloud commands ═╣ [0m[91m╚[0m[91m════════════════════════════════════════════════════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: Google Cloud CLI Core Libraries (Platform... ═╣ [0m[91m╚[0m[91m══════════════════════════════[0m[91m═══════════════[0m[91m═══════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: Google Cloud CRC32C Hash Tool ═╣ [0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═══════════════[0m[91m═══════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ [0m[91m╠═ Installing: Google Cloud CRC32C Hash Tool ═╣ [0m[91m╚[0m[91m════════════════════════════════════════════════════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ [0m[91m╠═ Installing: anthoscli ═╣ [0m[91m╚[0m[91m════════════════════════════════════════════════════════════[0m[91m╝ [0m[91m╔════════════════════════════════════════════════════════════╗ [0m[91m╠═ Installing: anthoscli ═╣ [0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m══════════[0m[91m═════════[0m[91m═══════════╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Installing: gcloud cli dependencies ═╣ [0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════╝ [0m[91m╔════════════════════════════════════════════════════════════╗ ╠═ Creating backup and activating new installation ═╣ [0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════[0m[91m╝ [0m[91m [0m[91mPerforming post processing steps... .......................................................................................done. Update done! [0m To help improve the quality of this product, we collect anonymized usage data and anonymized stacktraces when crashes are encountered; additional information is available at <https://cloud.google.com/sdk/usage-statistics>. This data is handled in accordance with our privacy policy <https://cloud.google.com/terms/cloud-privacy-notice>. You may choose to opt in this collection now (by choosing 'Y' at the below prompt), or at any time in the future by running the following command: gcloud config set disable_usage_reporting false This will install all the core command line tools necessary for working with the Google Cloud Platform. For more information on how to get started, please visit: https://cloud.google.com/sdk/docs/quickstarts [91m==> Source [/usr/local/gcloud/google-cloud-sdk/completion.bash.inc] in your profile to enable shell command completion for gcloud. ==> Source [/usr/local/gcloud/google-cloud-sdk/path.bash.inc] in your profile to add the Google Cloud SDK command line tools to your $PATH. [0mRemoving intermediate container d94f5b19d68c ---> 08167caef163 Step 11/32 : RUN ln -s /usr/bin/ccache /usr/local/bin/gcc ---> Running in 705dc9a1caa4 Removing intermediate container 705dc9a1caa4 ---> a846b17e53b5 Step 12/32 : RUN ccache --set-config=sloppiness=file_macro && ccache --set-config=hash_dir=false ---> Running in ca41ea44a65b Removing intermediate container ca41ea44a65b ---> 0c317a281270 Step 13/32 : COPY target/apache-beam.tar.gz /opt/apache/beam/tars/ ---> 16f37571e9cd Step 14/32 : RUN pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp] ---> Running in 0c776db35410 Using pip 22.2.2 from /usr/local/lib/python3.7/site-packages/pip (python 3.7) Processing /opt/apache/beam/tars/apache-beam.tar.gz Preparing metadata (setup.py): started [91m Running command python setup.py egg_info [0m[91m Traceback (most recent call last): [0m[91m File "<string>", line 36, in <module> [0m[91m File "<pip-setuptools-caller>", line 34, in <module> [0m[91m File "/tmp/pip-req-build-nqvg0pt6/setup.py", line 169, in <module> [0m[91m generate_protos_first() [0m[91m File "/tmp/pip-req-build-nqvg0pt6/setup.py", line 139, in generate_protos_first [0m[91m gen_protos.generate_proto_files() [0m[91m File "/tmp/pip-req-build-nqvg0pt6/gen_protos.py", line 476, in generate_proto_files [0m[91m raise RuntimeError(error_msg) [0m[91m RuntimeError: Not in apache git tree, unable to find proto definitions. [0m[91m error: subprocess-exited-with-error × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. [0m[91m full command: /usr/local/bin/python -c ' exec(compile('"'"''"'"''"'"' # This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py # # - It imports setuptools before invoking setup.py, to enable projects that directly # import from `distutils.core` to work with newer packaging standards. # - It provides a clear error message when setuptools is not installed. # - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so # setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning: # manifest_maker: standard file '"'"'-c'"'"' not found". # - It generates a shim setup.py, for handling setup.cfg-only projects. import os, sys, tokenize try: import setuptools except ImportError as error: print( "ERROR: Can not execute `setup.py` since setuptools is not available in " "the build environment.", file=sys.stderr, ) sys.exit(1) __file__ = %r sys.argv[0] = __file__ if os.path.exists(__file__): filename = __file__ with tokenize.open(__file__) as f: setup_py_code = f.read() else: filename = "<auto-generated setuptools caller>" setup_py_code = "from setuptools import setup; setup()" exec(compile(setup_py_code, filename, "exec")) '"'"''"'"''"'"' % ('"'"'/tmp/pip-req-build-nqvg0pt6/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' egg_info --egg-base /tmp/pip-pip-egg-info-ug99rsod [0m[91m cwd: /tmp/pip-req-build-nqvg0pt6/ [0m Preparing metadata (setup.py): finished with status 'error' [91merror: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. [0mThe command '/bin/sh -c pip install --no-deps -v /opt/apache/beam/tars/apache-beam.tar.gz[gcp]' returned a non-zero code: 1 > Task :sdks:python:container:py37:docker FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 5m 10s 142 actionable tasks: 94 executed, 44 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/ffvuhcyhwjm52 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
