See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/2812/display/redirect?page=changes>
Changes: [noreply] (#25316) Enable LZMA compression in Python SDK I/O (#25317) [noreply] Add WatchFilePattern (#25393) [noreply] Support gauge metrics in portable mode (#25396) ------------------------------------------ [...truncated 245.42 KB...] go: added google.golang.org/grpc v1.51.0 go: added google.golang.org/protobuf v1.28.1 + go-licenses save github.com/apache/beam/sdks/v2/go/container --save_path=/output/licenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:go:test:setupVirtualenv Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-67.2.0-py3-none-any.whl (1.1 MB) Collecting six Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting wheel>=0.36.0 Using cached wheel-0.38.4-py3-none-any.whl (36 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting numpy<1.25,>=1.14.3 Using cached numpy-1.24.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB) Collecting filelock>=3.0.0 Using cached filelock-3.9.0-py3-none-any.whl (9.7 kB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting packaging>=14 Using cached packaging-23.0-py3-none-any.whl (42 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.19.0-py3-none-any.whl (8.7 MB) Collecting grpcio>=1.37.0 Using cached grpcio-1.51.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting platformdirs<4,>=2.4 Using cached platformdirs-3.0.0-py3-none-any.whl (14 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.18.0-py3-none-any.whl (8.7 MB) Collecting platformdirs<3,>=2.4 Using cached platformdirs-2.6.2-py3-none-any.whl (14 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.17.1-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Installing collected packages: distlib, wheel, toml, six, setuptools, py, protobuf, pluggy, platformdirs, packaging, numpy, grpcio, filelock, virtualenv, mypy-protobuf, grpcio-tools, tox Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 > Task :sdks:java:container:pullLicenses FAILED Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 58, in pull_from_url url_read = urlopen(Request(url, headers={ File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python3.8/urllib/request.py", line 531, in open response = meth(req, response) File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response response = self.parent.error( File "/usr/lib/python3.8/urllib/request.py", line 569, in error return self._call_chain(*args) File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain result = func(*args) File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 404: Not Found ERROR:root:Invalid url for zstd-jni-1.5.2-5: https://opensource.org/licenses/BSD-2-Clause. Retrying... Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 58, in pull_from_url url_read = urlopen(Request(url, headers={ File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python3.8/urllib/request.py", line 531, in open response = meth(req, response) File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response response = self.parent.error( File "/usr/lib/python3.8/urllib/request.py", line 569, in error return self._call_chain(*args) File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain result = func(*args) File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 404: Not Found ERROR:root:Invalid url for zstd-jni-1.5.2-5: https://opensource.org/licenses/BSD-2-Clause. Retrying... Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 58, in pull_from_url url_read = urlopen(Request(url, headers={ File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python3.8/urllib/request.py", line 531, in open response = meth(req, response) File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response response = self.parent.error( File "/usr/lib/python3.8/urllib/request.py", line 569, in error return self._call_chain(*args) File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain result = func(*args) File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 404: Not Found ERROR:root:Invalid url for zstd-jni-1.5.2-5: https://opensource.org/licenses/BSD-2-Clause after 9 retries. ERROR:root:['zstd-jni-1.5.2-5'] ERROR:root:**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [zstd-jni-1.5.2-5] INFO:root:pull_licenses_java.py failed. It took 44.221971 seconds with 16 threads. Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 326, in <module> raise RuntimeError('{n} error(s) occurred.'.format(n=len(error_msg)), RuntimeError: ('1 error(s) occurred.', ['**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [zstd-jni-1.5.2-5]']) > Task :sdks:java:container:goPrepare UP-TO-DATE > Task :release:go-licenses:go:dockerRun W0213 20:54:07.673552 28 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/v2/go/container W0213 20:54:21.741571 69 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s > Task :sdks:java:container:goBuild > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > Task :release:go-licenses:go:dockerRun + chmod -R a+w /output/licenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker ---> Running in cc5a18e594bc Removing intermediate container cc5a18e594bc ---> d9ea2d0fac11 Step 3/11 : ARG pull_licenses ---> Running in 47f6628b879a Removing intermediate container 47f6628b879a ---> 5d492481d054 Step 4/11 : RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/* ---> Running in 56ae8d3a276c Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB] Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB] Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB] Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [226 kB] Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.6 kB] Fetched 8632 kB in 3s (2882 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: openssl The following NEW packages will be installed: ca-certificates openssl 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded. Need to get 1011 kB of archives. After this operation, 1892 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian-security bullseye-security/main amd64 openssl amd64 1.1.1n-0+deb11u4 [853 kB] Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 1011 kB in 0s (4707 kB/s) Selecting previously unselected package openssl. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6661 files and directories currently installed.) Preparing to unpack .../openssl_1.1.1n-0+deb11u4_amd64.deb ... Unpacking openssl (1.1.1n-0+deb11u4) ... Selecting previously unselected package ca-certificates. Preparing to unpack .../ca-certificates_20210119_all.deb ... Unpacking ca-certificates (20210119) ... Setting up openssl (1.1.1n-0+deb11u4) ... Setting up ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 129 added, 0 removed; done. Processing triggers for ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Removing intermediate container 56ae8d3a276c ---> a634a1af5c7e Step 5/11 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 8d71f1bbc92c Step 6/11 : COPY target/LICENSE /opt/apache/beam/ ---> 38d19e7c7d2c Step 7/11 : COPY target/NOTICE /opt/apache/beam/ ---> 88493101c986 Step 8/11 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> c6ccf8e0d638 Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 9b8d66fd5cbe Removing intermediate container 9b8d66fd5cbe ---> f8e45c35ccd8 Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in c346d81d3671 Removing intermediate container c346d81d3671 ---> e2972552beab Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 019be7597b60 Removing intermediate container 019be7597b60 ---> 847f3d3aa260 Successfully built 847f3d3aa260 Successfully tagged apache/beam_go_sdk:latest FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:container:pullLicenses'. > Process 'command './license_scripts/license_script.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 3m 19s 99 actionable tasks: 66 executed, 27 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/4d3pezwl7szd4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
