See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/34/display/redirect?page=changes>
Changes: [noreply] [BEAM-13574] Large Wordcount (#16455) [noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686) ------------------------------------------ [...truncated 64.64 KB...] Collecting botocore<1.24.0,>=1.23.46 Using cached botocore-1.23.46-py3-none-any.whl (8.5 MB) Collecting jmespath<1.0.0,>=0.7.1 Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB) Collecting fasteners>=0.14 Using cached fasteners-0.17.3-py3-none-any.whl (18 kB) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting rsa<5,>=3.1.4 Using cached rsa-4.8-py3-none-any.whl (39 kB) Collecting google-resumable-media<3.0dev,>=0.6.0 Using cached google_resumable_media-2.1.0-py2.py3-none-any.whl (75 kB) Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.37.0.dev0) (21.3) Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0 Using cached google_api_core-2.4.0-py2.py3-none-any.whl (111 kB) Collecting libcst>=0.2.5 Using cached libcst-0.4.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB) Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 Using cached grpc_google_iam_v1-0.12.3-py3-none-any.whl Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0 Using cached google_api_core-1.31.5-py2.py3-none-any.whl (93 kB) Collecting google-auth<3,>=1.18.0 Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB) Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.37.0.dev0) (59.6.0) Collecting overrides<7.0.0,>=6.0.1 Using cached overrides-6.1.0-py3-none-any.whl (14 kB) Collecting grpcio-status>=1.18.0 Using cached grpcio_status-1.43.0-py3-none-any.whl (10.0 kB) Collecting docopt Using cached docopt-0.6.2-py2.py3-none-any.whl Collecting pyparsing<3,>=2.4.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting pbr>=0.11 Using cached pbr-5.8.0-py2.py3-none-any.whl (112 kB) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.37.0.dev0) (2.1.3) Collecting more-itertools>=4.0.0 Using cached more_itertools-8.12.0-py3-none-any.whl (54 kB) Collecting wcwidth Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB) Collecting pluggy<1.0,>=0.12 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting attrs>=17.4.0 Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB) Collecting atomicwrites>=1.0 Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB) Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.37.0.dev0) (1.11.0) Collecting pytest-forked Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB) Collecting execnet>=1.1 Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.11-py3-none-any.whl (39 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.8-py2.py3-none-any.whl (138 kB) Collecting greenlet!=0.4.17 Using cached greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting wrapt Using cached wrapt-1.13.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (78 kB) Collecting deprecation Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting docker Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB) Collecting cffi>=1.12 Using cached cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Using cached googleapis_common_protos-1.54.0-py2.py3-none-any.whl (207 kB) Collecting google-crc32c<2.0dev,>=1.0 Using cached google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB) Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.37.0.dev0) (3.6.0) Collecting typing-inspect>=0.4.0 Using cached typing_inspect-0.7.1-py3-none-any.whl (8.4 kB) Collecting requests-oauthlib>=0.5.0 Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB) Collecting isodate>=0.6.0 Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting typing-utils>=0.0.3 Using cached typing_utils-0.1.0-py3-none-any.whl (10 kB) Collecting websocket-client>=0.32.0 Using cached websocket_client-1.2.3-py3-none-any.whl (53 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.2.0-py3-none-any.whl (151 kB) Collecting mypy-extensions>=0.3.0 Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started > Task :sdks:java:container:pullLicenses FAILED Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 53, in pull_from_url url_read = urlopen(url) File "/usr/lib/python3.6/urllib/request.py", line 223, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python3.6/urllib/request.py", line 532, in open response = meth(req, response) File "/usr/lib/python3.6/urllib/request.py", line 642, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python3.6/urllib/request.py", line 570, in error return self._call_chain(*args) File "/usr/lib/python3.6/urllib/request.py", line 504, in _call_chain result = func(*args) File "/usr/lib/python3.6/urllib/request.py", line 650, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 500: Internal Server Error ERROR:root:Invalid url for xz-1.5: https://git.tukaani.org/?p=xz-java.git;a=blob;f=COPYING;h=c1d404dc7a6f06a0437bf1055fedaa4a4c89d728;hb=9f1f97a26f090ffec6568c004a38c6534aa82b94 after 9 retries. ERROR:root:['xz-1.5'] ERROR:root:**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [xz-1.5] INFO:root:pull_licenses_java.py failed. It took 60.14562 seconds with 16 threads. Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,> line 315, in <module> error_msg) RuntimeError: ('1 error(s) occurred.', ['**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJava_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [xz-1.5]']) > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:container:py36:dockerPrepare > Task :sdks:python:container:py36:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] 494efe40a1d2: Preparing b7bf94f65795: Preparing b8e76a937085: Preparing ad7acd34b441: Preparing a036623508b4: Preparing c843f04e85fa: Preparing 763b39e08853: Preparing eacaff427f59: Preparing 6fb696042080: Preparing ebc364cfcfc2: Preparing 9c0a6e5bddbf: Preparing cfd11dd27762: Preparing c04afe1043ac: Preparing ea969d416f81: Preparing 028e855c3708: Preparing aa4c808c19f6: Preparing 8ba9f690e8ba: Preparing 3e607d59ef9f: Preparing ebc364cfcfc2: Waiting c843f04e85fa: Waiting 1e18e7e1fcc2: Preparing c3a0d593ed24: Preparing eacaff427f59: Waiting 028e855c3708: Waiting 26a504e63be4: Preparing 8bf42db0de72: Preparing 1e18e7e1fcc2: Waiting 31892cc314cb: Preparing c3a0d593ed24: Waiting 8ba9f690e8ba: Waiting 11936051f93b: Preparing 26a504e63be4: Waiting 3e607d59ef9f: Waiting 31892cc314cb: Waiting 11936051f93b: Waiting cfd11dd27762: Waiting ea969d416f81: Waiting 6fb696042080: Waiting aa4c808c19f6: Waiting 9c0a6e5bddbf: Waiting 494efe40a1d2: Pushed a036623508b4: Pushed b8e76a937085: Pushed ad7acd34b441: Pushed c843f04e85fa: Pushed b7bf94f65795: Pushed 763b39e08853: Pushed 6fb696042080: Pushed ebc364cfcfc2: Pushed 9c0a6e5bddbf: Pushed ea969d416f81: Pushed aa4c808c19f6: Layer already exists 8ba9f690e8ba: Layer already exists 3e607d59ef9f: Layer already exists 1e18e7e1fcc2: Layer already exists 028e855c3708: Pushed c3a0d593ed24: Layer already exists 8bf42db0de72: Layer already exists 26a504e63be4: Layer already exists 31892cc314cb: Layer already exists 11936051f93b: Layer already exists eacaff427f59: Pushed cfd11dd27762: Pushed c04afe1043ac: Pushed 20220202060119: digest: sha256:93f11ed42d0e534a6459d96f2220de681ccafb4b1c8a9d852179ca9c711a905a size: 5361 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:container:pullLicenses'. > Process 'command './license_scripts/license_script.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 18m 1s 104 actionable tasks: 69 executed, 29 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/x4eaabxy3eo6o Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
