See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1312/display/redirect?page=changes>
Changes: [dmitrii_kuzin] [BEAM-12730] Custom delimiter always bytes [noreply] Minor: Add base_func to Series.aggregate expression names (#15706) [noreply] [BEAM-13013] Extend cross language expansion. (#15698) [noreply] Minor: Clarify confusing boolean logic for selecting PerWindowInvoker [noreply] [BEAM-4424] Execute hooks in enabling order (#15713) ------------------------------------------ [...truncated 71.03 KB...] Using cached SQLAlchemy-1.4.25-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) Collecting psycopg2-binary<3.0.0,>=2.8.5 Using cached psycopg2_binary-2.9.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.4 MB) Collecting testcontainers<4.0.0,>=3.0.3 Using cached testcontainers-3.4.2-py2.py3-none-any.whl (31 kB) Collecting boto3>=1.9 Using cached boto3-1.18.60-py3-none-any.whl (131 kB) Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from azure-core>=1.7.0->apache-beam==2.35.0.dev0) (1.16.0) Collecting msrest>=0.6.21 Using cached msrest-0.6.21-py2.py3-none-any.whl (85 kB) Collecting cryptography>=2.1.4 Using cached cryptography-35.0.0-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.7 MB) Collecting botocore<1.22.0,>=1.21.60 Using cached botocore-1.21.60-py3-none-any.whl (8.0 MB) Collecting s3transfer<0.6.0,>=0.5.0 Using cached s3transfer-0.5.0-py3-none-any.whl (79 kB) Collecting jmespath<1.0.0,>=0.7.1 Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB) Collecting fasteners>=0.14 Using cached fasteners-0.16.3-py2.py3-none-any.whl (28 kB) Collecting rsa<5,>=3.1.4 Using cached rsa-4.7.2-py3-none-any.whl (34 kB) Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.35.0.dev0) (58.2.0) Collecting pyasn1-modules>=0.2.1 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Collecting google-resumable-media<3.0dev,>=0.6.0 Using cached google_resumable_media-2.0.3-py2.py3-none-any.whl (75 kB) Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.35.0.dev0) (21.0) Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0 Using cached google_api_core-2.1.0-py2.py3-none-any.whl (94 kB) Collecting proto-plus>=1.10.0 Using cached proto_plus-1.19.5-py3-none-any.whl (44 kB) Collecting libcst>=0.2.5 Using cached libcst-0.3.21-py3-none-any.whl (514 kB) Collecting grpc-google-iam-v1<0.13dev,>=0.12.3 Using cached grpc_google_iam_v1-0.12.3-py3-none-any.whl Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0 Using cached google_api_core-1.31.3-py2.py3-none-any.whl (93 kB) Collecting google-auth<3,>=1.18.0 Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB) Collecting docopt Using cached docopt-0.6.2-py2.py3-none-any.whl Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.35.0.dev0) (2.4.7) Collecting pbr>=0.11 Using cached pbr-5.6.0-py2.py3-none-any.whl (111 kB) Collecting pyasn1>=0.1.7 Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB) Collecting pluggy<1.0,>=0.12 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting wcwidth Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB) Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.35.0.dev0) (1.10.0) Collecting more-itertools>=4.0.0 Using cached more_itertools-8.10.0-py3-none-any.whl (51 kB) Collecting attrs>=17.4.0 Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB) Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.35.0.dev0) (2.1.1) Collecting atomicwrites>=1.0 Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB) Collecting pytest-forked Using cached pytest_forked-1.3.0-py2.py3-none-any.whl (4.7 kB) Collecting execnet>=1.1 Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.7-py3-none-any.whl (38 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting greenlet!=0.4.17 Using cached greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting wrapt Downloading wrapt-1.13.2-cp36-cp36m-manylinux2010_x86_64.whl (77 kB) Collecting deprecation Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting docker Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB) Collecting cffi>=1.12 Downloading cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB) Collecting protobuf<4,>=3.12.2 Using cached protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Using cached googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB) Collecting google-crc32c<2.0dev,>=1.0 Using cached google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB) Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.35.0.dev0) (3.6.0) Collecting typing-inspect>=0.4.0 Using cached typing_inspect-0.7.1-py3-none-any.whl (8.4 kB) Collecting isodate>=0.6.0 Using cached isodate-0.6.0-py2.py3-none-any.whl (45 kB) Collecting requests-oauthlib>=0.5.0 Using cached requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting websocket-client>=0.32.0 Using cached websocket_client-1.2.1-py2.py3-none-any.whl (52 kB) Collecting pycparser Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.1.1-py2.py3-none-any.whl (146 kB) Collecting mypy-extensions>=0.3.0 Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:python:installGcpTest Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.35.0.dev0-py3-none-any.whl size=2576370 sha256=06132ea86c3967c498e464b1cf01a1d2c122acd8115b4603e8af4f1b8d080e82 Stored in directory: /home/jenkins/.cache/pip/wheels/ac/28/6e/20a1cb68f78721e12815f377be5bd7dc86dac3332b84355793 Successfully built apache-beam Installing collected packages: pyasn1, urllib3, rsa, pyasn1-modules, protobuf, idna, charset-normalizer, certifi, cachetools, wcwidth, typing-extensions, requests, pytz, python-dateutil, pycparser, pluggy, oauthlib, mypy-extensions, more-itertools, jmespath, googleapis-common-protos, google-auth, attrs, atomicwrites, websocket-client, typing-inspect, requests-oauthlib, pyyaml, pytest, numpy, isodate, httplib2, grpcio-gcp, google-crc32c, google-api-core, docopt, dataclasses, cffi, botocore, wrapt, s3transfer, pytest-forked, pymongo, pydot, pyarrow, proto-plus, pbr, orjson, oauth2client, msrest, libcst, hdfs, grpc-google-iam-v1, greenlet, google-resumable-media, google-cloud-core, fasteners, fastavro, execnet, docker, dill, deprecation, cryptography, crcmod, azure-core, avro-python3, testcontainers, tenacity, sqlalchemy, requests-mock, pytest-xdist, pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-apitools, freezegun, boto3, azure-storage-blob, apache-beam Attempting uninstall: protobuf Found existing installation: protobuf 3.18.1 Uninstalling protobuf-3.18.1: Successfully uninstalled protobuf-3.18.1 Attempting uninstall: pluggy Found existing installation: pluggy 1.0.0 Uninstalling pluggy-1.0.0: Successfully uninstalled pluggy-1.0.0 > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:container:py36:dockerPrepare > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker ---> ff829135ebc1 Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 92758487ecba Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> b60b6350fec0 Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 3951783c8815 > Task :sdks:python:container:py36:docker a8367252e08e: Pull complete > Task :sdks:java:container:java8:docker Removing intermediate container 3951783c8815 ---> 6d7724759c39 Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in e861eed391db Removing intermediate container e861eed391db ---> bd20ccd83c1c Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 350aacb7f464 Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 40354744331d Removing intermediate container 40354744331d ---> 5b68c1b34fd2 Successfully built 5b68c1b34fd2 Successfully tagged apache/beam_java8_sdk:2.35.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20211013180115] FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 279 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'. > Process 'command 'gcloud'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 23m 49s 131 actionable tasks: 93 executed, 34 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/cqqfqd3erghv4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
