See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/884/display/redirect?page=changes>
Changes: [noreply] Revert "Remove subprocess.PIPE usage by using a temp file (#22654)" ------------------------------------------ [...truncated 92.86 KB...] /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + go-licenses csv github.com/apache/beam/sdks/v2/java/container + tee /output/licenses/list.csv W0906 03:10:19.688352 193 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:py:dockerRun go: downloading golang.org/x/text v0.3.7 go: added github.com/apache/beam/sdks/v2 v2.41.0 go: added github.com/golang/protobuf v1.5.2 go: added github.com/nightlyone/lockfile v1.0.0 go: added golang.org/x/net v0.0.0-20220624214902-1bab6f366d9e go: added golang.org/x/sys v0.0.0-20220624220833-87e55d714810 go: added golang.org/x/text v0.3.7 go: added google.golang.org/genproto v0.0.0-20220714211235-042d03aeabc9 go: added google.golang.org/grpc v1.48.0 go: added google.golang.org/protobuf v1.28.0 + go-licenses save github.com/apache/beam/sdks/v2/python/container --save_path=/output/licenses W0906 03:10:12.733385 32 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + go-licenses csv github.com/apache/beam/sdks/v2/python/container + tee /output/licenses/list.csv W0906 03:10:17.680836 190 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/python/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/v1.0.0/LICENSE,MIT golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py37:copyGolangLicenses > Task :sdks:python:installGcpTest Installing collected packages: pytz, pyasn1, parameterized, iniconfig, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, tomli, threadpoolctl, tenacity, rsa, regex, pyyaml, python-dateutil, pymysql, pymongo, pyhamcrest, pydot, pycparser, pyasn1-modules, psycopg2-binary, proto-plus, pbr, overrides, orjson, objsize, oauthlib, numpy, joblib, jmespath, isodate, idna, httplib2, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, dill, cloudpickle, charset-normalizer, certifi, cachetools, attrs, sqlalchemy, scipy, requests, pyarrow, pandas, oauth2client, mock, grpcio-status, grpcio-gcp, google-resumable-media, google-auth, freezegun, deprecation, cffi, botocore, scikit-learn, s3transfer, requests-oauthlib, requests_mock, pytest, hdfs, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, docker, cryptography, azure-core, testcontainers, pytest-timeout, pytest-forked, msrest, google-cloud-core, boto3, apache-beam, pytest-xdist, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, azure-storage-blob, google-cloud-pubsublite > Task :sdks:python:container:py37:dockerPrepare > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker Removing intermediate container de3737330350 ---> 7f27f338ed37 Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 577556e8b4f5 Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 30cff439aa5f Removing intermediate container 30cff439aa5f ---> 4a0c078e8e6d Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in e1839c1ccd2e Removing intermediate container e1839c1ccd2e ---> 398115b66f06 Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> a91f07baac03 Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 2934e454bf6a Removing intermediate container 2934e454bf6a ---> f2d9c8021b5d Successfully built f2d9c8021b5d Successfully tagged apache/beam_java8_sdk:2.42.0.dev > Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :sdks:python:container:py37:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python] bd03dd3814b4: Preparing 81be1492e42a: Preparing 334c03d04483: Preparing 1cdf646f177f: Preparing b33522f493a8: Preparing 6a6dac1be764: Preparing efdb293a1935: Preparing 35b4f78f8e0f: Preparing 7e4bae7b81e2: Preparing c6ee7b7a189c: Preparing 713d8a3676ac: Preparing cbcd4eeea9a7: Preparing 7ff8d04f135b: Preparing 965ca9f89a2f: Preparing bd2aedacc58f: Preparing 0d858d352b03: Preparing 76bc459f764a: Preparing 100796cdf3b1: Preparing 54acb5a6fa0b: Preparing 713d8a3676ac: Waiting 8d51c618126f: Preparing 9ff6e4d46744: Preparing cbcd4eeea9a7: Waiting c6ee7b7a189c: Waiting a89d1d47b5a1: Preparing 655ed1b7a428: Preparing 35b4f78f8e0f: Waiting 7e4bae7b81e2: Waiting 6a6dac1be764: Waiting 54acb5a6fa0b: Waiting efdb293a1935: Waiting a89d1d47b5a1: Waiting 8d51c618126f: Waiting 655ed1b7a428: Waiting bd2aedacc58f: Waiting 0d858d352b03: Waiting 76bc459f764a: Waiting 100796cdf3b1: Waiting b33522f493a8: Pushed 334c03d04483: Pushed 1cdf646f177f: Pushed bd03dd3814b4: Pushed 81be1492e42a: Pushed 35b4f78f8e0f: Pushed efdb293a1935: Pushed 7e4bae7b81e2: Pushed 7ff8d04f135b: Pushed 965ca9f89a2f: Pushed 713d8a3676ac: Pushed bd2aedacc58f: Layer already exists 0d858d352b03: Layer already exists 76bc459f764a: Layer already exists 100796cdf3b1: Layer already exists 54acb5a6fa0b: Layer already exists 8d51c618126f: Layer already exists 9ff6e4d46744: Layer already exists a89d1d47b5a1: Layer already exists 655ed1b7a428: Layer already exists 6a6dac1be764: Pushed c6ee7b7a189c: Pushed cbcd4eeea9a7: Pushed 20220906030928: digest: sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47 size: 5156 > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 36411 Launching Python expansion service @ 34017 > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED java.lang.IllegalStateException at RunInferenceTransformTest.java:108 java.lang.NullPointerException at Preconditions.java:980 org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED java.lang.IllegalStateException at RunInferenceTransformTest.java:60 java.lang.NullPointerException at Preconditions.java:980 16 tests completed, 2 failed, 2 skipped > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 223104. Stopping expansion service pid: 223105. > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906030928 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906030928] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906030928] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:295e90b3e619064a77dd419a0c21991bff9ec037f43965f5c383c7485d161e47]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906030928 Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18 Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906030928] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906030928] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18])]. Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18 Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:e5bb74b9938409bb3fdb1d8f4c40f7102d365fb93d0651c05febcfe3ea004c18]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 32m 52s 184 actionable tasks: 121 executed, 57 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/ojrpgb76pypak Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
