See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1181/display/redirect?page=changes>
Changes: [noreply] Port changes from Pub/Sub Lite to beam (#15418) [heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the [BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for [noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494) [noreply] [BEAM-12802] Add support for prefetch through data layers down through [noreply] [BEAM-11097] Add implementation of side input cache (#15483) ------------------------------------------ [...truncated 44.40 KB...] Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 207 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.5432 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :runners:core-construction-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses > Task :runners:core-construction-java:classes > Task :runners:core-construction-java:jar > Task :release:go-licenses:java:dockerRun + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:py:dockerRun + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:container:py36:dockerPrepare > Task :runners:core-java:compileJava > Task :sdks:python:container:py36:docker ---> Running in f9a5a9831799 Removing intermediate container f9a5a9831799 ---> 67594eb5e82e Step 4/27 : ARG pull_licenses ---> Running in bf30b2e6ed19 Removing intermediate container bf30b2e6ed19 ---> 029050972f4c Step 5/27 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* ---> Running in 028bc0929e50 Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB] Get:2 http://deb.debian.org/debian buster InRelease [122 kB] Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB] Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [303 kB] Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7907 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [15.2 kB] Fetched 8465 kB in 4s (2355 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2373 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20% (Reading database ... 25%(Reading database ... 30% (Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24613 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container 028bc0929e50 ---> ea6cbadab43f Step 6/27 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 9524f4130d8f Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in fb156fc51550 Ignoring pandas: markers 'python_version >= "3.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==1.0.0.post1 Downloading fastavro-1.0.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (1.4 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting grpcio==1.34.0 Downloading grpcio-1.34.0-cp36-cp36m-manylinux2014_x86_64.whl (4.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.19.1 Downloading httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp36-cp36m-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==3.0.0 Downloading pyarrow-3.0.0-cp36-cp36m-manylinux2014_x86_64.whl (20.7 MB) > Task :runners:core-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:core-java:classes > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:harness:classes > Task :sdks:java:harness:jar > Task :sdks:java:harness:shadowJar > Task :runners:java-fn-execution:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:java-fn-execution:classes > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:testing:expansion-service:compileTestJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:testing:expansion-service:testClasses > Task :sdks:java:io:kafka:compileJava > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > Task :sdks:java:io:kafka:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:kafka:classes > Task :sdks:java:io:kafka:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03. As an alternative, use `gcloud auth configure-docker` to configure `docker` to use `gcloud` as a credential helper, then use `docker` as you would for non-GCR registries, e.g. `docker pull gcr.io/project-id/my-image`. Add `--verbosity=error` to silence this warning: `gcloud docker --verbosity=error -- pull gcr.io/project-id/my-image`. See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker > Task :runners:google-cloud-dataflow-java:setupXVR > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup > Task :runners:google-cloud-dataflow-java:cleanUpDockerImages Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911000146] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a3c5b2ad963d6ccf63ad4a03ff48b61093ec7b64f17ab9bc4023b81403bc0fea] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911000146] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a3c5b2ad963d6ccf63ad4a03ff48b61093ec7b64f17ab9bc4023b81403bc0fea])]. Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a3c5b2ad963d6ccf63ad4a03ff48b61093ec7b64f17ab9bc4023b81403bc0fea Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a3c5b2ad963d6ccf63ad4a03ff48b61093ec7b64f17ab9bc4023b81403bc0fea]. Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba4e7f3bb2a3b66a80198260a4ec9227dc969323ddbb7d3d8fd3a8c39b5c8a41 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ba4e7f3bb2a3b66a80198260a4ec9227dc969323ddbb7d3d8fd3a8c39b5c8a41]. Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6249b538866651f32026af70b15130077fbceadd7ca2b42b170cded4bc800706 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:6249b538866651f32026af70b15130077fbceadd7ca2b42b170cded4bc800706]. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 17m 14s 105 actionable tasks: 84 executed, 17 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/lwz7caudrp4lu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
