See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/2907/display/redirect?page=changes>
Changes: [chamikaramj] Include coders embedded in CombinePayload when converting x-lang [kevinsijo] [BEAM-9919] Refining xlang types and wrappers [Luke Cwik] [BEAM-9979] Support a reset call that happens after the bundle is done [noreply] [BEAM-10200] Add optional experiment to enable heap dump through the … [kevinsijo] [BEAM-9919] xlang transforms wrapped with namespaces [kevinsijo] [BEAM-9919] cleaning namespace.go ------------------------------------------ [...truncated 110.13 KB...] > Task :runners:portability:java:compileTestJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/runners/portability/java/src/test/java/org/apache/beam/runners/portability/CloseableResourceTest.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :runners:portability:java:testClasses > Task :runners:portability:java:testJar > Task :sdks:java:container:pullLicenses Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :sdks:python:installGcpTest Successfully installed apache-beam-2.25.0.dev0 apipkg-1.5 atomicwrites-1.4.0 attrs-19.3.0 avro-1.9.2 backports.functools-lru-cache-1.6.1 boto3-1.14.46 botocore-1.17.46 cachetools-3.1.1 certifi-2020.6.20 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.23.6 fasteners-0.15 freezegun-0.3.15 funcsigs-1.0.2 google-api-core-1.22.1 google-apitools-0.5.31 google-auth-1.20.1 google-cloud-bigquery-1.27.2 google-cloud-bigtable-1.4.0 google-cloud-core-1.4.1 google-cloud-datastore-1.15.0 google-cloud-dlp-1.0.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.7.0 google-cloud-spanner-1.17.1 google-cloud-videointelligence-1.15.0 google-cloud-vision-1.0.0 google-resumable-media-0.7.1 googleapis-common-protos-1.52.0 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.17.4 idna-2.10 jmespath-0.10.0 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.4 pandas-0.24.2 parameterized-0.7.4 pbr-5.4.5 pyarrow-0.16.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.11.0 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.3.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.1 pytz-2020.1 pyvcf-0.6.8 pyyaml-5.3.1 requests-2.24.0 requests-mock-1.8.0 rsa-4.0 s3transfer-0.3.3 tenacity-5.1.5 typing-extensions-3.7.4.2 urllib3-1.25.10 wcwidth-0.2.5 > Task :sdks:java:container:pullLicenses done. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.9.1-py3-none-any.whl (115 kB) Processing /home/jenkins/.cache/pip/wheels/c4/f0/ae/d4689c4532d1f111462ed6a884a7767d502e511ee65f0d8e1b/future-0.18.2-py3-none-any.whl Processing /home/jenkins/.cache/pip/wheels/57/d0/2c/e2003abb5bc1a94c2e8a6fe1c03b8055d074e34c13672e7eb7/PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.0.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Installing collected packages: soupsieve, beautifulsoup4, future, pyyaml, six, tenacity Successfully installed beautifulsoup4-4.9.1 future-0.18.2 pyyaml-5.3.1 six-1.15.0 soupsieve-2.0.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 176 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.105555 seconds with 16 threads. Copy licenses to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:copyDockerfileDependencies > Task :runners:flink:1.10:job-server:shadowJar > Task :runners:flink:1.10:job-server:flinkJobServerSetup Launching job server @ 18091 ... > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go> > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:java:container:dockerPrepare > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py2:copyLauncherDependencies > Task :sdks:python:container:py2:dockerPrepare > Task :sdks:java:container:docker > Task :sdks:python:container:py2:docker Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 52 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2874 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24538 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container 44b49f4c36cc ---> 12ff8a3f81c7 Step 6/18 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> f5096bca572c Step 7/18 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip ---> Running in 46d13abcbc2f [91mDEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support [0mIgnoring avro-python3: markers 'python_version >= "3.4"' don't match your environment Ignoring guppy3: markers 'python_version >= "3.5"' don't match your environment Ignoring numpy: markers 'python_version >= "3.4"' don't match your environment Ignoring scipy: markers 'python_version >= "3.4"' don't match your environment Ignoring pandas: markers 'python_version >= "3.4"' don't match your environment Ignoring tensorflow: markers 'python_version >= "3.5"' don't match your environment Collecting avro==1.8.2 Downloading avro-1.8.2.tar.gz (43 kB) Collecting fastavro==0.23.3 Downloading fastavro-0.23.3-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting futures==3.2.0 Downloading futures-3.2.0-py2-none-any.whl (15 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==3.0.0 Downloading oauth2client-3.0.0.tar.gz (77 kB) Collecting protobuf==3.12.2 Downloading protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyvcf==0.6.8 Downloading PyVCF-0.6.8.tar.gz (34 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Requirement already satisfied: typing==3.7.4.1 in /usr/local/lib/python2.7/site-packages (from -r /tmp/base_image_requirements.txt (line 44)) (3.7.4.1) Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py2-none-any.whl (9.0 kB) Collecting google-api-core==1.21.0 Downloading google_api_core-1.21.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google_apitools-0.5.28-py2-none-any.whl (134 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp27-cp27mu-manylinux1_x86_64.whl (2.0 MB) Collecting guppy==0.1.11 Downloading guppy-0.1.11.tar.gz (500 kB) Collecting numpy==1.16.5 Downloading numpy-1.16.5-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB) [91mERROR: Exception: Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/pip/_internal/cli/base_command.py", line 186, in _main status = self.run(options, args) File "/usr/local/lib/python2.7/site-packages/pip/_internal/commands/install.py", line 331, in run resolver.resolve(requirement_set) File "/usr/local/lib/python2.7/site-packages/pip/_internal/legacy_resolve.py", line 177, in resolve discovered_reqs.extend(self._resolve_one(requirement_set, req)) File "/usr/local/lib/python2.7/site-packages/pip/_internal/legacy_resolve.py", line 333, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/usr/local/lib/python2.7/site-packages/pip/_internal/legacy_resolve.py", line 282, in _get_abstract_dist_for abstract_dist = self.preparer.prepare_linked_requirement(req) File "/usr/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 482, in prepare_linked_requirement hashes=hashes, File "/usr/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 287, in unpack_url hashes=hashes, File "/usr/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 159, in unpack_http_url link, downloader, temp_dir.path, hashes File "/usr/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 303, in _download_http_url for chunk in download.chunks: File "/usr/local/lib/python2.7/site-packages/pip/_internal/utils/ui.py", line 160, in iter for x in it: File "/usr/local/lib/python2.7/site-packages/pip/_internal/network/utils.py", line 39, in response_chunks decode_content=False, File "/usr/local/lib/python2.7/site-packages/pip/_vendor/urllib3/response.py", line 564, in stream data = self.read(amt=amt, decode_content=decode_content) File "/usr/local/lib/python2.7/site-packages/pip/_vendor/urllib3/response.py", line 529, in read raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File "/usr/local/lib/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback) File "/usr/local/lib/python2.7/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher raise ProtocolError("Connection broken: %r" % e, e) ProtocolError: ("Connection broken: error(104, 'Connection reset by peer')", error(104, 'Connection reset by peer')) [0m[91mWARNING: You are using pip version 20.0.2; however, version 20.2.2 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 2 > Task :sdks:python:container:py2:docker FAILED > Task :runners:flink:1.10:job-server:flinkJobServerCleanup Stopping job server pid: 29599. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py2:docker'. > Process 'command 'docker'' finished with non-zero exit value 2 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 56s 140 actionable tasks: 106 executed, 32 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/q5gf3ba6c24bu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
