See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/2799/display/redirect?page=changes>
Changes: [noreply] Disable defensive_copy by default in InMemoryUnmergedState [je.ik] [BEAM-10400] Fix race condition in DirectRunner watermark update [je.ik] [BEAM-10400] remove redundant state cleanup from [noreply] Fix minor issue in the Generator type hint [Kenneth Knowles] Re-enable checkerframework in Flink job server [Kenneth Knowles] Re-enable checkerframework in Spark job server [Kenneth Knowles] Make Preconditions nullness annotations separate-compilation-friendly [Kenneth Knowles] Fix preconditions nullability [Kenneth Knowles] Eliminate nullability issues from :sdks:java:build-tools and enable [Kenneth Knowles] Eliminate nullability issue from :sdks:java:expansion-service and enable [noreply] Fix typos on programming-guide.md [noreply] Fixing typo on programming-guide.md [Brian Hulette] Use TMPDIR or WORKSPACE if set rather than /tmp [Brian Hulette] Update local_job_service_main call to use --stdout_file [Brian Hulette] Add missing dependency on java container [dcavazos] [BEAM-7390] Add distinct code snippets [noreply] [BEAM-10411] Minor fix to kafkataxi instructions [noreply] [BEAM-7996] Add support for BYTES and BOOL in Python RowCoder (#12324) [Udi Meiri] [BEAM-10566] Update PythonDocker in GH README and template [noreply] [BEAM-7390] Add combinevalues code snippets (#12328) ------------------------------------------ [...truncated 106.53 KB...] > Task :runners:portability:java:compileTestJava FROM-CACHE > Task :runners:portability:java:testClasses UP-TO-DATE > Task :runners:portability:java:testJar > Task :sdks:java:container:pullLicenses done. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.9.1-py3-none-any.whl (115 kB) Processing /home/jenkins/.cache/pip/wheels/c4/f0/ae/d4689c4532d1f111462ed6a884a7767d502e511ee65f0d8e1b/future-0.18.2-py3-none-any.whl Processing /home/jenkins/.cache/pip/wheels/57/d0/2c/e2003abb5bc1a94c2e8a6fe1c03b8055d074e34c13672e7eb7/PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.0.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Installing collected packages: soupsieve, beautifulsoup4, future, pyyaml, six, tenacity > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :runners:core-java:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:core-java:testClasses > Task :sdks:java:container:pullLicenses Successfully installed beautifulsoup4-4.9.1 future-0.18.2 pyyaml-5.3.1 six-1.15.0 soupsieve-2.0.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_dir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 174 dependencies using 16 threads. > Task :runners:core-java:testJar > Task :sdks:java:container:pullLicenses INFO:root:pull_licenses_java.py succeed. It took 2.442279 seconds with 16 threads. Copy licenses to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:copyDockerfileDependencies > Task :sdks:python:installGcpTest Successfully installed apache-beam-2.24.0.dev0 apipkg-1.5 atomicwrites-1.4.0 attrs-19.3.0 avro-1.9.2 backports.functools-lru-cache-1.6.1 boto3-1.14.27 botocore-1.17.27 cachetools-3.1.1 certifi-2020.6.20 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.23.6 fasteners-0.15 freezegun-0.3.15 funcsigs-1.0.2 google-api-core-1.22.0 google-apitools-0.5.31 google-auth-1.19.2 google-cloud-bigquery-1.24.0 google-cloud-bigtable-1.0.0 google-cloud-core-1.3.0 google-cloud-datastore-1.7.4 google-cloud-dlp-0.13.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.0.2 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0 google-cloud-vision-0.42.0 google-resumable-media-0.5.1 googleapis-common-protos-1.52.0 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.17.4 idna-2.10 jmespath-0.10.0 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.4 pandas-0.24.2 parameterized-0.7.4 pbr-5.4.5 pyarrow-0.16.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.2.0 pytest-timeout-1.4.2 pytest-xdist-1.33.0 python-dateutil-2.8.1 pytz-2020.1 pyvcf-0.6.8 pyyaml-5.3.1 requests-2.24.0 requests-mock-1.8.0 rsa-4.0 s3transfer-0.3.3 tenacity-5.1.5 typing-extensions-3.7.4.2 urllib3-1.25.10 wcwidth-0.2.5 > Task :runners:flink:1.10:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:flink:1.10:testClasses > Task :runners:flink:1.10:testJar > Task :runners:flink:1.10:job-server:shadowJar > Task :runners:flink:1.10:job-server:flinkJobServerSetup Launching job server @ 18091 ... > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go> > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:java:container:dockerPrepare > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py2:copyLauncherDependencies > Task :sdks:java:container:docker Sending build context to Docker daemon 347MB Step 1/12 : FROM openjdk:8 ---> 3b85321ce426 Step 2/12 : MAINTAINER "Apache Beam <[email protected]>" > Task :sdks:python:container:py2:dockerPrepare > Task :sdks:python:container:py2:docker Fetched 8364 kB in 4s (2389 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 38 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2666 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24538 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container 622a722b9b8b ---> f7e58ea95773 Step 6/18 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 5d1dddd802c9 Step 7/18 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip ---> Running in 33d77a83a6e9 [91mDEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support [0mIgnoring avro-python3: markers 'python_version >= "3.4"' don't match your environment Ignoring guppy3: markers 'python_version >= "3.5"' don't match your environment Ignoring numpy: markers 'python_version >= "3.4"' don't match your environment Ignoring scipy: markers 'python_version >= "3.4"' don't match your environment Ignoring pandas: markers 'python_version >= "3.4"' don't match your environment Ignoring tensorflow: markers 'python_version >= "3.5"' don't match your environment Collecting avro==1.8.2 Downloading avro-1.8.2.tar.gz (43 kB) Collecting fastavro==0.23.3 Downloading fastavro-0.23.3-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) Collecting futures==3.2.0 Downloading futures-3.2.0-py2-none-any.whl (15 kB) Collecting grpcio==1.29.0 Downloading grpcio-1.29.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.12.0 Downloading httplib2-0.12.0.tar.gz (218 kB) Collecting mock==2.0.0 Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB) Collecting oauth2client==3.0.0 Downloading oauth2client-3.0.0.tar.gz (77 kB) Collecting protobuf==3.12.0 Downloading protobuf-3.12.0-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB) Collecting pyarrow==0.16.0 Downloading pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pytz==2019.3 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) Collecting pyvcf==0.6.8 Downloading PyVCF-0.6.8.tar.gz (34 kB) Collecting pyyaml==5.1 Downloading PyYAML-5.1.tar.gz (274 kB) Requirement already satisfied: typing==3.7.4.1 in /usr/local/lib/python2.7/site-packages (from -r /tmp/base_image_requirements.txt (line 44)) (3.7.4.1) Collecting typing-extensions==3.7.4.1 Downloading typing_extensions-3.7.4.1-py2-none-any.whl (9.0 kB) [91mWARNING: The candidate selected for download or install is a yanked version: 'google-api-core' candidate (version 1.20.0 at https://files.pythonhosted.org/packages/5c/ca/e172037b74fe39535731319e7c936160194204e07ba11222a5366ee0c346/google_api_core-1.20.0-py2.py3-none-any.whl#sha256=65ca5396393b3e592c49cba968380b6d2534d9c78b25fedbedea9dd1c6c50249 (from https://pypi.org/simple/google-api-core/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*)) Reason for being yanked: Pinned protobuf version was too low. See https://github.com/googleapis/python-api-core/issues/48 [0mCollecting google-api-core==1.20.0 Downloading google_api_core-1.20.0-py2.py3-none-any.whl (90 kB) Collecting google-apitools==0.5.28 Downloading google_apitools-0.5.28-py2-none-any.whl (134 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.24.0 Downloading google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.1.0 Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.7.4 Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB) Collecting cython==0.29.13 Downloading Cython-0.29.13-cp27-cp27mu-manylinux1_x86_64.whl (2.0 MB) Collecting guppy==0.1.11 Downloading guppy-0.1.11.tar.gz (500 kB) Collecting numpy==1.16.5 Downloading numpy-1.16.5-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB) Collecting scipy==1.2.2 Downloading scipy-1.2.2-cp27-cp27mu-manylinux1_x86_64.whl (24.8 MB) Collecting pandas==0.24.2 Downloading pandas-0.24.2-cp27-cp27mu-manylinux1_x86_64.whl (10.1 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0-py2-none-any.whl (134 kB) Collecting python-gflags==3.0.6 Downloading python-gflags-3.0.6.tar.gz (49 kB) Collecting tensorflow==2.1.0 Downloading tensorflow-2.1.0-cp27-cp27mu-manylinux2010_x86_64.whl (421.8 MB) [91mERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device [0m[91mWARNING: You are using pip version 20.0.2; however, version 20.1.1 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. [0mThe command '/bin/sh -c pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip' returned a non-zero code: 1 > Task :sdks:python:container:py2:docker FAILED > Task :runners:flink:1.10:job-server:flinkJobServerCleanup Skipping invalid pid: 10318. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py2:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 52s 138 actionable tasks: 105 executed, 31 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/eyvxazi2isweg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
