See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/502/display/redirect?page=changes>
Changes: [zyichi] Update BigQuery source in bigquery_tornadoes example ------------------------------------------ [...truncated 723.50 KB...] > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:harness:shadowJar UP-TO-DATE > Task :sdks:java:container:copyDockerfileDependencies UP-TO-DATE > Task :sdks:go:installDependencies > Task :runners:java-fn-execution:compileJava UP-TO-DATE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar UP-TO-DATE > Task :runners:portability:java:compileJava UP-TO-DATE > Task :runners:portability:java:classes UP-TO-DATE > Task :runners:portability:java:jar UP-TO-DATE > Task :sdks:java:core:compileTestJava UP-TO-DATE > Task :sdks:java:core:testClasses UP-TO-DATE > Task :runners:spark:compileJava UP-TO-DATE > Task :runners:spark:classes UP-TO-DATE > Task :runners:spark:jar UP-TO-DATE > Task :runners:spark:job-server:compileJava NO-SOURCE > Task :runners:spark:job-server:classes UP-TO-DATE > Task :sdks:java:core:shadowTestJar UP-TO-DATE > Task :runners:spark:job-server:shadowJar UP-TO-DATE > Task :runners:spark:job-server:sparkJobServerSetup Launching job server @ 18087 ... > Task :runners:core-construction-java:compileTestJava UP-TO-DATE > Task :runners:core-construction-java:testClasses UP-TO-DATE > Task :runners:core-construction-java:testJar UP-TO-DATE > Task :runners:portability:java:compileTestJava UP-TO-DATE > Task :runners:portability:java:testClasses UP-TO-DATE > Task :runners:portability:java:testJar UP-TO-DATE > Task :runners:core-java:compileTestJava UP-TO-DATE > Task :runners:core-java:testClasses UP-TO-DATE > Task :runners:core-java:testJar UP-TO-DATE > Task :runners:spark:compileTestJava UP-TO-DATE > Task :runners:spark:testClasses UP-TO-DATE > Task :runners:spark:testJar UP-TO-DATE > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:sdist setup.py:251: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py:476: UserWarning: Normalizing '2.21.0.dev' to '2.21.0.dev0' normalized_version, INFO:gen_protos:Skipping proto regeneration: all files up to date warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py35:copyDockerfileDependencies > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/sdks/go > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/sdks/go > Task :sdks:python:container:installDependencies > Task :sdks:java:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 UP-TO-DATE > Task :sdks:java:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:java:container:goBuild > Task :sdks:python:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:python:container:goBuild > Task :sdks:python:installGcpTest DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Processing ./build/apache-beam.tar.gz Requirement already satisfied: crcmod<2.0,>=1.7 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.7) Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.3.1.1) Requirement already satisfied: fastavro<0.22,>=0.21.4 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.21.24) Requirement already satisfied: future<1.0.0,>=0.16.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.16.0) Requirement already satisfied: grpcio<2,>=1.12.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.27.2) Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (2.5.8) Requirement already satisfied: httplib2<=0.12.0,>=0.8 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.12.0) Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (2.0.0) Requirement already satisfied: numpy<2,>=1.14.3 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.16.6) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.10.1) Requirement already satisfied: oauth2client<4,>=2.0.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.0.0) Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.11.3) Requirement already satisfied: pydot<2,>=1.2.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.4.1) Requirement already satisfied: python-dateutil<3,>=2.8.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (2.8.1) Requirement already satisfied: pytz>=2018.3 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (2019.3) Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.7.4.1) Requirement already satisfied: avro<1.10.0,>=1.8.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.9.2) Requirement already satisfied: funcsigs<2,>=1.0.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.0.2) Requirement already satisfied: futures<4.0.0,>=3.2.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.3.0) Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.6.8) Requirement already satisfied: pyarrow<0.17.0,>=0.15.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.16.0) Requirement already satisfied: typing<3.8.0,>=3.7.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.7.4.1) Requirement already satisfied: boto3>=1.9 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.12.33) Requirement already satisfied: cachetools<4,>=3.1.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (3.1.1) Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.5.28) Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.7.4) Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.0.2) Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.24.0) Requirement already satisfied: google-cloud-core<2,>=0.28.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.3.0) Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.0.0) Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.13.0) Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.2.2) Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.13.0) Requirement already satisfied: google-cloud-language<2,>=1.3.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.3.0) Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.13.0) Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.42.0) Requirement already satisfied: googledatastore<7.1,>=7.0.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (7.0.2) Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.90.4) Requirement already satisfied: freezegun>=0.3.12 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.3.15) Requirement already satisfied: nose>=1.3.7 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.3.7) Requirement already satisfied: nose_xunitmp>=0.4.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.4.1) Requirement already satisfied: pandas<0.25,>=0.23.4 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.24.2) Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (0.7.1) Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.10.1) Requirement already satisfied: pyyaml<6.0.0,>=3.12 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (5.3.1) Requirement already satisfied: requests_mock<2.0,>=1.7 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.7.0) Requirement already satisfied: tenacity<6.0,>=5.0.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (5.1.5) Requirement already satisfied: pytest<5.0,>=4.4.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (4.6.9) Requirement already satisfied: pytest-xdist<2,>=1.29.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.31.0) Requirement already satisfied: pytest-timeout<2,>=1.3.3 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from apache-beam==2.21.0.dev0) (1.3.4) Requirement already satisfied: six>=1.5.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.14.0) Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.1.10) Requirement already satisfied: docopt in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (0.6.2) Requirement already satisfied: requests>=2.7.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.23.0) Requirement already satisfied: pbr>=0.11 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.21.0.dev0) (5.4.4) Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (4.0) Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.4.8) Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.2.8) Requirement already satisfied: setuptools in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.21.0.dev0) (44.1.0) Requirement already satisfied: pyparsing>=2.1.4 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pydot<2,>=1.2.0->apache-beam==2.21.0.dev0) (2.4.6) Requirement already satisfied: s3transfer<0.4.0,>=0.3.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.3.3) Requirement already satisfied: botocore<1.16.0,>=1.15.33 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from boto3>=1.9->apache-beam==2.21.0.dev0) (1.15.33) Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.9.5) Requirement already satisfied: fasteners>=0.14 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.21.0.dev0) (0.15) Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.21.0.dev0) (1.16.0) Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam==2.21.0.dev0) (0.12.3) Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (1.12.0) Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (0.5.0) Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.21.0.dev0) (1.51.0) Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from tenacity<6.0,>=5.0.2->apache-beam==2.21.0.dev0) (1.5) Requirement already satisfied: atomicwrites>=1.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.3.0) Requirement already satisfied: pluggy<1.0,>=0.12 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.13.1) Requirement already satisfied: packaging in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3) Requirement already satisfied: attrs>=17.4.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0) Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0) Requirement already satisfied: wcwidth in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9) Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0) Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5) Requirement already satisfied: py>=1.5.0 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1) Requirement already satisfied: pytest-forked in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3) Requirement already satisfied: execnet>=1.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1) Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2019.11.28) Requirement already satisfied: idna<3,>=2.5 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9) Requirement already satisfied: chardet<4,>=3.0.2 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8) Requirement already satisfied: docutils<0.16,>=0.10 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from botocore<1.16.0,>=1.15.33->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2) Requirement already satisfied: contextlib2; python_version < "3" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0) Requirement already satisfied: configparser>=3.5; python_version < "3" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2) Requirement already satisfied: scandir; python_version < "3.5" in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0) Requirement already satisfied: apipkg>=1.4 in /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Spark/src/build/gradleenv/1922375555/lib/python2.7/site-packages (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started > Task :sdks:python:container:py35:copyLauncherDependencies > Task :sdks:python:container:py35:dockerPrepare > Task :sdks:java:container:dockerPrepare > Task :sdks:java:container:docker ---> Running in 26d404380c59 Removing intermediate container 26d404380c59 ---> 8a24deb3fb39 Step 3/11 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> b487d5a1010a Step 4/11 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> fe80dfd73b31 Step 5/11 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> 00079d929925 Step 6/11 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> 6fc5fc0c22b5 Step 7/11 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> 695e7d3cf094 Step 8/11 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> c614e4de0094 Step 9/11 : COPY target/LICENSE /opt/apache/beam/ ---> 6da918b43943 Step 10/11 : COPY target/NOTICE /opt/apache/beam/ ---> a8151ad1fc56 Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 5684eb12f4f2 Removing intermediate container 5684eb12f4f2 ---> 172c9d835c69 Successfully built 172c9d835c69 Successfully tagged apache/beam_java_sdk:2.21.0.dev > Task :sdks:python:container:py35:docker ---> Running in 28b3f51942db Removing intermediate container 28b3f51942db ---> b778cd36537a Step 4/15 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/* ---> Running in e7a3d18d9012 Get:1 http://security.debian.org/debian-security stretch/updates InRelease [94.3 kB] Ign:2 http://deb.debian.org/debian stretch InRelease Get:3 http://deb.debian.org/debian stretch-updates InRelease [91.0 kB] Get:4 http://deb.debian.org/debian stretch Release [118 kB] Get:5 http://deb.debian.org/debian stretch Release.gpg [2410 B] Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [520 kB] Get:7 http://deb.debian.org/debian stretch-updates/main amd64 Packages [27.9 kB] Get:8 http://deb.debian.org/debian stretch/main amd64 Packages [7083 kB] Fetched 7937 kB in 1s (3987 kB/s) Reading package lists... Reading package lists... > Task :runners:spark:job-server:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 18085 Launching Python expansion service @ 18084 > Task :runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingJava Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure FATAL: java.nio.channels.ClosedChannelException java.nio.channels.ClosedChannelException Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from 103.55.66.34.bc.googleusercontent.com/34.66.55.103:55872 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1743) at hudson.remoting.Request.call(Request.java:202) at hudson.remoting.Channel.call(Channel.java:956) at hudson.Launcher$RemoteLauncher.kill(Launcher.java:1086) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:510) at hudson.model.Run.execute(Run.java:1815) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused: hudson.remoting.RequestAbortedException at hudson.remoting.Request.abort(Request.java:340) at hudson.remoting.Channel.terminate(Channel.java:1040) at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209) at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222) at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816) at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287) at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:172) at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816) at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154) at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:142) at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:795) at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) ERROR: apache-beam-jenkins-15 is offline; cannot locate JDK 1.8 (latest) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
