See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/642/display/redirect?page=changes>
Changes: [lcwik] [BEAM-2939] Update unbounded source as SDF wrapper to resume [lcwik] fixup! Fix spotbugs warning ------------------------------------------ [...truncated 80.14 KB...] Collecting pyasn1-modules>=0.0.5 Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB) Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.22.0.dev0) (44.1.0) Collecting pyparsing>=2.1.4 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting s3transfer<0.4.0,>=0.3.0 Using cached s3transfer-0.3.3-py2.py3-none-any.whl (69 kB) Collecting jmespath<1.0.0,>=0.7.1 Using cached jmespath-0.9.5-py2.py3-none-any.whl (24 kB) Collecting botocore<1.16.0,>=1.15.39 Using cached botocore-1.15.39-py2.py3-none-any.whl (6.1 MB) Collecting fasteners>=0.14 Using cached fasteners-0.15-py2.py3-none-any.whl (23 kB) Collecting google-api-core[grpc]<2.0.0dev,>=1.6.0 Using cached google_api_core-1.17.0-py2.py3-none-any.whl (70 kB) Processing /home/jenkins/.cache/pip/wheels/77/4d/90/443c1cecdcfbf9d97f6e567304aacddc234cf1b26e48c6f0e5/grpc_google_iam_v1-0.12.3-py2-none-any.whl Collecting google-auth<2.0dev,>=1.9.0 Using cached google_auth-1.14.0-py2.py3-none-any.whl (88 kB) Collecting google-resumable-media<0.6dev,>=0.5.0 Using cached google_resumable_media-0.5.0-py2.py3-none-any.whl (38 kB) Collecting monotonic>=0.6; python_version == "2.7" Using cached monotonic-1.5-py2.py3-none-any.whl (5.3 kB) Collecting atomicwrites>=1.0 Using cached atomicwrites-1.3.0-py2.py3-none-any.whl (5.9 kB) Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (0.13.1) Collecting packaging Using cached packaging-20.3-py2.py3-none-any.whl (37 kB) Collecting attrs>=17.4.0 Using cached attrs-19.3.0-py2.py3-none-any.whl (39 kB) Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.6.0) Collecting wcwidth Using cached wcwidth-0.1.9-py2.py3-none-any.whl (19 kB) Collecting more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" Using cached more_itertools-5.0.0-py2-none-any.whl (52 kB) Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (2.3.5) Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.8.1) Collecting pytest-forked Using cached pytest_forked-1.1.3-py2.py3-none-any.whl (4.5 kB) Collecting execnet>=1.1 Using cached execnet-1.7.1-py2.py3-none-any.whl (39 kB) Collecting certifi>=2017.4.17 Using cached certifi-2020.4.5.1-py2.py3-none-any.whl (157 kB) Collecting idna<3,>=2.5 Using cached idna-2.9-py2.py3-none-any.whl (58 kB) Collecting chardet<4,>=3.0.2 Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB) > Task :runners:spark:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:classes > Task :runners:spark:jar > Task :runners:spark:job-server:compileJava NO-SOURCE > Task :runners:spark:job-server:classes UP-TO-DATE > Task :runners:portability:java:compileJava > Task :runners:portability:java:classes > Task :runners:portability:java:jar > Task :sdks:python:installGcpTest Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 Using cached urllib3-1.25.8-py2.py3-none-any.whl (125 kB) Collecting docutils<0.16,>=0.10 Using cached docutils-0.15.2-py2-none-any.whl (548 kB) Processing /home/jenkins/.cache/pip/wheels/56/af/44/f0c28e985bc224ffb90612f7cdeef432ba4fbd5d15485ab271/googleapis_common_protos-1.51.0-py2-none-any.whl Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (0.6.0.post1) Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.2.0) Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (4.0.2) Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.22.0.dev0) (1.10.0) Collecting apipkg>=1.4 Using cached apipkg-1.5-py2.py3-none-any.whl (4.9 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.22.0.dev0-py2-none-any.whl size=2031386 sha256=41927e5fb69d5314588c1972bdbc14cf7cf486f6b95697fda8105ae1141d17c9 Stored in directory: /home/jenkins/.cache/pip/wheels/f2/b0/4f/c4389c81ddb5fa6a9261073a77dcdd1bd828e0d4b43417b55c Successfully built apache-beam Installing collected packages: crcmod, dill, fastavro, docopt, certifi, idna, chardet, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, numpy, pymongo, pyasn1, rsa, pyasn1-modules, oauth2client, pyparsing, pydot, python-dateutil, pytz, typing-extensions, avro, pyvcf, pyarrow, docutils, jmespath, botocore, s3transfer, boto3, cachetools, monotonic, fasteners, google-apitools, googleapis-common-protos, google-auth, google-api-core, google-cloud-core, google-cloud-datastore, grpc-google-iam-v1, google-cloud-pubsub, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, google-cloud-spanner, grpcio-gcp, google-cloud-dlp, google-cloud-language, google-cloud-videointelligence, google-cloud-vision, freezegun, nose, nose-xunitmp, pandas, parameterized, pyhamcrest, pyyaml, requests-mock, tenacity, atomicwrites, packaging, attrs, wcwidth, more-itertools, pytest, pytest-forked, apipkg, execnet, pytest-xdist, pytest-timeout, apache-beam > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > Task :runners:portability:java:compileTestJava Note: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/portability/java/src/test/java/org/apache/beam/runners/portability/CloseableResourceTest.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :runners:portability:java:testClasses > Task :runners:portability:java:testJar > Task :runners:spark:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:testClasses > Task :runners:spark:testJar > Task :sdks:python:installGcpTest Successfully installed apache-beam-2.22.0.dev0 apipkg-1.5 atomicwrites-1.3.0 attrs-19.3.0 avro-1.9.2 boto3-1.12.39 botocore-1.15.39 cachetools-3.1.1 certifi-2020.4.5.1 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.21.24 fasteners-0.15 freezegun-0.3.15 funcsigs-1.0.2 google-api-core-1.17.0 google-apitools-0.5.28 google-auth-1.14.0 google-cloud-bigquery-1.24.0 google-cloud-bigtable-1.0.0 google-cloud-core-1.3.0 google-cloud-datastore-1.7.4 google-cloud-dlp-0.13.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.0.2 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0 google-cloud-vision-0.42.0 google-resumable-media-0.5.0 googleapis-common-protos-1.51.0 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.12.0 idna-2.9 jmespath-0.9.5 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.3 pandas-0.24.2 parameterized-0.7.4 pbr-5.4.5 pyarrow-0.16.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.7 pytest-4.6.9 pytest-forked-1.1.3 pytest-timeout-1.3.4 pytest-xdist-1.31.0 python-dateutil-2.8.1 pytz-2019.3 pyvcf-0.6.8 pyyaml-5.3.1 requests-2.23.0 requests-mock-1.7.0 rsa-4.0 s3transfer-0.3.3 tenacity-5.1.5 typing-extensions-3.7.4.2 urllib3-1.25.8 wcwidth-0.1.9 > Task :sdks:java:container:generateThirdPartyLicenses > Task :sdks:java:container:generateLicenseReport > Task :runners:spark:job-server:shadowJar > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] > Task :runners:spark:job-server:sparkJobServerSetup Launching job server @ 18091 ... > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py2:copyLauncherDependencies > Task :sdks:python:container:py2:dockerPrepare > Task :sdks:java:container:generateThirdPartyLicenses You are using pip version 8.1.1, however version 20.0.2 is available. You should consider upgrading via the 'pip install --upgrade pip' command. You are using pip version 8.1.1, however version 20.0.2 is available. You should consider upgrading via the 'pip install --upgrade pip' command. > Task :sdks:python:container:py2:docker > Task :sdks:java:container:generateThirdPartyLicenses You are using pip version 8.1.1, however version 20.0.2 is available. You should consider upgrading via the 'pip install --upgrade pip' command. You are using pip version 8.1.1, however version 20.0.2 is available. You should consider upgrading via the 'pip install --upgrade pip' command. 1 were pulled automatically. Successfully pulled java_third_party_licenses/model-builder-1.3.jar/LICENSE from https://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/unused-1.0.0.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt License/notice for spring-core-4.3.18.RELEASE were pulled automatically. License/notice for spring-expression-4.3.18.RELEASE were pulled automatically. License/notice for xmpcore-shaded-6.1.10 were pulled automatically. Successfully pulled java_third_party_licenses/jmatio-1.5.jar/LICENSE from http://www.linfo.org/bsdlicense.html Successfully pulled java_third_party_licenses/metadata-extractor-2.13.0.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/clickhouse-1.10.5.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/database-commons-1.10.5.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/jdbc-1.10.5.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/localstack-1.11.2.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/testcontainers-1.10.5.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/testcontainers-1.11.2.jar/LICENSE from http://opensource.org/licenses/MIT Successfully pulled java_third_party_licenses/testcontainers-1.11.3.jar/LICENSE from http://opensource.org/licenses/MIT License/notice for threetenbp-1.4.1 were pulled automatically. Invalid url: https://git.tukaani.org/?p=xz-java.git;a=blob_plain;f=COPYING;h=c1d404dc7a6f06a0437bf1055fedaa4a4c89d728;hb=HEAD Invalid url: https://git.tukaani.org/?p=xz-java.git;a=blob_plain;f=COPYING;h=c1d404dc7a6f06a0437bf1055fedaa4a4c89d728;hb=HEAD License/notice for snappy-java-1.1.4 were pulled automatically. Successfully pulled java_third_party_licenses/snakeyaml-1.12.jar/LICENSE from https://bitbucket.org/asomov/snakeyaml/raw/3d49667ece57d564668b9a155c55ccfe26aaca00/LICENSE.txt Successfully pulled java_third_party_licenses/snakeyaml-1.15.jar/LICENSE from https://bitbucket.org/asomov/snakeyaml/raw/3d49667ece57d564668b9a155c55ccfe26aaca00/LICENSE.txt Successfully pulled java_third_party_licenses/snakeyaml-1.17.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/snakeyaml-1.23.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/snakeyaml-1.24.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt License/notice for oro-2.0.8 were pulled automatically. Successfully pulled java_third_party_licenses/jedis-3.0.1.jar/LICENSE from http://github.com/xetorthio/jedis/raw/master/LICENSE.txt Successfully pulled java_third_party_licenses/generics-resolver-2.0.1.jar/LICENSE from https://raw.githubusercontent.com/xvik/generics-resolver/master/LICENSE Successfully pulled java_third_party_licenses/clickhouse-jdbc-0.1.47.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0 Successfully pulled java_third_party_licenses/annotations-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/apache-client-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/auth-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/aws-core-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/aws-json-protocol-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/aws-query-protocol-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/cloudwatch-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/dynamodb-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/http-client-spi-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Traceback (most recent call last): File "sdks/java/container/license_scripts/pull_licenses_java.py", line 225, in <module> Successfully pulled java_third_party_licenses/netty-nio-client-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/profiles-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 error_msg) Successfully pulled java_third_party_licenses/protocol-core-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 RuntimeError: ('1 error(s) occurred.', ['**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to sdks/java/container/license_scripts/dep_urls_java.yaml for each missing license. Dependency List: [xz-1.5,xz-1.8]']) Successfully pulled java_third_party_licenses/regions-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/sdk-core-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/sns-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/sqs-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/utils-2.10.61.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/eventstream-1.0.1.jar/LICENSE from https://aws.amazon.com/apache2.0 Successfully pulled java_third_party_licenses/ion-java-1.0.2.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/sqlline-1.4.0.jar/LICENSE from http://opensource.org/licenses/BSD-3-Clause Successfully pulled java_third_party_licenses/stax-api-1.0.1.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/jasper-compiler-5.5.23.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/jasper-runtime-5.5.23.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/xercesimpl-2.12.0.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/xercesimpl-2.9.1.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt License/notice for xml-apis-1.3.04 were pulled automatically. License/notice for xml-apis-1.4.01 were pulled automatically. Successfully pulled java_third_party_licenses/xml-resolver-1.2.jar/LICENSE from http://www.apache.org/licenses/LICENSE-2.0.txt Successfully pulled java_third_party_licenses/xmlenc-0.52.jar/LICENSE from http://www.opensource.org/licenses/bsd-license.php > Task :sdks:java:container:generateThirdPartyLicenses FAILED > Task :sdks:java:container:copyDockerfileDependencies > Task :sdks:java:container:dockerClean UP-TO-DATE > Task :sdks:java:container:goPrepare Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/container/.gogradle/project_gopath> > Task :sdks:java:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go> > Task :sdks:java:container:installDependencies > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:container:goBuild > Task :runners:spark:job-server:sparkJobServerCleanup Stopping job server pid: 6965. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:container:generateThirdPartyLicenses'. > Process 'command './sdks/java/container/license_scripts/license_script.sh'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 9m 46s 98 actionable tasks: 81 executed, 15 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/aoopfzixckdc6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
