See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/4042/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage. [Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO. [Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow, [Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name. [noreply] [BEAM-13893] improved coverage of jobopts package (#17003) [noreply] Merge pull request #16977 from [BEAM-12164] Added integration test for ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src> # > timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 31ed3311711d64dc5588fea0e555122c4f2cbb4c (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 31ed3311711d64dc5588fea0e555122c4f2cbb4c # timeout=10 Commit message: "Merge pull request #16977 from [BEAM-12164] Added integration test for transaction boundaries and transaction ID ordering." > git rev-list --no-walk 0510cecb8a6bf8950699bf7a2253ee82bf37ea39 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:python:test-suites:portable:py37:testPipelineJarSparkRunner Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Task :model:fn-execution:createCheckerFrameworkManifest > Task :model:job-management:createCheckerFrameworkManifest > Task :sdks:java:core:createCheckerFrameworkManifest > Task :runners:java-fn-execution:createCheckerFrameworkManifest > Task :sdks:java:expansion-service:createCheckerFrameworkManifest > Task > :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :runners:core-construction-java:createCheckerFrameworkManifest > Task :model:pipeline:createCheckerFrameworkManifest > Task :runners:core-java:createCheckerFrameworkManifest > Task :runners:java-job-service:createCheckerFrameworkManifest > Task :model:fn-execution:extractProto > Task :sdks:java:fn-execution:createCheckerFrameworkManifest > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :runners:core-java:processResources NO-SOURCE > Task :sdks:java:harness:createCheckerFrameworkManifest > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :runners:core-construction-java:processResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :model:job-management:extractProto > Task :runners:spark:2:job-server:createCheckerFrameworkManifest > Task :sdks:java:harness:processResources NO-SOURCE > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :runners:java-job-service:processResources NO-SOURCE > Task :sdks:python:container:goPrepare UP-TO-DATE > Task :model:fn-execution:processResources > Task :runners:spark:2:copySourceOverrides > Task :sdks:java:io:amazon-web-services2:createCheckerFrameworkManifest > Task :runners:spark:2:job-server:processResources NO-SOURCE > Task :model:job-management:processResources > Task :runners:spark:2:createCheckerFrameworkManifest > Task :sdks:java:io:amazon-web-services2:processResources NO-SOURCE > Task :runners:spark:2:copyResourcesOverrides NO-SOURCE > Task :release:go-licenses:py:copyLicenses > Task :sdks:python:container:py37:copyLicenseScripts > Task :release:go-licenses:py:dockerClean UP-TO-DATE > Task :runners:spark:2:processResources > Task :release:go-licenses:py:dockerPrepare > Task :sdks:python:container:py37:copyLicenses > Task :sdks:python:container:py37:dockerClean UP-TO-DATE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:core:processResources > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto FROM-CACHE > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :release:go-licenses:py:docker > Task :model:pipeline:shadowJar FROM-CACHE > Task :sdks:python:container:goBuild > Task :sdks:python:container:py37:copyLauncherDependencies > Task :model:fn-execution:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:extractIncludeProto > Task :model:job-management:generateProto FROM-CACHE > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:fn-execution:shadowJar FROM-CACHE > Task :model:job-management:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :release:go-licenses:py:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/python/container > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:amazon-web-services2:compileJava FROM-CACHE > Task :sdks:java:io:amazon-web-services2:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar > Task :sdks:java:io:amazon-web-services2:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:java-job-service:compileJava FROM-CACHE > Task :runners:java-job-service:classes UP-TO-DATE > Task :runners:java-job-service:jar > Task :runners:spark:2:compileJava FROM-CACHE > Task :runners:spark:2:classes > Task :runners:spark:2:jar > Task :runners:spark:2:job-server:compileJava NO-SOURCE > Task :runners:spark:2:job-server:classes UP-TO-DATE > Task :sdks:python:setupVirtualenv > Task :runners:spark:2:job-server:shadowJar FROM-CACHE > Task :sdks:python:sdist Regenerating Python proto definitions (no output files). Found protoc_gen_mypy at <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy> beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to external_transforms_pb2.pyi Writing mypy to beam_runner_api_pb2.pyi Writing mypy to standard_window_fns_pb2.pyi Writing mypy to metrics_pb2.pyi Writing mypy to endpoints_pb2.pyi Writing mypy to schema_pb2.pyi Writing mypy to beam_artifact_api_pb2.pyi Writing mypy to beam_expansion_api_pb2.pyi Writing mypy to beam_job_api_pb2.pyi Writing mypy to beam_provision_api_pb2.pyi Writing mypy to beam_fn_api_pb2.pyi Writing mypy to beam_interactive_api_pb2.pyi Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py> Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py> Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py> Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py> Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py> <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:506: UserWarning: Normalizing '2.38.0.dev' to '2.38.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py37:copyDockerfileDependencies > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py37:copyGolangLicenses > Task :sdks:python:container:py37:dockerPrepare > Task :sdks:python:container:py37:docker The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi' returned a non-zero code: 1 > Task :sdks:python:container:py37:docker FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 11m 25s 87 actionable tasks: 56 executed, 27 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/l56qfhol5nv4m Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
