See
<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/4897/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [TPC-DS] Use "nonpartitioned" input for Jenkins jobs
[noreply] [GitHub Actions] - Run RC Validations Workflow (#23531)
[noreply] Add workflow to update milestone on issue close (#23629)
[noreply] add website page about data processing for ML (#23552)
------------------------------------------
[...truncated 19.17 KB...]
Step 8/8 : ENTRYPOINT /opt/apache/beam/get-licenses.sh
---> Using cache
---> 99260da35007
Successfully built 99260da35007
Successfully tagged golicenses-python:latest
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto FROM-CACHE
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:pipeline:shadowJar FROM-CACHE
> Task :sdks:python:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/launcher/linux_amd64/boot
boot.go piputil.go
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:extractIncludeProto
> Task :model:job-management:generateProto FROM-CACHE
> Task :model:fn-execution:generateProto FROM-CACHE
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:fn-execution:shadowJar FROM-CACHE
> Task :model:job-management:shadowJar FROM-CACHE
> Task :release:go-licenses:py:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/python/container
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:python:container:py37:copyLauncherDependencies
> Task :sdks:java:io:amazon-web-services2:compileJava FROM-CACHE
> Task :sdks:java:io:amazon-web-services2:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:amazon-web-services2:jar
> Task :sdks:java:fn-execution:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :sdks:python:setupVirtualenv
Collecting pip
Using cached pip-22.3-py3-none-any.whl (2.1 MB)
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :release:go-licenses:py:dockerRun
go: downloading github.com/apache/beam/sdks/v2 v2.42.0
go: downloading github.com/apache/beam v2.42.0+incompatible
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :runners:spark:2:jar
> Task :runners:spark:2:job-server:compileJava NO-SOURCE
> Task :runners:spark:2:job-server:classes UP-TO-DATE
> Task :sdks:python:setupVirtualenv
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Uninstalling pip-20.0.2:
Successfully uninstalled pip-20.0.2
Successfully installed pip-22.3
Collecting tox==3.20.1
Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: setuptools in
<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages>
(from -r
<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/build-requirements.txt>
(line 20)) (44.0.0)
Collecting setuptools
Using cached setuptools-65.5.0-py3-none-any.whl (1.2 MB)
Collecting wheel>=0.36.0
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Collecting grpcio-tools==1.37.0
Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB)
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting numpy<1.23.0,>=1.14.3
Using cached
numpy-1.22.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.9 MB)
Collecting six>=1.14.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting filelock>=3.0.0
Using cached filelock-3.8.0-py3-none-any.whl (10 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB)
> Task :runners:spark:2:job-server:shadowJar FROM-CACHE
> Task :sdks:python:setupVirtualenv
Collecting protobuf<4.0dev,>=3.5.0.post1
Using cached
protobuf-3.20.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting grpcio>=1.37.0
Using cached
grpcio-1.49.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting pyparsing!=3.0.5,>=2.0.2
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting platformdirs<3,>=2.4
Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB)
Collecting
virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB)
Installing collected packages: distlib, wheel, toml, six, setuptools,
pyparsing, py, protobuf, pluggy, platformdirs, numpy, filelock, virtualenv,
packaging, mypy-protobuf, grpcio, tox, grpcio-tools
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.49.1
grpcio-tools-1.37.0 mypy-protobuf-1.18 numpy-1.22.4 packaging-21.3
platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 pyparsing-3.0.9
setuptools-65.5.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2
wheel-0.37.1
> Task :release:go-licenses:py:dockerRun
go: downloading github.com/golang/protobuf v1.5.2
go: downloading github.com/nightlyone/lockfile v1.0.0
go: downloading google.golang.org/grpc v1.49.0
go: downloading google.golang.org/protobuf v1.28.1
go: downloading google.golang.org/genproto v0.0.0-20220822174746-9e6da59bd2fc
go: downloading golang.org/x/net v0.0.0-20220624214902-1bab6f366d9e
go: downloading golang.org/x/sys v0.0.0-20220624220833-87e55d714810
go: added github.com/apache/beam/sdks/v2 v2.42.0
go: added github.com/golang/protobuf v1.5.2
go: added github.com/nightlyone/lockfile v1.0.0
go: added golang.org/x/net v0.0.0-20220624214902-1bab6f366d9e
go: added golang.org/x/sys v0.0.0-20220624220833-87e55d714810
go: added golang.org/x/text v0.3.7
go: added google.golang.org/genproto v0.0.0-20220822174746-9e6da59bd2fc
go: added google.golang.org/grpc v1.49.0
go: added google.golang.org/protobuf v1.28.1
+ go-licenses save github.com/apache/beam/sdks/v2/python/container
--save_path=/output/licenses
W1018 14:00:01.022590 32 library.go:94] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/python/container
+ tee /output/licenses/list.csv
> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning:
Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to
org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to
org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to
org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:530:
UserWarning: Normalizing '2.43.0.dev' to '2.43.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
> Task :sdks:python:container:py37:copyDockerfileDependencies
> Task :release:go-licenses:py:dockerRun
W1018 14:00:06.743604 204 library.go:94] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.42.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/python/container,https://github.com/apache/beam/blob/sdks/v2.42.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/v1.0.0/LICENSE,MIT
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/9e6da59bd2fc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.49.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.1/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py37:copyGolangLicenses
> Task :sdks:python:container:py37:dockerPrepare
> Task :sdks:python:container:py37:docker
> Task :sdks:python:container:py37:docker FAILED
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=d651ba31-aa2c-4891-a3d3-95a502ec90b6,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 3855447
log file: /home/jenkins/.gradle/daemon/7.5.1/daemon-3855447.out.log
----- Last 20 lines from daemon log file - daemon-3855447.out.log -----
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
+ go-licenses csv github.com/apache/beam/sdks/v2/python/container
+ tee /output/licenses/list.csv
W1018 14:00:06.743604 204 library.go:94] "golang.org/x/sys/unix" contains
non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.42.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/python/container,https://github.com/apache/beam/blob/sdks/v2.42.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/v1.0.0/LICENSE,MIT
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/9e6da59bd2fc/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.49.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.1/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
