See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/5709/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare
[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing
------------------------------------------
[...truncated 42.21 KB...]
Attempting uninstall: setuptools
Found existing installation: setuptools 44.0.0
Uninstalling setuptools-44.0.0:
Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.0.2 setuptools-60.7.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 pyyaml-5.4.1 six-1.16.0
soupsieve-2.3.1 tenacity-5.1.5
Executing
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/virtualenv/bin/python>
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py>
--license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/reports/dependency-license/index.json>
--output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses>
--dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
--manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 217 dependencies using 16 threads.
> Task :sdks:java:io:amazon-web-services2:compileJava
> Task :sdks:java:container:pullLicenses
INFO:root:Replaced local file URL with
file://<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING>
for xz-1.5
> Task :sdks:java:io:amazon-web-services2:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:amazon-web-services2:classes
> Task :sdks:java:io:amazon-web-services2:jar
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 57.215475 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:java11:copyJavaThirdPartyLicenses
> Task :runners:spark:2:job-server:shadowJar
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:container:java11:docker
Sending build context to Docker daemon 170MB
Step 1/19 : ARG java_version
Step 2/19 : FROM openjdk:${java_version}-bullseye
---> ae2fd7709d3b
Step 3/19 : MAINTAINER "Apache Beam <[email protected]>"
---> Running in 332c7192fc0e
Removing intermediate container 332c7192fc0e
---> dfd4ca842297
Step 4/19 : ARG pull_licenses
---> Running in b1e5de62fd0a
Removing intermediate container b1e5de62fd0a
---> 561fc152ded6
Step 5/19 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> d11196b0eee9
Step 6/19 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> e99ac90b099c
Step 7/19 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 56e259252bd3
Step 8/19 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 713559a236a8
Step 9/19 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> 60282b5a885b
Step 10/19 : ADD target/jamm.jar /opt/apache/beam/jars/
---> f6a5ebf4aa8a
Step 11/19 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 66ccc212226a
Step 12/19 : COPY target/LICENSE /opt/apache/beam/
---> 01570f25bf87
Step 13/19 : COPY target/NOTICE /opt/apache/beam/
---> 4bdbe04c0024
Step 14/19 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> e20d3f78e695
Step 15/19 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 0531dddfc50a
Step 16/19 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in ab421140cf4e
> Task :sdks:java:container:java8:docker
Sending build context to Docker daemon 170MB
Step 1/19 : ARG java_version
Step 2/19 : FROM openjdk:${java_version}-bullseye
---> 3bc5f7759e81
Step 3/19 : MAINTAINER "Apache Beam <[email protected]>"
---> Running in 4013d7518016
Removing intermediate container 4013d7518016
---> babc215f3bc2
Step 4/19 : ARG pull_licenses
---> Running in 13770e27e338
Removing intermediate container 13770e27e338
---> 473d5c850efc
Step 5/19 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 5180d3d485a7
Step 6/19 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> f12776457df4
Step 7/19 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> a3d24172bee7
Step 8/19 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> a3fa22a09cc2
Step 9/19 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> e237f242ee12
Step 10/19 : ADD target/jamm.jar /opt/apache/beam/jars/
---> 19addc342431
Step 11/19 : ADD target/linux_amd64/boot /opt/apache/beam/
---> caec3cf47bec
Step 12/19 : COPY target/LICENSE /opt/apache/beam/
---> 645bb237db0c
Step 13/19 : COPY target/NOTICE /opt/apache/beam/
---> d07b651ad7da
Step 14/19 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> bebe7adcd43c
Step 15/19 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> eb38cb4449a2
Step 16/19 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in a48f030d2951
Removing intermediate container a48f030d2951
---> bbff8138c9bd
Step 17/19 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in 6e00d13ec25a
Removing intermediate container 6e00d13ec25a
---> fed60a0c5dc0
Step 18/19 : COPY target/profiler/* /opt/google_cloud_profiler/
---> c61083867791
Step 19/19 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 6605fa216521
Removing intermediate container 6605fa216521
---> d6d8cd5a74c3
Successfully built d6d8cd5a74c3
Successfully tagged apache/beam_java8_sdk:2.37.0.dev
> Task :sdks:java:container:java11:docker
Removing intermediate container ab421140cf4e
---> f209703cb5a2
Step 17/19 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in aa10af66cae5
Removing intermediate container aa10af66cae5
---> e40ea32c748e
Step 18/19 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 6b564e44bf92
Step 19/19 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4297c6c63747
Removing intermediate container 4297c6c63747
---> 49f08d1b7126
Successfully built 49f08d1b7126
Successfully tagged apache/beam_java11_sdk:2.37.0.dev
> Task :sdks:go:test:sparkValidatesRunner
Feb 02, 2022 6:04:08 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk,
beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix,
beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk,
beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk,
beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq,
beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write,
beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read,
beam:external:java:generate_sequence:v1]
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=37ea63c1-ec5f-492a-ad6a-f26c92fd7f7e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 3299301
log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-3299301.out.log
----- Last 20 lines from daemon log file - daemon-3299301.out.log -----
2022-02-02T18:04:08.251+0000 [DEBUG]
[org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by
address: [2bd8c084-af4c-4924-90f5-8b8a89f85fc5 port:32889,
addresses:[localhost/127.0.0.1]]
2022-02-02T18:04:08.251+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive
lock on daemon addresses registry.
2022-02-02T18:04:08.251+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon
addresses registry.
2022-02-02T18:04:08.252+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon
addresses registry.
2022-02-02T18:04:08.252+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2022-02-02T18:04:08.252+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running.
Sleeping until state changes.
2022-02-02T18:04:08.253+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is
about to start building Build{id=37ea63c1-ec5f-492a-ad6a-f26c92fd7f7e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src}.>
Dispatching build started information...
2022-02-02T18:04:08.253+0000 [DEBUG]
[org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 266:
dispatching org.gradle.launcher.daemon.protocol.BuildStarted@42569c28
2022-02-02T18:04:08.255+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring
env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL,
JOB_URL, HUDSON_COOKIE, MOTD_SHOWN, DBUS_SESSION_BUS_ADDRESS,
JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL,
BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD,
GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME,
BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS,
SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG,
XDG_SESSION_ID, XDG_SESSION_TYPE, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE,
GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE,
ROOT_BUILD_CAUSE_TIMERTRIGGER, XDG_SESSION_CLASS, _, GIT_COMMIT,
COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT,
JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL,
RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME]
2022-02-02T18:04:08.256+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying
all logs to the client via the connection.
2022-02-02T18:04:08.256+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogToClient] The client will now
receive all logging from the daemon (pid: 3299301). The daemon log file:
/home/jenkins/.gradle/daemon/7.3.2/daemon-3299301.out.log
2022-02-02T18:04:08.257+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build
in daemon [uptime: 3 mins 43.954 secs, performance: 98%]
2022-02-02T18:04:08.264+0000 [DEBUG]
[org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 264:
received class org.gradle.launcher.daemon.protocol.CloseInput
2022-02-02T18:04:08.264+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 264:
Received IO message from client:
org.gradle.launcher.daemon.protocol.CloseInput@3e111340
2022-02-02T18:04:08.271+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started
executing the build.
2022-02-02T18:04:08.271+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with
daemon context:
DefaultDaemonContext[uid=ca7e60a9-87d1-4beb-a056-dcf9ca91d510,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=3299301,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
2022-02-02T18:04:08.271+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.ForwardClientInput] Closing daemon's
stdin at end of input.
2022-02-02T18:04:08.271+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.ForwardClientInput] The daemon will no
longer process any standard input.
Configuration on demand is an incubating feature.
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'>
line: 109
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3m 45s
112 actionable tasks: 76 executed, 31 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/sxftd7bv75fqw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
