See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/5881/display/redirect>
Changes:
------------------------------------------
[...truncated 51.95 KB...]
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for checker-compat-qual-2.5.5:
http://opensource.org/licenses/MIT. Retrying...
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py";,>
line 58, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 563, in error
result = self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 755, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway
ERROR:root:Invalid url for slf4j-simple-1.7.30:
http://www.opensource.org/licenses/mit-license.php. Retrying...
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container
--save_path=/output/licenses
> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 60.828906 seconds with 16
threads.
Copying licenses from
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/java_third_party_licenses>
to
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java11:copyJavaThirdPartyLicenses
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :sdks:java:container:java11:docker
> Task :sdks:go:test:sparkValidatesRunner
$
CURRENT_DIRECTORY=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test>
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--runner
$ case --runner in
$ RUNNER=spark
$ key=--spark_job_server_jar
$ case --spark_job_server_jar in
$
SPARK_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-job-server-2.38.0-SNAPSHOT.jar>
$ key=--test_expansion_jar
$ case --test_expansion_jar in
$
TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.38.0-SNAPSHOT.jar>
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src>
$ test -d sdks/go/test
$ JOB_PORT=60957
$ ENDPOINT=localhost:60877
No endpoint specified; starting a new spark job server on localhost:60877
$ java -jar
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-job-server-2.38.0-SNAPSHOT.jar>
--spark-master-url local --job-port 60877 --expansion-port 0 --artifact-port 0
$ JOBSERVER_PID=1032255
$ EXPANSION_PORT=43475
$ TEST_EXPANSION_ADDR=localhost:44053
No test expansion address specified; starting a new test expansion server on
localhost:44053
$ java -jar
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.38.0-SNAPSHOT.jar>
44053
$ TEST_EXPANSION_PID=1032295
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:44053
Configuration on demand is an incubating feature.
Mar 21, 2022 12:03:58 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk,
beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix,
beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk,
beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk,
beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq,
beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write,
beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read,
beam:external:java:generate_sequence:v1]
beam:transforms:xlang:test:cgbk:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@459e9125
beam:transforms:xlang:test:flatten:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@128d2484
beam:transforms:xlang:test:prefix:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7cc0cdad
beam:transforms:xlang:test:multi:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7c7b252e
beam:transforms:xlang:test:gbk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4d5d943d
beam:transforms:xlang:test:comgl:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@368f2016
beam:transforms:xlang:test:compk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c583ecf
beam:transforms:xlang:count:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@692f203f
beam:transforms:xlang:filter_less_than_eq:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b
beam:transforms:xlang:test:partition:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3
beam:transforms:xlang:test:parquet_write:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc
beam:transforms:xlang:parquet_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419
beam:transforms:xlang:textio_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
22/03/21 00:03:59 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/03/21 00:04:00 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
ArtifactStagingService started on localhost:42183
22/03/21 00:04:00 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
Java ExpansionService started on localhost:44939
22/03/21 00:04:00 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
JobService started on localhost:60877
22/03/21 00:04:00 INFO org.apache.beam.runners.jobsubmission.JobServerDriver:
Job server now running, terminate with Ctrl+C
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64;
Preparing to use /home/jenkins/go/bin/go1.16.12
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
GOCMD=/home/jenkins/go/bin/go1.16.12
> Task :sdks:go:container:copyLicenses
> Task :sdks:go:container:dockerClean UP-TO-DATE
> Task :sdks:go:container:goPrepare UP-TO-DATE
> Task :sdks:go:container:goBuild FAILED
/home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
/home/jenkins/sdk/go1.16.12/pkg/tool/linux_amd64/link: signal: terminated
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=f743032d-a65e-45ee-81ee-3ed4a21e596b,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1013432
log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-1013432.out.log
----- Last 20 lines from daemon log file - daemon-1013432.out.log -----
2022-03-21T00:03:58.381+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive
lock on daemon addresses registry.
2022-03-21T00:03:58.383+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon
addresses registry.
2022-03-21T00:03:58.383+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon
addresses registry.
2022-03-21T00:03:58.384+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2022-03-21T00:03:58.384+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running.
Sleeping until state changes.
2022-03-21T00:03:58.384+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is
about to start building Build{id=f743032d-a65e-45ee-81ee-3ed4a21e596b,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src}.>
Dispatching build started information...
2022-03-21T00:03:58.384+0000 [DEBUG]
[org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 268:
dispatching org.gradle.launcher.daemon.protocol.BuildStarted@5621232e
2022-03-21T00:03:58.385+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring
env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL,
JOB_URL, HUDSON_COOKIE, MOTD_SHOWN, DBUS_SESSION_BUS_ADDRESS,
JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL,
BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD,
GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME,
BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS,
SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG,
XDG_SESSION_ID, XDG_SESSION_TYPE, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE,
GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE,
ROOT_BUILD_CAUSE_TIMERTRIGGER, XDG_SESSION_CLASS, _, GIT_COMMIT,
COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT,
JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL,
RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME]
2022-03-21T00:03:58.388+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying
all logs to the client via the connection.
2022-03-21T00:03:58.389+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogToClient] The client will now
receive all logging from the daemon (pid: 1013432). The daemon log file:
/home/jenkins/.gradle/daemon/7.3.2/daemon-1013432.out.log
2022-03-21T00:03:58.391+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build
in daemon [uptime: 3 mins 22.723 secs, performance: 99%, GC rate: 0.03/s, heap
usage: 0% of 17 GiB]
2022-03-21T00:03:58.394+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started
executing the build.
2022-03-21T00:03:58.394+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with
daemon context:
DefaultDaemonContext[uid=3d9827e0-8bbd-4012-bcaa-b727eb2f0d5e,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=1013432,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Configuration on demand is an incubating feature.
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64;
Preparing to use /home/jenkins/go/bin/go1.16.12
go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12
GOCMD=/home/jenkins/go/bin/go1.16.12
/home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go
boot_test.go
/home/jenkins/sdk/go1.16.12/pkg/tool/linux_amd64/link: signal: terminated
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'>
line: 109
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3m 34s
112 actionable tasks: 74 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/fo4ttc2ys5hfs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
