See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/642/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-13088] Add parameter tempWriteDataset to BigQueryIO
to store temp
[benjamin.gonzalez] [BEAM-13088] Make tempDataset final
[Kyle Weaver] [BEAM-13496] Upgrade Flink runner to include log4j patches.
[Kyle Weaver] [BEAM-13497] Correct class name in Flink tests.
[noreply] [BEAM-13434] Bump solr to 8.11.1 (#16296)
[noreply] Use a patched shadow 6.1.0 plugin using Log4j 2.16.0 (#16269)
------------------------------------------
[...truncated 53.23 KB...]
> Task :runners:java-job-service:classes
> Task :runners:java-job-service:jar
> Task :sdks:java:io:kafka:compileJava
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar
> Task :runners:samza:compileJava
> Task :sdks:java:io:kafka:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:kafka:classes
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:container:java11:copyDockerfileDependencies
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java11:dockerPrepare
> Task :runners:samza:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:samza:classes
> Task :sdks:java:container:java8:docker
---> efaf09303174
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
> Task :runners:samza:jar
> Task :runners:samza:job-server:compileJava NO-SOURCE
> Task :runners:samza:job-server:classes UP-TO-DATE
> Task :sdks:java:container:java11:docker
---> 69ce5bb6a6d7
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> f3f36e22e3e4
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> 016424e3ef21
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> b8f9597bce13
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 479330238a26
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 342585fd9fdf
Removing intermediate container 342585fd9fdf
---> 7639aa1238ea
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in da5ac2e20b06
Removing intermediate container da5ac2e20b06
---> 058e4b6bff1b
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> 834c4e0b74a1
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in c81b1b611797
Removing intermediate container c81b1b611797
---> 57a5f8ae10fc
> Task :sdks:java:container:java8:docker
---> 2fdaab278675
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> 5205cbd8800d
Step 13/18 : ADD target/third_party_licenses
/opt/apache/beam/third_party_licenses/
---> f0257fabe6f4
Step 14/18 : COPY target/LICENSE target/go-licenses/*
/opt/apache/beam/third_party_licenses/golang/
---> 4228e9ae55b7
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in ed24d5071f38
Removing intermediate container ed24d5071f38
---> 39e03cb5484c
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf
/opt/apache/beam/third_party_licenses ; fi
---> Running in e14247ca1e9f
Removing intermediate container e14247ca1e9f
---> 94b85924c7bc
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> d36170b29e31
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 82400602ada6
Removing intermediate container 82400602ada6
---> e722d269490d
Successfully built e722d269490d
Successfully tagged apache/beam_java8_sdk:2.36.0.dev
> Task :sdks:java:container:java11:docker
Successfully built 57a5f8ae10fc
Successfully tagged apache/beam_java11_sdk:2.36.0.dev
> Task :runners:samza:job-server:shadowJar
> Task :sdks:go:test:samzaValidatesRunner
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--runner
$ case --runner in
$ RUNNER=samza
$ key=--samza_job_server_jar
$ case --samza_job_server_jar in
$
SAMZA_JOB_SERVER_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.36.0-SNAPSHOT.jar>
$ key=--test_expansion_jar
$ case --test_expansion_jar in
$
TEST_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.36.0-SNAPSHOT.jar>
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src>
$ test -d sdks/go/test
$ JOB_PORT=51093
$ ENDPOINT=localhost:36007
No endpoint specified; starting a new samza job server on localhost:36007
$ java -jar
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.36.0-SNAPSHOT.jar>
--job-port 36007 --expansion-port 0 --artifact-port 0
$ JOBSERVER_PID=14390
$ EXPANSION_PORT=41837
$ TEST_EXPANSION_ADDR=localhost:32793
No test expansion address specified; starting a new test expansion server on
localhost:32793
$ java -jar
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.36.0-SNAPSHOT.jar>
32793
$ TEST_EXPANSION_PID=14436
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:32793
Dec 21, 2021 6:15:05 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
beam:transforms:xlang:test:cgbk:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestCoGroupByKeyTransformProvider@59474f18
beam:transforms:xlang:test:flatten:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestServiceRegistrar$TestFlattenTransformProvider@65fb9ffc
INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk,
beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix,
beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk,
beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk,
beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq,
beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write,
beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read,
beam:external:java:generate_sequence:v1]
beam:transforms:xlang:test:prefix:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3e694b3f
beam:transforms:xlang:test:multi:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb5a082
beam:transforms:xlang:test:gbk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@78691363
beam:transforms:xlang:test:comgl:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@41d477ed
beam:transforms:xlang:test:compk:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3590fc5b
beam:transforms:xlang:count:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@397fbdb
beam:transforms:xlang:filter_less_than_eq:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@33d512c1
beam:transforms:xlang:test:partition:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@515c6049
beam:transforms:xlang:test:parquet_write:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@639c2c1d
beam:transforms:xlang:parquet_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5fe94a96
beam:transforms:xlang:textio_read:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@443118b0
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@765d7657
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver -
ArtifactStagingService started on localhost:39827
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - Java
ExpansionService started on localhost:34421
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - JobService
started on localhost:36007
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - Job server
now running, terminate with Ctrl+C
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=f151d405-c26c-4d75-8be0-d9028e56126e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 32213
log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-32213.out.log
----- Last 20 lines from daemon log file - daemon-32213.out.log -----
2021-12-21T06:15:04.331+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting
executing command: Build{id=f151d405-c26c-4d75-8be0-d9028e56126e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src}>
with connection: socket connection from /127.0.0.1:41885 to /127.0.0.1:50628.
2021-12-21T06:15:04.331+0000 [ERROR]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution:
started DaemonCommandExecution[command =
Build{id=f151d405-c26c-4d75-8be0-d9028e56126e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src},>
connection = DefaultDaemonConnection: socket connection from /127.0.0.1:41885
to /127.0.0.1:50628] after 1.0 minutes of idle
2021-12-21T06:15:04.331+0000 [INFO]
[org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as
busy, address: [79a2dfc2-ecfd-46fc-b61c-40f83b0a7877 port:41885,
addresses:[localhost/127.0.0.1]]
2021-12-21T06:15:04.332+0000 [DEBUG]
[org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by
address: [79a2dfc2-ecfd-46fc-b61c-40f83b0a7877 port:41885,
addresses:[localhost/127.0.0.1]]
2021-12-21T06:15:04.332+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive
lock on daemon addresses registry.
2021-12-21T06:15:04.332+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon
addresses registry.
2021-12-21T06:15:04.333+0000 [DEBUG]
[org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon
addresses registry.
2021-12-21T06:15:04.333+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2021-12-21T06:15:04.333+0000 [DEBUG]
[org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running.
Sleeping until state changes.
2021-12-21T06:15:04.334+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is
about to start building Build{id=f151d405-c26c-4d75-8be0-d9028e56126e,
currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src}.>
Dispatching build started information...
2021-12-21T06:15:04.334+0000 [DEBUG]
[org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 293:
dispatching org.gradle.launcher.daemon.protocol.BuildStarted@119e0d7e
2021-12-21T06:15:04.335+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring
env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL,
JOB_URL, HUDSON_COOKIE, MAIL, JENKINS_SERVER_COOKIE, LOGNAME, PWD,
RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE,
BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1,
CODECOV_TOKEN, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH,
SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME,
BUILD_ID, LANG, XDG_SESSION_ID, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE,
GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE,
ROOT_BUILD_CAUSE_TIMERTRIGGER, _, GIT_COMMIT, COVERALLS_REPO_TOKEN, CI,
EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER,
SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL,
XDG_RUNTIME_DIR, HOME]
2021-12-21T06:15:04.336+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying
all logs to the client via the connection.
2021-12-21T06:15:04.336+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogToClient] The client will now
receive all logging from the daemon (pid: 32213). The daemon log file:
/home/jenkins/.gradle/daemon/6.9.1/daemon-32213.out.log
2021-12-21T06:15:04.338+0000 [INFO]
[org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build
in daemon [uptime: 14 mins 31.104 secs, performance: 100%, GC rate: 0.00/s,
heap usage: 0% of 17 GiB]
2021-12-21T06:15:04.341+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started
executing the build.
2021-12-21T06:15:04.341+0000 [DEBUG]
[org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with
daemon context:
DefaultDaemonContext[uid=50cc650b-9d99-4dad-812a-e42c98ff93ee,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=32213,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Configuration on demand is an incubating feature.
Use project GOPATH:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/container/.gogradle/project_gopath>
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :sdks:go:container:docker
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
> Task :sdks:go:test:samzaValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/test/build.gradle'>
line: 128
* What went wrong:
Execution failed for task ':sdks:go:test:samzaValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 47s
115 actionable tasks: 101 executed, 9 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/gopbtxygd3koo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
