See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/229/display/redirect?page=changes>
Changes: [Etienne Chauchot] [BEAM-12591] Put Spark Structured Streaming runner sources back to main [Etienne Chauchot] [BEAM-12629] As spark DataSourceV2 is only available for spark 2, [Etienne Chauchot] [BEAM-12627] Deal with spark Encoders braking change between spark 2 and [Etienne Chauchot] [BEAM-12591] move SchemaHelpers to correct package [Etienne Chauchot] [BEAM-8470] Disable wait for termination in a streaming pipeline because [Etienne Chauchot] [BEAM-12630] Deal with breaking change in streaming pipelines start by [Etienne Chauchot] [BEAM-12629] Make source tests spark version agnostic and move them back [Etienne Chauchot] [BEAM-12629] Make a spark 3 source impl [ajamato] [BEAM-12670] Relocate bq client exception imports to try block and [Etienne Chauchot] [BEAM-12591] Fix checkstyle and spotless [Etienne Chauchot] [BEAM-12629] Reduce serializable to only needed classes and Fix schema [Etienne Chauchot] [BEAM-12591] Add checkstyle exceptions for version specific classes [Etienne Chauchot] [BEAM-12629] Fix sources javadocs and improve impl [dpires] [BEAM-12715] Use shard number specified by user in SnowflakeIO batch [Etienne Chauchot] [BEAM-12591] Add spark 3 to structured streaming validates runner tests [relax] fix GroupIntoBatches [noreply] [BEAM-12703] Fix universal metrics. (#15260) [noreply] [BEAM-12702] Pull step unique names from pipeline for metrics. (#15261) [noreply] [BEAM-12678] Add dependency of java jars when running go VR on portable [noreply] [BEAM-12671] Mark known composite transforms native (#15236) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-1 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.7.4' > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 2144cab210d4608d10a0855eeef45ce4e113e074 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 2144cab210d4608d10a0855eeef45ce4e113e074 # timeout=10 Commit message: "Merge pull request #15218 from echauchot/BEAM-7093-spark3-fix-for-SS-runner" > git rev-list --no-walk 8b6f6756254ee0f5a0529d10eb8038a5305a725f # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [beam_LoadTests_Go_ParDo_Dataflow_Batch] $ /bin/bash -xe /tmp/jenkins4477467491239957578.sh + echo '*** ParDo Go Load test: 20M 100 byte records 10 iterations ***' *** ParDo Go Load test: 20M 100 byte records 10 iterations *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/gradlew> -PloadTest.mainClass=pardo -Prunner=DataflowRunner '-PloadTest.args=--job_name=load-tests-go-dataflow-batch-pardo-1-0805100324 --project=apache-beam-testing --region=us-central1 --temp_location=gs://temp-storage-for-perf-tests/loadtests --staging_location=gs://temp-storage-for-perf-tests/loadtests --influx_measurement=go_batch_pardo_1 --influx_namespace=dataflow --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90}' --iterations=10 --number_of_counter_operations=0 --number_of_counters=0 --num_****s=5 --autoscaling_algorithm=NONE --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --runner=DataflowRunner' --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:go:test:load:run > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 20005 log file: /home/jenkins/.gradle/daemon/6.8.3/daemon-20005.out.log ----- Last 20 lines from daemon log file - daemon-20005.out.log ----- 2021-08-05T10:47:21.506+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 248: Received non-IO message from client: Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src}> 2021-08-05T10:47:21.506+0000 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src}.> 2021-08-05T10:47:21.506+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src}> with connection: socket connection from /127.0.0.1:34957 to /127.0.0.1:47514. 2021-08-05T10:47:21.506+0000 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src},> connection = DefaultDaemonConnection: socket connection from /127.0.0.1:34957 to /127.0.0.1:47514] after 0.0 minutes of idle 2021-08-05T10:47:21.507+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [5a180a10-96be-4b53-a9c8-dcc635e8c2c7 port:34957, addresses:[localhost/127.0.0.1]] 2021-08-05T10:47:21.507+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [5a180a10-96be-4b53-a9c8-dcc635e8c2c7 port:34957, addresses:[localhost/127.0.0.1]] 2021-08-05T10:47:21.507+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry. 2021-08-05T10:47:21.507+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 2021-08-05T10:47:21.507+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 2021-08-05T10:47:21.508+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer 2021-08-05T10:47:21.508+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes. 2021-08-05T10:47:21.508+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=b3bdfc32-da65-44a3-9d33-5aafe3fae7cd, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src}.> Dispatching build started information... 2021-08-05T10:47:21.508+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 27: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@7337dcbe 2021-08-05T10:47:21.509+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, INFLUXDB_USER, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MAIL, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, INFLUXDB_USER_PASSWORD, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, _, GIT_COMMIT, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME] 2021-08-05T10:47:21.509+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection. 2021-08-05T10:47:21.510+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 20005). The daemon log file: /home/jenkins/.gradle/daemon/6.8.3/daemon-20005.out.log 2021-08-05T10:47:21.510+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 9 mins 5.07 secs, performance: 100%] 2021-08-05T10:47:21.510+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build. 2021-08-05T10:47:21.510+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=a7082e5a-97c1-43ac-8e2e-eb0a972779df,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=20005,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant] Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
