See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/111/display/redirect?page=changes>
Changes: [Boyuan Zhang] Refactor SplittableParDoExpander. [kcweaver] [BEAM-7632] Add Python quickstart instructions for Flink and Spark. [ningk] Fixed pcoll visualization in datatable [hsuryawirawan] Update Python Katas on Stepik based on the latest pipeline "with" style [Maximilian Michels] [BEAM-10622] Prefix Gradle paths with a colon for user-facing output [qz689] [BEAM-9543] built the basis for Match_Recog [qz689] [BEAM-9543] built the basis for Match_Recog [qz689] [BEAM-9543] implemented `partition by` [qz689] [BEAM-9543] implemented `order by` [qz689] [BEAM-9543] fixed `order by` coder issue [qz689] [BEAM-9543] fixed `order by` coder issue [qz689] [BEAM-9543] applied regex pattern match [qz689] [BEAM-9543] applied regex pattern match [qz689] [BEAM-9543] fixed sortKey serialization problem [qz689] [BEAM-9543] fixed sortKey serialization problem [qz689] [BEAM-9543] fixed serialization problem [qz689] [BEAM-9543] recognized simple pattern [qz689] [BEAM-9543] recognized simple pattern [qz689] [BEAM-9543] fixed code style [qz689] [BEAM-9543] supported regex quantifier [qz689] [BEAM-9543] added javadoc [qz689] [BEAM-9543] removed CEPTypeName.java [qz689] [BEAM-9543] added Measures implementation (unfinished) [qz689] [BEAM-9543] added Measures implementation [qz689] [BEAM-9543] added Measures implementation [qz689] [BEAM-9543] fixed minor issues [qz689] [BEAM-9543] fixed minor style issues [noreply] [BEAM-10599] Add documentation about CI on GitHub Action (#12405) [noreply] Fix link for S3FileSystem (#12450) [dcavazos] [BEAM-7390] Add min code snippets [noreply] [BEAM-7390] Add max code snippets (#12409) [noreply] [BEAM-7390] Add mean code snippets (#12437) [borzoo.esmailloo] [BEAM-10499] Adds a descriptive toString to SamzaRunner KeyedTimerData [noreply] [BEAM-9839] OnTimerContext should not create a new one when processing [noreply] Fix dictionary changes size error in pickler.py (#12458) [noreply] [BEAM-9891] TPC-DS module initialization, tables and queries stored [Boyuan Zhang] Address comments. [Boyuan Zhang] Fix SDF/Process input id. [noreply] Interactive: clean up when pipeline is out of scope (#12339) [noreply] Merge pull request #12331 [BEAM-10601] DICOM API Beam IO connector [noreply] [BEAM-10631] Fix performance of Schema#indexOf (#12456) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 1bf60b99741ff4d0a8b88e93f5241379e1f3962f (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 1bf60b99741ff4d0a8b88e93f5241379e1f3962f # timeout=10 Commit message: "Merge pull request #12397: [BEAM-7632] Add Python quickstart instructions for Flink and Spark." > git rev-list --no-walk cbd9aa2821f1891586f707f321d4ed97d3869eaf # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch] $ /bin/bash -xe /tmp/jenkins6164841410947997445.sh + echo '*** Load test: 2GB of 10B records ***' *** Load test: 2GB of 10B records *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src/gradlew> -PloadTest.mainClass=org.apache.beam.sdk.loadtests.GroupByKeyLoadTest -Prunner=:runners:spark -PwithDataflowWorkerJar=false '-PloadTest.args=--project=apache-beam-testing --appName=load_tests_Java_SparkStructuredStreaming_batch_GBK_1 --tempLocation=gs://temp-storage-for-perf-tests/loadtests --publishToBigQuery=true --bigQueryDataset=load_test --bigQueryTable=java_sparkstructuredstreaming_batch_GBK_1 --influxMeasurement=java_batch_gbk_1 --publishToInfluxDB=true --sourceOptions={"numRecords":200000000,"keySizeBytes":1,"valueSizeBytes":9} --fanout=1 --iterations=1 --streaming=false --influxDatabase=beam_test_metrics --influxHost=http://10.128.0.96:8086 --runner=SparkStructuredStreamingRunner' --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses :sdks:java:testing:load-tests:run The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 16782 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-16782.out.log ----- Last 20 lines from daemon log file - daemon-16782.out.log ----- 12:17:18.567 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 135: Received non-IO message from client: Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src}> 12:17:18.567 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src}.> 12:17:18.567 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src}> with connection: socket connection from /0:0:0:0:0:0:0:1:38041 to /0:0:0:0:0:0:0:1:58172. 12:17:18.568 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src},> connection = DefaultDaemonConnection: socket connection from /0:0:0:0:0:0:0:1:38041 to /0:0:0:0:0:0:0:1:58172] after 0.0 minutes of idle 12:17:18.568 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [1b546695-44f3-495b-aa00-03bf7f6619d8 port:38041, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]] 12:17:18.568 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [1b546695-44f3-495b-aa00-03bf7f6619d8 port:38041, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]] 12:17:18.568 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry. 12:17:18.568 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 12:17:18.569 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 12:17:18.569 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer 12:17:18.569 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes. 12:17:18.569 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=4126bf8b-f386-4387-9eb4-78e480a398d4, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src}.> Dispatching build started information... 12:17:18.569 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 26: dispatching class org.gradle.launcher.daemon.protocol.BuildStarted 12:17:18.570 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, INFLUXDB_USER=****, RUN_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/111/display/redirect, HUDSON_HOME=/home/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/111/display/redirect?page=changes, JOB_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/, HUDSON_COOKIE=4cd003d2-86d3-4ec6-a25f-13192b16050e, MAIL=/var/mail/jenkins, JENKINS_SERVER_COOKIE=14925adb602d4986, LOGNAME=jenkins, PWD=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src,> JENKINS_URL=https://ci-beam.apache.org/, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch-111, ROOT_BUILD_CAUSE=TIMERTRIGGER, BUILD_CAUSE_TIMERTRIGGER=true, OLDPWD=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/src,> GIT_CHECKOUT_DIR=src, JENKINS_HOME=/home/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-8, BUILD_DISPLAY_NAME=#111, JOB_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/display/redirect, GIT_BRANCH=origin/master, SHLVL=1, WORKSPACE_TMP=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/@tmp,> GIT_PREVIOUS_COMMIT=cbd9aa2821f1891586f707f321d4ed97d3869eaf, INFLUXDB_USER_PASSWORD=****, JAVA_HOME=/home/jenkins/tools/java/latest1.8, BUILD_ID=111, LANG=en_US.UTF-8, XDG_SESSION_ID=108, JOB_NAME=beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=TIMERTRIGGER, GIT_PREVIOUS_SUCCESSFUL_COMMIT=cbd9aa2821f1891586f707f321d4ed97d3869eaf, NODE_LABELS=apache-beam-jenkins-8 beam, HUDSON_URL=https://ci-beam.apache.org/, WORKSPACE=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/ws/,> ROOT_BUILD_CAUSE_TIMERTRIGGER=true, _=/usr/bin/java, GIT_COMMIT=1bf60b99741ff4d0a8b88e93f5241379e1f3962f, EXECUTOR_NUMBER=3, HUDSON_SERVER_COOKIE=14925adb602d4986, SSH_CLIENT=3.94.149.17 57114 22, JOB_BASE_NAME=beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch, USER=jenkins, SSH_CONNECTION=3.94.149.17 57114 10.128.0.63 22, BUILD_NUMBER=111, BUILD_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_SparkStructuredStreaming_Batch/111/, GIT_URL=https://github.com/apache/beam.git, XDG_RUNTIME_DIR=/run/user/1017, HOME=/home/jenkins} 12:17:18.571 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection. 12:17:18.571 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 16782). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-16782.out.log 12:17:18.572 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 16 mins 53.838 secs, performance: 100%] 12:17:18.572 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build. 12:17:18.572 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=b2956ed3-4d24-422a-90d9-74c8b09ef5bd,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=16782,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant] Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
