See <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/863/display/redirect?page=changes>
Changes: [chamikaramj] Python support for directly using Java transforms using constructor and [chamikaramj] Fixes yapf [chamikaramj] Fixes lint [chamikaramj] Addressing reviewer comments [chamikaramj] Adds support for a field name format that will be ignored at expansion [danthev] Fix flaky test. [danthev] Fix lint errors. [Robert Bradshaw] Additional CoGBK tests. [chamikaramj] Addresses reviewer comments [chamikaramj] Use correct ignore field prefix in Python side [noreply] [BEAM-12803] Update deprecated use of _field_types (#15539) [Robert Bradshaw] Move CoGBK tests into appropreate module. ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/> The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git --version # 'git version 2.7.4' > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 6f0a1c9aa62d7cd4ca93435d72d524d40f002308 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6f0a1c9aa62d7cd4ca93435d72d524d40f002308 # timeout=10 Commit message: "Merge pull request #15484: [BEAM-12769] Python support for directly using Java transforms using constructor and builder methods" > git rev-list --no-walk 8072cc0bcfd4eee08a95902e13b9bf1dc2338693 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. [beam_LoadTests_Java_Combine_Dataflow_Batch] $ /bin/bash -xe /tmp/jenkins4640036591267727111.sh + echo '*** Load test: 2GB of 10B records ***' *** Load test: 2GB of 10B records *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src/gradlew> -PloadTest.mainClass=org.apache.beam.sdk.loadtests.CombineLoadTest -Prunner=:runners:google-cloud-dataflow-java '-PloadTest.args=--project=apache-beam-testing --region=us-central1 --appName=load_tests_Java_Dataflow_batch_Combine_1 --tempLocation=gs://temp-storage-for-perf-tests/loadtests --publishToBigQuery=true --bigQueryDataset=load_test --bigQueryTable=java_dataflow_batch_Combine_1 --influxMeasurement=java_batch_combine_1 --publishToInfluxDB=true --sourceOptions={"numRecords":200000000,"keySizeBytes":1,"valueSizeBytes":9} --fanout=1 --iterations=1 --topCount=20 --numWorkers=5 --autoscalingAlgorithm=NONE --perKeyCombiner=TOP_LARGEST --streaming=false --influxDatabase=beam_test_metrics --influxHost=http://10.128.0.96:8086 --runner=DataflowRunner' --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:java:testing:load-tests:run The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 30213 log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-30213.out.log ----- Last 20 lines from daemon log file - daemon-30213.out.log ----- 2021-09-21T12:23:48.637+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 296: Received non-IO message from client: Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src}> 2021-09-21T12:23:48.637+0000 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src}.> 2021-09-21T12:23:48.638+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src}> with connection: socket connection from /127.0.0.1:34789 to /127.0.0.1:51708. 2021-09-21T12:23:48.638+0000 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src},> connection = DefaultDaemonConnection: socket connection from /127.0.0.1:34789 to /127.0.0.1:51708] after 0.0 minutes of idle 2021-09-21T12:23:48.638+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [7dc27e8d-6e74-4e12-a657-07907946cb04 port:34789, addresses:[localhost/127.0.0.1]] 2021-09-21T12:23:48.638+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [7dc27e8d-6e74-4e12-a657-07907946cb04 port:34789, addresses:[localhost/127.0.0.1]] 2021-09-21T12:23:48.639+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry. 2021-09-21T12:23:48.639+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 2021-09-21T12:23:48.783+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 2021-09-21T12:23:48.784+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer 2021-09-21T12:23:48.784+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes. 2021-09-21T12:23:48.784+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=1db1764f-ebdc-4250-9923-5eda7660e40b, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_Combine_Dataflow_Batch/ws/src}.> Dispatching build started information... 2021-09-21T12:23:48.784+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 27: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@3d255335 2021-09-21T12:23:48.785+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, INFLUXDB_USER, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MAIL, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, INFLUXDB_USER_PASSWORD, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, _, GIT_COMMIT, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME] 2021-09-21T12:23:48.786+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection. 2021-09-21T12:23:48.786+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 30213). The daemon log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-30213.out.log 2021-09-21T12:23:48.787+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 23 mins 11.884 secs, performance: 100%] 2021-09-21T12:23:48.787+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build. 2021-09-21T12:23:48.788+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=0eeef628-8a26-4e65-875b-2fdce11d3ee7,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=30213,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant] Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
