See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/298/display/redirect?page=changes>
Changes: [hannahjiang] BEAM-3645 add ParallelBundleProcessor [hannahjiang] BEAM-3645 reflect comments [hannahjiang] BEAM-3645 add changes from review comments [hannahjiang] BEAM-3645 add thread lock when generating process_bundle_id ------------------------------------------ [...truncated 38.75 KB...] > Task :runners:flink:1.5:job-server:shadowJar > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, [email protected]:coreos/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:go:test:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go> > Task :sdks:go:test:resolveTestDependencies > Task :sdks:go:test:installDependencies > Task :sdks:go:test:buildLinuxAmd64 > Task :sdks:go:test:goBuild > Task :sdks:go:test:assemble > Task :sdks:go:test:goVendor > Task :sdks:go:test:goTest Test for github.com/apache/beam/sdks/go/test/regression finished, 6 completed, 0 failed. Test for github.com/apache/beam/sdks/go/test/integration/wordcount finished, 1 completed, 0 failed. Test for github.com/apache/beam/sdks/go/test/integration/primitives finished, 6 completed, 0 failed. > Task :sdks:go:test:goCover > Task :sdks:go:test:goVet > Task :sdks:go:test:goCheck > Task :sdks:go:test:check > Task :sdks:go:test:build > Task :sdks:go:test:flinkValidatesRunner RUNNER=dataflow # Where to store integration test outputs. GCS_LOCATION=gs://temp-storage-for-end-to-end-tests # Project for the container and integration test PROJECT=apache-beam-testing DATAFLOW_PROJECT=apache-beam-testing /usr/bin/docker # Number of tests to run in parallel /usr/bin/gcloud PARALLEL=10 while [[ $# -gt 0 ]] do key="$1" case $key in --runner) RUNNER="$2" shift # past argument shift # past value ;; --project) PROJECT="$2" shift # past argument shift # past value ;; --dataflow_project) DATAFLOW_PROJECT="$2" shift # past argument shift # past value ;; --gcs_location) GCS_LOCATION="$2" shift # past argument shift # past value ;; --dataflow_worker_jar) DATAFLOW_WORKER_JAR="$2" shift # past argument shift # past value ;; --flink_job_server_jar) FLINK_JOB_SERVER_JAR="$2" shift # past argument shift # past value ;; --spark_job_server_jar) SPARK_JOB_SERVER_JAR="$2" shift # past argument shift # past value ;; --endpoint) ENDPOINT="$2" shift # past argument shift # past value ;; --parallel) PARALLEL="$2" shift # past argument shift # past value ;; *) # unknown option echo "Unknown option: $1" exit 1 ;; esac done # Go to the root of the repository cd $(git rev-parse --show-toplevel) git rev-parse --show-toplevel # Verify in the root of the repository test -d sdks/go/test # Verify docker and gcloud commands exist command -v docker command -v gcloud docker -v Docker version 18.09.4, build d14af54 gcloud -v Google Cloud SDK 212.0.0 alpha 2018.08.13 beta 2018.08.13 bq 2.0.34 core 2018.08.13 gsutil 4.33 # ensure gcloud is version 186 or above TMPDIR=$(mktemp -d) mktemp -d gcloud_ver=$(gcloud -v | head -1 | awk '{print $4}') gcloud -v | head -1 | awk '{print $4}' if [[ "$gcloud_ver" < "186" ]] then pushd $TMPDIR curl https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-186.0.0-linux-x86_64.tar.gz --output gcloud.tar.gz tar xf gcloud.tar.gz ./google-cloud-sdk/install.sh --quiet . ./google-cloud-sdk/path.bash.inc popd gcloud components update --quiet || echo 'gcloud components update failed' gcloud -v fi # Build the container TAG=$(date +%Y%m%d-%H%M%S) date +%Y%m%d-%H%M%S CONTAINER=us.gcr.io/$PROJECT/$USER/go Using container us.gcr.io/apache-beam-testing/jenkins/go echo "Using container $CONTAINER" ./gradlew :sdks:go:container:docker -Pdocker-repository-root=us.gcr.io/$PROJECT/$USER -Pdocker-tag=$TAG > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:goPrepare Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/.gogradle/project_gopath> > Task :sdks:go:container:dockerClean UP-TO-DATE > Task :sdks:go:container:goPrepare Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/.gogradle/project_gopath> The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=31679953-d439-4044-adab-f96284a974e9, currentDir=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 6625 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-6625.out.log ----- Last 20 lines from daemon log file - daemon-6625.out.log ----- 19:30:54.745 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=31679953-d439-4044-adab-f96284a974e9, currentDir=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src},> connection = DefaultDaemonConnection: socket connection from /0:0:0:0:0:0:0:1:38491 to /0:0:0:0:0:0:0:1:47270] after 0.0 minutes of idle 19:30:54.745 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [f133ae33-a563-4f1f-8d2f-80afcf17ca1e port:38491, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]] 19:30:54.745 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [f133ae33-a563-4f1f-8d2f-80afcf17ca1e port:38491, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]] 19:30:54.745 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry. 19:30:54.745 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 19:30:54.746 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 19:30:54.746 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer 19:30:54.746 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes. 19:30:54.746 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=31679953-d439-4044-adab-f96284a974e9, currentDir=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src}.> Dispatching build started information... 19:30:54.747 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 26: dispatching class org.gradle.launcher.daemon.protocol.BuildStarted 19:30:54.747 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, RUN_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/298/display/redirect, HUDSON_HOME=/x1/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/298/display/redirect?page=changes, JOB_URL=https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/, ROOT_BUILD_CAUSE_SCMTRIGGER=true, HUDSON_COOKIE=312c70b6-421f-439c-afa6-75444d7de1b2, NIX_LABEL=ubuntu, SLACK_WEBHOOK_URL=****, SUDO_USER=yifanzou, MAIL=/var/mail/jenkins, WIN_LABEL=Windows, JENKINS_SERVER_COOKIE=f4ebd1e6b0d976e8, USERNAME=root, LOGNAME=jenkins, PWD=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src,> JENKINS_URL=https://builds.apache.org/, BUILD_CAUSE_SCMTRIGGER=true, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_PostCommit_Go_VR_Flink-298, [email protected], LESSOPEN=| /usr/bin/lesspipe %s, ROOT_BUILD_CAUSE=SCMTRIGGER, GIT_AUTHOR_NAME=jenkins, OLDPWD=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src,> JENKINS_HOME=/x1/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-1, BUILD_DISPLAY_NAME=#298, JOB_DISPLAY_URL=https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/display/redirect, GIT_BRANCH=origin/master, LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:, SHLVL=2, GIT_PREVIOUS_COMMIT=3d576f7c4f86c0b12bd7b682fe2816fbd1137bbe, LESSCLOSE=/usr/bin/lesspipe %s %s, JAVA_HOME=/home/jenkins/tools/java/latest1.8, TERM=xterm-256color, BUILD_ID=298, LANG=en_US.UTF-8, JOB_NAME=beam_PostCommit_Go_VR_Flink, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=SCMTRIGGER, SUDO_GID=1014, GIT_PREVIOUS_SUCCESSFUL_COMMIT=3d576f7c4f86c0b12bd7b682fe2816fbd1137bbe, NODE_LABELS=apache-beam-jenkins-1 beam, HUDSON_URL=https://builds.apache.org/, WORKSPACE=<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/,> SUDO_UID=1013, _=./gradlew, GIT_COMMIT=45d8a28191a686493534acb3588bbd7e9c3d3139, COVERALLS_REPO_TOKEN=****, EXECUTOR_NUMBER=1, HUDSON_SERVER_COOKIE=f4ebd1e6b0d976e8, GIT_COMMITTER_NAME=jenkins, JOB_BASE_NAME=beam_PostCommit_Go_VR_Flink, USER=jenkins, SUDO_COMMAND=/bin/su jenkins, BUILD_NUMBER=298, BUILD_URL=https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/298/, [email protected], GIT_URL=https://github.com/apache/beam.git, HOME=/home/jenkins} 19:30:54.748 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection. 19:30:54.748 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 6625). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-6625.out.log 19:30:54.749 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 16 mins 2.922 secs, performance: 100%] 19:30:54.749 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build. 19:30:54.750 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=7c6b129e-d9f4-45ed-a811-dd7361a95eb6,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=6625,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant] Configuration on demand is an incubating feature. Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/.gogradle/project_gopath> Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/.gogradle/project_gopath> Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :sdks:go:resolveBuildDependencies > Task :sdks:go:test:flinkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59 * What went wrong: Execution failed for task ':sdks:go:test:flinkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2m 14s 63 actionable tasks: 48 executed, 15 from cache Publishing build scan... https://gradle.com/s/6ovalecksj7wa Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
