See <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/102/display/redirect?page=changes>
Changes: [sijieg] Initial Check-in for distributedlog oss [sijieg] Initial Check-in for distributedlog oss [sijie] Fixes #14: remove concurrency from ConfigurationSubscription tests (#16) [sijieg] Add documents on running distributedlog in distributed mode [arvind.kandhare] Added vagrant files to start 3 ZK nodes and 3 BK nodes with writeproxy [sijie] Vagrant based solution to create multi-node deployment (#34) [sijieg] DL-20: Validate bk read timeout in configuration [sijieg] DL-21: Fix DL flaky test cases [sijieg] DL-1: Clean up the distributedlog pom files [sijieg] DL-1: Clean up the distributedlog pom files [sijieg] DL-31: Provide flag to disable zk based distributed lock [sijieg] DL-36: travis ci build failed with assembly plugin [sijieg] Mark some dl tests as flaky [sijieg] Add infinite retry policy to zookeeper client used by tests [sijieg] DL-32: Fix Findbug warnings [sijieg] DL-32: Fix Findbug warnings [sijieg] Fix deadlock on BKSyncLogReaderDLSN [sijie] Update a couple of scripts [sijie] DL-49: Support building project with scala 2.10 and 2.11 [sijieg] DL-127: Fix coverall report [sijieg] DL-127: Fix coverall report [fcuny] Clean up and fix a few shell scripts [sijieg] DL-141: Fix broken scripts in tutorials and add integration test to [sijie] DL-86: Improve handling of lock conflicts in zk session lock [sijie] DL-87: Introduce periodic keepalive control record in writer [sijie] DL-88: remove watches when unregister children watches [sijie] DL-90: Don't use stack and codec together for configuring thriftmux [sijie] DL-136: Avoid empty catch blocks [sijie] DL-123: Every tests should have timeout [sijie] DL-122: Use assertions from Junit rather than assert() for tests [sijie] DL-28: using /* */ style comment to avoid scrooge windows platform issue [sijie] DL-91: Be able to close writer within a timeout duration [sijieg] DL-129: Enable checkstyle plugin for distributedlog-protocol module [sijieg] DL-97: Remove unused methods in BKLogHandler [sijieg] DL-145: the write requests should be error out immediately even if the [sijieg] DL-155: fix flaky TestAsyncReaderLock#testReaderLockMultiReadersScenario [sijie] DL-150: Ensure namespace path is created for TestZKLogMetadataForWriter [sijie] DL-151: TestBKLogReadHandler#testGetFirstDLSNWithOpenLedger is flaky [sijieg] DL-101: Improve session expire handling on fetching log segments for [sijieg] DL-101: Improve session expire handling on fetching log segments for [sijieg] DL-102: Add routing service to write proxy server side [sijieg] DL-104: BKClientReadTimeout can be equal to getReadLACLongPollTimeout so [sijieg] DL-105: Make compression stats available per stream [sijieg] DL-102: Add routing service to write proxy server side [sijieg] DL-106: Use namespace after it is closed will throw [sijieg] DL-107: Added unregistering gauges for distributedlog-core and [sijieg] DL-108: Log rate limiting more clearly [sijieg] DL-109: Add a tool to find the stream containing the given ledger [sijieg] DL-110: Write control record if necessary when roll a log segment [sijieg] DL-111: ReadAhead Cache should cache entries rather than records [sijieg] DL-112: Improve SyncReader to access readahead cache directly [sijieg] DL-113: Improve the sync reader benchmark [sijieg] DL-114: Add namespace watch tool [sijieg] DL-115: fix force get log segment logic [sijieg] DL-116: Add tool for deleting subscriber from subscription store [sijieg] DL-117: Stream metadata store [sijieg] DL-118: Stream metadata store followup - rename ZKLogMetadata* to [sijieg] DL-119: Fix the logging on closing readahead worker [sijieg] DL-157: resource placement for write proxy [sijieg] DL-158: update truncation status for all completed log segments [sijieg] DL-195: ReadAhead Improvement (part 1) - Interface for [sijieg] DL-195: ReadAhead Improvement (part 1) - Interface for [sijieg] DL-159: ReadAhead Improvement (part 2) - New ReadAhead Reader using the [sijieg] DL-159: ReadAhead Improvement (part 2) - New ReadAhead Reader using the [sijieg] DL-160: Remove 'DLSN' suffix from async and sync readers [sijieg] DL-161: Rename ledger id to log segment id [sijieg] DL-162: Use log segment entry store interface [sijieg] DL-163: clean up direct zookeeper and bookkeeper usage and use [sijieg] DL-164: Create stream operation should not be submitted by StreamImpl [sijie] DL-140: Fix distributedlog-core findbug inconsistent synchronization [sijieg] DL-165: Add TestTimedOutTestsListener to dump timed out cases thread [sijieg] DL-165: Add TestTimedOutTestsListener to dump timed out cases thread [sijieg] DL-4: Repackage the source under apache namespace [sijieg] DL-4: Repackage the source under apache namespace [sijieg] DL-171: adding a short sleep to let the WriteCompleteListener have time [sijieg] DL-176: Rename the DL artifact from com.twitter to [sijieg] DL-176: Rename the DL artifact from com.twitter to [sijie] DL-83: Add javadoc to website [sijie] DL-83: Add javadoc to website [sijie] DL-28: changed // comments to /* */ [sijie] DL-170: All dependency versions should be defined in the parent pom [sijie] DL-170: All dependency versions should be defined in the parent pom [sijieg] Remove Xlint compiler arguments for building release [sijieg] [maven-release-plugin] prepare branch release-0.4.0-incubating [sijieg] [maven-release-plugin] prepare branch release-0.4.0-incubating [sijieg] [maven-release-plugin] prepare for next development iteration [sijieg] [maven-release-plugin] prepare for next development iteration [sijie] Fix the script to make sure binary package can execute scripts correctly [sijie] DL-186: fix common.sh grep bug; kill MultiReader java process as [sijie] DL-191: Fix license header issues [sijie] DL-184: reduce server_graceful_shutdown_period_ms from 35s to 20s, which [sijie] DL-196: Remove 'Copyright 2017 The Apache Software Foundation' from [sijie] DL-173: changed FileUtils.deleteDirectory to FileUtils.forceDeleteOnExit [sijie] DL-174: added getParent method to Utils to replace usage of [sijie] Remove package-info.java under com.twitter.distributedlog.subscription [sijie] DL-205: Remove StatusCode dependency on DLException [sijie] DL-205: Remove StatusCode dependency on DLException [sijie] DL-199: Be able to support filesystem-path like name [sijie] DL-204: Bump libthrift to latest version for distributedlog-core [sijie] DL-124: Use Java8 Future rather than twitter Future [sijie] DL-124: Use Java8 Future rather than twitter Future [sijie] DL-124: Use Java8 Future rather than twitter Future [sijie] Issue 141: graduation changes, remove/change incubate related things [sijie] Issue 141: graduation changes, remove/change incubate related things [sijie] Issue 141: graduation changes, remove/change incubate related things [sijie] DL-2: DistributedLog should work with the official apache bookkeeper [sijie] DL-2: DistributedLog should work with the official apache bookkeeper [sijie] DL-2: DistributedLog should work with the official apache bookkeeper [sijie] DL-206: Delete the log should also delete the underline ledgers [sijie] ISSUE #156: Provide a shading jar for distributedlog-core [sijie] DL-45: DL should allow ByteBuf based API to avoid copying bytes array [sijie] DL-45: DL should allow ByteBuf based API to avoid copying bytes array [sijie] DL-45: DL should allow ByteBuf based API to avoid copying bytes array [zhaijia] ISSUE #166: Code cleanup for 0.5.0 release [zhaijia] ISSUE #166: Code cleanup for 0.5.0 release [zhaijia] ISSUE #166: Code cleanup for 0.5.0 release [sijie] ISSUE #160: Introduce backward compatibility testing [zhaijia] [maven-release-plugin] prepare branch release-0.5.0 [zhaijia] [maven-release-plugin] prepare for next development iteration [zhaijia] [maven-release-plugin] prepare for next development iteration [zhaijia] [maven-release-plugin] prepare for next development iteration [sijie] ISSUE #181: Enable LogRecord ByteBuf based constructor public [sijie] ISSUE #165: Enable checkstyle in core module [sijie] ISSUE #193: Shade Bookkeeper and unshade ZooKeeper in core module [zhaijia] ISSUE #197: Provide a guide for running on k8s [sijie] Fix the flaky test TestBKDistributedLogManager.deleteDuringRead [sijie] Avoid copying bytebuf for constructing log record to write [sijie] ISSUE #213: Correct logger name in BKLogWriteHandler [sijie] ISSUE173: Implement AutoCloseable in BKDistributedLogNamespace [sijie] ISSUE #207: Support getFirstLogRecord [sijie] ISSUE #211: Support listing logs by prefix [sijie] ISSUE164: Move findbug settings files to distributedlog-build-tools [sijie] ISSUE164: Move findbug settings files to distributedlog-build-tools [sijie] ISSUE164: Move findbug settings files to distributedlog-build-tools [zhaijia] ISSUE #209: Support rename log [zhaijia] Issue 225: Create log should create missing path components [zhaijia] ISSUE #224: listing logs should exclude <default> [zhaijia] ISSUE #226: ByteBuf.release() was not called before it's [zhaijia] DLFS - A FileSystem API wrapper over dlog API [guosijie] Fix DistributedSchedule.WriteSet compilation issue [guosijie] Update exception handling in constructing bookkeeper client [sijie] issue #236: shaded jar lose necessary bk jar to execute [sijie] Make distributedlog compiled with latest bookkeeper version [sijie] Move distributedlog-common module [sijie] Move distributedlog-protocol module [sijie] Move distributedlog-core module [sijie] Move distributedlog-io module ------------------------------------------ [...truncated 1.48 MB...] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility SUCCESS [ 0.726 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test upgrade between all released versions and current version SUCCESS [ 2.587 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test upgrade between 4.1.0 and current version SUCCESS [ 1.239 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test compat between old version and new version of hierarchical ledger manager SUCCESS [ 0.962 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test upgrade between 4.1.0 and current version (with hostname bookie ID) SUCCESS [ 1.019 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test recovery does not work when password no in metadata SUCCESS [ 1.269 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test upgrade 4.1.0 to current in cluster with cookies SUCCESS [ 0.964 s] [INFO] Apache BookKeeper :: Tests :: Backward Compatibility :: Test old clients working on current server SUCCESS [ 0.990 s] [INFO] Apache BookKeeper :: Dist (All) .................... SUCCESS [ 4.982 s] [INFO] Apache BookKeeper :: microbenchmarks ............... SUCCESS [ 7.145 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:55 min [INFO] Finished at: 2018-01-31T19:11:34Z [INFO] Final Memory: 141M/1897M [INFO] ------------------------------------------------------------------------ Built the javadoc for version latest. + ./docker/ci.sh +++ dirname ./docker/ci.sh ++ cd ./docker ++ pwd + SCRIPT_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker> + export IMAGE_NAME=bookkeeper/docs + IMAGE_NAME=bookkeeper/docs + pushd <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker> ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site/docker ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site + docker build --rm=true -t bookkeeper/docs . Sending build context to Docker daemon 8.192kB Step 1/1 : FROM ruby:2.4.1 2.4.1: Pulling from library/ruby aa18ad1a0d33: Pulling fs layer 15a33158a136: Pulling fs layer f67323742a64: Pulling fs layer c4b45e832c38: Pulling fs layer c1d1736737e7: Pulling fs layer c1dfd7e8047d: Pulling fs layer 54f441bf1206: Pulling fs layer b20cc84e5780: Pulling fs layer c4b45e832c38: Waiting c1d1736737e7: Waiting c1dfd7e8047d: Waiting 54f441bf1206: Waiting b20cc84e5780: Waiting 15a33158a136: Verifying Checksum 15a33158a136: Download complete aa18ad1a0d33: Verifying Checksum aa18ad1a0d33: Download complete c1d1736737e7: Verifying Checksum c1d1736737e7: Download complete c1dfd7e8047d: Verifying Checksum c1dfd7e8047d: Download complete f67323742a64: Verifying Checksum f67323742a64: Download complete b20cc84e5780: Download complete 54f441bf1206: Download complete c4b45e832c38: Verifying Checksum c4b45e832c38: Download complete aa18ad1a0d33: Pull complete 15a33158a136: Pull complete f67323742a64: Pull complete c4b45e832c38: Pull complete c1d1736737e7: Pull complete c1dfd7e8047d: Pull complete 54f441bf1206: Pull complete b20cc84e5780: Pull complete Digest: sha256:b6d5b373153e87809d2dd067bfda8a88e901731c3efec0ca640e9a49ffcdd26d Status: Downloaded newer image for ruby:2.4.1 ---> e7ca4a0b5b6d Successfully built e7ca4a0b5b6d Successfully tagged bookkeeper/docs:latest + popd ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site ++ uname -s + '[' Linux == Linux ']' + USER_NAME=jenkins ++ id -u jenkins + USER_ID=910 ++ id -g jenkins + GROUP_ID=910 + LOCAL_HOME=/home/jenkins + docker build -t bookkeeper/docs-jenkins - Sending build context to Docker daemon 2.048kB Step 1/3 : FROM bookkeeper/docs ---> e7ca4a0b5b6d Step 2/3 : RUN groupadd --non-unique -g 910 jenkins && useradd -g 910 -u 910 -k /root -m jenkins ---> Running in 2684f01d8f88 ---> 8bf6e45d182d Removing intermediate container 2684f01d8f88 Step 3/3 : ENV HOME /home/jenkins ---> Running in 8180325e99c6 ---> 22fa31451433 Removing intermediate container 8180325e99c6 Successfully built 22fa31451433 Successfully tagged bookkeeper/docs-jenkins:latest + BOOKKEEPER_DOC_ROOT=<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker/..> + pushd <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker/..> ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site + docker run --rm=true -w <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker/..> -u jenkins -v <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker/..>:<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/docker/..> -v /home/jenkins:/home/jenkins -e JEKYLL_ENV=production bookkeeper/docs-jenkins bash -c 'make setup && make apache' gem install bundler \ -v 1.15.1 \ --no-rdoc \ --no-ri Successfully installed bundler-1.15.1 1 gem installed NOKOGIRI_USE_SYSTEM_LIBRARIES=true bundle _1.15.1_ install \ --path vendor/bundle Fetching gem metadata from https://rubygems.org/.............. Fetching version metadata from https://rubygems.org/... Fetching dependency metadata from https://rubygems.org/.. Fetching public_suffix 2.0.5 Installing public_suffix 2.0.5 Fetching colorator 1.1.0 Installing colorator 1.1.0 Fetching sass 3.4.24 Installing sass 3.4.24 Fetching rb-fsevent 0.9.8 Installing rb-fsevent 0.9.8 Fetching ffi 1.9.18 Installing ffi 1.9.18 with native extensions Fetching kramdown 1.13.2 Installing kramdown 1.13.2 Fetching liquid 3.0.6 Installing liquid 3.0.6 Fetching mercenary 0.3.6 Installing mercenary 0.3.6 Fetching forwardable-extended 2.6.0 Installing forwardable-extended 2.6.0 Fetching rouge 1.11.1 Installing rouge 1.11.1 Fetching safe_yaml 1.0.4 Installing safe_yaml 1.0.4 Fetching mini_portile2 2.3.0 Installing mini_portile2 2.3.0 Fetching eventmachine 1.2.3 Installing eventmachine 1.2.3 with native extensions Fetching http_parser.rb 0.6.0 Installing http_parser.rb 0.6.0 with native extensions Using bundler 1.15.1 Fetching addressable 2.5.1 Installing addressable 2.5.1 Fetching jekyll-sass-converter 1.5.0 Installing jekyll-sass-converter 1.5.0 Fetching rb-inotify 0.9.10 Installing rb-inotify 0.9.10 Fetching pathutil 0.14.0 Installing pathutil 0.14.0 Fetching nokogiri 1.8.1 Installing nokogiri 1.8.1 with native extensions Fetching em-websocket 0.5.1 Installing em-websocket 0.5.1 Fetching listen 3.0.8 Installing listen 3.0.8 Fetching jekyll-toc 0.2.1 Installing jekyll-toc 0.2.1 Fetching jekyll-watch 1.5.0 Installing jekyll-watch 1.5.0 Fetching jekyll 3.4.3 Installing jekyll 3.4.3 Fetching jekyll-livereload 0.2.2 Installing jekyll-livereload 0.2.2 Bundle complete! 4 Gemfile dependencies, 26 gems now installed. Bundled gems are installed into ./vendor/bundle. The latest bundler is 1.16.1, but you are currently running 1.15.1. To update, run `gem install bundler` rm -rf _site local-generated generated_site JEKYLL_ENV=production bundle _1.15.1_ exec jekyll build \ --config _config.yml,_config.apache.yml Configuration file: _config.yml Configuration file: _config.apache.yml Configuration file: <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/_config.yml> Source: <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site> Destination: generated_site/content Incremental build: disabled. Enable with --incremental Generating... done in 13.167 seconds. Auto-regeneration: disabled. Use --watch to enable. + popd ~/jenkins-slave/workspace/bookkeeper_postcommit_publish_website/site + source scripts/common.sh ++ DOC_VERSION=latest +++ git rev-parse --show-toplevel ++ ROOT_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/> +++ git rev-parse --short HEAD ++ REVISION=937de49 ++ JAVADOC_GEN_DIR=target/site/apidocs ++ JAVADOC_DEST_DIR=site/docs/latest/api/javadoc ++ LOCAL_GENERATED_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/local-generated> ++ APACHE_GENERATED_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site> ++ TMP_DIR=/tmp/bookkeeper-site ++ git remote show origin ++ awk -F// '{print $NF}' ++ grep 'Push URL' + ORIGIN_REPO=gitbox.apache.org/repos/asf/bookkeeper.git + echo 'ORIGIN_REPO: gitbox.apache.org/repos/asf/bookkeeper.git' ORIGIN_REPO: gitbox.apache.org/repos/asf/bookkeeper.git + cd <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site> + rm -rf /tmp/bookkeeper-site + mkdir -p /tmp/bookkeeper-site + cd /tmp/bookkeeper-site + git clone https://gitbox.apache.org/repos/asf/bookkeeper.git . Cloning into '.'... + git config user.name 'Apache BookKeeper Site Updater' + git config user.email [email protected] + git fetch origin + git checkout asf-site Switched to a new branch 'asf-site' Branch asf-site set up to track remote branch asf-site from origin. + git log + head commit 3c83528d18d7422f4f4a61cefdd3bfa101484201 Author: jenkins <[email protected]> Date: Tue Jan 30 21:27:14 2018 +0000 Updated site at revision 8a25353 commit e95546145231588e9b09db32c9a5ff7fa3fdaad3 Author: jenkins <[email protected]> Date: Tue Jan 30 19:58:50 2018 +0000 + cp -r <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/bps> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/community> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/css> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/docker> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/docs> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/fonts> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/img> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/index.html> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/js> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/project> <https://builds.apache.org/job/bookkeeper_postcommit_publish_website/ws/site/generated_site/content/releases> /tmp/bookkeeper-site/content + git add -A . + git diff-index --quiet HEAD + git commit -m 'Updated site at revision 937de49' [asf-site f1d94d5] Updated site at revision 937de49 139 files changed, 1277 insertions(+), 1208 deletions(-) + git log + head commit f1d94d57bff23fde2b6e61b374537048e1e1c8ba Author: jenkins <[email protected]> Date: Wed Jan 31 19:13:28 2018 +0000 Updated site at revision 937de49 commit 3c83528d18d7422f4f4a61cefdd3bfa101484201 Author: jenkins <[email protected]> Date: Tue Jan 30 21:27:14 2018 +0000 + git push -q origin HEAD:asf-site remote: This repository is currently out of sync, please remote: contact [email protected]! remote: To https://gitbox.apache.org/repos/asf/bookkeeper.git ! [remote rejected] HEAD -> asf-site (pre-receive hook declined) error: failed to push some refs to 'https://gitbox.apache.org/repos/asf/bookkeeper.git' Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
