Re: New BookKeeper Proposal "Allow Reads outside the LAC Protocol"

til it reaches a > > NoEntry error. > > > > Thank you Matteo > That's exacly what I meant. But I would like to port it to the standard > client (non-admin) > I will refer to this work in the BP > > > > > > > > > > On Fri, Mar 31, 2017 a

High Performance Logging with Apache BookKeeper

FYI. https://www.linux.com/news/event/apachecon/2017/4/high-performance-logging-apache-bookkeeper This is the follow article for Apache BookKeeper talk at #vault. - Sijie

[DISCUSS] AutoRecovery bug fixes and improvements

Hi all, As we discussed in today's community call, I created the master jira for tracking the existing bug fixes (that are needed to merge) and the improvements that we are looking for. This is the master jira: https://issues.apache.org/jira/browse/BOOKKEEPER-1023 Let's use this email thread for

[ANNOUNCE] New BookKeeper Committer: Enrico Olivelli & Charan Reddy

The Apache BookKeeper PMC recently extended committer karma to Enrico Olivelli & Charan Reddy and they have accepted. Charan Reddy and Enrico Olivelli have been contributing bookkeeper changes to the community for a while. They are active in code contributions, discussion and code reviews. We are

Re: Question regarding Checkpoint/Flush codePath

Charan, will check later today On Apr 20, 2017 10:55 PM, "Charan Reddy G" wrote: > Hey, > > SyncThread.checkpoint(Checkpoint checkpoint) (which is called periodically > by SyncThread's executor for every flushInterval) ultimately calls > EntryLogger.flushRotatedLogs. > > In EntryLogger.flushRota

Re: Publish SNAPSHOT artifacts on Maven Central

I don't have any objections on doing this, if we can figure out following: - does Apache infra allow doing this? - what does SNAPSHOT mean? How many snapshots do you want to publish? - why not shorten the release scope and publish a release instead? Thoughts? On Apr 21, 2017 9:29 AM, "Venkatesw

Re: Question regarding Checkpoint/Flush codePath

, Apr 21, 2017 at 5:22 PM, Sijie Guo wrote: > Charan, will check later today > > On Apr 20, 2017 10:55 PM, "Charan Reddy G" > wrote: > >> Hey, >> >> SyncThread.checkpoint(Checkpoint checkpoint) (which is called >> periodically >> by SyncThre

Re: Publish SNAPSHOT artifacts on Maven Central

On Sat, Apr 22, 2017 at 12:30 AM, Enrico Olivelli wrote: > Il sab 22 apr 2017, 02:27 Sijie Guo ha scritto: > > > I don't have any objections on doing this, if we can figure out > following: > > > > - does Apache infra allow doing this? > > > > Yes.

Re: Github mirror not in sync

Can you describe more on what are not in sync? Sijie On Apr 25, 2017 8:33 AM, "Enrico Olivelli" wrote: > Hi, > Github mirror is not in synch. > What can we do? > This is a problem for PRs > > Enrico > -- > > > -- Enrico Olivelli >

Re: Github mirror not in sync

Thank you Enrico! - Sijie On Wed, Apr 26, 2017 at 9:49 AM, Enrico Olivelli wrote: > Done! > > Il mer 26 apr 2017, 12:37 Enrico Olivelli ha > scritto: > > > According to this table: > > https://www.apache.org/dev/infra-contact > > > > I'm going to send an email to us...@infra.apache.org > > > >

Re: Issue with entryLogger.leastUnflushedLogId, when preallocatedLogId rolls over Int.MAX

I think Bookkeeper-833 is irrelevant, no? Even it is Long.MAX, it would still have the roll over problem. The question is - is this really an issue? When roll over happen, it might cause an entry log file won't be garbage collected or compacted in this lifecycle of the bookie. But it doesn't actua

Re: Issue with entryLogger.leastUnflushedLogId, when preallocatedLogId rolls over Int.MAX

Hi Enrico, Let's try to figure things out in the email thread before create a JIRA. - Sijie On Thu, Apr 27, 2017 at 11:43 PM, Enrico Olivelli wrote: > Thank you Charan, > Can you create a JIRA? > Do you already have a fix? > > Il ven 28 apr 2017, 00:27 Charan Reddy G ha > scritto: > >> Hey, >

[DRAFT] [REPORT] BookKeeper - May 2017

Hi all, We have a board report due this month. Here is the draft. Let me know if anything else that I need to add. --- ## Description: BookKeeper is a distributed, reliable, and high performance logging service. It has been used as a fundamental service to build high available and replicated s

Re: why write to journal is happening after write to ledgerStorage?

I don't think this is an inconsistent issue. The in memory update is updating lac not current entry. Even the entry is added into memory but this entry will not be readable after lac is advanced, lac is advanced only after the next entry is added which happened after current entry is acked. So addi

Re: why write to journal is happening after write to ledgerStorage?

On Mon, May 1, 2017 at 6:03 PM, Venkateswara Rao Jujjuri wrote: > On Mon, May 1, 2017 at 5:56 PM, Sijie Guo wrote: > > > I don't think this is an inconsistent issue. The in memory update is > > updating lac not current entry. Even the entry is added into memory but >

Re: why write to journal is happening after write to ledgerStorage?

On Mon, May 1, 2017 at 6:14 PM, Venkateswara Rao Jujjuri wrote: > On Mon, May 1, 2017 at 6:03 PM, Venkateswara Rao Jujjuri < > jujj...@gmail.com> > wrote: > > > > > > > On Mon, May 1, 2017 at 5:56 PM, Sijie Guo wrote: > > > >> I don't thin

Re: Publish SNAPSHOT artifacts on Maven Central

>> > >> I will come back to the list with some proposal > >> > >> 2017-04-27 15:31 GMT+02:00 Bobby Evans : > >>> There is a special SNAPSHOTS repo that is already setup. I know that > hadoop has been using it for a while, so you should just need to ask

Re: why write to journal is happening after write to ledgerStorage?

might be worth to let the throttling kick in, rather than let journal disk accepting writes and putting ledger storage into worse state. - Sijie On Mon, May 1, 2017 at 6:23 PM, Sijie Guo wrote: > > > On Mon, May 1, 2017 at 6:14 PM, Venkateswara Rao Jujjuri < > jujj...@gmail.com>

Re: why write to journal is happening after write to ledgerStorage?

re capacity is needed then. - Sijie > > On Mon, May 1, 2017 at 6:33 PM, Sijie Guo wrote: > > > In the other to think about this, > > > > when 'throttling' happens, it typically means: > > > > - the bookie doesn't have enough bandwidth/capacit

Re: why write to journal is happening after write to ledgerStorage?

en to Journal, or bookie could crash > at that time. Will that bring inconsistency? > > Correct me if I'm wrong. > > Best, > Yiming > > On Mon, May 1, 2017 at 6:52 PM, Sijie Guo wrote: > > > On Mon, May 1, 2017 at 6:35 PM, Venkateswara Rao Jujjuri < > &

Re: why write to journal is happening after write to ledgerStorage?

try 2, but in fact, > > entry 2 could even failed to be written to Journal, or bookie could crash > > at that time. Will that bring inconsistency? > > > > Correct me if I'm wrong. > > > > Best, > > Yiming > > > > On Mon, May 1, 2017 at 6:52

Re: Issue with entryLogger.leastUnflushedLogId, when preallocatedLogId rolls over Int.MAX

nflushedLogId() reaches close to Int.MAX > but not rolled over again. > I agreed with this is an issue that we need to address. I am just trying to clarify the severity of this issue. - Sijie > > Thanks, > Charan > > > On Fri, Apr 28, 2017 at 12:11 AM, Enrico Olivelli > w

Re: Publish SNAPSHOT artifacts on Maven Central

Gotcha. Let me check the wiki. (I am currently traveling.) I will try to get this ready for you when I have a better access to internet. - Sijie On Tue, May 2, 2017 at 8:48 PM, Enrico Olivelli wrote: > 2017-05-02 3:27 GMT+02:00 Sijie Guo : > > Enrico, > > > > Let me chec

Re: [DRAFT] [REPORT] BookKeeper - May 2017

wrote: > On Mon, May 1, 2017 at 9:29 AM, Sijie Guo wrote: > > > Hi all, > > > > We have a board report due this month. Here is the draft. > > > > Let me know if anything else that I need to add. > > > > --- > > > > ## Description: > &g

Re: Issue in GarbageCollectorThread compaction logic

We don't force flush metadata in bookies. Because: - flush metadata requires more I/O operations. - flush metadata usually updates file metadata information (e.g. access permissions, last modification/access time). The difference of force(false) and force(true) is the difference between fdatasync

Re: Question regarding synchronization in EntryLogger

On Sat, May 6, 2017 at 9:51 AM, Charan Reddy G wrote: > Hey, > > In EntryLogger, I'm wondering what is the need of making flushCurrentLog > method synchronized? (if we make logChannel variable volatile or of type > AtomicReference and bytesWrittenSinceLastFlush of type AtomicLong). Anyhow > in Bu

Re: [DRAFT] [REPORT] BookKeeper - May 2017

Sent the report to the board. - Sijie On Wed, May 3, 2017 at 5:25 PM, Enrico Olivelli wrote: > +1 for me > > 2017-05-03 11:24 GMT+02:00 Sijie Guo : > > Discussed with JV offline. Updated the draft. Folks, please take a look > and > > give me feedback. > > > >

Re: Issue in GarbageCollectorThread compaction logic

rything to false for consistency I don't remember that we called force(true) on file channel. Do you mean the buffered channel? JV On Tue, May 9, 2017 at 4:40 PM, Sijie Guo wrote: > We don't force flush metadata in bookies. Because: > > - flush metadata requires more I/O o

Re: Issue in GarbageCollectorThread compaction logic

dependent > upon the underlying operating system and is therefore unspecified. Invoking > this method may cause an I/O operation to occur even if the channel was > only opened for reading. Some operating systems, for example, maintain a > last-access time as part of a file's metadata, a

Re: Issue in GarbageCollectorThread compaction logic

n if the channel was > only opened for reading. Some operating systems, for example, maintain a > last-access time as part of a file's metadata, and this time is updated > whenever the file is read. Whether or not this is actually done is > system-dependent and is therefore unspecified.

Re: Issue in GarbageCollectorThread compaction logic

datasync won't require flushing metadata as the file size has been changed on pre-allocation. In entry logger file, we didn't do pre-allocation (we probably should do). Passing true will enforce unnecessary metadata syncs when journal file size isn't changed. > > What do you guys

Re: Issue in GarbageCollectorThread compaction logic

>>> only and we needed it to be "persisted" >>> Even if we can think/come up with some obscure cases of #2, majority of >>> of our use-case falls into #1. >>> So why not put force(true) all the time? What cases we may incur >>> penalty? If we p

Re: Issue in GarbageCollectorThread compaction logic

) for journal files. because journal does preallocation to reduce syncing metadata. if the underneath disk blocks are allocated, it doesn't need to sync metadata as file size is not changed. > > On Wed, May 10, 2017 at 5:09 PM, Sijie Guo wrote: > >> >> >>

Netty 4

I merged BOOKKEEPER-1008. It lands on master now! It is a great milestone for 4.5.0. Thank you everyone for making this happen! - Sijie

Re: Client-Bookie Protocol Enhancements.

On Mon, May 15, 2017 at 10:35 PM, Venkateswara Rao Jujjuri < jujj...@gmail.com> wrote: > As we are moving towards mega store, which can house 10s of millions(even > 100s) of ledgers, and 1000s of bookies, there can be a huge overhead on > some of the operations we are performing right now. > > 1.

Re: Client-Bookie Protocol Enhancements.

On May 16, 2017 12:09 AM, "Enrico Olivelli - Diennea" < enrico.olive...@diennea.com> wrote: Il giorno mar, 16/05/2017 alle 00.06 -0700, Sijie Guo ha scritto: On Mon, May 15, 2017 at 10:35 PM, Venkateswara Rao Jujjuri < jujj...@gmail.com<mailto:jujj...@gmail.com>>

Re: Bookie labels and Placement policy

My personal feeling is the use cases are so different across organizations. It would be really hard to design a **standard** policy for such things. What is your major concern of customizing your own placement policy? - Sijie On Tue, May 16, 2017 at 4:05 AM, Enrico Olivelli wrote: > Hi bookkeep

Re: Issue in entryLogFilePreallocationEnabled logic in EntryLogger.java

In my opinion, this isn't a real issue. I don't see the real problem behind this. Turning a disk to full is an eventual behavior. Any real concern behind this? - Sijie On Thu, May 18, 2017 at 9:30 AM, Charan Reddy G wrote: > As part of BOOKKEEPER-643 ( > https://github.com/apache/bookkeeper/c

Re: Client-Bookie Protocol Enhancements.

On Tue, May 16, 2017 at 10:59 PM, Venkateswara Rao Jujjuri < jujj...@gmail.com> wrote: > Please note that I started this thread to stir up discussion.. not my final > proposals. > > > On Tue, May 16, 2017 at 1:02 AM, Sijie Guo wrote: > > > On May 16, 2017 12:09

Re: Cutting a 4.4.1 release ?

4.4.* should only be the bug fix branch for 4.4.0. If we are cutting a new release from master, it should be 4.5.0. This is just to follow release standard and make things clear. If we agree on current feature set, we can cut 4.5.0 and defer some features into 4.6.0. - Sijie On Wed, May 24, 201

Re: Bookie labels and Placement policy

On Tue, May 16, 2017 at 11:39 PM, Venkateswara Rao Jujjuri < jujj...@gmail.com> wrote: > We have this use case too. I believe introducing "pools" Is the right > approach for this. > Pools are very high level abstraction and it is treated as simply two > different clusters, but wrapped into one. >

[DISCUSS] Issue Tracking - Jira or Github Issues

Hi all, Currently we are using Jira for issue tracking and using Github for managing pull requests. For a new developer, he has to create two accounts in order to engage with BookKeeper community. I am thinking - shall we also move the issue tracking to use Github Issues (which I believe Apache In

Re: [DISCUSS] Issue Tracking - Jira or Github Issues

t; I have not used github issues much but from what I have done it does not > look even close to being as full featured as JIRA. So my vote would be to > ask people to use JIRA, but not ignore the github issues. > > - Bobby > > On Friday, May 26, 2017, 9:57:43 AM CDT, Sijie Guo

Re: [DISCUSS] Issue Tracking - Jira or Github Issues

or by having a > fire-hose of changes from the external system sent to some apache mailing > list that it can archive. > > I have not used github issues much but from what I have done it does not > look even close to being as full featured as JIRA. So my vote would be to > ask p

Re: Official Bookkeeper Docker Image

Ah, sorry my bad. Do you mind pointing me the JIRA/pull request that needs responses from me? What is your confluence wiki handle? I can grant you the edit permission. - Sijie On Mon, May 29, 2017 at 12:44 AM, Francesco Caliumi - Diennea < francesco.cali...@diennea.com> wrote: > Hi all, > some

Re: Publish SNAPSHOT artifacts on Maven Central

critto: > > > 2017-05-03 11:23 GMT+02:00 Sijie Guo : > > > Gotcha. Let me check the wiki. (I am currently traveling.) I will try > to > > > get this ready for you when I have a better access to internet. > > > > > > > Did you have time to che

Re: Publish SNAPSHOT artifacts on Maven Central

Cool, thank you Enrico! - Sijie On Tue, May 30, 2017 at 1:21 PM, Enrico Olivelli wrote: > 2017-05-30 22:07 GMT+02:00 Sijie Guo : > > Sorry for late response. > > > > I just added you. Please check and let me know if it works. > > Now I can edit the configuration. &

Agenda for community meeting this week

Hi all, Anyone wants to put up an agenda for community meeting this week? I have on item in my mind: - Docker Image: I see there are a few efforts on delivering an official docker image for bookkeeper. It will be good to consolidate it. Please feel free to drop in the items that need to be disc

Re: Issue with 'preallocation' feature in EntryLogger

You are right. At current implementation, this feature seems to be disabled. It seems to be an issue when we backported this feature. Do you mind creating a jira for that? It is an easy fix. - Sijie On Wed, May 31, 2017 at 11:15 AM, Charan Reddy G wrote: > Hey, > > With BOOKKEEPER-643 > (https

Re: Official Bookkeeper Docker Image

between > keeping docker build files in a seperate repo (like zookkeeper does) or put > them in bookkeeper main repo. > > I need to refresh my mind on the matter anyway, I'll try to do it before > next meeting. > > My user on confluence is "caio". > > Franc

Jenkins Pull-Request Build

Hi all, Currently, the bookkeeper-master-git-pullrequest [1] build is broken due to failing to find the "mvn" command. This build is using customized shell script to execute the maven command. Not sure if it is related to any environment changes in Jenkins. I re-created a new job to do the pull r

Re: Agenda for community meeting this week

FYI Meeting minutes : https://cwiki.apache.org/confluence/display/BOOKKEEPER/2017-06-01+Meeting+notes - Sijie On Wed, May 31, 2017 at 1:14 AM, Enrico Olivelli wrote: > 2017-05-31 2:31 GMT+02:00 Sijie Guo : > > Hi all, > > > > Anyone wants to put up an agenda for commun

Re: Jenkins Pull-Request Build

since there is no objection coming up, deleting the broken "bookkeeper-master-git-pullrequest" jenkins job. - Sijie On Thu, Jun 1, 2017 at 12:50 AM, Sijie Guo wrote: > Hi all, > > Currently, the bookkeeper-master-git-pullrequest [1] build is broken due > to failing to

Re: Jenkins Pull-Request Build

b as we are only using github > now > > Il gio 1 giu 2017, 19:56 Sijie Guo ha scritto: > > > since there is no objection coming up, deleting the broken > > "bookkeeper-master-git-pullrequest" jenkins job. > > > > - Sijie > > > > On Thu, Jun 1, 2

Re: Jenkins Pull-Request Build

snapshots to > repository.apache.org > > Enrico > > Il gio 1 giu 2017, 20:10 Sijie Guo ha scritto: > > > Cleaned up the jenkins jobs. > > > > Also put up a wiki page documenting this - > > > > https://cwiki.apache.org/confluence/display/BOOKKEEPER/ > Continuou

[VOTE] Use Github Issues for Issue Tracking

Per the community meeting this morning, JV proposed to start use Github issues for issue tracking for a few months and see how does it work out. I am starting this email thread to vote for this. The vote will be: -

Re: [DISCUSS] Issue Tracking - Jira or Github Issues

discussions. Moving to Github will make the life much easier. - Sijie On Fri, May 26, 2017 at 9:54 AM, Sijie Guo wrote: > I don't any documents at INFRA to point. I do observe more incubator > projects are using Github Issues directly when they transfer to the ASF. I > knew some of th

Re: [VOTE] Use Github Issues for Issue Tracking

My vote on this is +1. Simply because I'd like to have one central place for tracking issues and reviewing pull requests. - Sijie On Thu, Jun 1, 2017 at 12:59 PM, Sijie Guo wrote: > Per the community meeting > <https://cwiki.apache.org/confluence/display/BOOKKEEPER/2017-06-01

Re: [DISCUSS] Issue Tracking - Jira or Github Issues

I agree, having one place is more convenient. But what is the feature > parity between Jira and Github? > Here is what I found by googling. > https://confluence.sakaiproject.org/display/PMC/ > Github+Issues+vs+Jira+pros+and+cons > > On Thu, Jun 1, 2017 at 2:59 PM, Sijie Guo wrote:

[DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

I'd like to raise another discussion about moving bookkeeper website from CMS to other static generators (e.g. Jekyll, Hugo). BookKeeper uses Apache CMS for generating the documentation and website [1]. The website source code is hosted at a svn repo, which now becomes obsolete from our current re

Re: Publish SNAPSHOT artifacts on Maven Central

On Sat, Apr 22, 2017 at 2:43 AM, Ivan Kelly wrote: > > I volunteer to setup the jenkins job and deal with infra > Is there already a nightly job? I remember in the past there was only > a precommit job. It would be good to have a nightly job so that flakes > can be easily tracked. It's hard to do

Re: [DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

r toto carry on the > migration. > > On the infra side it would be good to listen to experiences from other > apache projects. On new DL site what technology are you using? > Kafka website has been restyled some month ago, maybe we can take a look > > -- Enrico > > Il sa

Re: [VOTE] Use Github Issues for Issue Tracking

otes. The voting period is 3 days. - Sijie > > Thanks, > -Flavio > > > On 01 Jun 2017, at 21:59, Sijie Guo wrote: > > > > Per the community meeting > > <https://cwiki.apache.org/confluence/display/BOOKKEEPER/ > 2017-06-01+Meeting+notes> > > t

Re: Publish SNAPSHOT artifacts on Maven Central

gt; I believe there are projects using this tool. you might just search INFRA tickets to see if there were related tickets. > > Travis looks really more simple from this point of view at first glance > > Enrico > > Il sab 3 giu 2017, 08:38 Enrico Olivelli ha scritto: > >

Re: [DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

l be to switch the cms, maybe just a request to > > infra to switch to github pages will be enough > > > > Enrico > > > > 2017-06-03 19:15 GMT+02:00 Sijie Guo : > >> I don't think there is any enforcements from Apache INFRA side. You can > use > >&

Re: [VOTE] Use Github Issues for Issue Tracking

ommendation is that we clarify what we are voting for and call a > second vote. I'd happy to help out if it comes to that. > Let me know if the clarification is good to you or not. > > Thanks, > -Flavio > > > > On 03 Jun 2017, at 19:29, Sijie Guo wrote: > >

Re: [DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

On Mon, Jun 5, 2017 at 10:20 AM, Enrico Olivelli wrote: > Il lun 5 giu 2017, 17:56 Sijie Guo ha scritto: > > > On Mon, Jun 5, 2017 at 3:07 AM, Flavio Junqueira wrote: > > > > > I don't have a super strong opinion here, but I'm not sure I understand >

Re: [VOTE] Use Github Issues for Issue Tracking

On Tue, Jun 6, 2017 at 12:41 AM, Flavio Junqueira wrote: > > > On 05 Jun 2017, at 18:30, Sijie Guo wrote: > > > > On Mon, Jun 5, 2017 at 2:53 AM, Flavio Junqueira wrote: > > > >> Ok, so why don't we make clear what we are voting for? > > > &g

Re: [VOTE] Use Github Issues for Issue Tracking

On Tue, Jun 6, 2017 at 12:41 AM, Flavio Junqueira wrote: > > > On 05 Jun 2017, at 18:30, Sijie Guo wrote: > > > > On Mon, Jun 5, 2017 at 2:53 AM, Flavio Junqueira wrote: > > > >> Ok, so why don't we make clear what we are voting for? > > > &g

Re: Releases 4.5.0 and 4.4.1

BOOKKEEPER-670 (long poll) and BOOKKEEPER-575 (SSL) are the two remaining big features for 4.5.0. The timeline for 4.5.0 for completing BOOKKEEPER-670 is in 2 weeks. The SSL one is almost done, waiting for Kishore pushing a new pull request. We don't do 4.4.1 because we are converging Twitter/Yah

[RESULT] [VOTE] Use Github Issues for Issue Tracking

he changes. The result is: 5 +1, 0 -1 Matteo Merli (binding) Ivan Kelly (binding) Sijie Guo (binding) Enrico Ollivelli Jia Zhai - Sijie On Thu, Jun 1, 2017 at 12:59 PM, Sijie Guo wrote: > Per the community meeting > <https://cwiki.apache.org/confluence/display/BOOKKEEPER/2017-06-01+Me

[VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

( /cc bookkeeper dev@ and incubator general@ for awareness ) Hi all, There was a joint discussion between BookKeeper PMC and DistributedLog PPMC about moving the development of DistributedLog as part of Apache BookKeeper. The reasons behind it are: First, DistributedLog is born as an extension t

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

for the first step. Let me know if I missed anything. - Sijie On Thu, Jun 8, 2017 at 5:37 PM, John D. Ament wrote: > Sije, > > Can you provide links to the PPMC and PMC votes going on for this move? > > John > > On Thu, Jun 8, 2017 at 8:21 PM Sijie Guo wrote: > >

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

On Thu, Jun 8, 2017 at 5:47 PM, John D. Ament wrote: > On Thu, Jun 8, 2017 at 8:44 PM Sijie Guo wrote: > > > Sure. > > > > The discussion email thread between BookKeeper PMC and DistributedLog > PPMC: > > > > https://mail-search.apache.org/pmc/private

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

(dropping general@) - Sijie On Thu, Jun 8, 2017 at 5:21 PM, Sijie Guo wrote: > ( /cc bookkeeper dev@ and incubator general@ for awareness ) > > Hi all, > > There was a joint discussion between BookKeeper PMC and DistributedLog > PPMC about moving the development of Distrib

Re: GitHub permissions

On Fri, Jun 9, 2017 at 1:51 AM, Enrico Olivelli wrote: > Hi, > I would like to ask infra permissions to edit pull requests of other > users, at least "close"/"reopen" to force automatic QA. > You can manually trigger the pre-commit job to build a specific pull request. There is one parameter and

Re: Master is broker

I will take a look at the failures. On Fri, Jun 9, 2017 at 5:17 AM, Enrico Olivelli wrote: > In order to automatically publish snapshots I added > -Dmaven.test.failure.ignore=true option but this is actaully hiding > the fact that the job is failing consistently I have reverted the > configurat

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

on-binding) > > > > > > On Fri, Jun 9, 2017 at 3:21 AM, Jia Zhai wrote: > > > > > > > +1 (non-binding) > > > > > > > > On Fri, Jun 9, 2017 at 3:02 PM, Stevo Slavić > > wrote: > > > > > > &

Re: CompactionTest tests are broken because of BOOKKEEPER-1088 change

Yes, I am working on it. Enrico pointed it out earlier. Sijie On Jun 9, 2017 6:23 PM, "Charan Reddy G" wrote: > Hey Sijie, > > It seems one of your commit > https://github.com/apache/bookkeeper/commit/5fe86525a9c823f79b3e97fd82ea4a > a1c75c79eb > has broken CompactionTests tests. For me locally

Re: GitHub permissions

ns from INFRA >- > > Permissions for committers to create labels and milestones > - > > Permission for merge and close issues/pull requests > - > >Add Issue and RP template under .github > - > >Change to merge script to close PR

Re: CompactionTest tests are broken because of BOOKKEEPER-1088 change

I found the problem. I think it is a merge issue. there were two same lines merged. sending a pull request out now. - Sijie On Fri, Jun 9, 2017 at 7:02 PM, Sijie Guo wrote: > Yes, I am working on it. Enrico pointed it out earlier. > > Sijie > > On Jun 9, 2017 6:23 PM, "Ch

Re: BP-9 - Github issues for Issue Tracking

Thanks Jia. More comments added on Enrico's. There are unknowns related INFRA permissions. It might be making sense for you to reach out first and update what permissions work in the BP. So other people knows the INFRA situation. On Jun 11, 2017 4:38 AM, "Enrico Olivelli" wrote: Thank you Jia f

Re: BP-9 - Github issues for Issue Tracking

On Mon, Jun 12, 2017 at 12:27 PM, Jia Zhai wrote: > Hi Enrico, Sijie And Flavio, > > Thanks a lot for the great comments on this. the BP have changed following > the comments. > > ``` > I think the labels/milestones can work as you described, but maybe we can > consider to use composite labels l

Re: [VOTE] Merge DistributedLog as the subproject of Apache BookKeeper

/cc (dev@bookkeeper.apache.org and d...@pulsar.incubator.apache.org) Closed the vote. The vote passed with 10 +1 and no -1. The 10 +1 includes 3 +1 (binding) and 7 +1 (non-binding) 3 +1 (binding): - Franck Cuny - Leigh Stewart - Sijie Guo 7 +1 (non-binding) - Edward Ribeiro - Gerrit Sundaram

Re: [VOTE] BP-9: Github issues for Issue Tracking

+1 from me. As we discussed today morning, Enrico raised the concern about merging directly from Github. The conclusion that we achieved: - At this point, we will still use the merge script for merging pull requests. The merge script will be changed to handle Github Issues. - At the same time, Ji

Re: Official Bookkeeper Docker Image

freshing the topic, so I think that discussing > it is useless in today meeting, but I think that in the next one I will be > ready. > > On Wed, 2017-05-31 at 13:12 -0700, Sijie Guo wrote: > > Francesco, > > I granted you the permission for confluence page. > > I am oka

Re: Verify signature for BookKeeper releases

Sounds like a documentation improvement on Download/Release pages? - Sijie On Tue, Jun 20, 2017 at 3:30 AM, Enrico Olivelli wrote: > Hi all, > While developing the Docker image Francesco noticed that it is not > very clear how to find the official signature of BookKeeper release > > If an user

Re: Official Bookkeeper Docker Image

On Tue, Jun 20, 2017 at 1:46 PM, Enrico Olivelli wrote: > Il mar 20 giu 2017, 19:45 Sijie Guo ha scritto: > > > Hi Francesco, > > > > - regarding the gpg, if we make pushing the new docker image as part of > the > > release procedure, we should be able to

Re: Official Bookkeeper Docker Image

could do it once we have our docker dir in the repo. > > And regarding the docker use case, some use case may use it on K8S and > DCOS, so automatic deploy would be a requirement. > > Thanks. > > On Wed, Jun 21, 2017 at 6:29 AM, Sijie Guo wrote: > > > On Tue, Jun 20, 201

Re: [DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

FYI. I created a BP for this - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71012301 - Sijie On Mon, Jun 5, 2017 at 10:45 AM, Sijie Guo wrote: > > > On Mon, Jun 5, 2017 at 10:20 AM, Enrico Olivelli > wrote: > >> Il lun 5 giu 2017, 17:56 Sijie Guo h

Re: Improvements to GitHub templates

I would prefer 2). Keep the instructions there would help reminding people when they are creating PR. Sijie On Jun 22, 2017 7:43 AM, "Jia Zhai" wrote: > Seems to me, it is not a big problem to have these lines there. :) > If we decide to move these lines, I would prefer solution 2) or 3). > > O

Re: [jira] [Commented] (BOOKKEEPER-1099) Make bookie automatically create folders on new machine.

(sorry about being paranoid on this issue) On Thu, Jun 22, 2017 at 9:09 AM, Zhimeng Shi wrote: > I think I didn't provide enough detail about what I would do for this > issue. Basically what we need is just creating the needed folders when > found there is no folders , which normally happens on

Re: Write retry issues with ZooKeeperClient

Hi Sam, Let's assume there is no such retry logic. How do you expect to handle this situation? Can your application try to create a new ledger or catch NodeExists exception? - Sijie On Mon, Jun 26, 2017 at 5:49 PM, Sam Just wrote: > Hmm, curator seems to have essentially the same problem: > h

Re: Write retry issues with ZooKeeperClient

, "Venkateswara Rao Jujjuri" wrote: This is nothing different in any network based system. Like nfs. So we need to have some kind of logic on the client side to make reasonable assumption. May not be perfect for negative testing. JV On Mon, Jun 26, 2017 at 11:19 PM Sijie Guo wrote:

Re: Write retry issues with ZooKeeperClient

evel logs and sometime this is annoying. > In the future I would like to add more details on errors > > -- Enrico > > > > > > JV > > On Mon, Jun 26, 2017 at 11:19 PM Sijie Guo mailto:guo > si...@gmail.com>> wrote: > > > > Hi Sam, > > Let'

Re: Write retry issues with ZooKeeperClient

methods introduced in > 1 or handle the ConnectionLoss events explicitly. > 3) Switch ZooKeeperClient to not retry conditional writes instead > propagating the ConnectionLoss event, that should make its semantics match > the vanilla ZK client. > -Sam > > On Tue, Jun 27, 2017 at 8:59

Re: [DISCUSS] Move Bookkeeper Website from CMS to Jekyll (or other static generators)

entation place. > > > > On Thu, Jun 22, 2017 at 10:31 AM, Sijie Guo wrote: > > > > > FYI. I created a BP for this - > > > > > https://cwiki.apache.org/confluence/pages/viewpage. > action?pageId=71012301 > > > > > > - Sijie > > >

Re: Write retry issues with ZooKeeperClient

On Tue, Jun 27, 2017 at 2:36 PM, Sam Just wrote: > On Tue, Jun 27, 2017 at 2:29 PM, Sijie Guo wrote: > > > On Tue, Jun 27, 2017 at 10:18 AM, Sam Just wrote: > > > > > JV: What do you mean by "May not be perfect for negative testing"? > > > > &g

Re: Write retry issues with ZooKeeperClient

at this request used is also expired and all ephemeral nodes associated with this session will also be deleted. so it is a safe situation for retries. > -Sam > > On Tue, Jun 27, 2017 at 4:08 PM, Sijie Guo wrote: > > > On Tue, Jun 27, 2017 at 2:36 PM, Sam Just wrote: > > &

Re: BookKeeper repo has been moved into gitbox

I think the GitBox change is related to BP-9: Using Github Issues. Gitbox is the solution provided by ASF to managing Github repos, linking the Github accounts with Apache counts. Before this, the bookkeeper repo was setup with dural-sync, when the source-of-truth is the git-wp-us.apache.org/repos

  1   2   3   4   5   6   7   8   9   10   >