Re: FileSystem API over distributedlog logs

2016-11-12 Thread Gerrit Sundaram
It would be great if you guys can push it. - Gerrit On Fri, Nov 11, 2016 at 12:21 PM, Leigh Stewart < lstew...@twitter.com.invalid> wrote: > Sure we could do it. We skipped last time because dl was not OSS. > > Need to find some time though - lets discuss quickly next week. > > On Fri, Nov 11, 2

Re: FileSystem API over distributedlog logs

2016-11-11 Thread Leigh Stewart
Sure we could do it. We skipped last time because dl was not OSS. Need to find some time though - lets discuss quickly next week. On Fri, Nov 11, 2016 at 12:10 PM, Sijie Guo wrote: > /cc Leigh > > I don't think we pushed the DL related code to kestrel. As I think kestrel > has been in the depre

Re: FileSystem API over distributedlog logs

2016-11-11 Thread Sijie Guo
/cc Leigh I don't think we pushed the DL related code to kestrel. As I think kestrel has been in the deprecation path internally at Twitter. But it might be worth pushing the code change just for reference. Leigh, what's your opinion? - Sijie On Wed, Nov 9, 2016 at 2:48 AM, Gerrit Sundaram wrot

Re: FileSystem API over distributedlog logs

2016-11-09 Thread Gerrit Sundaram
Sijie, thank your for your comments and suggestions. I will start a separate thread for discussing the metadata operation primitives. BTW, I didn't find any code in kestrel that is related to distributedlog :( Can you kindly point me the files? - Gerrit On Wed, Nov 2, 2016 at 10:35 AM, Sijie Guo

Re: FileSystem API over distributedlog logs

2016-11-02 Thread Sijie Guo
On Wed, Nov 2, 2016 at 3:14 AM, Gerrit Sundaram wrote: > FYI - I tried to use the AppendOnlyStreamWriter and AppendOnlyStreamReader > to demonstrate the idea : https://github.com/apache/ > incubator-distributedlog/pulls/43 Let me know if this is a good direction > to go after. > > - Gerrit > > On

Re: FileSystem API over distributedlog logs

2016-11-02 Thread Gerrit Sundaram
FYI - I tried to use the AppendOnlyStreamWriter and AppendOnlyStreamReader to demonstrate the idea : https://github.com/apache/incubator-distributedlog/pulls/43 Let me know if this is a good direction to go after. - Gerrit On Wed, Nov 2, 2016 at 2:21 AM, Gerrit Sundaram wrote: > Hi distributedl