Re: Beam IO: suggestions and new features

2016-09-20 Thread Eugene Kirpichov
On Mon, Sep 19, 2016 at 7:17 PM Jean-Baptiste Onofré wrote: > Hi Eugene, > > thanks for your feedbacks. > > See my comments: > > 1/ I now have a better understanding the logic/steps to write IO and as > a IO Developer, it's not really a problem. My concern is more when you >

Re: Beam IO: suggestions and new features

2016-09-19 Thread Jean-Baptiste Onofré
Hi Eugene, thanks for your feedbacks. See my comments: 1/ I now have a better understanding the logic/steps to write IO and as a IO Developer, it's not really a problem. My concern is more when you have to build an application on top of Beam (like for instance a DSL). Then, we can identify

Beam IO: suggestions and new features

2016-09-16 Thread Jean-Baptiste Onofré
Hi all, as you may know I'm working on different new IOs for Beam. I have some suggestions that I would like to discuss with you all. 1/ Sink The SDK provides a Sink abstract class. It represents a resource that can be written using a Write transform: p.apply(Write.to(new MySink())); The