Sure, sounds good, thanks! On Mon, Mar 13, 2017 at 1:37 AM Borisa Zivkovic <[email protected]> wrote:
> Thanks Eugene, > > I thought about this over the weekend and I think the best is for me to > spend some time trying to mock up some code to see how grpcIO woulc help us. > I propose you give me few weeks and we keep JIRA open. After that I will > either close JIRA or propose how API would look like. > > makes sense? > > On Fri, 10 Mar 2017 at 14:20 Eugene Kirpichov <[email protected]> > wrote: > > Hi, > > I want to clarify: I am not pushing back on your proposal, merely trying > to understand your use case, and what part of it you want Beam to do for > you. E.g. obviously you, as the user, will be specifying what service you > want to contact, what RPC method to call, you will construct arguments to > this call, and you will handle the results of the call - this is all > application-specific logic and Beam can not decide any of this for you. It > vaguely seems like not very much remains for Beam to help with, but I may > be mistaken. > > So - can you tell more about your use case? Are you just calling an RPC > for every element of a collection? Are you applying an RPC to every element > of a collection and collecting the results into another collection? Are you > calling an RPC that returns a large number (or a stream) of results and > you're putting these results into a collection? Is it something else? > > Thanks. > > On Fri, Mar 10, 2017 at 1:40 PM Borisa Zivkovic < > [email protected]> wrote: > > Hi Eugene, > > did not try that - I thought that having one IO for this would be better > solution. > Of course, in case you think it would not be beneficial to other to have > this IO in Beam code no problem, > we can always use custom solution here... > > On Fri, 10 Mar 2017 at 13:01 Eugene Kirpichov <[email protected]> > wrote: > > Your first option would be to simply do RPCs from your ParDo's. > Have you tried that / is it not working for some reason / is the code > turning out unnecessarily complex or not performant enough etc.? > On Fri, Mar 10, 2017 at 12:36 PM Borisa Zivkovic < > [email protected]> wrote: > > well what we are looking into is using grpc with linkerd or envoy ... so > if beam supported grpc out of the box it would be great help... > > On Fri, 10 Mar 2017 at 11:58 Jean-Baptiste Onofré <[email protected]> wrote: > > Absolutely ! > > Thanks ! > > Regards > JB > > On 03/10/2017 11:18 AM, Borisa Zivkovic wrote: > > ok thanks JB, > > > > I guess I can create JIRA and see if I can contribute it? > > > > we need grpc IO... > > > > > > > > On Fri, 10 Mar 2017 at 10:08 Jean-Baptiste Onofré <[email protected] > > <mailto:[email protected]>> wrote: > > > > Hi Borisa, > > > > Not on my side, but definitely a good idea. > > > > Regards > > JB > > > > On 03/10/2017 10:58 AM, Borisa Zivkovic wrote: > > > Hi guys, > > > > > > any reason why there is no grpc IO available? Is it maybe planned? > > > > > > thanks > > > > -- > > Jean-Baptiste Onofré > > [email protected] <mailto:[email protected]> > > http://blog.nanthrax.net > > Talend - http://www.talend.com > > > > -- > Jean-Baptiste Onofré > [email protected] > http://blog.nanthrax.net > Talend - http://www.talend.com > >
