Hi, I want to clarify: I am not pushing back on your proposal, merely trying to understand your use case, and what part of it you want Beam to do for you. E.g. obviously you, as the user, will be specifying what service you want to contact, what RPC method to call, you will construct arguments to this call, and you will handle the results of the call - this is all application-specific logic and Beam can not decide any of this for you. It vaguely seems like not very much remains for Beam to help with, but I may be mistaken.
So - can you tell more about your use case? Are you just calling an RPC for every element of a collection? Are you applying an RPC to every element of a collection and collecting the results into another collection? Are you calling an RPC that returns a large number (or a stream) of results and you're putting these results into a collection? Is it something else? Thanks. On Fri, Mar 10, 2017 at 1:40 PM Borisa Zivkovic <[email protected]> wrote: > Hi Eugene, > > did not try that - I thought that having one IO for this would be better > solution. > Of course, in case you think it would not be beneficial to other to have > this IO in Beam code no problem, > we can always use custom solution here... > > On Fri, 10 Mar 2017 at 13:01 Eugene Kirpichov <[email protected]> > wrote: > > Your first option would be to simply do RPCs from your ParDo's. > Have you tried that / is it not working for some reason / is the code > turning out unnecessarily complex or not performant enough etc.? > On Fri, Mar 10, 2017 at 12:36 PM Borisa Zivkovic < > [email protected]> wrote: > > well what we are looking into is using grpc with linkerd or envoy ... so > if beam supported grpc out of the box it would be great help... > > On Fri, 10 Mar 2017 at 11:58 Jean-Baptiste Onofré <[email protected]> wrote: > > Absolutely ! > > Thanks ! > > Regards > JB > > On 03/10/2017 11:18 AM, Borisa Zivkovic wrote: > > ok thanks JB, > > > > I guess I can create JIRA and see if I can contribute it? > > > > we need grpc IO... > > > > > > > > On Fri, 10 Mar 2017 at 10:08 Jean-Baptiste Onofré <[email protected] > > <mailto:[email protected]>> wrote: > > > > Hi Borisa, > > > > Not on my side, but definitely a good idea. > > > > Regards > > JB > > > > On 03/10/2017 10:58 AM, Borisa Zivkovic wrote: > > > Hi guys, > > > > > > any reason why there is no grpc IO available? Is it maybe planned? > > > > > > thanks > > > > -- > > Jean-Baptiste Onofré > > [email protected] <mailto:[email protected]> > > http://blog.nanthrax.net > > Talend - http://www.talend.com > > > > -- > Jean-Baptiste Onofré > [email protected] > http://blog.nanthrax.net > Talend - http://www.talend.com > >
