Hi Borisa,
A IO will bring "extra" features that a ParDo can't: splitting, checkpointing,
watermarking. If you don't need or the backend doesn't support such features,
than a ParDo can deal.
For instance, you can take a look on the JdbcIO which is bascially an IO
implemented with ParDo.
Regards
JB
On 03/10/2017 02:40 PM, Borisa Zivkovic wrote:
Hi Eugene,
did not try that - I thought that having one IO for this would be better
solution.
Of course, in case you think it would not be beneficial to other to have this IO
in Beam code no problem,
we can always use custom solution here...
On Fri, 10 Mar 2017 at 13:01 Eugene Kirpichov <[email protected]
<mailto:[email protected]>> wrote:
Your first option would be to simply do RPCs from your ParDo's.
Have you tried that / is it not working for some reason / is the code
turning out unnecessarily complex or not performant enough etc.?
On Fri, Mar 10, 2017 at 12:36 PM Borisa Zivkovic <[email protected]
<mailto:[email protected]>> wrote:
well what we are looking into is using grpc with linkerd or envoy ... so
if beam supported grpc out of the box it would be great help...
On Fri, 10 Mar 2017 at 11:58 Jean-Baptiste Onofré <[email protected]
<mailto:[email protected]>> wrote:
Absolutely !
Thanks !
Regards
JB
On 03/10/2017 11:18 AM, Borisa Zivkovic wrote:
> ok thanks JB,
>
> I guess I can create JIRA and see if I can contribute it?
>
> we need grpc IO...
>
>
>
> On Fri, 10 Mar 2017 at 10:08 Jean-Baptiste Onofré
<[email protected]
<mailto:[email protected]>
> <mailto:[email protected] <mailto:[email protected]>>> wrote:
>
> Hi Borisa,
>
> Not on my side, but definitely a good idea.
>
> Regards
> JB
>
> On 03/10/2017 10:58 AM, Borisa Zivkovic wrote:
> > Hi guys,
> >
> > any reason why there is no grpc IO available? Is it maybe
planned?
> >
> > thanks
>
> --
> Jean-Baptiste Onofré
> [email protected] <mailto:[email protected]>
<mailto:[email protected] <mailto:[email protected]>>
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
--
Jean-Baptiste Onofré
[email protected] <mailto:[email protected]>
http://blog.nanthrax.net
Talend - http://www.talend.com
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
