Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Robert Bradshaw
On Fri, Apr 17, 2020 at 4:58 PM Holden Karau wrote: > > On Fri, Apr 17, 2020 at 3:52 PM Robert Bradshaw > wrote: > >> On Fri, Apr 17, 2020 at 2:56 PM Holden Karau >> wrote: >> >>> >>> On Fri, Apr 17, 2020 at 2:45 PM Robert Bradshaw >>> wrote: >>> Hi Holden! I agree with Kyle

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Holden Karau
On Fri, Apr 17, 2020 at 3:52 PM Robert Bradshaw wrote: > On Fri, Apr 17, 2020 at 2:56 PM Holden Karau wrote: > >> >> On Fri, Apr 17, 2020 at 2:45 PM Robert Bradshaw >> wrote: >> >>> Hi Holden! >>> >>> I agree with Kyle that it makes sense to have some caveat about Flink >>> and Spark, though

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Robert Bradshaw
On Fri, Apr 17, 2020 at 2:56 PM Holden Karau wrote: > > On Fri, Apr 17, 2020 at 2:45 PM Robert Bradshaw > wrote: > >> Hi Holden! >> >> I agree with Kyle that it makes sense to have some caveat about Flink and >> Spark, though at this point they're not /that/ new (at least not Flink). >> > True,

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Holden Karau
On Fri, Apr 17, 2020 at 2:45 PM Robert Bradshaw wrote: > Hi Holden! > > I agree with Kyle that it makes sense to have some caveat about Flink and > Spark, though at this point they're not /that/ new (at least not Flink). > True, maybe "early-stage" would be better wording? The TFX PyBeam Flink

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Holden Karau
On Fri, Apr 17, 2020 at 2:32 PM Ahmet Altay wrote: > Hi Holden, nice to hear from you. Thanks a lot for this email. Adding some > TFX folks as well. +Robert Crowe +Irene > Giannoumis +Zhitao Li +Anusha > Ramesh > > Would it be possible for TFX folks to review the TFX section of your book? >

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Robert Bradshaw
Hi Holden! I agree with Kyle that it makes sense to have some caveat about Flink and Spark, though at this point they're not /that/ new (at least not Flink). I am curious what extra support Kubeflow is "missing" (or, conversely, what extra support it has for Dataflow that goes beyond just

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Ahmet Altay
Hi Holden, nice to hear from you. Thanks a lot for this email. Adding some TFX folks as well. +Robert Crowe +Irene Giannoumis +Zhitao Li +Anusha Ramesh Would it be possible for TFX folks to review the TFX section of your book? On Fri, Apr 17, 2020 at 12:27 PM Kyle Weaver wrote: > Hi

Re: Reference to Beam in upcoming Kubeflow Book

2020-04-17 Thread Kyle Weaver
Hi Holden, The note on Flink & Spark support sounds reasonable to me. I am optimistic about getting Flink + TFX + Kubeflow working fairly soon, but I agree that we don't want to over-promise. I'm not so sure about the status of Dataflow here, perhaps someone else can comment on that. Looking