Re: [Proposal] Submitting pipelines to Runners in another language

[Aljoscha Krettek]

This looks excellent!

Please let me know once we get to actually implement this for a specific 
runner. Flink in my case, of course! :-)

> On 8. Jul 2017, at 00:07, Thomas Groh  wrote:
> 
> I left a couple of comments.
> 
> I'm looking forwards to this - it's going to be a good step towards being
> able to execute any pipeline on any runner.
> 
> On Thu, Jul 6, 2017 at 5:11 PM, Ahmet Altay 
> wrote:
> 
>> Thank you Sourabh. I added my comments as well and +1 to Kenn.
>> 
>> On Thu, Jul 6, 2017 at 2:21 PM, Kenneth Knowles 
>> wrote:
>> 
>>> I added a few detailed comments. I definitely think we should move
>> forward
>>> on this to get Python pipelines running on all our our runners, and
>>> hopefully that gets us ready for any future SDKs too.
>>> 
>>> On Wed, Jul 5, 2017 at 2:21 PM, Sourabh Bajaj <
>>> sourabhba...@google.com.invalid> wrote:
>>> 
 Hi,
 
 I wanted to share a proposal for submitting pipelines from SDK X
 (Python/Go) to runners written in another language Y (Java) (Flink /
>>> Spark
 / Apex) using the Runner API. Please find the doc here
 
 .
 
 As always comments and feedback are welcome.
 
 Thanks
 Sourabh
 
>>> 
>> 

Re: [Proposal] Submitting pipelines to Runners in another language

[Thomas Groh]

I left a couple of comments.

I'm looking forwards to this - it's going to be a good step towards being
able to execute any pipeline on any runner.

On Thu, Jul 6, 2017 at 5:11 PM, Ahmet Altay 
wrote:

> Thank you Sourabh. I added my comments as well and +1 to Kenn.
>
> On Thu, Jul 6, 2017 at 2:21 PM, Kenneth Knowles 
> wrote:
>
> > I added a few detailed comments. I definitely think we should move
> forward
> > on this to get Python pipelines running on all our our runners, and
> > hopefully that gets us ready for any future SDKs too.
> >
> > On Wed, Jul 5, 2017 at 2:21 PM, Sourabh Bajaj <
> > sourabhba...@google.com.invalid> wrote:
> >
> > > Hi,
> > >
> > > I wanted to share a proposal for submitting pipelines from SDK X
> > > (Python/Go) to runners written in another language Y (Java) (Flink /
> > Spark
> > > / Apex) using the Runner API. Please find the doc here
> > >  > > UVoH5BsFUofZuo/edit#>
> > > .
> > >
> > > As always comments and feedback are welcome.
> > >
> > > Thanks
> > > Sourabh
> > >
> >
>

Re: [Proposal] Submitting pipelines to Runners in another language

[Ahmet Altay]

Thank you Sourabh. I added my comments as well and +1 to Kenn.

On Thu, Jul 6, 2017 at 2:21 PM, Kenneth Knowles 
wrote:

> I added a few detailed comments. I definitely think we should move forward
> on this to get Python pipelines running on all our our runners, and
> hopefully that gets us ready for any future SDKs too.
>
> On Wed, Jul 5, 2017 at 2:21 PM, Sourabh Bajaj <
> sourabhba...@google.com.invalid> wrote:
>
> > Hi,
> >
> > I wanted to share a proposal for submitting pipelines from SDK X
> > (Python/Go) to runners written in another language Y (Java) (Flink /
> Spark
> > / Apex) using the Runner API. Please find the doc here
> >  > UVoH5BsFUofZuo/edit#>
> > .
> >
> > As always comments and feedback are welcome.
> >
> > Thanks
> > Sourabh
> >
>

[Proposal] Submitting pipelines to Runners in another language

[Sourabh Bajaj]

Hi,

I wanted to share a proposal for submitting pipelines from SDK X
(Python/Go) to runners written in another language Y (Java) (Flink / Spark
/ Apex) using the Runner API. Please find the doc here

.

As always comments and feedback are welcome.

Thanks
Sourabh