Re: Apache Beam UI job creator

2018-10-09 Thread Karan Kumar
HI Andrew
This is fantastic news. Yes we can definitely collaborate as we also plan
to open source what ever we are doing. We already have 2 people deep diving
into the steamline code base. This would help them take the next leap.
Reaching out to you from my official mail ID.

Thanks
Karan

On Wed, Oct 10, 2018 at 8:20 AM Andrew Psaltis 
wrote:

> Hi Karan,
> I'm familiar with the streamline codebase and have been a huge proponent
> of having an open source UI to allow the construction of real-time
> pipelines. I truly believe that this should be built on top of Beam. I was
> actually planning on forking the streamline codebase and pursuing this type
> of idea, but have been delayed due to other commitments.
>
> Is this something you would want to collaborate on?
>
> Best,
> Andrew
>
> On Tue, Oct 9, 2018 at 3:13 PM Jean-Baptiste Onofré 
> wrote:
>
>> Hi,
>>
>> I  don't know any open source UI right now.
>>
>> Regards
>> JB
>>
>> On 09/10/2018 04:09, Karan Kumar wrote:
>> > HI Juan and Jean
>> > Thanks for the reply. We were looking to adopt an open source codebase.
>> > Any pointers in that direction?
>> >
>> >
>> > On Mon, Oct 8, 2018 at 9:05 PM Jean-Baptiste Onofré > > > wrote:
>> >
>> > Hi
>> >
>> > We have such tool at Talend (named datastreams), already available
>> > (beta) as Amazon ami.
>> >
>> > Regards
>> > JB
>> > Le 8 oct. 2018, à 12:24, Karan Kumar > > > a écrit:
>> >
>> > Hello
>> >
>> > We want to expose a GUI for our engineers/business analysts to
>> > create real time pipelines using drag and drop constructs.
>> > Projects such as https://github.com/TouK/nussknacker for flink
>> > and https://github.com/hortonworks/streamline for storm match
>> > our requirements.
>> >
>> > We wanted to understand if a UI job creator is on the road map
>> > for the beam community or
>> > if there are any projects which have taken a stab at solving
>> > this problem.
>> >
>> > --
>> > Thanks
>> > Karan
>> >
>> >
>> >
>> > --
>> > Thanks
>> > Karan
>>
>> --
>> Jean-Baptiste Onofré
>> jbono...@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
>

-- 
Thanks
Karan


Re: Apache Beam UI job creator

2018-10-09 Thread Andrew Psaltis
Hi Karan,
I'm familiar with the streamline codebase and have been a huge proponent of
having an open source UI to allow the construction of real-time pipelines.
I truly believe that this should be built on top of Beam. I was actually
planning on forking the streamline codebase and pursuing this type of idea,
but have been delayed due to other commitments.

Is this something you would want to collaborate on?

Best,
Andrew

On Tue, Oct 9, 2018 at 3:13 PM Jean-Baptiste Onofré  wrote:

> Hi,
>
> I  don't know any open source UI right now.
>
> Regards
> JB
>
> On 09/10/2018 04:09, Karan Kumar wrote:
> > HI Juan and Jean
> > Thanks for the reply. We were looking to adopt an open source codebase.
> > Any pointers in that direction?
> >
> >
> > On Mon, Oct 8, 2018 at 9:05 PM Jean-Baptiste Onofré  > > wrote:
> >
> > Hi
> >
> > We have such tool at Talend (named datastreams), already available
> > (beta) as Amazon ami.
> >
> > Regards
> > JB
> > Le 8 oct. 2018, à 12:24, Karan Kumar  > > a écrit:
> >
> > Hello
> >
> > We want to expose a GUI for our engineers/business analysts to
> > create real time pipelines using drag and drop constructs.
> > Projects such as https://github.com/TouK/nussknacker for flink
> > and https://github.com/hortonworks/streamline for storm match
> > our requirements.
> >
> > We wanted to understand if a UI job creator is on the road map
> > for the beam community or
> > if there are any projects which have taken a stab at solving
> > this problem.
> >
> > --
> > Thanks
> > Karan
> >
> >
> >
> > --
> > Thanks
> > Karan
>
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>


Re: Apache Beam UI job creator

2018-10-09 Thread Jean-Baptiste Onofré
Hi,

I  don't know any open source UI right now.

Regards
JB

On 09/10/2018 04:09, Karan Kumar wrote:
> HI Juan and Jean
> Thanks for the reply. We were looking to adopt an open source codebase.
> Any pointers in that direction?
> 
> 
> On Mon, Oct 8, 2018 at 9:05 PM Jean-Baptiste Onofré  > wrote:
> 
> Hi
> 
> We have such tool at Talend (named datastreams), already available
> (beta) as Amazon ami.
> 
> Regards
> JB
> Le 8 oct. 2018, à 12:24, Karan Kumar  > a écrit:
> 
> Hello
> 
> We want to expose a GUI for our engineers/business analysts to
> create real time pipelines using drag and drop constructs.
> Projects such as https://github.com/TouK/nussknacker for flink
> and https://github.com/hortonworks/streamline for storm match
> our requirements.
> 
> We wanted to understand if a UI job creator is on the road map
> for the beam community or 
> if there are any projects which have taken a stab at solving
> this problem.
> 
> -- 
> Thanks
> Karan 
> 
> 
> 
> -- 
> Thanks
> Karan

-- 
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com


Re: Apache Beam UI job creator

2018-10-08 Thread Jean-Baptiste Onofré
Hi

We have such tool at Talend (named datastreams), already available (beta) as 
Amazon ami.

Regards
JB

Le 8 oct. 2018 à 12:24, à 12:24, Karan Kumar  a écrit:
>Hello
>
>We want to expose a GUI for our engineers/business analysts to create
>real
>time pipelines using drag and drop constructs. Projects such as
>https://github.com/TouK/nussknacker for flink and
>https://github.com/hortonworks/streamline for storm match our
>requirements.
>
>We wanted to understand if a UI job creator is on the road map for the
>beam
>community or
>if there are any projects which have taken a stab at solving this
>problem.
>
>-- 
>Thanks
>Karan


Re: Apache Beam UI job creator

2018-10-08 Thread Juan Carlos Garcia
I think (maybe i am wrong) but there is already a project within the Google
products that aim for this and still is on beta /alpha ... (i can
recall the name)

And personally i would definitely like to see something like this.

Karan Kumar  schrieb am Mo., 8. Okt. 2018, 11:24:

> Hello
>
> We want to expose a GUI for our engineers/business analysts to create real
> time pipelines using drag and drop constructs. Projects such as
> https://github.com/TouK/nussknacker for flink and
> https://github.com/hortonworks/streamline for storm match our
> requirements.
>
> We wanted to understand if a UI job creator is on the road map for the
> beam community or
> if there are any projects which have taken a stab at solving this problem.
>
> --
> Thanks
> Karan
>


Apache Beam UI job creator

2018-10-08 Thread Karan Kumar
Hello

We want to expose a GUI for our engineers/business analysts to create real
time pipelines using drag and drop constructs. Projects such as
https://github.com/TouK/nussknacker for flink and
https://github.com/hortonworks/streamline for storm match our requirements.

We wanted to understand if a UI job creator is on the road map for the beam
community or
if there are any projects which have taken a stab at solving this problem.

-- 
Thanks
Karan