Re: Generate Beam Pipeline from JSON

[Kenneth Knowles]

I would mention two other options to keep in mind:

 - In Python, the driver program can be tiny (much smaller than JSON
probably)
 - Beam SQL (tied to the Java SDK) is experimenting with a SQL shell/CLI.
It is not quite done, but you could follow
https://issues.apache.org/jira/browse/BEAM-3773.

Kenn

On Fri, May 25, 2018 at 8:51 AM Jean-Baptiste Onofré 
wrote:

> Hi,
>
> That's on the Declarative DSLs scope: XML and JSON.
>
> It's not yet ready but it's a work in progress.
>
> You can follow:
>
> https://issues.apache.org/jira/browse/BEAM-14
>
> Regards
> JB
>
> On 25/05/2018 17:15, S. Sahayaraj wrote:
> > Hello,
> >
> > I would like to create the Beam pipeline (in Java) from
> > the definitions given in JSON file. Is there any Beam Compiler
> > available? Is any specification that guides me on how to do it?  I don’t
> > want to write the driver program for every pipeline. Please suggest.
> >
> >
> >
> > Cheers,
> >
> > S. Sahayaraj
> >
>
> --
> --
> Jean-Baptiste Onofré
> jbono...@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>

Re: Generate Beam Pipeline from JSON

[Jean-Baptiste Onofré]

Hi,

That's on the Declarative DSLs scope: XML and JSON.

It's not yet ready but it's a work in progress.

You can follow:

https://issues.apache.org/jira/browse/BEAM-14

Regards
JB

On 25/05/2018 17:15, S. Sahayaraj wrote:
> Hello,
> 
>     I would like to create the Beam pipeline (in Java) from
> the definitions given in JSON file. Is there any Beam Compiler
> available? Is any specification that guides me on how to do it?  I don’t
> want to write the driver program for every pipeline. Please suggest.
> 
>  
> 
> Cheers,
> 
> S. Sahayaraj
> 

-- 
--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Generate Beam Pipeline from JSON

[S. Sahayaraj]

Hello,
I would like to create the Beam pipeline (in Java) from the 
definitions given in JSON file. Is there any Beam Compiler available? Is any 
specification that guides me on how to do it?  I don't want to write the driver 
program for every pipeline. Please suggest.

Cheers,
S. Sahayaraj