Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Mingmin - it sounds like an awesome idea to translate from SparkSQL. It's even more exciting to know if we could translate Spark Structured Streaming code by a similar way, which enables existing Spark SQL/Structure Streaming pipelines run on Beam. Reuven - Thanks for bringing it up. I tried to

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

I hear rumours that the Calcite project is planning on adding a zeta-SQL compatible parser to Calcite itself, in which case there will be a Java parser we can use as well. Does anyone know if this work is still going on? On Sat, Aug 3, 2019 at 8:41 PM Manu Zhang wrote: > A question to the

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Interesting feature, thanks Rui to bring the new option. Please keep me in loop, I’ll take a look when back to home tomorrow. It seems the chance to support other dialects, we see lots of concerns to translate from like SparkSQL. Mingmin Sent from my iPhone > On Aug 4, 2019, at 2:43 PM, Rui

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Hi David, That's a good point. I just add a section to discuss benefits in the doc ( link ). -Rui On Sun, Aug 4, 2019 at 2:01 PM David Morávek wrote: > Hi Rui, > > This is definitely

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Hi Rui, This is definitely an interesting topic! Can you please elaborate little bit more about the benefits, that this will bring to the end user? All the documents only cover technical details and I'm still not sure what you're trying to achieve product-wise. Best, D. On Sun, Aug 4, 2019 at

Snapshots not been updated

Hello, It seems the 2.16.0-SNAPSHOTS are not been updated since last friday 02/08. https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-core/2.16.0-SNAPSHOT/ Can somebody PTAL. Thanks

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

I created a google doc to explain basic design on Beam ZetaSQL: https://docs.google.com/document/d/14Yi4oEMzqS3n9-LfSNi6Q6kQpEP3gWTHzX0HxqUksdc/edit?usp=sharing -Rui On Sun, Aug 4, 2019 at 10:02 AM Rui Wang wrote: > Thanks Manu for you feedback! Some comments inlined: > > > On Sat, Aug 3,

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Thanks Manu for you feedback! Some comments inlined: On Sat, Aug 3, 2019 at 8:41 PM Manu Zhang wrote: > A question to the community, does the size of the change require any >> process besides the usual PR reviews? >> > > I think so. This is a big change and has come as kind of a surprise