Thanks for everybody's effort, we're very close to finish existing tasks. Here's an status update of SQL DSL, feel free to have a try and share any comment:
*1. what's done* DSL feature is done, with basic filter/project/aggregation/union/join, built-in functions/UDF/UDAF(pending on #3491) *2. what's on-going* more unit tests, and documentation of README/Beam web. *3. open questions* BEAM-2441 <https://issues.apache.org/jira/browse/BEAM-2441> want to see any suggestion on the proper module name for SQL work. As mentioned in task, '*dsl/sql* is for the Java SDK and also prevents alternative language implementations, however there's another SQL client and not good to be included as Java SDK extention'. --- *How to run the example* beam/dsls/sql/example/BeamSqlExample.java <https://github.com/apache/beam/blob/DSL_SQL/dsls/sql/src/main/java/org/apache/beam/dsls/sql/example/BeamSqlExample.java> 1. run 'mvn install' to avoid the error in #3439 <https://github.com/apache/beam/pull/3439> 2. run 'mvn -pl dsls/sql compile exec:java -Dexec.mainClass=org.apache.beam.dsls.sql.example.BeamSqlExample -Dexec.args="--runner=DirectRunner" -Pdirect-runner' FYI: 1. burn-down list in google doc https://docs.google.com/document/d/1EHZgSu4Jd75iplYpYT_K_JwSZxL2DWG8kv_EmQzNXFc/edit?usp=sharing 2. JIRA tasks with label 'dsl_sql_merge' https://issues.apache.org/jira/browse/BEAM-2555?jql=labels%20%3D%20dsl_sql_merge Mingmin On Tue, Jun 13, 2017 at 8:51 AM, Lukasz Cwik <lc...@google.com.invalid> wrote: > Nevermind, I merged it into #2 about usability. > > On Tue, Jun 13, 2017 at 8:50 AM, Lukasz Cwik <lc...@google.com> wrote: > > > I added a section about maven module structure/packaging (#6). > > > > On Tue, Jun 13, 2017 at 8:30 AM, Tyler Akidau <taki...@google.com.invalid > > > > wrote: > > > >> Thanks Mingmin. I've copied your list into a doc[1] to make it easier to > >> collaborate on comments and edits. > >> > >> [1] https://s.apache.org/beam-dsl-sql-burndown > >> > >> -Tyler > >> > >> > >> On Mon, Jun 12, 2017 at 10:09 PM Jean-Baptiste Onofré <j...@nanthrax.net> > >> wrote: > >> > >> > Hi Mingmin > >> > > >> > Sorry, the meeting was in the middle of the night for me and I wasn't > >> able > >> > to > >> > make it. > >> > > >> > The timing and checklist look good to me. > >> > > >> > We plan to do a Beam release end of June, so, merging in July means we > >> can > >> > include it in the next release. > >> > > >> > Thanks ! > >> > Regards > >> > JB > >> > > >> > On 06/13/2017 03:06 AM, Mingmin Xu wrote: > >> > > Hi all, > >> > > > >> > > Thanks to join the meeting. As discussed, we're planning to merge > >> DSL_SQL > >> > > branch back to master, targeted in the middle of July. A tag > >> > > 'dsl_sql_merge'[1] is created to track all todo tasks. > >> > > > >> > > *What's added in Beam SQL?* > >> > > BeamSQL provides the capability to execute SQL queries with Beam > Java > >> > SDK, > >> > > either by translating SQL to a PTransform, or run with a standalone > >> CLI > >> > > client. > >> > > > >> > > *Checklist for merge:* > >> > > 1. functionality > >> > > 1.1. SQL grammer: > >> > > 1.1.1. basic query with SELECT/FILTER/PROJECT; > >> > > 1.1.2. AGGREGATION with global window; > >> > > 1.1.3. AGGREGATION with FIX_TIME/SLIDING_TIME/SESSION window; > >> > > 1.1.4. JOIN > >> > > 1.2. UDF/UDAF support; > >> > > 1.3. support predefined String/Math/Date functions, see[2]; > >> > > > >> > > 2. DSL interface to convert SQL as PTransform; > >> > > > >> > > 3. junit test; > >> > > > >> > > 4. Java document; > >> > > > >> > > 5. Document of SQL feature in website; > >> > > > >> > > Any comments/suggestions are very welcomed. > >> > > > >> > > Note: > >> > > [1]. > >> > > > >> > https://issues.apache.org/jira/browse/BEAM-2436?jql=labels% > >> 20%3D%20dsl_sql_merge > >> > > > >> > > [2]. https://calcite.apache.org/docs/reference.html > >> > > > >> > > >> > -- > >> > Jean-Baptiste Onofré > >> > jbono...@apache.org > >> > http://blog.nanthrax.net > >> > Talend - http://www.talend.com > >> > > >> > > > > > -- ---- Mingmin
