[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275945#comment-16275945
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user buddhiayesha2015 closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/225


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170074#comment-16170074
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/225#discussion_r139435394
  
--- Diff: 
experiments/sql/src/test/java/org/apache/gearpump/sql/planner/CalciteTest.java 
---
@@ -291,17 +290,25 @@ void calTest() throws SqlParseException {
   cluster,
   convertletTable);
 RelRoot root = sqlToRelConverter.convertQuery(validatedSqlNode, false, 
true);
-System.out.println(RelOptUtil.toString(root.rel));
+// Check logical plan
+String expectedResult = "LogicalProject(product_id=[$0], 
product_name=[$1], order_id=[$2])" +
+  "  LogicalFilter(condition=[>($3, 2)])" +
+  "LogicalProject(id=[$0], name=[$1], id1=[$3], quantity=[$4])" +
+  "  LogicalJoin(condition=[=($2, $5)], joinType=[inner])" +
+  "LogicalProject(id=[$0], name=[$1], id0=[CAST($0):VARCHAR 
CHARACTER SET \"ISO-8859-1\" COLLATE \"" +
+  "ISO-8859-1$en_US$primary\"])" +
+  "  EnumerableTableScan(table=[[t, products]])" +
+  "LogicalProject(id=[$0], quantity=[$1], 
id0=[CAST($0):VARCHAR CHARACTER SET \"ISO-8859-1\" COLLATE \"" +
+  "ISO-8859-1$en_US$primary\"])" +
+  "  EnumerableTableScan(table=[[t, orders]])";
+assertEquals(expectedResult,
--- End diff --

What's the usage of codes below this ?


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170071#comment-16170071
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on a diff in the pull request:

https://github.com/apache/incubator-gearpump/pull/225#discussion_r139435162
  
--- Diff: 
experiments/sql/src/test/java/org/apache/gearpump/sql/planner/CalciteTest.java 
---
@@ -80,19 +80,38 @@
   private RexExecutor executor;
   private RelRoot root;
 
-  public CalciteTest(FrameworkConfig config) {
-this.config = config;
-this.defaultSchema = config.getDefaultSchema();
-this.operatorTable = config.getOperatorTable();
-this.parserConfig = config.getParserConfig();
-this.state = State.STATE_0_CLOSED;
-this.traitDefs = config.getTraitDefs();
-this.convertletTable = config.getConvertletTable();
-this.executor = config.getExecutor();
+  @Before
+  public void setFrameworkConfig() throws ClassNotFoundException, 
SQLException {
+
+Class.forName("org.apache.calcite.jdbc.Driver");
--- End diff --

Is this used ?


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169521#comment-16169521
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user buddhiayesha2015 opened a pull request:

https://github.com/apache/incubator-gearpump/pull/225

[GEARPUMP-217] Convert into unit tests

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/BuddhiAR/incubator-gearpump master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/225.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #225


commit d83d3556206b7e1fcf2a799af492e89d6a69f779
Author: Buddhi Ayesha 
Date:   2017-09-17T19:41:49Z

[GEARPUMP-217] Convert into unit tests




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147267#comment-16147267
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/221


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147228#comment-16147228
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/221
  
+1


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147186#comment-16147186
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/221
  
R: @huafengw 


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147166#comment-16147166
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/221
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/221?src=pr=h1)
 Report
> Merging 
[#221](https://codecov.io/gh/apache/incubator-gearpump/pull/221?src=pr=desc) 
into 
[master](https://codecov.io/gh/apache/incubator-gearpump/commit/f75fb19c78ff7e04bfdb9727bd8bf6e08bc4d1e8?src=pr=desc)
 will **increase** coverage by `0.21%`.
> The diff coverage is `n/a`.



```diff
@@Coverage Diff @@
##   master #221  +/-   ##
==
+ Coverage   68.91%   69.12%   +0.21% 
==
  Files 191  191  
  Lines6103 6103  
  Branches  362  362  
==
+ Hits 4206 4219  +13 
+ Misses   1897 1884  -13
```




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147151#comment-16147151
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/221

[GEARPUMP-217] Merge sql branch into master

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump 
merge_sql_into_master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/221.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #221


commit b844cecfe19ff7aa49b7261b75d4f182c2e1eee7
Author: Buddhi Ayesha 
Date:   2017-05-27T13:50:00Z

Add Readme

commit 2fd23fb1192b93d9de5eb6a338b770e6a1c8390d
Author: Buddhi Ayesha 
Date:   2017-06-01T15:55:27Z

Add Connection class

commit 52d0f602c0031ea3a4a8770f151a6e9a30e616f1
Author: Buddhi Ayesha 
Date:   2017-06-02T03:57:21Z

Add pom.xml

commit c324bdd07a8f334d086cd176b437b34bea4b456e
Author: Buddhi Ayesha 
Date:   2017-06-02T03:59:53Z

Add unit testing for getting a logical plan.

commit 8dba2fd682ee0de6e85754b311a26e05ac0dabf8
Author: Buddhi Ayesha 
Date:   2017-06-02T04:58:26Z

Add transactions model.

commit 5512b496988f19cf3f6dda2442250decef1e4406
Author: Buddhi Ayesha 
Date:   2017-06-02T04:59:19Z

Add log4j properties

commit 54726945b42c69cb991510131e04074f3edca520
Author: Buddhi Ayesha 
Date:   2017-06-02T05:03:30Z

Implement Connection class

commit 13b5fa563de02c44b7a4b0965108a3ff3fd84edb
Author: Buddhi Ayesha 
Date:   2017-06-02T05:08:53Z

Add simple query planner

commit 6dadc40999163365f7da1ce908ccf716640ec818
Author: Buddhi Ayesha 
Date:   2017-06-02T05:53:54Z

Add sql model

commit 2ab90218a5105e19da02e04080dcb28ba81eea6d
Author: Buddhi Ayesha 
Date:   2017-06-08T13:01:42Z

Implement CalciteConnection

commit 012a3c0d3081a9c8fb5b6145b86f1435a26a9b0e
Author: Buddhi Ayesha 
Date:   2017-06-08T13:06:24Z

Update getLogicalPlan()

commit 50985140e3cd6449a1956c5daee8cbc1e3ddf265
Author: Buddhi Ayesha 
Date:   2017-06-08T14:09:21Z

Remove null values

commit a90723ab7c6a01a54fa64abaaa237aedefc58afc
Author: Buddhi Ayesha 
Date:   2017-06-14T19:27:53Z

Add SQLNode for test purpose

commit c3d5b0e358262813dfddd5f3759e2af935a60782
Author: Buddhi Ayesha 
Date:   2017-06-17T09:08:39Z

Add StreamQueryPlanner class

commit 4b7dc7485e131bb424a982477d448b8685523942
Author: Buddhi Ayesha 
Date:   2017-06-17T09:14:06Z

Add framework configuration

commit dcf792cc50db9f05925d2ae4a7e2144584d86e0e
Author: Buddhi Ayesha 
Date:   2017-06-17T09:32:58Z

Add calcite sql validator

commit 5d719bd9605e89875748547106411f874dc287be
Author: Buddhi Ayesha 
Date:   2017-06-17T09:33:38Z

Add logical plan

commit f090b7d6107dd9ace97fd283ee8a419036cf4d03
Author: Buddhi Ayesha 
Date:   2017-06-21T14:34:37Z

Add calcite sql test class

commit 9fb6f7735d4fbe97e6a44a7fb4524cfe020af429
Author: Buddhi Ayesha 
Date:   2017-06-24T09:40:22Z

Add apache license

commit 9b750feb74f918955107a394ba3be2d564bbc966
Author: manuzhang 
Date:   2017-07-09T00:17:21Z

Add sql project

commit 6edd19e60086f25d76210a1508c6aacc3648775c
Author: Buddhi Ayesha 
Date:   2017-08-19T00:24:49Z

[GEARPUMP-217] Add Gearpump rel, rule and examples.

Author: Buddhi Ayesha 
Author: Buddhi Rathnayaka 

Closes #217 from buddhiayesha2015/upstream_sql.

commit dcf5273be7a8780faa5d5aa6dea276e1b9d826d6
Author: Buddhi Ayesha 
Date:   2017-08-24T05:30:32Z

[GEARPUMP-217] Remove 

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147134#comment-16147134
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/220


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147125#comment-16147125
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/220

[GEARPUMP-217] Merge sql branch into master

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-gearpump sql

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/220.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #220


commit 1dd9d8fc45bbfbda16f38320e66fe3f75434bd0d
Author: Buddhi Ayesha 
Date:   2017-05-27T13:50:00Z

Add Readme

commit 6f1e1823d4c7fbbbca8dd48e755ee0fe3bf8c9d8
Author: Buddhi Ayesha 
Date:   2017-06-01T15:55:27Z

Add Connection class

commit 0219d0b362a13d4d0cae0db35af575ea91534090
Author: Buddhi Ayesha 
Date:   2017-06-02T03:57:21Z

Add pom.xml

commit 1f30ec34a2ef85b37db44868847d473854148714
Author: Buddhi Ayesha 
Date:   2017-06-02T03:59:53Z

Add unit testing for getting a logical plan.

commit 2b2a7e76df9084f61c343e6f9890b90721d7689e
Author: Buddhi Ayesha 
Date:   2017-06-02T04:58:26Z

Add transactions model.

commit eb3caec968f55a471950b6acf9044fe4808d2b84
Author: Buddhi Ayesha 
Date:   2017-06-02T04:59:19Z

Add log4j properties

commit 156bfd087331f57af339d6305c67046a874ff866
Author: Buddhi Ayesha 
Date:   2017-06-02T05:03:30Z

Implement Connection class

commit 7e9cf0d3c06ae17b64016f814d1792a1014b30d6
Author: Buddhi Ayesha 
Date:   2017-06-02T05:08:53Z

Add simple query planner

commit feaf04bb4f882266265626d9b2d1552b7ee471c1
Author: Buddhi Ayesha 
Date:   2017-06-02T05:53:54Z

Add sql model

commit c0c38e3642452fa270b4490cd12836792154d3e7
Author: Buddhi Ayesha 
Date:   2017-06-08T13:01:42Z

Implement CalciteConnection

commit 30a9ac5ace14f5ff774c81ac0a20cdcee85ddba5
Author: Buddhi Ayesha 
Date:   2017-06-08T13:06:24Z

Update getLogicalPlan()

commit e37978998ebb2095b47f8644bfec943b2575ee96
Author: Buddhi Ayesha 
Date:   2017-06-08T14:09:21Z

Remove null values

commit 9a1a7c2483c8f2d55f0d1d777d1ac2fb0ebc4c74
Author: Buddhi Ayesha 
Date:   2017-06-14T19:27:53Z

Add SQLNode for test purpose

commit 00430fd8990396e598423a249de455dd60a96b58
Author: Buddhi Ayesha 
Date:   2017-06-17T09:08:39Z

Add StreamQueryPlanner class

commit 83d85783d19a15dfa5be40c2af8ada35ea6758f7
Author: Buddhi Ayesha 
Date:   2017-06-17T09:14:06Z

Add framework configuration

commit 4a22d8ac95ca12893bc23187901c32d0e71ec8c2
Author: Buddhi Ayesha 
Date:   2017-06-17T09:32:58Z

Add calcite sql validator

commit e1c16163bba80308d35ba24d6114a14d4e7c9b71
Author: Buddhi Ayesha 
Date:   2017-06-17T09:33:38Z

Add logical plan

commit f24411c7615d5c978ae120a7eb66f8177d324350
Author: Buddhi Ayesha 
Date:   2017-06-21T14:34:37Z

Add calcite sql test class

commit 7585b5b3b8104808c0edd5ea4c3a4853f7669d48
Author: Buddhi Ayesha 
Date:   2017-06-24T09:40:22Z

Add apache license

commit d089902ca3aab142cadd046c87153700ffd09e13
Author: manuzhang 
Date:   2017-07-09T00:17:21Z

Add sql project

commit e4c33004bfaf37c9fa39b45bede439bbadffa8cf
Author: manuzhang 
Date:   2017-07-26T03:04:06Z

[GEARPUMP-217] Merge master into sql branch

Author: manuzhang 
Author: darionyaphet 
Author: huafengw 

Closes #201 from manuzhang/master.

commit e04df0dddb9d45cced5b3587ee61caf7e25bbcbd
Author: manuzhang 
Date:   2017-08-02T11:03:36Z

Merge master into sql

Author: manuzhang 

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139580#comment-16139580
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/219
  
This PR has been merged. You can close now.


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139579#comment-16139579
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/219
  
LGTM


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139526#comment-16139526
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/219
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/219?src=pr=h1)
 Report
> :exclamation: No coverage uploaded for pull request base (`sql@1cf87bf`). 
[Click here to learn what that 
means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit).
> The diff coverage is `n/a`.



```diff
@@  Coverage Diff   @@
## sql #219   +/-   ##
==
  Coverage   ?   68.89%   
==
  Files  ?  192   
  Lines  ? 6108   
  Branches   ?  363   
==
  Hits   ? 4208   
  Misses ? 1900   
  Partials   ?0
```




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139517#comment-16139517
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user buddhiayesha2015 opened a pull request:

https://github.com/apache/incubator-gearpump/pull/219

[GEARPUMP-217] Remove irrelevant files, Update README.md

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/GearGSoC/incubator-gearpump sql

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/219.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #219


commit cb509674b3507e5224a3c3a442b7030f469f4ebb
Author: Buddhi Ayesha 
Date:   2017-08-23T16:23:24Z

[GEARPUMP-217] Remove irrelevant files, Update README.md




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134053#comment-16134053
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user huafengw commented on the issue:

https://github.com/apache/incubator-gearpump/pull/218
  
+1


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134052#comment-16134052
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang commented on the issue:

https://github.com/apache/incubator-gearpump/pull/218
  
R: @huafengw 


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134038#comment-16134038
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/218
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/218?src=pr=h1)
 Report
> :exclamation: No coverage uploaded for pull request base (`sql@54686e0`). 
[Click here to learn what that 
means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit).
> The diff coverage is `66.03%`.



```diff
@@  Coverage Diff   @@
## sql #218   +/-   ##
==
  Coverage   ?   68.84%   
==
  Files  ?  192   
  Lines  ? 6108   
  Branches   ?  363   
==
  Hits   ? 4205   
  Misses ? 1903   
  Partials   ?0
```




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134034#comment-16134034
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/218

[GEARPUMP-217] Merge master into sql branch

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-gearpump sync_master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/218.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #218


commit a9755cbec0426a3e11504640e87a2970071854a9
Author: manuzhang 
Date:   2017-07-14T05:26:27Z

Bump up version to 0.8.5-SNAPSHOT

Author: manuzhang 

Closes #193 from manuzhang/bump_up_version.

commit e3c63ef2b51af6a6c4d97c91479b7c1f6082c0fe
Author: manuzhang 
Date:   2017-07-17T08:02:09Z

[GEARPUMP-325] Fix license issues

Author: manuzhang 

Closes #194 from manuzhang/fix_licenses.

commit 05f68bc55aad8e56c0587995fce84fd471823bc1
Author: huafengw 
Date:   2017-07-20T08:34:50Z

[GEARPUMP-322] Fix multiple SLF4J bindings on classpath

Author: huafengw 

Closes #196 from huafengw/fix322.

commit 50316ce31db34785c4af8261dd66d8a1740a5601
Author: manuzhang 
Date:   2017-07-21T01:42:59Z

[GEARPUMP-327] Put jarstore and logs under "gearpump.home"

Author: manuzhang 

Closes #197 from manuzhang/fix_jarstore_logs.

commit a47e1a6dbe2ab594a891f48b2bb4f32b613f1b22
Author: darionyaphet 
Date:   2017-07-25T05:23:14Z

[GEARPUMP-328] FetchThread fetchSleepMS from Int to Long

currently *KafkaConfig.FETCH_SLEEP_MS_CONFIG* is a INT parameter , move it 
into a LONG parameter is better .

Author: darionyaphet 

Closes #199 from darionyaphet/GEARPUMP-328.

commit ac8ac039217725f9f924ec901fdf7adfd9f51657
Author: manuzhang 
Date:   2017-07-26T02:28:25Z

[GEARPUMP-330] Allow examples to run in `sbt run` and Intellij

Author: manuzhang 

Closes #200 from manuzhang/run_examples_in_ide.

commit fa3f892d76ca932fae44587f7860030b32f401bf
Author: huafengw 
Date:   2017-07-31T06:36:38Z

[GEARPUMP-331] Allow applications to be run in IDE

Author: huafengw 

Closes #202 from huafengw/GP331.

commit 0f5f7221ea7ff01e4e2c0d6ee4f7f95b537f5298
Author: manuzhang 
Date:   2017-08-02T06:20:55Z

[GEARPUMP-333] Fix examples assembling

Author: manuzhang 

Closes #203 from manuzhang/fix_example_dep.

commit 4ad0ec42819d81adeac57b13b772b023a8746aac
Author: manuzhang 
Date:   2017-08-02T09:53:15Z

[GEARPUMP-334] Fix Java WordCount DSL example

Author: manuzhang 

Closes #204 from manuzhang/fix_wc_java_dsl.

commit db3e8bd1eaa3a0a89c1e544ac26dae65ecd57908
Author: manuzhang 
Date:   2017-08-02T10:10:46Z

[GEARPUMP-335] Set kafka tests log level to ERROR

Author: manuzhang 

Closes #205 from manuzhang/reduce_logs.

commit b6f5ccd6ed0bb70d878c1f786da637ac4597a84f
Author: manuzhang 
Date:   2017-08-03T12:17:52Z

[GEARPUMP-336] Add scalac options and fix warnings

Author: manuzhang 

Closes #207 from manuzhang/fix_warnings.

commit f96aca995d6acd0770529a39fb25a4c4ef18c31e
Author: manuzhang 
Date:   2017-08-04T02:11:58Z

[GEARPUMP-338] Improve time related types and constants

Author: manuzhang 

Closes #208 from manuzhang/fix_time.

commit e1228a31445418e6aca77ad3cf4c2c18fb6748ee
Author: manuzhang 
Date:   2017-08-06T22:02:29Z

[GEARPUMP-339] Add ScalaDoc to Streaming DSL

Author: manuzhang 

Closes #212 from manuzhang/plan_doc.

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101106#comment-16101106
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user manuzhang closed the pull request at:

https://github.com/apache/incubator-gearpump/pull/201


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101099#comment-16101099
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

Github user codecov-io commented on the issue:

https://github.com/apache/incubator-gearpump/pull/201
  
# 
[Codecov](https://codecov.io/gh/apache/incubator-gearpump/pull/201?src=pr=h1)
 Report
> :exclamation: No coverage uploaded for pull request base (`sql@d089902`). 
[Click here to learn what that 
means](https://docs.codecov.io/docs/error-reference#section-missing-base-commit).
> The diff coverage is `90%`.



```diff
@@  Coverage Diff   @@
## sql #201   +/-   ##
==
  Coverage   ?   71.72%   
==
  Files  ?  189   
  Lines  ? 6104   
  Branches   ?  542   
==
  Hits   ? 4378   
  Misses ? 1726   
  Partials   ?0
```




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101092#comment-16101092
 ] 

ASF GitHub Bot commented on GEARPUMP-217:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-gearpump/pull/201

[GEARPUMP-217] Merge master into sql branch

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the commit message is formatted like:
   `[GEARPUMP-] Meaningful description of pull request` 
 - [ ] Make sure tests pass via `sbt clean test`.
 - [ ] Make sure old documentation affected by the pull request has been 
updated and new documentation added for new functionality. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/incubator-gearpump master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-gearpump/pull/201.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #201


commit a9755cbec0426a3e11504640e87a2970071854a9
Author: manuzhang 
Date:   2017-07-14T05:26:27Z

Bump up version to 0.8.5-SNAPSHOT

Author: manuzhang 

Closes #193 from manuzhang/bump_up_version.

commit e3c63ef2b51af6a6c4d97c91479b7c1f6082c0fe
Author: manuzhang 
Date:   2017-07-17T08:02:09Z

[GEARPUMP-325] Fix license issues

Author: manuzhang 

Closes #194 from manuzhang/fix_licenses.

commit 05f68bc55aad8e56c0587995fce84fd471823bc1
Author: huafengw 
Date:   2017-07-20T08:34:50Z

[GEARPUMP-322] Fix multiple SLF4J bindings on classpath

Author: huafengw 

Closes #196 from huafengw/fix322.

commit 50316ce31db34785c4af8261dd66d8a1740a5601
Author: manuzhang 
Date:   2017-07-21T01:42:59Z

[GEARPUMP-327] Put jarstore and logs under "gearpump.home"

Author: manuzhang 

Closes #197 from manuzhang/fix_jarstore_logs.

commit a47e1a6dbe2ab594a891f48b2bb4f32b613f1b22
Author: darionyaphet 
Date:   2017-07-25T05:23:14Z

[GEARPUMP-328] FetchThread fetchSleepMS from Int to Long

currently *KafkaConfig.FETCH_SLEEP_MS_CONFIG* is a INT parameter , move it 
into a LONG parameter is better .

Author: darionyaphet 

Closes #199 from darionyaphet/GEARPUMP-328.

commit ac8ac039217725f9f924ec901fdf7adfd9f51657
Author: manuzhang 
Date:   2017-07-26T02:28:25Z

[GEARPUMP-330] Allow examples to run in `sbt run` and Intellij

Author: manuzhang 

Closes #200 from manuzhang/run_examples_in_ide.




> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Buddhi Ayesha
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[Buddhi Ayesha (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952114#comment-15952114
 ] 

Buddhi Ayesha commented on GEARPUMP-217:


Hi [~mauzhang],
 
I have shared a draft proposal for “Add SQL support to Gearpump” in GSoC 
Dashboard. I really appreciate your feedback on it.

Thanks & Regards,

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[Manu Zhang (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927517#comment-15927517
 ] 

Manu Zhang commented on GEARPUMP-217:
-

[~lvkr10],

I've touched a bit about design in the description. My thought is to leverage 
Apache Calcite to translate a SQL query to Gearpump high level DSL. You may 
have your own preference in your design, and list pros and cons for each 
solution.

[~buddhiayesha2013],
Thank you for your interest. The scope is to support simple streaming SQL 
queries like {{select * from kafka}} with {{filter}} and {{groupBy}}. 

Manu  

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>  Components: streaming
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[Buddhi Ayesha (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922796#comment-15922796
 ] 

Buddhi Ayesha commented on GEARPUMP-217:


Dear Manu,

I am a final year undergraduate of Computer Science & Engineering, University 
of Moratuwa, Sri Lanka.

I agree with your proposal and also went through the reference documents given 
here. I have prior experience working with streaming queries and open-source 
projects during my internship.

I would like to contribute to this project in GSoC 2017 and want to know more 
about the scope of this project. 

Thank you.

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[Manu Zhang (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904261#comment-15904261
 ] 

Manu Zhang commented on GEARPUMP-217:
-

My mistake, this jira is now a gsoc 2017 project under Apache foundation and 
I've got the acknowledgement for mentoring it.

For students who are interested in this project, here are some prerequisites 

1. Familiar with Java or Scala.
2. Experience with using SQL language.
3. Basic understanding of distributed systems.
4. Knowledge of stream processing would be a plus.
5. Experience of building a (part of) distributed system would be a plus.
6. A rough design doc attached with your application would be a plus. 

Thanks,
Manu


> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[Manu Zhang (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886990#comment-15886990
 ] 

Manu Zhang commented on GEARPUMP-217:
-

Hi, Venkat

I'm sorry that our application for GSOC 2017 has been turned down and not sure 
whether we qualify under the Apache umbrella.
That said, you are more than welcome to work on this issue and make 
contribution to this project.
You may contact me at owenzhang1990 at gmail dot com or subscribe and write to 
our [mailing 
list|http://gearpump.incubator.apache.org/community.html#mailing-lists]

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (GEARPUMP-217) Add SQL support

[venkat kumar reddy (JIRA)]

[ 
https://issues.apache.org/jira/browse/GEARPUMP-217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886215#comment-15886215
 ] 

venkat kumar reddy commented on GEARPUMP-217:
-

Hello Manu  Zhang,
I am interested in working on this feature for #GSOC 2017.
I am new to open source contribution.
Could you please let me know the how to communicate with you for discussing 
about this project.

Regards,
Venkat
  

> Add SQL support 
> 
>
> Key: GEARPUMP-217
> URL: https://issues.apache.org/jira/browse/GEARPUMP-217
> Project: Apache Gearpump
>  Issue Type: New Feature
>Affects Versions: 0.8.1
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>  Labels: gsoc2017, mentor
>
> SQL support will allow those unfamiliar with Scala/Java to use Gearpump. I 
> propose to build SQL layer with Apache Calcite because
> 1. It has done the hard job of parsing, translating logical plan to physical 
> plan and optimizing.
> 2. It is under active development and has a great community.
> 3. It's proved to be a good solution since Apache Storm, Apache Flink and 
> Apache Samza all build their Streaming SQL with Apache Calcite
> Note SQL here actually means Streaming SQL dialects supported by Calcite 
> (check reference 1 and 2). Please checkout reference 3 for an example 
> implementation. 
> The physical plan will be translated to Gearpump high level DSL.
> References:
> 1. http://www.slideshare.net/julianhyde/streaming-sql
> 2. https://calcite.apache.org/docs/stream.html
> 3. https://github.com/milinda/samza-sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)