Re: [DISCUSS] Plan for merge SQE and Storm SQL

2016-10-12 Thread Haohui Mai
a standardize way to specify schemas will greatly help the adoption. Thanks, Haohui On Mon, Oct 10, 2016 at 3:27 PM Jungtaek Lim <kabh...@gmail.com> wrote: > One more, Flink seems to made lots of progress on SQL (still in > experimenting), but they set more limited features to streaming SQ

[jira] [Commented] (STORM-1435) Build a single jar with dependency for StormSQL dependency

2016-08-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1542#comment-1542 ] Haohui Mai commented on STORM-1435: --- It's required because it powers the built-in SQL functions (e.g

[jira] [Commented] (STORM-1435) Build a single jar with dependency for StormSQL dependency

2016-07-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400926#comment-15400926 ] Haohui Mai commented on STORM-1435: --- The core jar essentially compiles the SQL statements into topology

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-23 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1239#issuecomment-200583518 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-1625: Move storm-sql dependencies out of...

2016-03-20 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1239#issuecomment-199093496 Might need to run some manual tests to validate. I think there are several jars (e.g., guava) need to be bundled as well. Is it a good place to put them

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775610 --- Diff: external/sql/storm-sql-core/src/codegen/includes/parserImpls.ftl --- @@ -83,4 +83,23 @@ SqlNode SqlCreateTable

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775558 --- Diff: external/sql/storm-sql-core/src/test/org/apache/storm/sql/TestStormSql.java --- @@ -129,4 +134,20 @@ public void testExternalNestedInvalidAccess

[GitHub] storm pull request: [Storm-1585] Add DDL support for UDFs in storm...

2016-03-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/1169#discussion_r56775507 --- Diff: external/sql/storm-sql-core/src/jvm/org/apache/storm/sql/parser/SqlCreateFunction.java --- @@ -0,0 +1,68 @@ +package

[GitHub] storm pull request: [STORM-1570] Storm SQL support for nested fiel...

2016-02-29 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1141#issuecomment-190309254 The patch looks good. There are a few nits in the latest commit, +1 once they are addressed. Thanks for the work! --- If your project is set up for it, you can

[GitHub] storm pull request: [STORM-1570] Storm SQL support for nested fiel...

2016-02-26 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1141#issuecomment-189522481 Thanks for updating the patch! > In some cases like true AND null the query was still returning results, hence I had changed StormSqlFunctions

[jira] [Commented] (STORM-1281) port backtype.storm.testing to java

2016-02-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168625#comment-15168625 ] Haohui Mai commented on STORM-1281: --- Sure please go ahead. > port backtype.storm.testing to j

The svn repository of the storm website seems out-of-dated

2016-01-31 Thread Haohui Mai
thoughts? Regards, Haohui

[jira] [Updated] (STORM-1480) some fixes for storm-sql docs

2016-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1480: -- Description: The documentation of StormSQL needs to be updated w.r.t. STORM-1202 and STORM-822. > s

[jira] [Updated] (STORM-1480) Fix broken links in the storm-sql documentations

2016-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1480: -- Summary: Fix broken links in the storm-sql documentations (was: some fixes for storm-sql docs) >

[jira] [Updated] (STORM-1480) some fixes for storm-sql docs

2016-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1480: -- Description: The documentation of StormSQL needs to be updated w.r.t. STORM-1202 and changes

[GitHub] storm pull request: [STORM-1480] some fixes for storm-sql docs

2016-01-16 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1022#issuecomment-172286948 +1. Mind changing the commit messages to be a little bit more descriptive? The title of STORM-1480 will work well. --- If your project is set up for it, you can reply

Re: 1.x storm and jstorm merger

2016-01-13 Thread Haohui Mai
I wonder, is it possible to separate the ZooKeeper part of the code to make things easier to review? ~Haohui On Wed, Jan 13, 2016 at 6:39 AM, Bobby Evans <ev...@yahoo-inc.com.invalid> wrote: > That is great to hear. We will work on getting your dependencies put in > place ASAP

[jira] [Resolved] (STORM-1366) Add documentation for StormSQL into the website

2016-01-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved STORM-1366. --- Resolution: Fixed Fix Version/s: 1.0.0 Committed to the master. Thanks very much

[GitHub] storm pull request: [STORM-1453] nimbus.clj/wait-for-desired-code-...

2016-01-12 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/1003#issuecomment-171078363 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-1404. Mockito test failures in storm-kaf...

2016-01-08 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/993#issuecomment-170099926 The test passed locally. Committing. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm pull request: STORM-1404. Mockito test failures in storm-kaf...

2016-01-08 Thread haohui
Github user haohui closed the pull request at: https://github.com/apache/storm/pull/993 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request: STORM-1404. Mockito test failures in storm-kaf...

2016-01-08 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/993#issuecomment-170101211 Merged in 1f1ba77be849e50cdc09fcfe08dcec8f4984b4f9 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Created] (STORM-1459) Allow not specifying producer properties in read-only Kafka table in StormSQL

2016-01-08 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1459: - Summary: Allow not specifying producer properties in read-only Kafka table in StormSQL Key: STORM-1459 URL: https://issues.apache.org/jira/browse/STORM-1459 Project

[jira] [Updated] (STORM-1404) Fix Mockito test failures in storm-kafka

2016-01-07 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1404: -- Summary: Fix Mockito test failures in storm-kafka (was: Mockito test failures in storm-kafka) >

[GitHub] storm pull request: STORM-1366. Add documentation for StormSQL int...

2016-01-06 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/931#discussion_r49017930 --- Diff: documentation/storm-sql.md --- @@ -0,0 +1,87 @@ +--- +title: Storm SQL integration +layout: documentation +documentation: true

[GitHub] storm pull request: STORM-1009: link on http://storm.apache.org/do...

2016-01-06 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/882#issuecomment-169482130 +1 can you please squash the two commits into one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Created] (STORM-1446) Compile the Calcite logical plan to Storm physical plan

2016-01-06 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1446: - Summary: Compile the Calcite logical plan to Storm physical plan Key: STORM-1446 URL: https://issues.apache.org/jira/browse/STORM-1446 Project: Apache Storm Issue

[jira] [Assigned] (STORM-1404) mockito test failures in storm-kafka

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned STORM-1404: - Assignee: Haohui Mai > mockito test failures in storm-ka

[jira] [Updated] (STORM-1404) Mockito test failures in storm-kafka

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1404: -- Summary: Mockito test failures in storm-kafka (was: mockito test failures in storm-kafka) > Mock

[GitHub] storm pull request: STORM-1404. Mockito test failures in storm-kaf...

2016-01-06 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/993 STORM-1404. Mockito test failures in storm-kafka. This PR fixes the failed test reported in STORM-1404. It replaces the unreliable `Thread.sleep()` with comprehensive mocking to make sure the tests

[GitHub] storm pull request: STORM-1366. Add documentation for StormSQL int...

2016-01-06 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/931#discussion_r49000550 --- Diff: documentation/storm-sql-internal.md --- @@ -0,0 +1,55 @@ +--- +title: The Internals of Storm SQL +layout: documentation +documentation

[GitHub] storm pull request: STORM-1366. Add documentation for StormSQL int...

2016-01-06 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/931#discussion_r49001896 --- Diff: documentation/storm-sql.md --- @@ -0,0 +1,87 @@ +--- +title: Storm SQL integration +layout: documentation +documentation: true

[jira] [Updated] (STORM-1433) StormSQL Phase II

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1433: -- Component/s: storm-sql > StormSQL Phase II > - > > Key

[jira] [Updated] (STORM-1443) Support customizing parallelism in StormSQL

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1443: -- Issue Type: New Feature (was: Bug) > Support customizing parallelism in Storm

[jira] [Created] (STORM-1444) Support EXPLAIN statement in StormSQL

2016-01-06 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1444: - Summary: Support EXPLAIN statement in StormSQL Key: STORM-1444 URL: https://issues.apache.org/jira/browse/STORM-1444 Project: Apache Storm Issue Type: New Feature

[jira] [Created] (STORM-1443) Support customizing parallelism in StormSQL

2016-01-06 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1443: - Summary: Support customizing parallelism in StormSQL Key: STORM-1443 URL: https://issues.apache.org/jira/browse/STORM-1443 Project: Apache Storm Issue Type: Bug

[jira] [Commented] (STORM-1443) Support customizing parallelism in StormSQL

2016-01-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086189#comment-15086189 ] Haohui Mai commented on STORM-1443: --- One possible approach is to allow users to set the parallelism

[GitHub] storm pull request: STORM-1366. Add documentation for StormSQL int...

2016-01-06 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/931#discussion_r49015121 --- Diff: documentation/storm-sql.md --- @@ -0,0 +1,87 @@ +--- +title: Storm SQL integration +layout: documentation +documentation: true

[GitHub] storm pull request: storm-starter: Guide JDK version to later than...

2016-01-05 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/988#issuecomment-169154978 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[jira] [Created] (STORM-1435) Build a single jar with dependency for StormSQL dependency

2016-01-05 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1435: - Summary: Build a single jar with dependency for StormSQL dependency Key: STORM-1435 URL: https://issues.apache.org/jira/browse/STORM-1435 Project: Apache Storm

[jira] [Created] (STORM-1434) Support the GROUP BY clause in StormSQL

2016-01-05 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1434: - Summary: Support the GROUP BY clause in StormSQL Key: STORM-1434 URL: https://issues.apache.org/jira/browse/STORM-1434 Project: Apache Storm Issue Type: New

[jira] [Created] (STORM-1433) StormSQL Phase II

2016-01-05 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1433: - Summary: StormSQL Phase II Key: STORM-1433 URL: https://issues.apache.org/jira/browse/STORM-1433 Project: Apache Storm Issue Type: Epic Reporter

[GitHub] storm pull request: [STORM-1427] add TupleUtils/listHashCode metho...

2016-01-04 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/985#issuecomment-168778369 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-1366. Add documentation for StormSQL int...

2015-12-08 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/931 STORM-1366. Add documentation for StormSQL into the website. This PR adds the documentation for StormSQL in the ASF website. You can merge this pull request into a Git repository by running

[jira] [Closed] (STORM-1201) Support distributed deployment in StormSQL

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1201. - Resolution: Fixed Fix Version/s: 0.11.0 Committed as ff22fd970f02a39c73f1ee8bfc49f42212f5534e

Re: Welcome new Apache Storm Committers/PMC Members

2015-12-08 Thread Haohui Mai
Congrats everyone! On Wed, Dec 9, 2015 at 8:14 AM Harsha wrote: > Congrats everyone. > -Harsha > > On Tue, Dec 8, 2015, at 03:19 PM, Priyank Shah wrote: > > Congratulation everyone! > > > > > > > > > > On 12/8/15, 3:17 PM, "Hugo Da Cruz Louro" > wrote: >

[jira] [Closed] (STORM-1040) SQL support for Storm

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1040. - Resolution: Fixed Fix Version/s: 0.11.0 The branch has been merged. Thanks everyone

[jira] [Updated] (STORM-1040) SQL support for Storm Phase I - Supporting filtering and projection SQL queries

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1040: -- Summary: SQL support for Storm Phase I - Supporting filtering and projection SQL queries (was: SQL

[jira] [Closed] (STORM-1040) SQL support for Storm Phase I - Supporting filtering and projection SQL queries

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1040. - Resolution: Fixed > SQL support for Storm Phase I - Supporting filtering and projection SQL > q

[jira] [Closed] (STORM-1357) Support writing to Kafka streams in Storm SQL

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1357. - Resolution: Fixed Fix Version/s: 0.11.0 Committed as b5efe2c4433c0245c2fe0c1119e64baf6ecca776

[jira] [Reopened] (STORM-1040) SQL support for Storm

2015-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened STORM-1040: --- > SQL support for Storm > - > > Key: STORM-1040 >

Re: [DISCUSSION] More convenient way to maintain committer / contributor list and changelogs

2015-12-07 Thread Haohui Mai
Just ran https://raw.githubusercontent.com/apache/yetus/master/release-doc-maker/releasedocmaker.py against STORM. It generates CHANGES and RELEASENOTES automatically. Do they look good? It is also possible to tailor the script for STORM as well. ~Haohui On Wed, Dec 2, 2015 at 5:03 PM, 임정택

[jira] [Created] (STORM-1366) Add documentation for StormSQL into the website

2015-12-03 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1366: - Summary: Add documentation for StormSQL into the website Key: STORM-1366 URL: https://issues.apache.org/jira/browse/STORM-1366 Project: Apache Storm Issue Type

[jira] [Updated] (STORM-1366) Add documentation for StormSQL into the website

2015-12-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1366: -- Component/s: storm-sql documentation > Add documentation for StormSQL into the webs

[GitHub] storm pull request: STORM-1357. Support writing to Kafka streams i...

2015-12-03 Thread haohui
Github user haohui closed the pull request at: https://github.com/apache/storm/pull/906 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request: STORM-1357. Support writing to Kafka streams i...

2015-12-03 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/906#issuecomment-161735900 The effort has been folded into #914 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm pull request: STORM-1201. Support distributed deployment in ...

2015-12-03 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/910#issuecomment-161735759 The effort has been folded in #914 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm pull request: STORM-1040. SQL support for Storm

2015-12-03 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/919 STORM-1040. SQL support for Storm This is a duplicate of #914. This PR rebases all the changes in the STORM-1040 branch towards the latest master. You can merge this pull request

[GitHub] storm pull request: STORM-1040. SQL support for Storm.

2015-12-03 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/914#issuecomment-161738550 Currently the implementation does not support any aggregation (i.e., count, sum, max) yet. It will be added once StormSQL supports windowing. --- If your project is set

[GitHub] storm pull request: STORM-1040. SQL support for Storm.

2015-12-03 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/914#issuecomment-161738187 For some reasons I can't reopen this PR now. Created #919 as a duplicate for this PR. Thanks everybody for the comments. I have addressed them in the latest PR

[GitHub] storm pull request: STORM-1201. Support distributed deployment in ...

2015-12-03 Thread haohui
Github user haohui closed the pull request at: https://github.com/apache/storm/pull/910 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request: STORM-1201. Support distributed deployment in ...

2015-12-02 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/910 STORM-1201. Support distributed deployment in StormSQL. This PR implements the support of submitting StormSQL topologies to a Storm cluster. It introduces a new `storm sql` command in the CLI so

Re: [DISCUSSION] More convenient way to maintain committer / contributor list and changelogs

2015-12-02 Thread Haohui Mai
In Hadoop we have a script that scan through all the jira lists and generates the change log. https://github.com/aw-altiscale/hadoop-release-metadata Do you think it is useful in the context of Storm as well? ~Haohui On Wed, Dec 2, 2015 at 3:06 PM, 임정택 <kabh...@gmail.com> wrote: &g

[GitHub] storm pull request: STORM-1040. SQL support for Storm.

2015-12-02 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/914 STORM-1040. SQL support for Storm. This PR rebases all the changes in the STORM-1040 branch towards the latest master. You can merge this pull request into a Git repository by running: $ git

[jira] [Commented] (STORM-1040) SQL support for Storm

2015-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036651#comment-15036651 ] Haohui Mai commented on STORM-1040: --- Thanks [~jul...@hydromatic.net] and [~milinda] for the feedbacks

[jira] [Created] (STORM-1357) Support writing to Kafka streams in Storm SQL

2015-11-30 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1357: - Summary: Support writing to Kafka streams in Storm SQL Key: STORM-1357 URL: https://issues.apache.org/jira/browse/STORM-1357 Project: Apache Storm Issue Type: New

[jira] [Updated] (STORM-1357) Support writing to Kafka streams in Storm SQL

2015-11-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1357: -- Component/s: storm-sql > Support writing to Kafka streams in Storm

[GitHub] storm pull request: STORM-1357. Support writing to Kafka streams i...

2015-11-30 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/906 STORM-1357. Support writing to Kafka streams in Storm SQL. This PR adds supports to stream the results from Storm SQL to `KafkaProducer`. It contains two main components: * Allow

[GitHub] storm pull request: STORM-1357. Support writing to Kafka streams i...

2015-11-30 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/906#issuecomment-160856554 Commit 15d3c2e is cherry-picked from the master. Just checked the kafka website the link is valid. --- If your project is set up for it, you can reply to this email

[GitHub] storm pull request: Upmerge STORM-1040 to the latest master

2015-11-30 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/907 Upmerge STORM-1040 to the latest master This PR merges the latest master to the STORM-1040 branch. You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] storm pull request: STORM-1220. Avoid double copying in the Kafka ...

2015-11-25 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/894#issuecomment-159699064 Addressed in the latest patch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Closed] (STORM-1222) Support Kafka as external tables in StormSQL

2015-11-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1222. - Resolution: Fixed Thanks for the reviews and commits. > Support Kafka as external tables in Storm

[jira] [Closed] (STORM-1200) Support collations of primary keys

2015-11-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1200. - Resolution: Fixed Thanks for the reviews and commits. > Support collations of primary k

[GitHub] storm pull request: STORM-1352. Trident should support writing to ...

2015-11-25 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/905 STORM-1352. Trident should support writing to multiple Kafka clusters. This PR allows users to specify multiple Kafka configurations so that the topology can write to multiple Kafka clusters. You

[jira] [Closed] (STORM-1220) Avoid double copying in the Kafka spout

2015-11-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1220. - Resolution: Fixed Thanks for the reviews and commits. > Avoid double copying in the Kafka sp

[jira] [Created] (STORM-1352) Trident should support writing to multiple Kafka clusters

2015-11-24 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1352: - Summary: Trident should support writing to multiple Kafka clusters Key: STORM-1352 URL: https://issues.apache.org/jira/browse/STORM-1352 Project: Apache Storm

[jira] [Closed] (STORM-1181) Compile SQLs into Tridient topology and execute them in LocalCluster

2015-11-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1181. - Resolution: Fixed Thanks for the reviews and commits. > Compile SQLs into Tridient topology and exec

[jira] [Assigned] (STORM-1281) port backtype.storm.testing to java

2015-11-23 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned STORM-1281: - Assignee: Haohui Mai > port backtype.storm.testing to j

[GitHub] storm pull request: STORM-1221. Create a common interface for all ...

2015-11-20 Thread haohui
Github user haohui commented on a diff in the pull request: https://github.com/apache/storm/pull/895#discussion_r45505881 --- Diff: storm-core/src/jvm/storm/trident/TridentTopology.java --- @@ -127,7 +128,21 @@ public Stream newStream(String txId, IPartitionedTridentSpout spout

[jira] [Closed] (STORM-1221) Create a common interface for all Trident spout

2015-11-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1221. - Resolution: Fixed Fix Version/s: 0.11.0 Thanks everyone for the reviews and commits. > Cre

[jira] [Created] (STORM-1220) Avoid double copying in the Kafka spout

2015-11-19 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1220: - Summary: Avoid double copying in the Kafka spout Key: STORM-1220 URL: https://issues.apache.org/jira/browse/STORM-1220 Project: Apache Storm Issue Type: Bug

[GitHub] storm pull request: STORM-1220. Avoid double copying in the Kafka ...

2015-11-19 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/894 STORM-1220. Avoid double copying in the Kafka spout. Currently the Kafka spout performs an extra copy for all payloads in Kafka when integrating with Storm. This PR proposes to avoid the extra copy

[GitHub] storm pull request: STORM-1221. Create a common interface for all ...

2015-11-19 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/895 STORM-1221. Create a common interface for all Trident spout. This PR marks the trident spouts with a common interface. Such a common interface allows StormSQL to manage external data sources

[jira] [Created] (STORM-1221) Create a common interface for all Trident spout

2015-11-19 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1221: - Summary: Create a common interface for all Trident spout Key: STORM-1221 URL: https://issues.apache.org/jira/browse/STORM-1221 Project: Apache Storm Issue Type

[GitHub] storm pull request: STORM-1222. Support Kafka as external tables i...

2015-11-19 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/896 STORM-1222. Support Kafka as external tables in StormSQL This PR adds the support of Kafka as external tables in StormSQL. You can merge this pull request into a Git repository by running: $ git

[jira] [Created] (STORM-1222) Support Kafka as external tables in StormSQL

2015-11-19 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1222: - Summary: Support Kafka as external tables in StormSQL Key: STORM-1222 URL: https://issues.apache.org/jira/browse/STORM-1222 Project: Apache Storm Issue Type: New

[jira] [Closed] (STORM-1173) Support string operations in StormSQL

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1173. - Resolution: Fixed Thanks [~sriharsha] for the reviews and commit. > Support string operati

[jira] [Assigned] (STORM-1201) Support distributed deployment in StormSQL

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned STORM-1201: - Assignee: Haohui Mai > Support distributed deployment in Storm

[jira] [Updated] (STORM-1181) Compile SQLs into Tridient topology and execute them in LocalCluster

2015-11-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1181: -- Summary: Compile SQLs into Tridient topology and execute them in LocalCluster (was: Compile SQLs

[jira] [Updated] (STORM-1181) Compile SQLs in Tridient topology and execute them in LocalCluster

2015-11-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1181: -- Summary: Compile SQLs in Tridient topology and execute them in LocalCluster (was: Execute StormSQL

[GitHub] storm pull request: STORM-1181. Compile SQLs into Tridient topolog...

2015-11-11 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/876 STORM-1181. Compile SQLs into Tridient topology and execute them in LocalCluster This PR expands the capability of StormSQL to compile SQLs into Trident topology and execute them in LocalCluster

[jira] [Created] (STORM-1200) Support collations of primary keys

2015-11-11 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1200: - Summary: Support collations of primary keys Key: STORM-1200 URL: https://issues.apache.org/jira/browse/STORM-1200 Project: Apache Storm Issue Type: New Feature

[GitHub] storm pull request: STORM-1173. Support string operations in Storm...

2015-11-10 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/872 STORM-1173. Support string operations in StormSQL. This PR implements the support of string operations in StormSQL. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Closed] (STORM-1159) Support nullable operations in StormSQL

2015-11-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1159. - Resolution: Fixed Thanks for the reviews and commits. > Support nullable operations in Storm

[jira] [Created] (STORM-1181) Execute StormSQL in Trident topology

2015-11-05 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1181: - Summary: Execute StormSQL in Trident topology Key: STORM-1181 URL: https://issues.apache.org/jira/browse/STORM-1181 Project: Apache Storm Issue Type: New Feature

[jira] [Updated] (STORM-1159) Support nullable operations in StormSQL

2015-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated STORM-1159: -- Summary: Support nullable operations in StormSQL (was: Support nullable types in StormSQL) > Supp

[jira] [Created] (STORM-1173) Support string operations in StormSQL

2015-11-04 Thread Haohui Mai (JIRA)
Haohui Mai created STORM-1173: - Summary: Support string operations in StormSQL Key: STORM-1173 URL: https://issues.apache.org/jira/browse/STORM-1173 Project: Apache Storm Issue Type: New Feature

[GitHub] storm pull request: STORM-1159. Support nullable operations in Sto...

2015-11-04 Thread haohui
GitHub user haohui opened a pull request: https://github.com/apache/storm/pull/860 STORM-1159. Support nullable operations in StormSQL This PR implements the support of the nullable semantics of the expressions available in StormSQL. It also implements the `IS_NULL

[GitHub] storm pull request: STORM-1167: Add windowing support for storm co...

2015-11-04 Thread haohui
Github user haohui commented on the pull request: https://github.com/apache/storm/pull/855#issuecomment-153820936 The high level API looks good to me overall. It maintains a view of all the events in the window which is a powerful concept. I have several questions on how

[jira] [Closed] (STORM-1149) Support pluggable data sources in CREATE TABLE

2015-11-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/STORM-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai closed STORM-1149. - Resolution: Fixed Thanks [~harsha_ch] for the reviews and commits. > Support pluggable data sour

  1   2   >