[
https://issues.apache.org/jira/browse/STORM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15036651#comment-15036651
]
Haohui Mai commented on STORM-1040:
-----------------------------------
Thanks [[email protected]] and [~milinda] for the feedbacks.
bq. I have a concern that you are operating on Calcite logical algebra, rather
than having created a Storm physical algebra. It shouldn't matter in the short
term, but you will probably want to do query optimization in future.
bq. +1 for Julian Hyde's idea to create a physical algebra for Storm.
I think it makes a lot of sense. I'll work on migrating to physical plan at the
next phase.
bq. Have you published some SQL examples? And an example how to use SQL from
Java code?
It's in the pull requests on STORM-1201. The usage model is much closer to what
Storm has today, (i.e., submitting a topology) but I plan to revisit it later
to see how to
bq. What do you think of co-developing TCKs for streaming SQL semantics? Is
there anything that should be contributed back to Calcite?
PostOrderRelNodeVisitor looked like a candidate.
Co-developing the tests make a lot of sense. StormSQL should worry less on the
SQL expression semantics compared to translating to the Storm physical plan
correctly.
I think that it also makes sense to contribute the visitors and the code
generators of expressions back to Calcite. The code generators adopts a more
passive pattern (e.g., it does not actively pulling data through {{Enumerable}}
compared to the Calcite interpreter) so that it is easier to integrate with
Storm.
bq. I think Haohui Mai or maybe someone else from the Storm community should
join the Calcite dev list and actively participate.
Thanks for the reminder. I'll subscribe the mailing list.
> SQL support for Storm
> ---------------------
>
> Key: STORM-1040
> URL: https://issues.apache.org/jira/browse/STORM-1040
> Project: Apache Storm
> Issue Type: Epic
> Components: storm-sql
> Reporter: Haohui Mai
> Assignee: Haohui Mai
>
> SQL is one of the more popular languages in business intelligence. Instead of
> writing Storm topology directly, having supports to compile SQL down to
> topology will accelerate the development and deployment of real-time
> streaming solutions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
