Jungtaek Lim created STORM-2147:

             Summary: [Storm SQL] Support automatic spout parallelism based on 
DataSource metadata
                 Key: STORM-2147
                 URL: https://issues.apache.org/jira/browse/STORM-2147
             Project: Apache Storm
          Issue Type: New Feature
          Components: rm-sql, storm-sql
            Reporter: Jungtaek Lim

It would be better to receive metadata from Data Source, especially producer 
which can give some hints to optimize. 
A notable kind of hint is parallelism hint. In storm-kafka we know that 
normally it's best to set parallelism to same as topic's partition count so 
that Spouts can pull the data from all partitions in parallel.

We can apply non-query optimizations start from here.

This message was sent by Atlassian JIRA

Reply via email to