[ 
https://issues.apache.org/jira/browse/STORM-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jungtaek Lim updated STORM-2147:
--------------------------------
    Labels: storm-sql-optimaztion  (was: )

> [Storm SQL] Support automatic spout parallelism based on DataSource metadata
> ----------------------------------------------------------------------------
>
>                 Key: STORM-2147
>                 URL: https://issues.apache.org/jira/browse/STORM-2147
>             Project: Apache Storm
>          Issue Type: New Feature
>          Components: storm-sql
>            Reporter: Jungtaek Lim
>              Labels: storm-sql-optimaztion
>
> It would be better to receive metadata from Data Source, especially producer 
> which can give some hints to optimize. 
> A notable kind of hint is parallelism hint. In storm-kafka we know that 
> normally it's best to set parallelism to same as topic's partition count so 
> that Spouts can pull the data from all partitions in parallel.
> We can apply non-query optimizations start from here.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to