[ https://issues.apache.org/jira/browse/STORM-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim updated STORM-2147: -------------------------------- Labels: storm-sql-optimaztion (was: ) > [Storm SQL] Support automatic spout parallelism based on DataSource metadata > ---------------------------------------------------------------------------- > > Key: STORM-2147 > URL: https://issues.apache.org/jira/browse/STORM-2147 > Project: Apache Storm > Issue Type: New Feature > Components: storm-sql > Reporter: Jungtaek Lim > Labels: storm-sql-optimaztion > > It would be better to receive metadata from Data Source, especially producer > which can give some hints to optimize. > A notable kind of hint is parallelism hint. In storm-kafka we know that > normally it's best to set parallelism to same as topic's partition count so > that Spouts can pull the data from all partitions in parallel. > We can apply non-query optimizations start from here. -- This message was sent by Atlassian JIRA (v6.3.4#6332)