[
https://issues.apache.org/jira/browse/EAGLE-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Libin, Sun updated EAGLE-57:
----------------------------
Description:
storm provide interface for setting both parallelism hints(# storm executors)
and # task for spout/bolt like the following
{code:borderStyle=solid}
topologyBuilder.setBolt("green-bolt", new GreenBolt(), 2)
.setNumTasks(4)
{code}
But currently eagle only provide setting #parallelism for storm bolt/spout like:
{code:borderStyle=solid}
"parallelismConfig" : {
"kafkaMsgConsumer" : 8,
}
{code}
We have not exposed #task settings for spout/bolt, user can only set topology
level default #task in topology-storm.yaml like "topology.tasks: 8"
This is not enough because each bolt/spout has different #parallelism, In most
case, #parallelism should better equals to #task
A bolt with #parallelism=1 task=8 doesn't make sense for it's not efficient
was:
storm provide interface for setting both parallelism hints(# storm executors)
and # task for spout/bolt like the following
{code:title=Bar.java|borderStyle=solid}
topologyBuilder.setBolt("green-bolt", new GreenBolt(), 2)
.setNumTasks(4)
{code}
But currently eagle only provide setting #parallelism for storm bolt/spout like:
{code:title=Bar.java|borderStyle=solid}
"parallelismConfig" : {
"kafkaMsgConsumer" : 8,
}
{code}
We have not exposed #task settings for spout/bolt, user can only set topology
level default #task in topology-storm.yaml like "topology.tasks: 8"
This is not enough because each bolt/spout has different #parallelism, In most
case, #parallelism should better equals to #task
A bolt with #parallelism=1 task=8 doesn't make sense for it's not efficient
storm.yaml
> Eagle should expose interface for use to set numTask for spout/bolt
> -------------------------------------------------------------------
>
> Key: EAGLE-57
> URL: https://issues.apache.org/jira/browse/EAGLE-57
> Project: Eagle
> Issue Type: Bug
> Reporter: Libin, Sun
> Fix For: 0.3.0
>
>
> storm provide interface for setting both parallelism hints(# storm executors)
> and # task for spout/bolt like the following
>
> {code:borderStyle=solid}
> topologyBuilder.setBolt("green-bolt", new GreenBolt(), 2)
> .setNumTasks(4)
> {code}
>
> But currently eagle only provide setting #parallelism for storm bolt/spout
> like:
> {code:borderStyle=solid}
> "parallelismConfig" : {
> "kafkaMsgConsumer" : 8,
> }
> {code}
>
> We have not exposed #task settings for spout/bolt, user can only set topology
> level default #task in topology-storm.yaml like "topology.tasks: 8"
> This is not enough because each bolt/spout has different #parallelism, In
> most case, #parallelism should better equals to #task
> A bolt with #parallelism=1 task=8 doesn't make sense for it's not efficient
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
