[
https://issues.apache.org/jira/browse/EAGLE-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhao, Qingwen updated EAGLE-57:
-------------------------------
Comment: was deleted
(was: [~libsun] Storm guarantees each executor has one task to execute. If you
do not have very high requirement on the task # for each spout/bolt, you can
set task # by specifying the executor # for each bolt/spouts in your
configuration.
When submit the topology, storm will adjusts the task # if necessary
1) if executor # > task #, task # will be equal to executor # (each executor
should have one task)
2) if executor # < task #, task # remains the same.
So you can try to set topology.tasks=1
)
> Eagle should expose interface for user to set numTask for spout/bolt
> --------------------------------------------------------------------
>
> Key: EAGLE-57
> URL: https://issues.apache.org/jira/browse/EAGLE-57
> Project: Eagle
> Issue Type: Bug
> Reporter: Libin, Sun
> Fix For: 0.3.0
>
>
> storm provide interface for setting both parallelism hints(# storm executors)
> and # task for spout/bolt like the following
>
> {code:borderStyle=solid}
> topologyBuilder.setBolt("green-bolt", new GreenBolt(), 2)
> .setNumTasks(4)
> {code}
>
> But currently eagle only provide setting #parallelism for storm bolt/spout
> like:
> {code:borderStyle=solid}
> "parallelismConfig" : {
> "kafkaMsgConsumer" : 8
> }
> {code}
>
> We have not exposed #task settings for spout/bolt, user can only set topology
> level default #task in topology-storm.yaml like "topology.tasks: 8"
> This is not enough because each bolt/spout has different #parallelism, In
> most case, #parallelism should better equals to #task
> A bolt with #parallelism=1 #task=8 doesn't make sense for it's not efficient
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
