David Auclair created METRON-2187:
-------------------------------------

             Summary: Profiler parallelism
                 Key: METRON-2187
                 URL: https://issues.apache.org/jira/browse/METRON-2187
             Project: Metron
          Issue Type: Bug
    Affects Versions: 0.7.1
            Reporter: David Auclair


No matter how many workers are configured for the profiler, each component ends 
up using 1 task (at most).

For example, from the flux definition of the enrichment topology:
spouts:
 - id: "kafkaSpout"
 className: "org.apache.metron.storm.kafka.flux.StormKafkaSpout"
 constructorArgs:
 - ref: "kafkaConfig"
 parallelism: ${kafka.spout.parallelism}

 

While the flux definition of the profiler topology:

spouts:
 - id: "kafkaSpout"
 className: "org.apache.metron.storm.kafka.flux.StormKafkaSpout"
 constructorArgs:
 - ref: "kafkaConfig"

^^^ Note the lack of parallelism



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to