[ 
https://issues.apache.org/jira/browse/NUTCH-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

İlhami KALKAN updated NUTCH-1659:
---------------------------------

    Attachment: workload.patch

I added adaptiveQueuePartitioner  method  to distribute groups to reduce tasks. 
If "db.fetch.adaptive.queue.size" is active, this method distributes groups to 
reduce tasks in a balanced manner.

> Custom partitioner for Adaptive Queue Size 
> -------------------------------------------
>
>                 Key: NUTCH-1659
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1659
>             Project: Nutch
>          Issue Type: Sub-task
>    Affects Versions: 2.2.1
>            Reporter: İlhami KALKAN
>             Fix For: 2.3
>
>         Attachments: workload.patch
>
>
> According to workload, groups of queue are distributed to reducers.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to