[ 
https://issues.apache.org/jira/browse/IGNITE-4270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vladimir Ozerov updated IGNITE-4270:
------------------------------------
    Issue Type: Sub-task  (was: Task)
        Parent: IGNITE-4262

> Hadoop: optionally stripe mapper output for every partition.
> ------------------------------------------------------------
>
>                 Key: IGNITE-4270
>                 URL: https://issues.apache.org/jira/browse/IGNITE-4270
>             Project: Ignite
>          Issue Type: Sub-task
>          Components: hadoop
>    Affects Versions: 1.8
>            Reporter: Vladimir Ozerov
>            Assignee: Vladimir Ozerov
>             Fix For: 2.0
>
>
> Currently we have R maps for M mappers, where R is number of reducers. For 
> this reason many mappers writes to concurrent offheap data structure, loosing 
> time on concurrency burden.
> Let's add an option to create R * M maps, so that every mapper has dedicated 
> map for every reducer. This will eliminate almost all concurrency overhead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to