[
https://issues.apache.org/jira/browse/SYSTEMML-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
LI Guobao updated SYSTEMML-2396:
--------------------------------
Description: This task aims to improve the performance of workers.
Currently, in each iteration of mini-batch, we need to slice the matrix,
execute the gradients computation and then send them to the ps for updating the
model. While the ps is doing the aggregation work, the worker pauses due to
waiting for the new model. Hence the idea is to completely use this free slot
to pre-fetch the mini-batch in order to accelerate the future iteration.
> Batch pre-fetching per workers
> ------------------------------
>
> Key: SYSTEMML-2396
> URL: https://issues.apache.org/jira/browse/SYSTEMML-2396
> Project: SystemML
> Issue Type: Sub-task
> Reporter: LI Guobao
> Assignee: LI Guobao
> Priority: Major
>
> This task aims to improve the performance of workers. Currently, in each
> iteration of mini-batch, we need to slice the matrix, execute the gradients
> computation and then send them to the ps for updating the model. While the ps
> is doing the aggregation work, the worker pauses due to waiting for the new
> model. Hence the idea is to completely use this free slot to pre-fetch the
> mini-batch in order to accelerate the future iteration.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
