[
https://issues.apache.org/jira/browse/TAJO-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mai Hai Thanh updated TAJO-983:
-------------------------------
Attachment: TAJO-983.140825.patch.txt
This new patch resolves some conflicts with recent commits from other issues.
Hi [~hyunsik], may you check this latest patch ? This one already implements
the non-copy approach based on your suggestion. All tests passed successfully.
Since there are some other issues that deal with Task and TaskRunner (e.g.,
TAJO-855), it will be better if we can close this issue early to avoid
conflicts with other issues.
> Worker should directly read Intermediate data stored in localhost rather than
> fetching
> --------------------------------------------------------------------------------------
>
> Key: TAJO-983
> URL: https://issues.apache.org/jira/browse/TAJO-983
> Project: Tajo
> Issue Type: Bug
> Components: data shuffle
> Reporter: Hyunsik Choi
> Assignee: Mai Hai Thanh
> Attachments: TAJO-983.140820.0.patch.txt, TAJO-983.140822.patch.txt,
> TAJO-983.140825.patch.txt
>
>
> Currently, worker always fetches all intermediate via Fetcher and than store
> them in local file system even though some intermediate data already are
> stored in local file system. It is inefficient and causes unnecessary I/O and
> extra storage occupation. We should improve it.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
