[
https://issues.apache.org/jira/browse/TAJO-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146060#comment-14146060
]
Hudson commented on TAJO-983:
-----------------------------
SUCCESS: Integrated in Tajo-master-CODEGEN-build #16 (See
[https://builds.apache.org/job/Tajo-master-CODEGEN-build/16/])
TAJO-983: Worker should directly read Intermediate data stored in localhost
rather than fetching. (Mai Hai Thanh via hyunsik) (hyunsik: rev
644b7cd991ea402115c6dc1d198e7f1d7f41771b)
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/physical/ExternalSortExec.java
* CHANGES
*
tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/TajoPullServerService.java
* tajo-storage/src/main/java/org/apache/tajo/storage/RawFile.java
*
tajo-core/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java
* tajo-core/src/test/java/org/apache/tajo/worker/TestFetcher.java
* tajo-core/src/main/java/org/apache/tajo/worker/Task.java
* tajo-core/src/main/java/org/apache/tajo/worker/Fetcher.java
*
tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/PullServerAuxService.java
*
tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/retriever/FileChunk.java
> Worker should directly read Intermediate data stored in localhost rather than
> fetching
> --------------------------------------------------------------------------------------
>
> Key: TAJO-983
> URL: https://issues.apache.org/jira/browse/TAJO-983
> Project: Tajo
> Issue Type: Improvement
> Components: data shuffle
> Reporter: Hyunsik Choi
> Assignee: Mai Hai Thanh
> Fix For: 0.9.0
>
> Attachments: TAJO-983.140820.0.patch.txt, TAJO-983.140822.patch.txt,
> TAJO-983.140825.1.patch.txt, TAJO-983.140902.patch, TAJO-983.140904.patch,
> TAJO-983.140916.patch, TAJO-983.140918.patch, TAJO-983.140922.patch,
> TAJO-983.140923.patch, TAJO-983.140924-Hyunsik.patch
>
>
> Currently, worker always fetches all intermediate via Fetcher and than store
> them in local file system even though some intermediate data already are
> stored in local file system. It is inefficient and causes unnecessary I/O and
> extra storage occupation. We should improve it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
