----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25242/ -----------------------------------------------------------
(Updated Sept. 22, 2014, 4:32 a.m.) Review request for Tajo and Hyunsik Choi. Changes ------- Change the if-condition which deletes the intermediate file in ExternalSortExec and add some comments to explain the reason Repository: tajo Description ------- TAJO-983: Worker should directly read Intermediate data stored in localhost rather than fetching Currently, worker always fetches all intermediate via Fetcher and than store them in local file system even though some intermediate data already are stored in local file system. It is inefficient and causes unnecessary I/O and extra storage occupation. We should improve it. https://issues.apache.org/jira/browse/TAJO-983 Diffs (updated) ----- tajo-core/src/main/java/org/apache/tajo/engine/planner/UniformRangePartition.java db12285 tajo-core/src/main/java/org/apache/tajo/engine/planner/physical/ExternalSortExec.java 700e34d tajo-core/src/main/java/org/apache/tajo/worker/Fetcher.java 4867fe4 tajo-core/src/main/java/org/apache/tajo/worker/Task.java c9c83d1 tajo-core/src/test/java/org/apache/tajo/worker/TestFetcher.java b15d523 tajo-storage/src/main/java/org/apache/tajo/storage/RawFile.java 1f57675 tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/PullServerAuxService.java e6e7ce3 tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/TajoPullServerService.java f7bc489 tajo-yarn-pullserver/src/main/java/org/apache/tajo/pullserver/retriever/FileChunk.java a8b424e Diff: https://reviews.apache.org/r/25242/diff/ Testing ------- Thanks, Hai Thanh Mai
