[
https://issues.apache.org/jira/browse/TAJO-367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jihoon Son resolved TAJO-367.
-----------------------------
Resolution: Not A Problem
> Separate the locality information from Fragment
> -----------------------------------------------
>
> Key: TAJO-367
> URL: https://issues.apache.org/jira/browse/TAJO-367
> Project: Tajo
> Issue Type: Improvement
> Components: QueryMaster, Storage, Worker
> Reporter: Jihoon Son
>
> Fragment is designed to represent a portion of the abstracted input source.
> However, since It is currently used for the task scheduling and the task
> allocation, it includes the locality information as well as the abstraction
> of the input data.
> The locality information is used only in the task scheduling, and thus the
> locality information should be separated from Fragment.
> The locality information is used in the task scheduling to assign tasks to
> workers closes to the data regardless of the kind of the storage layer.
> To consider input data and their locality in the task scheduler, we need to
> design a new class including a Fragment and the locality information such as
> FragmentWithHost.
> In this issue, following works should be resolved.
> * Removing the host information from FileFragment
> * Creating a new class FragmentWithHost that contains an instance of the
> Fragment interface and the locality information consisting of hosts and disk
> ids
> * Refactoring SubQuery, StorageManager and TaskScheduler to use
> FragmentWithHost
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
