-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/18728/
-----------------------------------------------------------
(Updated March 4, 2014, 2:34 p.m.)
Review request for Tajo.
Summary (updated)
-----------------
TAJO-647: Work unbalance on disk scheduling of DefaultScheduler
Bugs: TAJO-647
https://issues.apache.org/jira/browse/TAJO-647
Repository: tajo
Description
-------
The main problem is that localAllocation does not find next lowest volume. and
it will assign to remote in rack.
We should control the remote tasks.
Leaf scheduling priorities
1. tasks in a volume of host
2. unknown disk, non-splitable in local host
3. remote tasks in rack. (consider the remaining tasks)
4. random remote tasks. (tail concurrency control of scheduled tasks)
Diffs
-----
tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/DefaultTaskScheduler.java
3ee93ac
tajo-core/tajo-core-backend/src/main/java/org/apache/tajo/master/querymaster/SubQuery.java
790d30b
Diff: https://reviews.apache.org/r/18728/diff/
Testing
-------
I've tested two cluster.
Cluster-1 : ( disk * 4) * 4 servers
Cluster-2 : ( disk * 8) * 10 servers
Test DataSet : TPCH 100GB, 1TB
Thanks,
Jinho Kim
