[
https://issues.apache.org/jira/browse/TAJO-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682073#comment-13682073
]
Hudson commented on TAJO-51:
----------------------------
Integrated in Tajo-trunk-postcommit #79 (See
[https://builds.apache.org/job/Tajo-trunk-postcommit/79/])
TAJO-51: Parallel Container Launch of TaskRunnerLauncherImpl. (hyunsik)
(Revision 9ca8d365df1dc95a87e6260d4659944ebd147d56)
Result = SUCCESS
hyunsik :
https://git-wip-us.apache.org/repos/asf?p=incubator-tajo.git&a=commit&h=9ca8d365df1dc95a87e6260d4659944ebd147d56
Files :
* tajo-core/tajo-core-backend/src/main/java/tajo/master/TaskSchedulerImpl.java
* tajo-core/tajo-core-backend/src/main/java/tajo/master/QueryMaster.java
*
tajo-core/tajo-core-backend/src/main/java/tajo/master/TaskRunnerLauncherImpl.java
*
tajo-core/tajo-core-backend/src/main/java/tajo/master/event/TaskRunnerLaunchEvent.java
*
tajo-core/tajo-core-backend/src/main/java/tajo/master/event/TaskRunnerStopEvent.java
* CHANGES.txt
* tajo-core/tajo-core-backend/src/main/java/tajo/master/TaskRunnerLauncher.java
* tajo-core/tajo-core-backend/src/main/java/tajo/master/TaskRunnerEvent.java
*
tajo-core/tajo-core-backend/src/main/java/tajo/master/TaskRunnerGroupEvent.java
* tajo-core/tajo-core-backend/src/main/java/tajo/master/SubQuery.java
* tajo-common/src/main/java/tajo/conf/TajoConf.java
> Parallel Container Launch of TaskRunnerLauncherImpl
> ---------------------------------------------------
>
> Key: TAJO-51
> URL: https://issues.apache.org/jira/browse/TAJO-51
> Project: Tajo
> Issue Type: Improvement
> Components: master
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Labels: yarn
> Fix For: 0.2-incubating
>
> Attachments: TAJO-51.patch
>
>
> TaskRunnerLauncherImpl plays a role to launch remote containers via the proxy
> of ContainerManager. This implementation sequentially launches containers, so
> it may take a long time in large clusters. For example, it consumes about 5
> seconds for starting 128 containers in our cluster, consisting of 32 nodes.
> To relieve this time-consuming work, we can make this part parallel by using
> ExecutorService.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira