[
https://issues.apache.org/jira/browse/YARN-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745752#comment-16745752
]
Xun Liu commented on YARN-9207:
-------------------------------
I saw an article here describing the service of a long service type.
Https://zh.hortonworks.com/blog/first-class-support-long-running-services-apache-hadoop-yarn/
It is tested that the service can be run for a specified time through the JSON
in the article.
{quote}{
"name":"[httpd-service|https://www.json.cn/httpd-service]";,
"lifetime":"3600",
"components":[
{
"name":"[httpd|https://www.json.cn/httpd]";,
"number_of_containers":2,
"artifact":{
"id":"centos/httpd-24-centos7:latest",
"type":"DOCKER"
},
"launch_command":"/usr/bin/run-httpd",
"resource":{
"cpus":1,
"memory":"1024"
}
}
]
}
{quote}
But there are no updates in the article, there are 2 problems:
1. The version field is missing.
2. When lefetime=-1, there is no time limit to run
Using a long service service can be achieved by the following json content
*_yarn app -launch_* *_my-httpd /path/to/httpd.json_*
{quote}{
"name":"[httpd-service|https://www.json.cn/httpd-service]";,
"lifetime":"-1",
"components":[
{
"name":"[httpd|https://www.json.cn/httpd]";,
"number_of_containers":2,
"artifact":{
"id":"10.120.196.232:5000/centos/httpd-24-centos7:latest",
"type":"DOCKER"
},
"launch_command":"/usr/bin/run-httpd",
"resource":{
"cpus":1,
"memory":"1024"
}
}
],
"version":"13535262542525424"
}
{quote}
> {Submarine} Support long-running service type services
> ------------------------------------------------------
>
> Key: YARN-9207
> URL: https://issues.apache.org/jira/browse/YARN-9207
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: submarine
> Reporter: Xun Liu
> Priority: Major
>
> At present, YANR only supports batch type tasks. After the batch is
> completed, the task ends and the container will exit.
> Machine learning needs to provide users with tensorboard, model prediction
> online service is a long-running service type of service, currently can
> increase the "{color:#205081}sleep infinity{color}" in the task's start
> command, so that the task has been sleeping until the container does not
> exit, need to be closed Time is terminated manually.
> But this method is not friendly enough or professional, so the YARN should
> add a task type parameter, the named task is batch processing or long-running
> service.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
