[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591330#comment-14591330 ] Hadoop QA commented on YARN-3244: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | pre-patch | 18m 13s | Pre-patch trunk compilation is healthy. | | {color:green}+1{color} | @author | 0m 0s | The patch does not contain any @author tags. | | {color:green}+1{color} | tests included | 0m 0s | The patch appears to include 1 new or modified test files. | | {color:green}+1{color} | javac | 7m 47s | There were no new javac warning messages. | | {color:green}+1{color} | javadoc | 10m 6s | There were no new javadoc warning messages. | | {color:green}+1{color} | release audit | 0m 22s | The applied patch does not increase the total number of release audit warnings. | | {color:red}-1{color} | checkstyle | 1m 27s | The applied patch generated 8 new checkstyle issues (total was 240, now 247). | | {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that end in whitespace. | | {color:green}+1{color} | install | 1m 36s | mvn install still works. | | {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with eclipse:eclipse. | | {color:green}+1{color} | findbugs | 3m 13s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. | | {color:green}+1{color} | yarn tests | 0m 26s | Tests passed in hadoop-yarn-api. | | {color:green}+1{color} | yarn tests | 1m 56s | Tests passed in hadoop-yarn-common. | | | | 45m 54s | | \\ \\ || Subsystem || Report/Notes || | Patch URL | http://issues.apache.org/jira/secure/attachment/12740224/YARN-3244.5.patch | | Optional Tests | javadoc javac unit findbugs checkstyle | | git revision | trunk / 74351af | | checkstyle | https://builds.apache.org/job/PreCommit-YARN-Build/8276/artifact/patchprocess/diffcheckstylehadoop-yarn-api.txt | | hadoop-yarn-api test log | https://builds.apache.org/job/PreCommit-YARN-Build/8276/artifact/patchprocess/testrun_hadoop-yarn-api.txt | | hadoop-yarn-common test log | https://builds.apache.org/job/PreCommit-YARN-Build/8276/artifact/patchprocess/testrun_hadoop-yarn-common.txt | | Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/8276/testReport/ | | Java | 1.7.0_55 | | uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/8276/console | This message was automatically generated. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch, YARN-3244.3.patch, YARN-3244.4.patch, YARN-3244.5.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590702#comment-14590702 ] Xuan Gong commented on YARN-3244: - [~jianhe] Please take a look. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch, YARN-3244.3.patch, YARN-3244.4.patch, YARN-3244.5.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555153#comment-14555153 ] Hadoop QA commented on YARN-3244: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | pre-patch | 14m 47s | Pre-patch trunk compilation is healthy. | | {color:green}+1{color} | @author | 0m 0s | The patch does not contain any @author tags. | | {color:green}+1{color} | tests included | 0m 0s | The patch appears to include 1 new or modified test files. | | {color:green}+1{color} | javac | 7m 36s | There were no new javac warning messages. | | {color:green}+1{color} | javadoc | 9m 45s | There were no new javadoc warning messages. | | {color:green}+1{color} | release audit | 0m 23s | The applied patch does not increase the total number of release audit warnings. | | {color:red}-1{color} | checkstyle | 1m 12s | The applied patch generated 8 new checkstyle issues (total was 241, now 249). | | {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that end in whitespace. | | {color:green}+1{color} | install | 1m 35s | mvn install still works. | | {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with eclipse:eclipse. | | {color:green}+1{color} | findbugs | 2m 46s | The patch does not introduce any new Findbugs (version 3.0.0) warnings. | | {color:green}+1{color} | yarn tests | 0m 30s | Tests passed in hadoop-yarn-api. | | {color:green}+1{color} | yarn tests | 1m 58s | Tests passed in hadoop-yarn-common. | | | | 41m 22s | | \\ \\ || Subsystem || Report/Notes || | Patch URL | http://issues.apache.org/jira/secure/attachment/12734647/YARN-3244.4.patch | | Optional Tests | javadoc javac unit findbugs checkstyle | | git revision | trunk / 4513761 | | checkstyle | https://builds.apache.org/job/PreCommit-YARN-Build/8049/artifact/patchprocess/diffcheckstylehadoop-yarn-api.txt | | hadoop-yarn-api test log | https://builds.apache.org/job/PreCommit-YARN-Build/8049/artifact/patchprocess/testrun_hadoop-yarn-api.txt | | hadoop-yarn-common test log | https://builds.apache.org/job/PreCommit-YARN-Build/8049/artifact/patchprocess/testrun_hadoop-yarn-common.txt | | Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/8049/testReport/ | | Java | 1.7.0_55 | | uname | Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/8049/console | This message was automatically generated. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch, YARN-3244.3.patch, YARN-3244.4.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544646#comment-14544646 ] Hadoop QA commented on YARN-3244: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | pre-patch | 14m 31s | Pre-patch trunk compilation is healthy. | | {color:green}+1{color} | @author | 0m 0s | The patch does not contain any @author tags. | | {color:green}+1{color} | tests included | 0m 0s | The patch appears to include 1 new or modified test files. | | {color:green}+1{color} | javac | 7m 30s | There were no new javac warning messages. | | {color:red}-1{color} | javadoc | 9m 39s | The applied patch generated 3 additional warning messages. | | {color:green}+1{color} | release audit | 0m 23s | The applied patch does not increase the total number of release audit warnings. | | {color:red}-1{color} | checkstyle | 1m 25s | The applied patch generated 8 new checkstyle issues (total was 241, now 249). | | {color:red}-1{color} | whitespace | 0m 0s | The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. | | {color:green}+1{color} | install | 1m 35s | mvn install still works. | | {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with eclipse:eclipse. | | {color:green}+1{color} | findbugs | 2m 46s | The patch does not introduce any new Findbugs (version 2.0.3) warnings. | | {color:green}+1{color} | yarn tests | 0m 22s | Tests passed in hadoop-yarn-api. | | {color:green}+1{color} | yarn tests | 1m 57s | Tests passed in hadoop-yarn-common. | | | | 40m 58s | | \\ \\ || Subsystem || Report/Notes || | Patch URL | http://issues.apache.org/jira/secure/attachment/12732989/YARN-3244.3.patch | | Optional Tests | javadoc javac unit findbugs checkstyle | | git revision | trunk / 53fe4ef | | javadoc | https://builds.apache.org/job/PreCommit-YARN-Build/7944/artifact/patchprocess/diffJavadocWarnings.txt | | checkstyle | https://builds.apache.org/job/PreCommit-YARN-Build/7944/artifact/patchprocess/diffcheckstylehadoop-yarn-api.txt | | whitespace | https://builds.apache.org/job/PreCommit-YARN-Build/7944/artifact/patchprocess/whitespace.txt | | hadoop-yarn-api test log | https://builds.apache.org/job/PreCommit-YARN-Build/7944/artifact/patchprocess/testrun_hadoop-yarn-api.txt | | hadoop-yarn-common test log | https://builds.apache.org/job/PreCommit-YARN-Build/7944/artifact/patchprocess/testrun_hadoop-yarn-common.txt | | Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/7944/testReport/ | | Java | 1.7.0_55 | | uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/7944/console | This message was automatically generated. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch, YARN-3244.3.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377175#comment-14377175 ] Hadoop QA commented on YARN-3244: - {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12706802/YARN-3244.2.patch against trunk revision 2c238ae. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7086//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7086//console This message is automatically generated. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377098#comment-14377098 ] Xuan Gong commented on YARN-3244: - Created a new object named CleanupContainer which includes launch-context for cleanup container and maxCleanupContainerAttempts. Also, add two global yarn configurations: RM_CLEAN_UP_CONTAINER_TIMEOUT_MS and RM_CLEAN_UP_CONTAINER_MAX_ATTEMPTS Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch, YARN-3244.2.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3244) Add user specified information for clean-up container in ApplicationSubmissionContext
[ https://issues.apache.org/jira/browse/YARN-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334455#comment-14334455 ] Hadoop QA commented on YARN-3244: - {color:green}+1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12700342/YARN-3244.1.patch against trunk revision 1dba572. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new or modified test files. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 2.0.3) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common. Test results: https://builds.apache.org/job/PreCommit-YARN-Build/6706//testReport/ Console output: https://builds.apache.org/job/PreCommit-YARN-Build/6706//console This message is automatically generated. Add user specified information for clean-up container in ApplicationSubmissionContext - Key: YARN-3244 URL: https://issues.apache.org/jira/browse/YARN-3244 Project: Hadoop YARN Issue Type: Sub-task Components: api Reporter: Xuan Gong Assignee: Xuan Gong Attachments: YARN-3244.1.patch To launch user-specified clean up container, users need to provide proper informations to YARN. It should at least have following properties: * A flag to indicate whether needs to launch the clean-up container * A time-out period to indicate how long the clean-up container can run * maxRetry times * containerLaunchContext for clean-up container -- This message was sent by Atlassian JIRA (v6.3.4#6332)