[jira] [Updated] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-17 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Attachment: YARN-3480.10.patch > Recovery may get very slow with lots of services with lots of app-attempts >

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061718#comment-15061718 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-17 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061702#comment-15061702 ] Jun Gong commented on YARN-3480: Thanks! The new patch addresses above problems and add test cases. >

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061750#comment-15061750 ] Hadoop QA commented on YARN-4195: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v1.008.patch Uploading a patch with correcting testcase, whitespace

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061850#comment-15061850 ] Naganarasimha G R commented on YARN-2934: - oops missed this comment had uploaded the latest patch

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061768#comment-15061768 ] Gera Shegalov commented on YARN-2934: - -1 on manual regexes in favor of code reuse. 99.9% of YARN users

[jira] [Commented] (YARN-2083) In fair scheduler, Queue should not been assigned more containers when its usedResource had reach the maxResource limit

2015-12-17 Thread yangcongqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061773#comment-15061773 ] yangcongqi commented on YARN-2083: -- There is a case: queue A maxResource is 1000mb, current usedResource

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061808#comment-15061808 ] Sunil G commented on YARN-4257: --- Looks like the patch is wrong. There are many unwanted changes such as

[jira] [Updated] (YARN-4452) NPE when submit Unmanaged application

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4452: Attachment: YARN-4452-branch-2.6.3.v1.001.patch Uploading the patch based on branch-2.6.3 >

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061805#comment-15061805 ] Naganarasimha G R commented on YARN-2934: - bq. Simple globs I was suggesting already cover even

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061847#comment-15061847 ] Gera Shegalov commented on YARN-2934: - Use RawLocalFileSystem, we don't need the checksumming version:

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-12-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061858#comment-15061858 ] Varun Saxena commented on YARN-3816: bq. Former value can be used to represent how much resources the

[jira] [Updated] (YARN-4454) NM to nodelabel mapping going wrong after RM restart

2015-12-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4454: --- Description: *Nodelabel mapping with NodeManager is going wrong if combination of hostname

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062082#comment-15062082 ] Junping Du commented on YARN-4452: -- Thanks Naga. A correction here is the patch will be commit to 2.6 (for

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-17 Thread Lin Wen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062106#comment-15062106 ] Lin Wen commented on YARN-4452: --- Naga and Junping, Thank you very much! > NPE when submit Unmanaged

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v2.001.patch Thanks for the review comments and opinions

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-12-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062188#comment-15062188 ] Eric Payne commented on YARN-4225: -- Oh, one more thing, [~leftnoteasy]. I ran testpatch in my own build

[jira] [Updated] (YARN-4454) NM to nodelabel mapping going wrong after RM restart

2015-12-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4454: --- Description: *Nodelabel mapping with NodeManager is going wrong if combination of hostname

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: (was: YARN-2934.v2.001.patch) > Improve handling of container's stderr >

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062294#comment-15062294 ] Junping Du commented on YARN-4234: -- Thanks [~xgong] for updating the patch. I just go through the latest

[jira] [Commented] (YARN-4463) Container launch failure when yarn.nodemanager.log-dirs directory path contains space

2015-12-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062262#comment-15062262 ] Bibin A Chundatt commented on YARN-4463: Hi [~rohithsharma] thank you for looking into the issue .

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v2.001.patch > Improve handling of container's stderr >

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-12-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062254#comment-15062254 ] Varun Saxena commented on YARN-3816: [~djp], Regarding using postfix in column qualifier to indicate

[jira] [Updated] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase updated YARN-4257: - Attachment: (was: YARN-4257.patch) > Move scheduler validateConf method to AbstractYarnScheduler and

[jira] [Updated] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase updated YARN-4257: - Attachment: YARN-4257.patch Uploading corrected patch. My apologies for the previous incorrect diff

[jira] [Commented] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2015-12-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062269#comment-15062269 ] Bibin A Chundatt commented on YARN-4465: Hi [~leftnoteasy]/[~sunilg] any thoughts ? The message

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062338#comment-15062338 ] Naganarasimha G R commented on YARN-4452: - Thanks for reviewing and committing the patch [~djp],

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062392#comment-15062392 ] Junping Du commented on YARN-3816: -- Thanks [~varun_saxena] for comments. I don't think we have any

[jira] [Updated] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4304: -- Attachment: 0005-YARN-4304.patch Test case failures were related. Uploading a new patch addressing the same. >

[jira] [Updated] (YARN-4350) TestDistributedShell fails for V2 scenarios

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4350: Summary: TestDistributedShell fails for V2 scenarios (was: TestDistributedShell fails) >

[jira] [Commented] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062416#comment-15062416 ] Naganarasimha G R commented on YARN-4466: - Hi [~djp], I discussed with [~varun_saxena] offline and

[jira] [Commented] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062418#comment-15062418 ] Junping Du commented on YARN-4466: -- Sounds good. Please feel free to assign to yourself if you would like

[jira] [Assigned] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4466: --- Assignee: Naganarasimha G R > ResourceManager should tolerate unexpected exceptions

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062342#comment-15062342 ] Naganarasimha G R commented on YARN-4350: - Hi [~sjlee0] & [~varun_saxena], I tried to check and

[jira] [Commented] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2015-12-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062451#comment-15062451 ] Sunil G commented on YARN-4465: --- [~bibinchundatt] Agree that message is not clear here. However this is a

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062545#comment-15062545 ] Hadoop QA commented on YARN-4257: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4350) TestDistributedShell fails for V2 scenarios

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062493#comment-15062493 ] Hadoop QA commented on YARN-4350: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-12-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062425#comment-15062425 ] Varun Saxena commented on YARN-3816: [~djp], I was actually not talking about Sangjin's comment above.

[jira] [Commented] (YARN-4385) TestDistributedShell times out

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062444#comment-15062444 ] Naganarasimha G R commented on YARN-4385: - Hi [~ozawa], Please confirm if this is reproducible if

[jira] [Commented] (YARN-4463) Container launch failure when yarn.nodemanager.log-dirs directory path contains space

2015-12-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062461#comment-15062461 ] Sunil G commented on YARN-4463: --- I am not very sure how you are planning to fix this. {{%20}} is an option

[jira] [Updated] (YARN-4350) TestDistributedShell fails

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4350: Attachment: YARN-4350-feature-YARN-2928.003.patch > TestDistributedShell fails >

[jira] [Updated] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4466: - Assignee: (was: Naganarasimha G R) > ResourceManager should tolerate unexpected exceptions to happen

[jira] [Comment Edited] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062410#comment-15062410 ] Junping Du edited comment on YARN-4466 at 12/17/15 5:42 PM: Make it

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062435#comment-15062435 ] Naganarasimha G R commented on YARN-2934: - checkstyle is not valid or not induced due to this patch

[jira] [Commented] (YARN-4350) TestDistributedShell fails for V2 scenarios

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062542#comment-15062542 ] Naganarasimha G R commented on YARN-4350: - Hi [~sjlee0] & [~varun_saxena], Same test case failed

[jira] [Updated] (YARN-4350) TestDistributedShell fails

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4350: Attachment: (was: YARN-4350-feature-YARN-2928.003.patch) > TestDistributedShell fails >

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062412#comment-15062412 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062410#comment-15062410 ] Junping Du commented on YARN-4466: -- Make it assignment unless someone volunteer to work on it. >

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-12-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062464#comment-15062464 ] Varun Saxena commented on YARN-3816: Just to elaborate further, the main thing is that if we keep on

[jira] [Created] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-17 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4468: -- Summary: Document the general ReservationSystem functionality, and the REST API Key: YARN-4468 URL: https://issues.apache.org/jira/browse/YARN-4468 Project: Hadoop YARN

[jira] [Updated] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase updated YARN-4257: - Attachment: YARN-4257.patch > Move scheduler validateConf method to AbstractYarnScheduler and make it >

[jira] [Updated] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase updated YARN-4257: - Attachment: (was: YARN-4257.patch) > Move scheduler validateConf method to AbstractYarnScheduler and

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062692#comment-15062692 ] Carlo Curino commented on YARN-1051: [~lars_francke], you can refer to the general tech-report for more

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062558#comment-15062558 ] Rich Haase commented on YARN-4257: -- Reviewing failed tests. > Move scheduler validateConf method to

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062590#comment-15062590 ] Rich Haase commented on YARN-4257: -- I've uploaded a new patch that removes the failing tests for zero MB

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-12-17 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062704#comment-15062704 ] Vinod Kumar Vavilapalli commented on YARN-1856: --- The style warnings are mostly non-fixable,

[jira] [Moved] (YARN-4467) Shell.checkIsBashSupported swallowed an interrupted exception

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang moved HADOOP-12652 to YARN-4467: Assignee: (was: Wei-Chiu Chuang) Component/s: (was:

[jira] [Commented] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2015-12-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062667#comment-15062667 ] Wangda Tan commented on YARN-4465: -- Thanks [~bibinchundatt]/[~sunilg] for looking at this issue. I agree

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062697#comment-15062697 ] Carlo Curino commented on YARN-1051: YARN-2609 also provides an example of how to invoke this from the

[jira] [Updated] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-17 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4428: --- Attachment: YARN-4428.2.patch .2 patch added a unit test for the change in RMAppAttemptImpl. web redirect is

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062959#comment-15062959 ] Hadoop QA commented on YARN-4304: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4467) Shell.checkIsBashSupported swallowed an interrupted exception

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062842#comment-15062842 ] Hadoop QA commented on YARN-4467: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062915#comment-15062915 ] Hadoop QA commented on YARN-4257: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4234: Attachment: YARN-4234.2015-12-17.1.patch > New put APIs in TimelineClient for ats v1.5 >

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062956#comment-15062956 ] Xuan Gong commented on YARN-4234: - Thanks for the review. [~djp]. Attached a new patch to address all your

[jira] [Commented] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062877#comment-15062877 ] Hadoop QA commented on YARN-4360: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-12-17 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062988#comment-15062988 ] Daniel Zhi commented on YARN-914: - AWS EMR (Elastic Map Reduce) implemented graceful decommission of YARN

[jira] [Commented] (YARN-4476) Matcher for complex node label expresions

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063549#comment-15063549 ] Hadoop QA commented on YARN-4476: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4477: -- Attachment: YARN-4477.001.patch > FairScheduler: encounter infinite loop in attemptScheduling >

[jira] [Updated] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4477: -- Attachment: (was: YARN-4477.001.patch) > FairScheduler: encounter infinite loop in attemptScheduling >

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063574#comment-15063574 ] Naganarasimha G R commented on YARN-2934: - Hi [~jira.shegalov], bq. Minor repetition is not big of

[jira] [Commented] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063592#comment-15063592 ] Arun Suresh commented on YARN-4477: --- Good catch [~Tao Jie] and Thanks for the patch !! Is it possible to

[jira] [Updated] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4479: Target Version/s: 2.8.0 > Retrospect app-priority in pendingOrderingPolicy during recovering

[jira] [Assigned] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie reassigned YARN-4477: - Assignee: Tao Jie > FairScheduler: encounter infinite loop in attemptScheduling >

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063619#comment-15063619 ] Sunil G commented on YARN-4479: --- Thanks [~rohithsharma] for raising this. As discussed offline, all running

[jira] [Updated] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4477: -- Attachment: YARN-4477.001.patch > FairScheduler: encounter infinite loop in attemptScheduling >

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-17 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063576#comment-15063576 ] sandflee commented on YARN-4138: {quote} We should not update lastConfirmedResource in this scenario. This

[jira] [Commented] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063577#comment-15063577 ] Tao Jie commented on YARN-4477: --- In the attached patch, add return value for reserve() to figure out whether

[jira] [Created] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-17 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-4479: --- Summary: Retrospect app-priority in pendingOrderingPolicy during recovering applications Key: YARN-4479 URL: https://issues.apache.org/jira/browse/YARN-4479

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2015-12-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063610#comment-15063610 ] Rohith Sharma K S commented on YARN-4479: - Thinking while recovering the applications, previous

[jira] [Updated] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-12-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4393: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4478 >

[jira] [Commented] (YARN-4164) Retrospect update ApplicationPriority API return type

2015-12-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063518#comment-15063518 ] Rohith Sharma K S commented on YARN-4164: - Looking into the HadoopQA result, bq. -1 cc 16m

[jira] [Commented] (YARN-4477) FairScheduler: encounter infinite loop in attemptScheduling

2015-12-17 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063538#comment-15063538 ] Xianyin Xin commented on YARN-4477: --- cc [~asuresh]. > FairScheduler: encounter infinite loop in

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-12-17 Thread Parvez (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063000#comment-15063000 ] Parvez commented on YARN-914: - HI Daniel, Thank you for the reply. Yes AWS released the latest AMI version that

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-12-17 Thread Parvez (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063002#comment-15063002 ] Parvez commented on YARN-914: - HI Daniel, Thank you for the reply. Yes AWS released the latest AMI version that

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063138#comment-15063138 ] Gera Shegalov commented on YARN-2934: - Thanks for the latest patch. good to see the patch lose 3kb,

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-12-17 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063033#comment-15063033 ] Daniel Zhi commented on YARN-914: - Yes. (Another related blog:

[jira] [Updated] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

2015-12-17 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-2575: -- Attachment: YARN-2575.v2.patch Pre test-patch patch. Removes the logic from queue hierarchy and adds

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063118#comment-15063118 ] Hudson commented on YARN-3226: -- FAILURE: Integrated in Hadoop-trunk-Commit #8991 (See

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-12-17 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062997#comment-15062997 ] Daniel Zhi commented on YARN-914: - Maybe you are already aware of this: EMR team has implemented graceful

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-12-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063021#comment-15063021 ] Junping Du commented on YARN-3226: -- +1. Committing patch in. > UI changes for decommissioning node >

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-17 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063066#comment-15063066 ] MENG DING commented on YARN-4138: - Hi, [~jianhe] Thanks for reviewing the code. * I think you are right

[jira] [Commented] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2015-12-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063074#comment-15063074 ] Subru Krishnan commented on YARN-4194: -- [~atumanov], thanks for the patch. I took a look at the patch

[jira] [Commented] (YARN-4340) Add "list" API to reservation system

2015-12-17 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063107#comment-15063107 ] Sean Po commented on YARN-4340: --- I made a comment about the test failures before, but to make it easier to

[jira] [Created] (YARN-4469) yarn application -status should not show a stack trace for an unknown application ID

2015-12-17 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-4469: -- Summary: yarn application -status should not show a stack trace for an unknown application ID Key: YARN-4469 URL: https://issues.apache.org/jira/browse/YARN-4469

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2015-12-17 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061968#comment-15061968 ] KWON BYUNGCHANG commented on YARN-4464: --- I have a question. my cluster is not secure mode.

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061978#comment-15061978 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2083) In fair scheduler, Queue should not been assigned more containers when its usedResource had reach the maxResource limit

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061981#comment-15061981 ] Hadoop QA commented on YARN-2083: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-12-17 Thread Alexey Tumanov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Tumanov updated YARN-4198: - Attachment: YARN-4198-v1.patch Please find attached the patch that relaxes some of the

  1   2   >