[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480254#comment-16480254 ] Ravi Prakash commented on YARN-5762: Sorry for the extremely late reply Arun. I'm afraid I don't think

[jira] [Commented] (YARN-6378) Negative usedResources memory in CapacityScheduler

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480253#comment-16480253 ] Ravi Prakash commented on YARN-6378: I'm afraid I don't think I'll find the cycles to work on this in

[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480258#comment-16480258 ] genericqa commented on YARN-5762: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-5762: --- Target Version/s: (was: 2.10.0) > Summarize ApplicationNotFoundException in the RM log >

[jira] [Updated] (YARN-6378) Negative usedResources memory in CapacityScheduler

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6378: --- Target Version/s: (was: 2.8.3) > Negative usedResources memory in CapacityScheduler >

[jira] [Commented] (YARN-8291) RMRegistryOperationService don't have limit on AsyncPurge threads

2018-05-18 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480334#comment-16480334 ] Feng Yuan commented on YARN-8291: - Hi, are you sure version 2.7.3? > RMRegistryOperationService don't have

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-18 Thread Hu Ziqian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480217#comment-16480217 ] Hu Ziqian commented on YARN-8232: - Thanks [~leftnoteasy] for reviewing it > RMContainer lost queue name

[jira] [Assigned] (YARN-6378) Negative usedResources memory in CapacityScheduler

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned YARN-6378: -- Assignee: (was: Ravi Prakash) > Negative usedResources memory in CapacityScheduler >

[jira] [Assigned] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2018-05-18 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned YARN-5762: -- Assignee: (was: Ravi Prakash) > Summarize ApplicationNotFoundException in the RM log >

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-18 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480234#comment-16480234 ] Wilfred Spiegelenburg commented on YARN-8191: - The way the return value for

[jira] [Updated] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-18 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8273: -- Attachment: YARN-8273.003.patch > Log aggregation does not warn if HDFS quota in target directory is

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Description: Currently NodeManager uses “cpu.cfs_period_us”, “cpu.cfs_quota_us” and “cpu.shares”

[jira] [Assigned] (YARN-8319) More YARN pages need to honor yarn.resourcemanager.display.per-user-apps

2018-05-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reassigned YARN-8319: Assignee: Sunil Govindan > More YARN pages need to honor

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-18 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.013.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-05-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7494: - Attachment: YARN-7494.008.patch > Add muti node lookup support for better placement >

[jira] [Updated] (YARN-8291) RMRegistryOperationService don't have limit on AsyncPurge threads

2018-05-18 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8291: Affects Version/s: (was: 2.7.3) 3.0.0 > RMRegistryOperationService don't

[jira] [Commented] (YARN-8291) RMRegistryOperationService don't have limit on AsyncPurge threads

2018-05-18 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480424#comment-16480424 ] Prabhu Joseph commented on YARN-8291: - The trunk code is having this issue. >

[jira] [Commented] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480461#comment-16480461 ] genericqa commented on YARN-8273: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8248: - Attachment: YARN-8248-009.patch > Job hangs when a job requests a resource that its queue does not

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-05-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480403#comment-16480403 ] Sunil Govindan commented on YARN-7494: -- Thanks [~cheersyang] and [~leftnoteasy] Attaching latest

[jira] [Updated] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-18 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8273: -- Attachment: (was: YARN-8273.003.patch) > Log aggregation does not warn if HDFS quota in target

[jira] [Updated] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-18 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8273: -- Attachment: YARN-8273.004.patch > Log aggregation does not warn if HDFS quota in target directory is

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480469#comment-16480469 ] Szilard Nemeth commented on YARN-8248: -- Thanks [~haibochen] for your comments! # Thanks, testcase

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480529#comment-16480529 ] Jiandan Yang commented on YARN-8320: - upload design doc v1. Please feel free to let me know your

[jira] [Updated] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8248: - Attachment: YARN-8248-008.patch > Job hangs when a job requests a resource that its queue does not

[jira] [Comment Edited] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480469#comment-16480469 ] Szilard Nemeth edited comment on YARN-8248 at 5/18/18 11:50 AM: Thanks

[jira] [Commented] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480565#comment-16480565 ] genericqa commented on YARN-8273: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Summary: Add support CPU isolation for latency-sensitive (LS) service (was: Add support CPU

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: CPU-isolation-for-latency-sensitive-services-v1.pdf > Add support CPU isolation for

[jira] [Comment Edited] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480469#comment-16480469 ] Szilard Nemeth edited comment on YARN-8248 at 5/18/18 10:31 AM: Thanks

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-18 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480478#comment-16480478 ] Gergo Repas commented on YARN-8191: --- [~wilfreds] Thanks for the review! All your suggestions make sense,

[jira] [Created] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-8320: --- Summary: Add support CPU isolation for latency-sensitive (LS) tasks Key: YARN-8320 URL: https://issues.apache.org/jira/browse/YARN-8320 Project: Hadoop YARN

[jira] [Commented] (YARN-8316) Diagnostic message should improve when yarn service fails to launch due to ATS unavailability

2018-05-18 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480442#comment-16480442 ] Feng Yuan commented on YARN-8316: - ATS fullname is? > Diagnostic message should improve when yarn service

[jira] [Updated] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) tasks

2018-05-18 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8320: Attachment: (was: CPU-isolation-for-latency-sensitive-services-v1.pdf) > Add support CPU

[jira] [Created] (YARN-8328) NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled

2018-05-18 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-8328: - Summary: NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled Key: YARN-8328 URL: https://issues.apache.org/jira/browse/YARN-8328

[jira] [Commented] (YARN-8328) NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled

2018-05-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481478#comment-16481478 ] Jonathan Eagles commented on YARN-8328: --- Attaching a patch that is to be used as discussion and

[jira] [Updated] (YARN-8328) NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled

2018-05-18 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-8328: -- Attachment: YARN-8328.001.patch > NonAggregatingLogHandler needlessly waits upon shutdown if

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480608#comment-16480608 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480689#comment-16480689 ] genericqa commented on YARN-8248: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8190) Yarn NodeManager fails to start and crashing with SIGBUS

2018-05-18 Thread Acharki Mohammed (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480716#comment-16480716 ] Acharki Mohammed commented on YARN-8190: here is the solution, posted by [~qwertymaniac]

[jira] [Commented] (YARN-8259) Revisit liveliness checks for privileged Docker containers

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480830#comment-16480830 ] Eric Badger commented on YARN-8259: --- bq. Root user signal can be too powerful for status check in some

[jira] [Updated] (YARN-8319) More YARN pages need to honor yarn.resourcemanager.display.per-user-apps

2018-05-18 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8319: - Attachment: YARN-8319.001.patch > More YARN pages need to honor

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480684#comment-16480684 ] genericqa commented on YARN-8248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480781#comment-16480781 ] Szilard Nemeth commented on YARN-8248: -- fixed checkstyle issues > Job hangs when a job requests a

[jira] [Updated] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8248: - Attachment: YARN-8248-010.patch > Job hangs when a job requests a resource that its queue does not

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-05-18 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480628#comment-16480628 ] Manikandan R commented on YARN-4606: {quote}If we are planning to move calling

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-18 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480659#comment-16480659 ] Gour Saha commented on YARN-7530: - +1 for this change. [~csingh], I am assuming that after the git moves

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481188#comment-16481188 ] genericqa commented on YARN-8290: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481187#comment-16481187 ] genericqa commented on YARN-8248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8015) Support inter-app placement constraints in AppPlacementAllocator

2018-05-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481199#comment-16481199 ] Wangda Tan commented on YARN-8015: -- Thanks [~cheersyang], in general the patch looks good. I'm only not

[jira] [Commented] (YARN-8321) AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481203#comment-16481203 ] genericqa commented on YARN-8321: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481207#comment-16481207 ] Eric Yang commented on YARN-8108: - cc [~rkanter] and [~tucu00] > RM metrics rest API throws GSSException

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481223#comment-16481223 ] Szilard Nemeth commented on YARN-8248: -- patch 012 fixes 2 failed testcases in FairScheduler > Job

[jira] [Updated] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8248: - Attachment: YARN-8248-012.patch > Job hangs when a job requests a resource that its queue does not

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481175#comment-16481175 ] Eric Badger commented on YARN-7960: --- Attaching patch 002 which uses a boolean to determine whether to

[jira] [Updated] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7960: -- Attachment: YARN-7960.002.patch > Add no-new-privileges flag to docker run >

[jira] [Commented] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481193#comment-16481193 ] Wangda Tan commented on YARN-8290: -- Patch looks good, +1, will commit by tonight.  > Yarn application

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2018-05-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8292: - Attachment: YARN-8292.005.patch > Fix the dominant resource preemption cannot happen when some of the

[jira] [Commented] (YARN-8322) Change log level when there is an IOException when the allocation file is loaded

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481214#comment-16481214 ] genericqa commented on YARN-8322: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481059#comment-16481059 ] Eric Yang commented on YARN-7530: - The pre-commit build failed because it downloaded pre-built binary of

[jira] [Created] (YARN-8323) FairScheduler.allocConf should be declared as volatile

2018-05-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8323: Summary: FairScheduler.allocConf should be declared as volatile Key: YARN-8323 URL: https://issues.apache.org/jira/browse/YARN-8323 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-8323) FairScheduler.allocConf should be declared as volatile

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8323: Assignee: Szilard Nemeth > FairScheduler.allocConf should be declared as volatile >

[jira] [Assigned] (YARN-7449) Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7449: Assignee: Szilard Nemeth > Split up class TestYarnClient to TestYarnClient and

[jira] [Updated] (YARN-8321) AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8321: - Attachment: YARN-8321-001.patch > AllocationFileLoaderService. getAllocationFile() should be

[jira] [Assigned] (YARN-8322) Change log level when there is an IOException when the allocation file is loaded

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8322: Assignee: Szilard Nemeth > Change log level when there is an IOException when the

[jira] [Updated] (YARN-8322) Change log level when there is an IOException when the allocation file is loaded

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8322: - Attachment: YARN-8322-001.patch > Change log level when there is an IOException when the

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480931#comment-16480931 ] Haibo Chen commented on YARN-8248: -- Thanks [~snemeth] for updating the patch! I agree that it's valuable

[jira] [Commented] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480938#comment-16480938 ] Botong Huang commented on YARN-7900: Awesome! Thanks [~asuresh] and [~giovanni.fumarola] for the review

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480943#comment-16480943 ] genericqa commented on YARN-8248: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-18 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480977#comment-16480977 ] Chandni Singh commented on YARN-7530: - [~gsaha] All the unit tests for Service api and service core

[jira] [Created] (YARN-8321) AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest

2018-05-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8321: Summary: AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest Key: YARN-8321 URL: https://issues.apache.org/jira/browse/YARN-8321 Project:

[jira] [Updated] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8248: - Attachment: YARN-8248-011.patch > Job hangs when a job requests a resource that its queue does not

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481009#comment-16481009 ] Haibo Chen commented on YARN-8248: -- +1 pending Jenkins. > Job hangs when a job requests a resource that

[jira] [Commented] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481046#comment-16481046 ] Subru Krishnan commented on YARN-7900: -- [~botong]/[~asuresh], don't we need this in branch-2 as well?

[jira] [Commented] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481051#comment-16481051 ] Arun Suresh commented on YARN-7900: --- [~subru], This code touches some of the changes we made for

[jira] [Assigned] (YARN-8321) AllocationFileLoaderService. getAllocationFile() should be declared as VisibleForTest

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8321: Assignee: Szilard Nemeth > AllocationFileLoaderService. getAllocationFile() should be

[jira] [Commented] (YARN-8319) More YARN pages need to honor yarn.resourcemanager.display.per-user-apps

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480954#comment-16480954 ] genericqa commented on YARN-8319: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8290) Yarn application failed to recover with "Error Launching job : User is not set in the application report" error after RM restart

2018-05-18 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8290: Attachment: YARN-8290.004.patch > Yarn application failed to recover with "Error Launching job : User is not

[jira] [Comment Edited] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481001#comment-16481001 ] Szilard Nemeth edited comment on YARN-8248 at 5/18/18 6:42 PM: --- Thanks

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481001#comment-16481001 ] Szilard Nemeth commented on YARN-8248: -- Thanks [~haibochen] for your comments again! # Indeed, I

[jira] [Commented] (YARN-8320) Add support CPU isolation for latency-sensitive (LS) service

2018-05-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481002#comment-16481002 ] Wangda Tan commented on YARN-8320: -- Thanks [~yangjiandan] This is definitely a very interesting feature

[jira] [Created] (YARN-8322) Change log level when there is an IOException when the allocation file is loaded

2018-05-18 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-8322: Summary: Change log level when there is an IOException when the allocation file is loaded Key: YARN-8322 URL: https://issues.apache.org/jira/browse/YARN-8322 Project: Hadoop

[jira] [Comment Edited] (YARN-8324) Fix TestPrivilegedOperationExecutor.testExecutorPath on Windows

2018-05-18 Thread Xiao Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481269#comment-16481269 ] Xiao Liang edited comment on YARN-8324 at 5/18/18 10:24 PM: How about using

[jira] [Commented] (YARN-8324) Fix TestPrivilegedOperationExecutor.testExecutorPath on Windows

2018-05-18 Thread Xiao Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481269#comment-16481269 ] Xiao Liang commented on YARN-8324: -- How about using org.apache.hadoop.fs.Path#SEPARATOR instead of '/' or

[jira] [Created] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-18 Thread Hsin-Liang Huang (JIRA)
Hsin-Liang Huang created YARN-8326: -- Summary: Yarn 3.0 seems runs slower than Yarn 2.6 Key: YARN-8326 URL: https://issues.apache.org/jira/browse/YARN-8326 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481351#comment-16481351 ] genericqa commented on YARN-8248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

2018-05-18 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8326: -- Environment: This is the yarn-site.xml for 3.0.    hadoop.registry.dns.bind-port 5353

[jira] [Updated] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-18 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8327: --- Component/s: log-aggregation > Fix

[jira] [Updated] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7900: --- Attachment: YARN-7900-branch-2.v9.patch > [AMRMProxy] AMRMClientRelayer for stateful

[jira] [Reopened] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang reopened YARN-7900: added patch for branch-2 > [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor >

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481384#comment-16481384 ] genericqa commented on YARN-7960: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-18 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481385#comment-16481385 ] Chandni Singh commented on YARN-7530: - Thanks [~eyang] for reviewing and committing the patch.

[jira] [Updated] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-18 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8327: -- Description: TestAggregatedLogFormat#testReadAcontainerLogs1 fails on Windows because of the line

[jira] [Commented] (YARN-8248) Job hangs when a job requests a resource that its queue does not have

2018-05-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481414#comment-16481414 ] genericqa commented on YARN-8248: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-18 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481416#comment-16481416 ] Anbang Hu commented on YARN-8327: - Thanks [~giovanni.fumarola] for providing [^YARN-8327.v1.patch]. I think

[jira] [Comment Edited] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-18 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481416#comment-16481416 ] Anbang Hu edited comment on YARN-8327 at 5/19/18 1:54 AM: -- Thanks 

[jira] [Comment Edited] (YARN-8327) Fix TestAggregatedLogFormat#testReadAcontainerLogs1 on Windows

2018-05-18 Thread Anbang Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481416#comment-16481416 ] Anbang Hu edited comment on YARN-8327 at 5/19/18 1:56 AM: -- Thanks 

  1   2   >