[jira] [Updated] (YARN-6952) Enable scheduling monitor in FS

2017-08-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6952: --- Attachment: YARN-6952.branch-2.001.patch > Enable scheduling monitor in FS > --- >

[jira] [Commented] (YARN-7002) branch-2 build is broken by AllocationFileLoaderService.java

2017-08-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124470#comment-16124470 ] John Zhuge commented on YARN-7002: -- Thanks for the quick fix [~templedf]. > branch-2 build is broken by

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124460#comment-16124460 ] Hadoop QA commented on YARN-6903: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-7002) branch-2 build is broken by AllocationFileLoaderService.java

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-7002. Resolution: Fixed Hadoop Flags: Reviewed I reverted the offending commit. > branch-2

[jira] [Assigned] (YARN-7002) branch-2 build is broken by AllocationFileLoaderService.java

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7002: -- Assignee: Daniel Templeton > branch-2 build is broken by

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124434#comment-16124434 ] Daniel Templeton commented on YARN-6882: Reverted from branch-2. It was breaking the build. >

[jira] [Updated] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6882: --- Fix Version/s: (was: 2.9.0) > AllocationFileLoaderService.reloadAllocations() should use

[jira] [Created] (YARN-7002) branch-2 build is broken by AllocationFileLoaderService.java

2017-08-11 Thread John Zhuge (JIRA)
John Zhuge created YARN-7002: Summary: branch-2 build is broken by AllocationFileLoaderService.java Key: YARN-7002 URL: https://issues.apache.org/jira/browse/YARN-7002 Project: Hadoop YARN

[jira] [Commented] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124422#comment-16124422 ] Hadoop QA commented on YARN-5328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-006.patch Missing dependency. > ZooKeeper based implementation of the

[jira] [Created] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-08-11 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7001: Summary: If shared cache upload is terminated in the middle, the temp file will never be deleted Key: YARN-7001 URL: https://issues.apache.org/jira/browse/YARN-7001

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124388#comment-16124388 ] Subru Krishnan commented on YARN-6840: -- [~jonathan_huang]/[~leftnoteasy], I committed HADOOP-14741 as

[jira] [Updated] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Attachment: YARN-5328-v8.patch Fixing checkstyle, javadoc warnings and test failure. Unfortunately

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124381#comment-16124381 ] Hadoop QA commented on YARN-6620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124377#comment-16124377 ] Hadoop QA commented on YARN-6900: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124369#comment-16124369 ] Hadoop QA commented on YARN-6594: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-08-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124360#comment-16124360 ] Carlo Curino commented on YARN-6687: I committed this to trunk. The patch applies cleanly to branch-2,

[jira] [Resolved] (YARN-1038) LocalizationProtocolPBClientImpl RPC failing

2017-08-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved YARN-1038. --- Resolution: Cannot Reproduce trunk branch no longer has this problem. [~tucu00] if you can repro with the

[jira] [Created] (YARN-7000) NMClient and NMClientAsync API is not compatible with work-preserving AM restart

2017-08-11 Thread Vlad Rozov (JIRA)
Vlad Rozov created YARN-7000: Summary: NMClient and NMClientAsync API is not compatible with work-preserving AM restart Key: YARN-7000 URL: https://issues.apache.org/jira/browse/YARN-7000 Project: Hadoop

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124354#comment-16124354 ] Karthik Kambatla commented on YARN-6964: Thanks for looking into these, Daniel. Comments on the

[jira] [Comment Edited] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124354#comment-16124354 ] Karthik Kambatla edited comment on YARN-6964 at 8/12/17 12:36 AM: -- Thanks

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124353#comment-16124353 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6999) Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

2017-08-11 Thread Linlin Zhou (JIRA)
Linlin Zhou created YARN-6999: - Summary: Add log about how to solve Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster Key: YARN-6999 URL:

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124336#comment-16124336 ] Hudson commented on YARN-6687: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12173 (See

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124327#comment-16124327 ] Yufei Gu commented on YARN-6882: This seems break branch-2. {code} [ERROR] Failed to execute goal

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-005.patch Tackling the comments from Subramanian. > ZooKeeper based

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124317#comment-16124317 ] Wangda Tan commented on YARN-6594: -- [~jianhe]/[~kkaranasos]/[~asuresh], I just checked the latest patch,

[jira] [Updated] (YARN-6903) Yarn-native-service framework core rewrite

2017-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6903: -- Attachment: YARN-6903.yarn-native-services.08.patch > Yarn-native-service framework core rewrite >

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124314#comment-16124314 ] Daniel Templeton commented on YARN-2098: You can assign it to me if you want, or you're welcome to

[jira] [Commented] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124311#comment-16124311 ] Wangda Tan commented on YARN-6892: -- [~sunilg], Could you check following two warnings: {code} [ERROR]

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2017-08-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124307#comment-16124307 ] Wei Yan commented on YARN-2098: --- Thanks for the reminder, [~sunilg]. Sorry I forgot some old jiras. To align

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-08-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124305#comment-16124305 ] Carlo Curino commented on YARN-6687: Thanks [~subru] the patch looks good to me. Per our offline

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: YARN-6620.003.patch Attached ver.3 patch, fixed findbug warnings, etc. > [YARN-6223] NM Java

[jira] [Updated] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-2162: --- Summary: add ability in Fair Scheduler to optionally configure maxResources in terms of percentage (was: Fair

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124298#comment-16124298 ] Sean Busbey commented on YARN-6996: --- +1 (non-binding) on patch as-is then. > Change javax.cache library

[jira] [Commented] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

2017-08-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124297#comment-16124297 ] ASF GitHub Bot commented on YARN-2162: -- GitHub user flyrain opened a pull request:

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124279#comment-16124279 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4325) Nodemanager log handlers fail to send finished/failed events in some cases

2017-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124276#comment-16124276 ] Junping Du commented on YARN-4325: -- [~mingma] said they hit similar issue in Twitter as well. We may need

[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-08-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124273#comment-16124273 ] Haibo Chen commented on YARN-6466: -- Thanks [~sjlee0] for the pointer! I will take a look at it in more

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124261#comment-16124261 ] Carlo Curino commented on YARN-6896: Thanks [~giovanni.fumarola] for the contribution. I committed this

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124252#comment-16124252 ] Hudson commented on YARN-6896: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12172 (See

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124248#comment-16124248 ] Hadoop QA commented on YARN-6704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124219#comment-16124219 ] Subru Krishnan commented on YARN-6900: -- Thanks [~elgoiri] for rebasing the patch. The latest ver is

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.YARN-3926.005.patch Corrected the compiler errors. > Update fair

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124207#comment-16124207 ] Hudson commented on YARN-6882: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12171 (See

[jira] [Comment Edited] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124199#comment-16124199 ] Subru Krishnan edited comment on YARN-6996 at 8/11/17 10:27 PM: [~busbey],

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124199#comment-16124199 ] Subru Krishnan commented on YARN-6996: -- [~busbey], thanks for validating the fix. Like I mentioned

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124198#comment-16124198 ] Hadoop QA commented on YARN-6995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5816) TestDelegationTokenRenewer#testCancelWithMultipleAppSubmissions is still flakey

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124193#comment-16124193 ] Ray Chiang commented on YARN-5816: -- [~ajithshetty] or [~bibinchundatt], can we get this done in time for

[jira] [Comment Edited] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124179#comment-16124179 ] Subru Krishnan edited comment on YARN-6996 at 8/11/17 10:17 PM: Thanks

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124188#comment-16124188 ] Hadoop QA commented on YARN-6900: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124179#comment-16124179 ] Subru Krishnan commented on YARN-6996: -- Thanks [~rchiang] for bringing this up. We had looked at jsr

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-08-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6704: --- Attachment: YARN-6704.v4.patch > Add Federation Interceptor restart when work preserving NM is enabled

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124170#comment-16124170 ] Hadoop QA commented on YARN-5146: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6952) Enable scheduling monitor in FS

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124166#comment-16124166 ] Hudson commented on YARN-6952: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12170 (See

[jira] [Commented] (YARN-6967) Limit application attempt's diagnostic message size thoroughly

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124168#comment-16124168 ] Hudson commented on YARN-6967: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12170 (See

[jira] [Commented] (YARN-6884) AllocationFileLoaderService.loadQueue() has an if without braces

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124167#comment-16124167 ] Hudson commented on YARN-6884: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12170 (See

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124162#comment-16124162 ] Ray Chiang commented on YARN-6996: -- Compiling works. Unit test that tests the class that uses the jcache

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124152#comment-16124152 ] Hadoop QA commented on YARN-6996: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124147#comment-16124147 ] Sean Busbey commented on YARN-6996: --- patch looks reasonable, presuming compiling works. is there no

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124146#comment-16124146 ] Daniel Templeton commented on YARN-6882: Those are known flakey tests. >

[jira] [Commented] (YARN-6885) AllocationFileLoaderService.loadQueue() should use a switch statement in the main tag parsing loop instead of the if/else-if/...

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124144#comment-16124144 ] Daniel Templeton commented on YARN-6885: bq. About the comment 4 and 5, I tried the treat these two

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124130#comment-16124130 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-08-11 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-5146: --- Attachment: YARN-5146.005.patch [~sunilg] Attached a patch that resolves this issue >

[jira] [Created] (YARN-6998) Dead code in SCMAdmin

2017-08-11 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6998: Summary: Dead code in SCMAdmin Key: YARN-6998 URL: https://issues.apache.org/jira/browse/YARN-6998 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-6997) org.apache.hadoop.yarn.client.SCMAdmin wrong package name

2017-08-11 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6997: Summary: org.apache.hadoop.yarn.client.SCMAdmin wrong package name Key: YARN-6997 URL: https://issues.apache.org/jira/browse/YARN-6997 Project: Hadoop YARN

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124115#comment-16124115 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6967) Limit application attempt's diagnostic message size thoroughly

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124108#comment-16124108 ] Daniel Templeton commented on YARN-6967: OK, LGTM +1 > Limit application attempt's diagnostic

[jira] [Updated] (YARN-6884) AllocationFileLoaderService.loadQueue() has an if without braces

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6884: --- Affects Version/s: 2.8.1 > AllocationFileLoaderService.loadQueue() has an if without braces >

[jira] [Commented] (YARN-6466) Provide shaded framework jar for containers

2017-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124097#comment-16124097 ] Sangjin Lee commented on YARN-6466: --- [~haibochen], I see you reassigned this to yourself. Let's resurrect

[jira] [Commented] (YARN-6884) AllocationFileLoaderService.loadQueue() has an if without braces

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124093#comment-16124093 ] Daniel Templeton commented on YARN-6884: LGTM +1 > AllocationFileLoaderService.loadQueue() has an

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-004.patch Rebased after HADOOP-14741 got into trunk. > ZooKeeper based

[jira] [Comment Edited] (YARN-6881) LOG is unused in AllocationConfiguration

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124080#comment-16124080 ] Daniel Templeton edited comment on YARN-6881 at 8/11/17 9:16 PM: - Thanks,

[jira] [Commented] (YARN-6881) LOG is unused in AllocationConfiguration

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124080#comment-16124080 ] Daniel Templeton commented on YARN-6881: LGTM +1 > LOG is unused in AllocationConfiguration >

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6995: --- Attachment: YARN-6995.YARN-3926.002.patch Cleanup up unused imports. > Improve use of

[jira] [Commented] (YARN-6956) preemption may only consider resource requests for one node

2017-08-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124069#comment-16124069 ] Karthik Kambatla commented on YARN-6956: bq. If so, how do we avoid preempting small amounts at a

[jira] [Updated] (YARN-6952) Enable scheduling monitor in FS

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6952: --- Affects Version/s: 3.0.0-alpha4 > Enable scheduling monitor in FS >

[jira] [Commented] (YARN-6935) ResourceProfilesManagerImpl.parseResource() has no need of the key parameter

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124054#comment-16124054 ] Daniel Templeton commented on YARN-6935: LGTM +1 > ResourceProfilesManagerImpl.parseResource() has

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124050#comment-16124050 ] Hadoop QA commented on YARN-6896: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124048#comment-16124048 ] Daniel Templeton commented on YARN-6953: I think the WIP is still much more complicated than it

[jira] [Commented] (YARN-6996) Discuss license issue with javax.cache library

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124047#comment-16124047 ] Ray Chiang commented on YARN-6996: -- [~subru], let me know what you think about this change. > Discuss

[jira] [Updated] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6996: - Summary: Change javax.cache library implementation from JSR107 to Apache Geronimo (was: Discuss license

[jira] [Updated] (YARN-6996) Discuss license issue with javax.cache library

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6996: - Attachment: YARN-6996.001.patch Based on a comment from LEGAL-325, trying out a patch that swaps to the

[jira] [Assigned] (YARN-6996) Discuss license issue with javax.cache library

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-6996: Assignee: Ray Chiang > Discuss license issue with javax.cache library >

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-08-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124043#comment-16124043 ] Suma Shivaprasad commented on YARN-6550: Updated patch with unit test failure fix and added

[jira] [Moved] (YARN-6996) Discuss license issue with javax.cache library

2017-08-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang moved HADOOP-14763 to YARN-6996: --- Affects Version/s: (was: 3.0.0-beta1) 3.0.0-beta1

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124041#comment-16124041 ] Wangda Tan commented on YARN-6840: -- [~jhung], HADOOP-14741 is close to be committed, could you check if

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-08-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.006.patch > Capture launch_container.sh logs >

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124032#comment-16124032 ] Hadoop QA commented on YARN-6995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6952) Enable scheduling monitor in FS

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124033#comment-16124033 ] Daniel Templeton commented on YARN-6952: LGTM +1 > Enable scheduling monitor in FS >

[jira] [Commented] (YARN-6994) Remove last uses of Long from resource types code

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124025#comment-16124025 ] Hadoop QA commented on YARN-6994: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124021#comment-16124021 ] Daniel Templeton commented on YARN-2098: It's on my radar. No concrete plans yet, though. > App

[jira] [Commented] (YARN-3610) FairScheduler: Add steady-fair-shares to the REST API documentation

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124013#comment-16124013 ] Daniel Templeton commented on YARN-3610: Looks pretty good. My one comment is that, "The resources

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.YARN-3926.004.patch Here's a new patch that's updated for YARN-6788. I

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123983#comment-16123983 ] Hadoop QA commented on YARN-6972: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6987) Log app attempt during InvalidStateTransition

2017-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123978#comment-16123978 ] Hadoop QA commented on YARN-6987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-08-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6995: --- Attachment: YARN-6995.YARN-3926.001.patch > Improve use of ResourceNotFoundException in

[jira] [Commented] (YARN-5927) BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate

2017-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123934#comment-16123934 ] Hudson commented on YARN-5927: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12168 (See

[jira] [Commented] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-11 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123933#comment-16123933 ] Giovanni Matteo Fumarola commented on YARN-6896: Fixed the checkstyle warning and add a

[jira] [Comment Edited] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs (part 1 - basic execution)

2017-08-11 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123933#comment-16123933 ] Giovanni Matteo Fumarola edited comment on YARN-6896 at 8/11/17 7:52 PM:

  1   2   >