[jira] [Updated] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-2674: Attachment: YARN-2674.4.patch Distributed shell AM may re-launch containers if RM work preserving restart

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574106#comment-14574106 ] Chun Chen commented on YARN-2674: - Upload a patch to fix test failures. Distributed shell

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574177#comment-14574177 ] Hadoop QA commented on YARN-2674: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-2674: Attachment: YARN-2674.5.patch Upload YARN-2674.5.patch to remove unnecessary synchronize. Distributed

[jira] [Created] (YARN-3770) SerializedException should also handle java.land.Error

Lavkesh Lahngir created YARN-3770: - Summary: SerializedException should also handle java.land.Error Key: YARN-3770 URL: https://issues.apache.org/jira/browse/YARN-3770 Project: Hadoop YARN

[jira] [Updated] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3770: -- Summary: SerializedException should also handle java.lang.Error (was: SerializedException

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574402#comment-14574402 ] Hadoop QA commented on YARN-3745: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574228#comment-14574228 ] Rohith commented on YARN-3017: -- bq. Could you give a little more detail about the possibility

[jira] [Commented] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574305#comment-14574305 ] Bibin A Chundatt commented on YARN-3754: [~rohithsharma] and [~sunilg] Have tried

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574388#comment-14574388 ] Hudson commented on YARN-2392: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #949 (See

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574391#comment-14574391 ] Hudson commented on YARN-3733: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #949 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574381#comment-14574381 ] Hudson commented on YARN-3764: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #949 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574386#comment-14574386 ] Hudson commented on YARN-41: SUCCESS: Integrated in Hadoop-Yarn-trunk #949 (See

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574385#comment-14574385 ] Hudson commented on YARN-3766: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #949 (See

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574332#comment-14574332 ] Lavkesh Lahngir commented on YARN-3745: --- deSerialize() method throws class

[jira] [Updated] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3745: -- Attachment: YARN-3745.2.patch SerializedException should also try to instantiate internal

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574350#comment-14574350 ] Hudson commented on YARN-2392: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #219 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574348#comment-14574348 ] Hudson commented on YARN-41: FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #219 (See

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574353#comment-14574353 ] Hudson commented on YARN-3733: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #219 (See

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574347#comment-14574347 ] Hudson commented on YARN-3766: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #219 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574343#comment-14574343 ] Hudson commented on YARN-3764: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #219 (See

[jira] [Commented] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working as expected in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574393#comment-14574393 ] Rohith commented on YARN-3758: -- All these confusion should be solved probably after YARN-2986.

[jira] [Updated] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3770: -- Description: IN SerializedExceptionPBImpl deserialize() method {code} Class classType =

[jira] [Moved] (YARN-3771) final behavior is not honored for YarnConfiguration.DEFAULT_YARN_APPLICATION_CLASSPATH since it is a String[]

[ https://issues.apache.org/jira/browse/YARN-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel moved HDFS-8526 to YARN-3771: --- Key: YARN-3771 (was: HDFS-8526) Project: Hadoop YARN (was: Hadoop HDFS) final

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574421#comment-14574421 ] Lavkesh Lahngir commented on YARN-3745: --- [~zxu] Sorry my bad. It *must* throw

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574263#comment-14574263 ] Hadoop QA commented on YARN-2674: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3771) final behavior is not honored for YarnConfiguration.DEFAULT_YARN_APPLICATION_CLASSPATH since it is a String[]

[ https://issues.apache.org/jira/browse/YARN-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-3771: Attachment: 0001-YARN-3771.patch Attached the patch. Please review final behavior is not honored for

[jira] [Updated] (YARN-3259) FairScheduler: Update to fairShare could be triggered early on node events instead of waiting for update interval

[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3259: Attachment: YARN-3259.003.patch Addressed feedback FairScheduler: Update to fairShare could be

[jira] [Commented] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574439#comment-14574439 ] Hadoop QA commented on YARN-3770: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3772) Let AMs to change the name of the application upon RM registration

Zoltán Zvara created YARN-3772: -- Summary: Let AMs to change the name of the application upon RM registration Key: YARN-3772 URL: https://issues.apache.org/jira/browse/YARN-3772 Project: Hadoop YARN

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574563#comment-14574563 ] Hudson commented on YARN-3764: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2147 (See

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574571#comment-14574571 ] Hudson commented on YARN-2392: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2147 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574569#comment-14574569 ] Hudson commented on YARN-41: SUCCESS: Integrated in Hadoop-Hdfs-trunk #2147 (See

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574567#comment-14574567 ] Hudson commented on YARN-3766: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2147 (See

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574574#comment-14574574 ] Hudson commented on YARN-3733: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2147 (See

[jira] [Updated] (YARN-467) Jobs fail during resource localization when public distributed-cache hits unix directory limits

[ https://issues.apache.org/jira/browse/YARN-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated YARN-467: Attachment: YARN-574.1.patch Jobs fail during resource localization when public distributed-cache hits

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574928#comment-14574928 ] Ashwin Shankar commented on YARN-3453: -- hey folks, Looking into the patch, will get

[jira] [Commented] (YARN-3774) ZKRMStateStore should use Curator 3.0 and avail CuratorOp

[ https://issues.apache.org/jira/browse/YARN-3774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574957#comment-14574957 ] Sean Busbey commented on YARN-3774: --- Please make sure to document the impact of moving to

[jira] [Created] (YARN-3774) ZKRMStateStore should use Curator 3.0 and avail CuratorOp

Karthik Kambatla created YARN-3774: -- Summary: ZKRMStateStore should use Curator 3.0 and avail CuratorOp Key: YARN-3774 URL: https://issues.apache.org/jira/browse/YARN-3774 Project: Hadoop YARN

[jira] [Updated] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated YARN-574: Release Note: YARN-574. Allow parallel download of resources in PrivateLocalizer. Contributed by Zheng Shao.

[jira] [Resolved] (YARN-1502) Protocol changes in RM side to support change container resource

[ https://issues.apache.org/jira/browse/YARN-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-1502. -- Resolution: Duplicate This one is actually duplicated with YARN-1646, protocol changes are already

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574979#comment-14574979 ] Karthik Kambatla commented on YARN-2716: Thanks for the thorough review, Jian.

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575059#comment-14575059 ] Vrushali C commented on YARN-2928: -- Hi [~jamestaylor] Thank you for taking the time to

[jira] [Commented] (YARN-3259) FairScheduler: Trigger fairShare updates on node events

[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574918#comment-14574918 ] Anubhav Dhoot commented on YARN-3259: - Thanks [~kasha] for review and commit!

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575025#comment-14575025 ] Joep Rottinghuis commented on YARN-3706: Oops, I introduced an infinite loop:

[jira] [Updated] (YARN-467) Jobs fail during resource localization when public distributed-cache hits unix directory limits

[ https://issues.apache.org/jira/browse/YARN-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated YARN-467: Attachment: (was: YARN-574.1.patch) Jobs fail during resource localization when public distributed-cache

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574935#comment-14574935 ] Jian He commented on YARN-3508: --- I think this make sense to move preemption events from main

[jira] [Updated] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2716: --- Attachment: yarn-2716-2.patch New patch to address review comments. [~jianhe] - once you are

[jira] [Commented] (YARN-3774) ZKRMStateStore should use Curator 3.0 and avail CuratorOp

[ https://issues.apache.org/jira/browse/YARN-3774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574993#comment-14574993 ] Karthik Kambatla commented on YARN-3774: Fair point, Sean. We should hold off until

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574988#comment-14574988 ] Hadoop QA commented on YARN-574: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574991#comment-14574991 ] James Taylor commented on YARN-2928: Nice writeup, [~vrushalic]. For your benchmarks,

[jira] [Updated] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated YARN-574: Attachment: YARN-574.1.patch PrivateLocalizer does not support parallel resource download via

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574996#comment-14574996 ] Sergey Shelukhin commented on YARN-1462: Patch looks like it won't break Tez AHS

[jira] [Updated] (YARN-3259) FairScheduler: Trigger fairShare updates on node events

[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3259: --- Summary: FairScheduler: Trigger fairShare updates on node events (was: FairScheduler: Update

[jira] [Commented] (YARN-3259) FairScheduler: Trigger fairShare updates on node events

[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574817#comment-14574817 ] Hudson commented on YARN-3259: -- FAILURE: Integrated in Hadoop-trunk-Commit #7976 (See

[jira] [Commented] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574746#comment-14574746 ] Karthik Kambatla commented on YARN-3655: Thanks for the clarifications, Zhihai. The

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574753#comment-14574753 ] Jason Lowe commented on YARN-3508: -- Yes, it's not a cure-all to move the preemption

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574308#comment-14574308 ] Lavkesh Lahngir commented on YARN-3745: --- sorry, typo: we don't need to declare it to

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574306#comment-14574306 ] Lavkesh Lahngir commented on YARN-3745: --- Uh. Yes you are right cls.getConstructor()

[jira] [Updated] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3770: -- Attachment: YARN-3770.patch SerializedException should also handle java.lang.Error

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574652#comment-14574652 ] Hudson commented on YARN-3766: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574648#comment-14574648 ] Hudson commented on YARN-3764: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574655#comment-14574655 ] Hudson commented on YARN-2392: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574658#comment-14574658 ] Hudson commented on YARN-3733: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (YARN-3259) FairScheduler: Update to fairShare could be triggered early on node events instead of waiting for update interval

[ https://issues.apache.org/jira/browse/YARN-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574665#comment-14574665 ] Hadoop QA commented on YARN-3259: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Resolved] (YARN-38) Add an option to drain the ResourceManager of all apps for upgrades

[ https://issues.apache.org/jira/browse/YARN-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-38. -- Resolution: Won't Fix Now that we have work-preserving RM/NM restarts, rolling restarts/upgrades

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575163#comment-14575163 ] Hadoop QA commented on YARN-2716: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575094#comment-14575094 ] Xuan Gong commented on YARN-1462: - Committed into trunk/branch-2. Thanks, zhijie for

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575102#comment-14575102 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-trunk-Commit #7977 (See

[jira] [Updated] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3655: Attachment: YARN-3655.004.patch FairScheduler: potential livelock due to maxAMShare limitation and

[jira] [Updated] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3655: Attachment: YARN-3655.004.patch FairScheduler: potential livelock due to maxAMShare limitation and

[jira] [Updated] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

[ https://issues.apache.org/jira/browse/YARN-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3776: Description: FairScheduler code refactoring, as discussed at YARN-3655, Separate out the code paths for

[jira] [Created] (YARN-3777) Move all reservation-related tests from TestFairScheduler to TestFairSchedulerReservations.

zhihai xu created YARN-3777: --- Summary: Move all reservation-related tests from TestFairScheduler to TestFairSchedulerReservations. Key: YARN-3777 URL: https://issues.apache.org/jira/browse/YARN-3777

[jira] [Updated] (YARN-3777) Move all reservation-related tests from TestFairScheduler to TestFairSchedulerReservations.

[ https://issues.apache.org/jira/browse/YARN-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3777: Component/s: (was: fairscheduler) Move all reservation-related tests from TestFairScheduler to

[jira] [Commented] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575472#comment-14575472 ] zhihai xu commented on YARN-3655: - [~kasha], thanks for the thorough review, I uploaded a

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575395#comment-14575395 ] Jian He commented on YARN-2716: --- bq. safeDelete checks if the znode exists before attempting

[jira] [Updated] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3655: Attachment: (was: YARN-3655.004.patch) FairScheduler: potential livelock due to maxAMShare limitation

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575358#comment-14575358 ] Li Lu commented on YARN-2928: - Hi [~jamestaylor] Thank you very much for your suggestions and

[jira] [Updated] (YARN-3775) Job does not exit after all node become unhealthy

[ https://issues.apache.org/jira/browse/YARN-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengshun Xia updated YARN-3775: Attachment: logs.tar.gz log of resource manager and node manager, /etc/hadoop command output of

[jira] [Updated] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2716: --- Attachment: yarn-2716-3.patch New patch just moves the class members (fields and methods)

[jira] [Updated] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

[ https://issues.apache.org/jira/browse/YARN-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3776: Description: FairScheduler code refactoring to separate out the code paths for assigning a reserved

[jira] [Created] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

zhihai xu created YARN-3776: --- Summary: FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container Key: YARN-3776 URL:

[jira] [Updated] (YARN-3748) Cleanup Findbugs volatile warnings

[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3748: --- Attachment: YARN-3748.5.patch Cleanup Findbugs volatile warnings --

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575406#comment-14575406 ] Karthik Kambatla commented on YARN-2716: bq. removeApplicationStateInternal can

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575435#comment-14575435 ] Sangjin Lee commented on YARN-3706: --- OK, I finally got around to making one pass. These

[jira] [Created] (YARN-3775) Job does not exit after all node become unhealthy

Chengshun Xia created YARN-3775: --- Summary: Job does not exit after all node become unhealthy Key: YARN-3775 URL: https://issues.apache.org/jira/browse/YARN-3775 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575417#comment-14575417 ] Jian He commented on YARN-2716: --- bq. creates and deletes the fencing node as well. I see,

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575519#comment-14575519 ] MENG DING commented on YARN-1197: - Just an update, I am currently working on: YARN-1449,

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.006.patch Added YARN-3726-YARN-2928.006.patch Thanks for

[jira] [Updated] (YARN-3773) hadoop-yarn-server-nodemanager's use of Linux /sbin/tc is non-portable

[ https://issues.apache.org/jira/browse/YARN-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Burlison updated YARN-3773: Summary: hadoop-yarn-server-nodemanager's use of Linux /sbin/tc is non-portable (was:

[jira] [Assigned] (YARN-3724) Native compilation on Solaris fails on Yarn due to use of FTS

[ https://issues.apache.org/jira/browse/YARN-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Burlison reassigned YARN-3724: --- Assignee: Alan Burlison Native compilation on Solaris fails on Yarn due to use of FTS

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574607#comment-14574607 ] Hudson commented on YARN-3733: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #208 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574596#comment-14574596 ] Hudson commented on YARN-3764: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #208 (See

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574604#comment-14574604 ] Hudson commented on YARN-2392: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #208 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574602#comment-14574602 ] Hudson commented on YARN-41: FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #208 (See

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574600#comment-14574600 ] Hudson commented on YARN-3766: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #208 (See

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574627#comment-14574627 ] Hudson commented on YARN-2392: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2165 (See

[jira] [Commented] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574630#comment-14574630 ] Hudson commented on YARN-3733: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2165 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574620#comment-14574620 ] Hudson commented on YARN-3764: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2165 (See