[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-07-04 Thread Karthik Kambatla (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14614105#comment-14614105
 ] 

Karthik Kambatla commented on YARN-3860:


bq. That is true only if RM restart is enabled and ZKRMStateStore is used but 
other settings should be cared.
bq. getServiceState is expected to return or fail immediately if the node is 
down.

Do we support other configurations? My only concern is the case when 
getServiceState fails because we can't reach the other node, but the node and 
the RM are actually active. If someone uses rmadmin -transitionToActive, they 
might falsely assume that a split-brain scenario is not possible.

Just to be clear, I agree the patch is benign. I want to make sure we are clear 
on why we are adding it.  

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605508#comment-14605508
 ] 

Hudson commented on YARN-3860:
--

SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #243 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/243/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605517#comment-14605517
 ] 

Hudson commented on YARN-3860:
--

SUCCESS: Integrated in Hadoop-Yarn-trunk #973 (See 
[https://builds.apache.org/job/Hadoop-Yarn-trunk/973/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605673#comment-14605673
 ] 

Hudson commented on YARN-3860:
--

FAILURE: Integrated in Hadoop-Hdfs-trunk #2171 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2171/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605704#comment-14605704
 ] 

Hudson commented on YARN-3860:
--

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #232 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/232/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* hadoop-yarn-project/CHANGES.txt
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605851#comment-14605851
 ] 

Hudson commented on YARN-3860:
--

SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2189 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2189/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605883#comment-14605883
 ] 

Hudson commented on YARN-3860:
--

SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #241 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/241/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Karthik Kambatla (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606588#comment-14606588
 ] 

Karthik Kambatla commented on YARN-3860:


Also, I wonder if this affects the latency of transitioning active by any 
significant amount? [~iwasakims] - any observations here? 

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Karthik Kambatla (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606586#comment-14606586
 ] 

Karthik Kambatla commented on YARN-3860:


I am not convinced we need this.

The only reason we don't want both RMs to be active is to avoid the split-brain 
situation. Today, if both RMs become active, one of them fails to create the 
fencing-node and should automatically transition to standby.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Masatake Iwasaki (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605207#comment-14605207
 ] 

Masatake Iwasaki commented on YARN-3860:


Thanks, [~zxu] and [~djp]!

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Junping Du (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606870#comment-14606870
 ] 

Junping Du commented on YARN-3860:
--

bq. The only reason we don't want both RMs to be active is to avoid the 
split-brain situation. Today, if both RMs become active, one of them fails to 
create the fencing-node and should automatically transition to standby.
Actually, this behavior could confuse user as it sounds like which RM is chosen 
by randomly. The expected behavior here is: if user doesn't specify 
--forceactive which means user may not know other RM get activated now - 
nothing should get updated by YARN and a warning message from CLI get thrown 
out if already another RM in activated state. No?

bq. I wonder if this affects the latency of transitioning active by any 
significant amount.
The only latency to add here is reading a YARN configuration which doesn't 
sounds like a problem for user experience especially we support RM down with 
work preserving.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Masatake Iwasaki (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607191#comment-14607191
 ] 

Masatake Iwasaki commented on YARN-3860:


bq. Today, if both RMs become active, one of them fails to create the 
fencing-node and should automatically transition to standby.

That is true only if RM restart is enabled and ZKRMStateStore is used but other 
settings should be cared. Also users can know failure reason from console 
output such as rmX is already active by the status checking.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-29 Thread Masatake Iwasaki (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607196#comment-14607196
 ] 

Masatake Iwasaki commented on YARN-3860:


bq. I wonder if this affects the latency of transitioning active by any 
significant amount?

I think the time to check state of other nodes is small and not to be problem 
especially when user is doing manual transition. getServiceState is expected to 
return or fail immediately if the node is down. I'll check corner cases but it 
is a bug if getServiceState blocks long time.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-28 Thread Junping Du (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605073#comment-14605073
 ] 

Junping Du commented on YARN-3860:
--

Thanks [~iwasakims] for nice catching and the patch! Latest patch LGTM. 
[~zxu], thanks for review here. I think times(1) is quite useful here as the 
calling times indicate the other nodes loops into consideration. If we have 
rm1, rm2, rm3 in config settings before, here we should get times(2). If you 
agree with it, I will go ahead to commit this patch soon.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-28 Thread zhihai xu (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605108#comment-14605108
 ] 

zhihai xu commented on YARN-3860:
-

yes, it makes sense. Although they are equivalent, it is easier to change from 
times(1) to  times(2) if we have rm1, rm2, rm3 in config settings. 
+1(non-binding) for the latest patch.


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-28 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605131#comment-14605131
 ] 

Hudson commented on YARN-3860:
--

FAILURE: Integrated in Hadoop-trunk-Commit #8082 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/8082/])
YARN-3860. rmadmin -transitionToActive should check the state of non-target 
node. (Contributed by Masatake Iwasaki) (junping_du: rev 
a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
* 
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestRMAdminCLI.java
* hadoop-yarn-project/CHANGES.txt


 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
  Components: resourcemanager
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
 Fix For: 2.8.0

 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604506#comment-14604506
 ] 

Hadoop QA commented on YARN-3860:
-

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m 41s | Pre-patch trunk compilation is 
healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any 
@author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to 
include 1 new or modified test files. |
| {color:green}+1{color} | javac |   7m 33s | There were no new javac warning 
messages. |
| {color:green}+1{color} | javadoc |   9m 35s | There were no new javadoc 
warning messages. |
| {color:green}+1{color} | release audit |   0m 22s | The applied patch does 
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   0m 29s | The applied patch generated  1 
new checkstyle issues (total was 38, now 39). |
| {color:red}-1{color} | whitespace |   0m  0s | The patch has 1  line(s) that 
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install |   1m 34s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 34s | The patch built with 
eclipse:eclipse. |
| {color:green}+1{color} | findbugs |   0m 51s | The patch does not introduce 
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | yarn tests |  19m 52s | Tests failed in 
hadoop-yarn-client. |
| | |  56m 34s | |
\\
\\
|| Reason || Tests ||
| Timed out tests | 
org.apache.hadoop.yarn.client.TestApplicationClientProtocolOnHA |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12742365/YARN-3860.001.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 79ed0f9 |
| checkstyle |  
https://builds.apache.org/job/PreCommit-YARN-Build/8365/artifact/patchprocess/diffcheckstylehadoop-yarn-client.txt
 |
| whitespace | 
https://builds.apache.org/job/PreCommit-YARN-Build/8365/artifact/patchprocess/whitespace.txt
 |
| hadoop-yarn-client test log | 
https://builds.apache.org/job/PreCommit-YARN-Build/8365/artifact/patchprocess/testrun_hadoop-yarn-client.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8365/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | 
https://builds.apache.org/job/PreCommit-YARN-Build/8365/console |


This message was automatically generated.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604531#comment-14604531
 ] 

Hadoop QA commented on YARN-3860:
-

\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m 15s | Pre-patch trunk compilation is 
healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any 
@author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to 
include 1 new or modified test files. |
| {color:green}+1{color} | javac |   7m 31s | There were no new javac warning 
messages. |
| {color:green}+1{color} | javadoc |   9m 35s | There were no new javadoc 
warning messages. |
| {color:green}+1{color} | release audit |   0m 23s | The applied patch does 
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle |   0m 28s | There were no new checkstyle 
issues. |
| {color:green}+1{color} | whitespace |   0m  0s | The patch has no lines that 
end in whitespace. |
| {color:green}+1{color} | install |   1m 34s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 32s | The patch built with 
eclipse:eclipse. |
| {color:green}+1{color} | findbugs |   0m 52s | The patch does not introduce 
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | yarn tests |   6m 55s | Tests passed in 
hadoop-yarn-client. |
| | |  43m  9s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12742371/YARN-3860.003.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 79ed0f9 |
| hadoop-yarn-client test log | 
https://builds.apache.org/job/PreCommit-YARN-Build/8367/artifact/patchprocess/testrun_hadoop-yarn-client.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8367/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | 
https://builds.apache.org/job/PreCommit-YARN-Build/8367/console |


This message was automatically generated.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-27 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604509#comment-14604509
 ] 

Hadoop QA commented on YARN-3860:
-

\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch |  15m 37s | Pre-patch trunk compilation is 
healthy. |
| {color:green}+1{color} | @author |   0m  0s | The patch does not contain any 
@author tags. |
| {color:green}+1{color} | tests included |   0m  0s | The patch appears to 
include 1 new or modified test files. |
| {color:green}+1{color} | javac |   7m 36s | There were no new javac warning 
messages. |
| {color:green}+1{color} | javadoc |   9m 39s | There were no new javadoc 
warning messages. |
| {color:green}+1{color} | release audit |   0m 23s | The applied patch does 
not increase the total number of release audit warnings. |
| {color:red}-1{color} | checkstyle |   0m 30s | The applied patch generated  1 
new checkstyle issues (total was 38, now 39). |
| {color:red}-1{color} | whitespace |   0m  1s | The patch has 1  line(s) that 
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install |   1m 33s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse |   0m 33s | The patch built with 
eclipse:eclipse. |
| {color:green}+1{color} | findbugs |   0m 52s | The patch does not introduce 
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | yarn tests |   6m 55s | Tests passed in 
hadoop-yarn-client. |
| | |  43m 42s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL | 
http://issues.apache.org/jira/secure/attachment/12742367/YARN-3860.002.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 79ed0f9 |
| checkstyle |  
https://builds.apache.org/job/PreCommit-YARN-Build/8366/artifact/patchprocess/diffcheckstylehadoop-yarn-client.txt
 |
| whitespace | 
https://builds.apache.org/job/PreCommit-YARN-Build/8366/artifact/patchprocess/whitespace.txt
 |
| hadoop-yarn-client test log | 
https://builds.apache.org/job/PreCommit-YARN-Build/8366/artifact/patchprocess/testrun_hadoop-yarn-client.txt
 |
| Test Results | 
https://builds.apache.org/job/PreCommit-YARN-Build/8366/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP 
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output | 
https://builds.apache.org/job/PreCommit-YARN-Build/8366/console |


This message was automatically generated.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-27 Thread zhihai xu (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604539#comment-14604539
 ] 

zhihai xu commented on YARN-3860:
-

[~iwasakims], thanks for working on this issue. This looks like a good catch.
One nit: I think times(1) is used by default, Can we just use 
{{verify(haadmin).getServiceStatus();}}? because all other tests didn't have 
times(1) in verify.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
 Attachments: YARN-3860.001.patch, YARN-3860.002.patch, 
 YARN-3860.003.patch


 Users can make both ResouceManagers active by {{rmadmin -transitionToActive}} 
 even if {{\--forceactive}} option is not given. {{haadmin 
 -transitionToActive}} of HDFS checks whether non-target nodes are already 
 active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

2015-06-27 Thread Masatake Iwasaki (JIRA)

[ 
https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604474#comment-14604474
 ] 

Masatake Iwasaki commented on YARN-3860:


HAAdmin#isOtherTargetNodeActive does not checks the other nodes are active 
without overriding HAAdmin#getTargetIds which returns list including only given 
target id. RMAdminCLI should have getTargetIds method which returns list of all 
node ids as DFSHAAdmin do.

 rmadmin -transitionToActive should check the state of non-target node
 -

 Key: YARN-3860
 URL: https://issues.apache.org/jira/browse/YARN-3860
 Project: Hadoop YARN
  Issue Type: Bug
Affects Versions: 2.7.0
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor

 {{haadmin -transitionToActive}} of HDFS checks whether non-target nodes are 
 already active but {{rmadmin -transitionToActive}} does not do.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)