[jira] [Assigned] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-16 Thread Akira AJISAKA (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira AJISAKA reassigned HDFS-6103:
---

Assignee: Akira AJISAKA

 FSImage file system image version check throw a (slightly) wrong parameter.
 ---

 Key: HDFS-6103
 URL: https://issues.apache.org/jira/browse/HDFS-6103
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 2.2.0
Reporter: jun aoki
Assignee: Akira AJISAKA
Priority: Trivial

 Trivial error message issue:
 When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start 
 namenode with upgrade option.
 e.g. 
 {code}
 sudo service namenode upgrade
 {code}
 That said, the actual error while without the option said -upgrade (with a 
 hyphen) 
 {code}
 2014-03-13 23:38:15,488 FATAL 
 org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
 java.io.IOException:
 File system image contains an old layout version -40.
 An upgrade to version -47 is required.
 Please restart NameNode with -upgrade option.
 at 
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
 status 1
 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
 SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202
 /
 ~
 {code}
 I'm referring to 2.0.5 above, 
 https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225
 I haven't tried the trunk but it seems to return UPGRADE (all upper case) 
 which again anther slightly wrong error description.
 https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-16 Thread Akira AJISAKA (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira AJISAKA updated HDFS-6103:


Attachment: HDFS-6103.patch

Attaching a patch.

 FSImage file system image version check throw a (slightly) wrong parameter.
 ---

 Key: HDFS-6103
 URL: https://issues.apache.org/jira/browse/HDFS-6103
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 2.2.0
Reporter: jun aoki
Assignee: Akira AJISAKA
Priority: Trivial
 Attachments: HDFS-6103.patch


 Trivial error message issue:
 When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start 
 namenode with upgrade option.
 e.g. 
 {code}
 sudo service namenode upgrade
 {code}
 That said, the actual error while without the option said -upgrade (with a 
 hyphen) 
 {code}
 2014-03-13 23:38:15,488 FATAL 
 org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
 java.io.IOException:
 File system image contains an old layout version -40.
 An upgrade to version -47 is required.
 Please restart NameNode with -upgrade option.
 at 
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
 status 1
 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
 SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202
 /
 ~
 {code}
 I'm referring to 2.0.5 above, 
 https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225
 I haven't tried the trunk but it seems to return UPGRADE (all upper case) 
 which again anther slightly wrong error description.
 https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-16 Thread Akira AJISAKA (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Akira AJISAKA updated HDFS-6103:


   Labels: newbie  (was: )
 Target Version/s: 2.4.0
Affects Version/s: (was: 2.2.0)
   2.4.0
   3.0.0
   Status: Patch Available  (was: Open)

 FSImage file system image version check throw a (slightly) wrong parameter.
 ---

 Key: HDFS-6103
 URL: https://issues.apache.org/jira/browse/HDFS-6103
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 3.0.0, 2.4.0
Reporter: jun aoki
Assignee: Akira AJISAKA
Priority: Trivial
  Labels: newbie
 Attachments: HDFS-6103.patch


 Trivial error message issue:
 When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start 
 namenode with upgrade option.
 e.g. 
 {code}
 sudo service namenode upgrade
 {code}
 That said, the actual error while without the option said -upgrade (with a 
 hyphen) 
 {code}
 2014-03-13 23:38:15,488 FATAL 
 org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
 java.io.IOException:
 File system image contains an old layout version -40.
 An upgrade to version -47 is required.
 Please restart NameNode with -upgrade option.
 at 
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
 status 1
 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
 SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202
 /
 ~
 {code}
 I'm referring to 2.0.5 above, 
 https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225
 I haven't tried the trunk but it seems to return UPGRADE (all upper case) 
 which again anther slightly wrong error description.
 https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-16 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937090#comment-13937090
 ] 

Hadoop QA commented on HDFS-6103:
-

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12634963/HDFS-6103.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-hdfs-project/hadoop-hdfs.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-HDFS-Build/6410//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6410//console

This message is automatically generated.

 FSImage file system image version check throw a (slightly) wrong parameter.
 ---

 Key: HDFS-6103
 URL: https://issues.apache.org/jira/browse/HDFS-6103
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 3.0.0, 2.4.0
Reporter: jun aoki
Assignee: Akira AJISAKA
Priority: Trivial
  Labels: newbie
 Attachments: HDFS-6103.patch


 Trivial error message issue:
 When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start 
 namenode with upgrade option.
 e.g. 
 {code}
 sudo service namenode upgrade
 {code}
 That said, the actual error while without the option said -upgrade (with a 
 hyphen) 
 {code}
 2014-03-13 23:38:15,488 FATAL 
 org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
 java.io.IOException:
 File system image contains an old layout version -40.
 An upgrade to version -47 is required.
 Please restart NameNode with -upgrade option.
 at 
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
 status 1
 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
 SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202
 /
 ~
 {code}
 I'm referring to 2.0.5 above, 
 https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225
 I haven't tried the trunk but it seems to return UPGRADE (all upper case) 
 which again anther slightly wrong error description.
 https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Commented] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-16 Thread Vinayakumar B (JIRA)

[ 
https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937133#comment-13937133
 ] 

Vinayakumar B commented on HDFS-6103:
-

As said in earlier comment, service scripts are not provided by Apache Hadoop, 
using -upgrade is the preferred way.

So attached patch fixes the error message.
+1 for the patch.

 FSImage file system image version check throw a (slightly) wrong parameter.
 ---

 Key: HDFS-6103
 URL: https://issues.apache.org/jira/browse/HDFS-6103
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 3.0.0, 2.4.0
Reporter: jun aoki
Assignee: Akira AJISAKA
Priority: Trivial
  Labels: newbie
 Attachments: HDFS-6103.patch


 Trivial error message issue:
 When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start 
 namenode with upgrade option.
 e.g. 
 {code}
 sudo service namenode upgrade
 {code}
 That said, the actual error while without the option said -upgrade (with a 
 hyphen) 
 {code}
 2014-03-13 23:38:15,488 FATAL 
 org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
 java.io.IOException:
 File system image contains an old layout version -40.
 An upgrade to version -47 is required.
 Please restart NameNode with -upgrade option.
 at 
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)
 at 
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)
 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
 status 1
 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
 SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202
 /
 ~
 {code}
 I'm referring to 2.0.5 above, 
 https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225
 I haven't tried the trunk but it seems to return UPGRADE (all upper case) 
 which again anther slightly wrong error description.
 https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Updated] (HDFS-6082) List all NNs with state

2014-03-16 Thread Rafal Wojdyla (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rafal Wojdyla updated HDFS-6082:


Priority: Minor  (was: Major)

 List all NNs with state
 ---

 Key: HDFS-6082
 URL: https://issues.apache.org/jira/browse/HDFS-6082
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: ha, namenode
Reporter: Rafal Wojdyla
Priority: Minor

 HAAdmin let's you determine state of *given* service. It would be nice to 
 have a call to determine states of all Namenodes (services?), something like:
 hdfs haadmin -ns foobar -getServicesState
 And the output would be:
 hostname | state
 This can be implemented at HAAdmin level - for all HA services or at 
 DFSHAAdmin level - for Namenode HA only.



--
This message was sent by Atlassian JIRA
(v6.2#6252)