[jira] [Assigned] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned HDFS-6103: --- Assignee: Akira AJISAKA FSImage file system image version check throw a (slightly) wrong parameter. --- Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 2.2.0 Reporter: jun aoki Assignee: Akira AJISAKA Priority: Trivial Trivial error message issue: When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start namenode with upgrade option. e.g. {code} sudo service namenode upgrade {code} That said, the actual error while without the option said -upgrade (with a hyphen) {code} 2014-03-13 23:38:15,488 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join java.io.IOException: File system image contains an old layout version -40. An upgrade to version -47 is required. Please restart NameNode with -upgrade option. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320) 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202 / ~ {code} I'm referring to 2.0.5 above, https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225 I haven't tried the trunk but it seems to return UPGRADE (all upper case) which again anther slightly wrong error description. https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6103: Attachment: HDFS-6103.patch Attaching a patch. FSImage file system image version check throw a (slightly) wrong parameter. --- Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 2.2.0 Reporter: jun aoki Assignee: Akira AJISAKA Priority: Trivial Attachments: HDFS-6103.patch Trivial error message issue: When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start namenode with upgrade option. e.g. {code} sudo service namenode upgrade {code} That said, the actual error while without the option said -upgrade (with a hyphen) {code} 2014-03-13 23:38:15,488 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join java.io.IOException: File system image contains an old layout version -40. An upgrade to version -47 is required. Please restart NameNode with -upgrade option. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320) 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202 / ~ {code} I'm referring to 2.0.5 above, https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225 I haven't tried the trunk but it seems to return UPGRADE (all upper case) which again anther slightly wrong error description. https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6103: Labels: newbie (was: ) Target Version/s: 2.4.0 Affects Version/s: (was: 2.2.0) 2.4.0 3.0.0 Status: Patch Available (was: Open) FSImage file system image version check throw a (slightly) wrong parameter. --- Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.0.0, 2.4.0 Reporter: jun aoki Assignee: Akira AJISAKA Priority: Trivial Labels: newbie Attachments: HDFS-6103.patch Trivial error message issue: When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start namenode with upgrade option. e.g. {code} sudo service namenode upgrade {code} That said, the actual error while without the option said -upgrade (with a hyphen) {code} 2014-03-13 23:38:15,488 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join java.io.IOException: File system image contains an old layout version -40. An upgrade to version -47 is required. Please restart NameNode with -upgrade option. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320) 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202 / ~ {code} I'm referring to 2.0.5 above, https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225 I haven't tried the trunk but it seems to return UPGRADE (all upper case) which again anther slightly wrong error description. https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937090#comment-13937090 ] Hadoop QA commented on HDFS-6103: - {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634963/HDFS-6103.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-hdfs-project/hadoop-hdfs. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6410//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6410//console This message is automatically generated. FSImage file system image version check throw a (slightly) wrong parameter. --- Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.0.0, 2.4.0 Reporter: jun aoki Assignee: Akira AJISAKA Priority: Trivial Labels: newbie Attachments: HDFS-6103.patch Trivial error message issue: When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start namenode with upgrade option. e.g. {code} sudo service namenode upgrade {code} That said, the actual error while without the option said -upgrade (with a hyphen) {code} 2014-03-13 23:38:15,488 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join java.io.IOException: File system image contains an old layout version -40. An upgrade to version -47 is required. Please restart NameNode with -upgrade option. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320) 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202 / ~ {code} I'm referring to 2.0.5 above, https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225 I haven't tried the trunk but it seems to return UPGRADE (all upper case) which again anther slightly wrong error description. https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937133#comment-13937133 ] Vinayakumar B commented on HDFS-6103: - As said in earlier comment, service scripts are not provided by Apache Hadoop, using -upgrade is the preferred way. So attached patch fixes the error message. +1 for the patch. FSImage file system image version check throw a (slightly) wrong parameter. --- Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.0.0, 2.4.0 Reporter: jun aoki Assignee: Akira AJISAKA Priority: Trivial Labels: newbie Attachments: HDFS-6103.patch Trivial error message issue: When upgrading hdfs, say from 2.0.5 to 2.2.0, users will need to start namenode with upgrade option. e.g. {code} sudo service namenode upgrade {code} That said, the actual error while without the option said -upgrade (with a hyphen) {code} 2014-03-13 23:38:15,488 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join java.io.IOException: File system image contains an old layout version -40. An upgrade to version -47 is required. Please restart NameNode with -upgrade option. at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:221) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568) at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:684) at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:669) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320) 2014-03-13 23:38:15,492 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1 2014-03-13 23:38:15,493 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down NameNode at nn1/192.168.2.202 / ~ {code} I'm referring to 2.0.5 above, https://github.com/apache/hadoop-common/blob/branch-2.0.5/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L225 I haven't tried the trunk but it seems to return UPGRADE (all upper case) which again anther slightly wrong error description. https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImage.java#L232 -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (HDFS-6082) List all NNs with state
[ https://issues.apache.org/jira/browse/HDFS-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated HDFS-6082: Priority: Minor (was: Major) List all NNs with state --- Key: HDFS-6082 URL: https://issues.apache.org/jira/browse/HDFS-6082 Project: Hadoop HDFS Issue Type: Improvement Components: ha, namenode Reporter: Rafal Wojdyla Priority: Minor HAAdmin let's you determine state of *given* service. It would be nice to have a call to determine states of all Namenodes (services?), something like: hdfs haadmin -ns foobar -getServicesState And the output would be: hostname | state This can be implemented at HAAdmin level - for all HA services or at DFSHAAdmin level - for Namenode HA only. -- This message was sent by Atlassian JIRA (v6.2#6252)