[ http://issues.apache.org/jira/browse/HADOOP-807?page=comments#action_12457015 ] dhruba borthakur commented on HADOOP-807: -----------------------------------------
I think the fsimage version and the datanode-storage-version are unrelated to one another. Thus a compatibility matrix does not arise. The namenode need not care what format the datanode is storing its data. The namenode cares about the fsimage version and the Datanode protocol version. Similarly, the datanode cares about the datanode-storage-version and the Datanode protocol version. The compatibility question arises *only* if the DatanodeProtocol changes. But I agree with you that if we say that all cluster nodes have to be upgraded at the same time, then we can live with a single data format version for both namenodes and datanodes. > splitting DFS version number > ---------------------------- > > Key: HADOOP-807 > URL: http://issues.apache.org/jira/browse/HADOOP-807 > Project: Hadoop > Issue Type: Bug > Components: dfs > Reporter: dhruba borthakur > Assigned To: dhruba borthakur > > In the current code, there is a enum named DFS_CURRENT_VERSION. It is being > used for three different purposes: > 1. It is stored in the fsimage and represents the format of the fsimage. > 2. It is stored in the "storage" file by the Datanodes. Thus, it represents > the format of data on Datanodes. > 3. It is used as a version of the Datanode Protocol. > The current implementation makes it difficult to change the fsimage format > without affecting the Datanode Protocol. My proposal is to introduce three > new constants, one for each of the functionality described above. > In the current code, we have: > public static final int DFS_CURRENT_VERSION = -3; > Instead, we can have: > public static final int DFS_FSIMAGE_CURRENT_VERSION = -3; > public static final int DFS_DATANODEPROTOCOL_CURRENT_VERSION = -3; > public static final int DFS_DATASTORAGE_CURRENT_VERSION = -3; > The first one is associated with the format of the fsimage/edits; the second > one is associated with the communication procotol between the namenode and > the datanode; the third one is associated with the format of the datastore on > the datanodes (e.g. directory fanout). > Please comment. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
