---------- 已转发邮件 ---------- 发件人： air <cnwe...@gmail.com> 日期： 2012年4月11日 上午11:21 主题： Re: Decommission process without deletion 收件人： CDH Users <cdh-u...@cloudera.org>
this is the log of last week's decommission log, the decommission process successfully at the end ！ 2012-03-28 14:18:12,429 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( 192.168.85.106:50010, storageID=DS-117065712 -192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020) Starting thread to transfer block blk_-5988161868320786448_405451 to 192.16 8.85.98:50010 2012-03-28 14:18:12,430 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( 192.168.85.106:50010, storageID=DS-117065712 -192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020) Starting thread to transfer block blk_-4840159203919666938_336712 to 192.16 8.85.102:50010 2012-03-28 14:18:12,450 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Receiving block blk_-5623726625798347617_167375 src: /192.168.85. 97:46739 dest: /192.168.85.106:50010 2012-03-28 14:18:12,464 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Received block blk_-5623726625798347617_167375 src: /192.168.85.9 7:46739 dest: /192.168.85.106:50010 of size 1321 2012-03-28 14:18:13,837 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( 192.168.85.106:50010, storageID=DS-117065712 -192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020):Transmitted block blk_-5988161868320786448_405451 to / 192.168.85.98:50010 2012-03-28 14:18:13,911 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( 192.168.85.106:50010, storageID=DS-117065712 -192.168.85.106-50010-1327909270390, infoPort=50075, ipcPort=50020):Transmitted block blk_-4840159203919666938_336712 to / 192.168.85.102:50010 2012-03-28 14:18:15,431 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block blk_-7595219335459687840_180028 file /data1/dfs/ data/current/subdir10/subdir50/blk_-7595219335459687840 for deletion 2012-03-28 14:18:15,432 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block blk_-4477867212286377943_214106 file /data/dfs/d ata/current/subdir48/blk_-4477867212286377943 for deletion 2012-03-28 14:18:15,432 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block blk_-1891414201539663539_454306 file /data1/dfs/ data/current/subdir52/subdir4/subdir13/blk_-1891414201539663539 for deletion *2012-03-28 14:18:15,432 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block blk_-400857555653086208_125812 file /data3/dfs/d* *ata/current/subdir41/blk_-400857555653086208 for deletion* *2012-03-28 14:18:15,433 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Scheduling block blk_3639319147299843291_395265 file /data1/dfs/d* *ata/current/subdir56/blk_3639319147299843291 for deletion* 2012-03-28 14:18:15,433 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Deleted block blk_-400857555653086208_125812 at file /data3/dfs/d ata/current/subdir41/blk_-400857555653086208 在 2012年4月11日 上午11:17，air <cnwe...@gmail.com>写道： I want to decommission a data node from our cluster , when look at the data > node page (50070) , *the node is in " Decommission In Progress " ,but > the total blocks on the data node do not decrease* ... > > I then trace the datanode's log something as follows printing , there is > no scheduler to delete blocks, but when I decommission a datanode last > week , *that datanode's total blocks keep decreasing*..., is there > something wrong ? or bugs ?: > > 2012-04-11 11:14:54,435 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6573017297751334656_168550 to / > 192.168.85.98:50010 > 2012-04-11 11:14:55,241 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6575243939298789628_114035 to / > 192.168.85.99:50010 > 2012-04-11 11:14:57,410 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6589031782005118375_649615 to 192.168.85.103:50010 > 2012-04-11 11:14:57,410 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6589952891904532767_468695 to 192.168.85.94:50010 > 2012-04-11 11:14:58,688 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6589952891904532767_468695 to / > 192.168.85.94:50010 > 2012-04-11 11:14:58,752 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6589031782005118375_649615 to / > 192.168.85.103:50010 > 2012-04-11 11:15:00,411 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6607872487411185264_383722 to 192.168.85.98:50010 192.168.85.99:50010 > 2012-04-11 11:15:00,411 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6608621128742038818_290623 to 192.168.85.99:50010 > 2012-04-11 11:15:02,245 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6608621128742038818_290623 to / > 192.168.85.99:50010 > 2012-04-11 11:15:02,486 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020):Transmitted block blk_6607872487411185264_383722 to / > 192.168.85.98:50010 > 2012-04-11 11:15:03,413 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6619660552568522275_159052 to 192.168.85.92:50010 > 2012-04-11 11:15:03,414 INFO > org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration( > 192.168.85.104:50010, > storageID=DS-246136933-192.168.85.104-50010-1327909266828, infoPort=50075, > ipcPort=50020) Starting thread to transfer block > blk_6619893588660468927_376751 to 192.168.85.93:50010 192.168.85.95:50010 > > -- > 不学习，不知道 > > -- 不学习，不知道 -- 不学习，不知道
