J.Andreina created HDFS-7821: -------------------------------- Summary: After rolling upgrade total files and directories displayed on UI does not match with actual value. Key: HDFS-7821 URL: https://issues.apache.org/jira/browse/HDFS-7821 Project: Hadoop HDFS Issue Type: Bug Reporter: J.Andreina Assignee: J.Andreina
Non Ha Cluster with one DN. dfs.blockreport.intervalMsec =120000 dfs.datanode.directoryscan.interval = 120 Steps to Reproduce: =================== Step 1: Write 11 files to HDFS. Step 2: Prepare rolling upgrade using "hdfs dfsadmin -rollingUpgrade prepare" Step 3: Shutdown SNN and NN . Start NN with the "hdfs namenode -rollingUpgrade started" option. Step 4: Executed "hdfs dfsadmin -shutdownDatanode <DATANODE_HOST:IPC_PORT> upgrade" and restarted Datanode Step 5: Write 3 files to hdfs ( block id assigned are : blk_1073741831_1007, blk_1073741832_1008,blk_1073741833_1009 ) Step 6: Shutdown both NN and DN Step 7: Start NNs with the "hdfs namenode -rollingUpgrade rollback" option. Start DNs with the "-rollback" option. Step 8: Write 3 files to hdfs. Issue: ======= On UI Total files and directories shown is 3 ( while the count is 14 ) Observations: ============= 1. fsck report shows 14. {noformat} Status: HEALTHY Total size: 37944 B Total dirs: 7 Total files: 7 Total symlinks: 0 Total blocks (validated): 6 (avg. block size 6324 B) Minimally replicated blocks: 6 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 6 (100.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 1.0 Corrupt blocks: 0 Missing replicas: 12 (66.666664 %) Number of data-nodes: 1 Number of racks: 1 FSCK ended at Mon Feb 23 16:38:38 CST 2015 in 6 milliseconds {noformat} 2. Afer restart of Namenode , UI gets updated with the actual count . -- This message was sent by Atlassian JIRA (v6.3.4#6332)