Hi Andreas, we have reproduced a test case and analyzed it with 'debugfs' and 'stat' commands the inconsistencies. As you can see in the attached file we have noticed two kinds of problem, since we see two different behaviors.
First of all, we have built two different lists with e2scan: One with files modified from 1 week ago (from Jan 11th 2010) and one with the files modified 3 days ago (Jan 15th 2010). After this, we have sorted both lists and taken the difference (with 'diff' command) to have as result the set of files modified between Jan 11th 2010 and Jan 14th 2010, both included. We have analyzed with the 'stat' command the mtime and ctime of the resulting list of files, observing that there were files in it with their mtime and ctime between Jan 15th and Jan 18th, while the output of debugfs command for these files reports dates before Jan 15th. So it seems that we may have some kind of inconsistence in the MDS. What do you think about it? The second problem we noticed is that some files show the same timestamp for mtime, ctime and atime with both commands (for example Jan 17th), but 'e2scan' shows them in the list of files modified from Jan 11th but not in the list from Jan 15th. The only difference with these files is that 'debugfs' command shows the crtime which is several months in the past, but this is not relevant for 'e2scan'. Could this be a bug of 'e2scan'? You can see the command output details in the attached file. For each file analyzed you will find a case comment, the 'stat' command output, a blank line and the 'debugfs' command output followed by a separation line (===========). Thanks a lot in advance, Miguel Subject: Re: [Lustre-discuss] e2scan wrong file list mtime/ctime From: Andreas Dilger <[email protected]> Date: Thu, 07 Jan 2010 15:59:06 -0700 To: "[email protected]" <[email protected]> CC: [email protected] On 2010-01-07, at 03:43, Andrea Pieretti wrote: > > sorry for answering you so late (Christmas holidays ;) , > > it seems that the information reported by the two commands you > > indicated, is different regarding the Access time of the file. > > > > Is this a normal behaviour ? The atime is only updated lazily on the MDS. What is important for the e2scan problem you reported is the mtime and ctime, which are identical in this case. Can you please reproduce with the original test case, and then report the timestamps of a file that does not show up in your e2scan list correctly. > > It seems that the MDS does not update the access time (we opened > > the file on the client to view it's content) > > > > > > ---> Issued on a lustre client # stat /scratch/pieretti/new.out > > File: `/scratch/pieretti/new.out' > > Size: 25959 Blocks: 56 IO Block: 2097152 regular file > > Device: a2f3dcdch/2733890780d Inode: 64740446 Links: 1 > > Access: (0644/-rw-r--r--) Uid: ( 244/pieretti) Gid: (20053/ > > bb) > > Access: 2010-01-07 11:28:56.000000000 +0100 > > Modify: 2009-04-04 23:44:36.000000000 +0200 > > Change: 2009-06-19 00:35:21.000000000 +0200 > > > > ---> Issued on the mds # debugfs -c -R 'stat <64740446>' /dev/mapper/ > > scratch_mdt > > debugfs 1.41.6.sun1 (30-May-2009) > > /dev/mapper/scratch_mdt: catastrophic mode - not reading inode or > > group bitmaps > > Inode: 64740446 Type: regular Mode: 0644 Flags: 0x0 > > Generation: 1095573155 Version: 0x00000000:00000000 > > User: 244 Group: 20053 Size: 0 > > File ACL: 0 Directory ACL: 0 > > Links: 1 Blockcount: 0 > > Fragment: Address: 0 Number: 0 Size: 0 > > ctime: 0x4a3ac129:c210ae38 -- Fri Jun 19 00:35:21 2009 > > atime: 0x4a3ac129:00000000 -- Fri Jun 19 00:35:21 2009 > > mtime: 0x49d7d4c4:00000000 -- Sat Apr 4 23:44:36 2009 > > crtime: 0x4a3ac129:c1969bb4 -- Fri Jun 19 00:35:21 2009 > > Size of extra inode fields: 28 > > Extended attributes stored in inode body: > > lov = "d0 0b d1 0b 01 00 00 00 5e dc db 03 00 00 00 00 00 00 00 00 > > 00 00 00 00 00 00 10 00 08 00 > > 00 00 f5 cd 0c 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 05 > > 00 00 00 f5 cd 0c 00 00 00 0 > > 0 00 00 00 00 00 00 00 00 00 00 00 00 00 04 00 00 00 f5 cd 0c 00 00 > > 00 00 00 00 00 00 00 00 00 00 > > 00 00 00 00 00 07 00 00 00 f5 cd 0c 00 00 00 00 00 00 00 00 00 00 00 > > 00 00 00 00 00 00 06 00 00 00 > > f5 cd 0c 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 > > 00 f5 cd 0c 00 00 00 00 00 0 > > 0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 f5 cd 0c 00 00 00 00 > > 00 00 00 00 00 00 00 00 00 00 > > 00 00 00 03 00 00 00 f5 cd 0c 00 00 00 00 00 00 00 00 00 00 00 00 00 > > 00 00 00 00 02 00 00 00 " (22 > > 4) > > BLOCKS: > > > > > > Thanks for your kindness > > > > Andrea > > > > > >
# e2scan error? # File: `/scratch/cannucci/runs/DVSCF_and_ELPH_15au_100q_alongx/ELPH/Q_8/trans-pa.save/K00090/eigenval.xml' Size: 2701 Blocks: 8 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 82058878 Links: 1 Access: (0644/-rw-r--r--) Uid: (10435/cannucci) Gid: (20591/ afi) Access: 2010-01-17 22:26:01.000000000 +0100 Modify: 2010-01-17 22:26:01.000000000 +0100 Change: 2010-01-17 22:26:01.000000000 +0100 Inode: 82058878 Type: regular Mode: 0644 Flags: 0x0 Generation: 1824481930 Version: 0x00000012:c0d0ca18 User: 10435 Group: 20591 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 atime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 mtime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 crtime: 0x4b260ab2:0bc6e878 -- Mon Dec 14 10:51:46 2009 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 7e 1e e4 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 f0 23 e5 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 " (56) BLOCKS: ============================ # e2scan error? # File: `/scratch/cannucci/runs/DVSCF_and_ELPH_15au_100q_alongx/ELPH/Q_8/trans-pa.save/K00094/eigenval.xml' Size: 2701 Blocks: 8 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 82058882 Links: 1 Access: (0644/-rw-r--r--) Uid: (10435/cannucci) Gid: (20591/ afi) Access: 2010-01-17 22:26:01.000000000 +0100 Modify: 2010-01-17 22:26:01.000000000 +0100 Change: 2010-01-17 22:26:01.000000000 +0100 Inode: 82058882 Type: regular Mode: 0644 Flags: 0x0 Generation: 1824481934 Version: 0x00000012:c0d0ca36 User: 10435 Group: 20591 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 atime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 mtime: 0x4b538069:00000000 -- Sun Jan 17 22:26:01 2010 crtime: 0x4b260ab2:29d17624 -- Mon Dec 14 10:51:46 2009 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 82 1e e4 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 1c e2 e3 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 07 00 00 00 " (56) BLOCKS: ============================ # MDS Inconsistence? # File: `/scratch/afilippi/g03run28906/dp02_etero1.chk' Size: 231915520 Blocks: 452968 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 76976805 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 1293/afilippi) Gid: (20699/ ago) Access: 2010-01-17 10:26:18.000000000 +0100 Modify: 2010-01-17 10:26:18.000000000 +0100 Change: 2010-01-17 10:26:18.000000000 +0100 Inode: 76976805 Type: regular Mode: 0644 Flags: 0x0 Generation: 441240560 Version: 0x00000013:19e8b636 User: 1293 Group: 20699 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b4ee678:4066df00 -- Thu Jan 14 10:40:08 2010 atime: 0x4b4ee678:dc2a2800 -- Thu Jan 14 10:40:08 2010 mtime: 0x4b4ee678:4066df00 -- Thu Jan 14 10:40:08 2010 crtime: 0x4b4ee678:e78ced58 -- Thu Jan 14 10:40:08 2010 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 a5 92 96 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 2e cd ec 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 05 00 00 00 " (56) BLOCKS: ============================ # # e2scan error? # File: `/scratch/cannucci/runs/1-trans-pa/1-IsolatedChain/2-Espresso/2-OPTIMIZED-GEOMETRY/17-TEST-E-PHON-DATABASES-4YAMBO-OPTIMIZED-PLUS-EXPERIMENTAL-GEOMETRY/SPLITTED/2-dVscf-1011_celldm33/atomic_kpts_cards' Size: 374 Blocks: 8 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 82248545 Links: 1 Access: (0644/-rw-r--r--) Uid: (10435/cannucci) Gid: (20591/ afi) Access: 2010-01-17 22:30:36.000000000 +0100 Modify: 2010-01-17 22:30:36.000000000 +0100 Change: 2010-01-17 22:30:36.000000000 +0100 Inode: 82248545 Type: regular Mode: 0644 Flags: 0x0 Generation: 1363844931 Version: 0x0000000f:3e936af0 User: 10435 Group: 20591 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b53817c:00000000 -- Sun Jan 17 22:30:36 2010 atime: 0x4b53817c:00000000 -- Sun Jan 17 22:30:36 2010 mtime: 0x4b53817c:00000000 -- Sun Jan 17 22:30:36 2010 crtime: 0x4adf7efa:9a067970 -- Wed Oct 21 23:36:58 2009 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 61 03 e7 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 2e e1 d7 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 06 00 00 00 " (56) BLOCKS: ============================ # # e2scan error? # File: `/scratch/cannucci/runs/1-trans-pa/1-IsolatedChain/test_my_and_dan_geo_VACUUM/60-1-1/1-celldm2_33au/SAVE-MY-GEO/yambo.in' Size: 1799 Blocks: 8 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 82121510 Links: 1 Access: (0644/-rw-r--r--) Uid: (10435/cannucci) Gid: (20591/ afi) Access: 2010-01-17 22:30:05.000000000 +0100 Modify: 2010-01-17 22:30:05.000000000 +0100 Change: 2010-01-17 22:30:05.000000000 +0100 Inode: 82121510 Type: regular Mode: 0644 Flags: 0x0 Generation: 1363306885 Version: 0x0000000f:3cce53ee User: 10435 Group: 20591 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b53815d:00000000 -- Sun Jan 17 22:30:05 2010 atime: 0x4b53815d:00000000 -- Sun Jan 17 22:30:05 2010 mtime: 0x4b53815d:00000000 -- Sun Jan 17 22:30:05 2010 crtime: 0x4adc2ac3:e34c86f8 -- Mon Oct 19 11:00:51 2009 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 26 13 e5 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 41 82 d6 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 04 00 00 00 " (56) BLOCKS: ============================ # MDS Inconsistence? # File: `/scratch/afilippi/g03run28906/Gau-28949.scr' Size: 524288 Blocks: 1024 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 76976806 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 1293/afilippi) Gid: (20699/ ago) Access: 2010-01-17 10:26:18.000000000 +0100 Modify: 2010-01-17 10:26:18.000000000 +0100 Change: 2010-01-17 10:26:18.000000000 +0100 Inode: 76976806 Type: regular Mode: 0644 Flags: 0x0 Generation: 441240561 Version: 0x00000013:19e8b637 User: 1293 Group: 20699 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b4ee678:4066df00 -- Thu Jan 14 10:40:08 2010 atime: 0x4b4ee678:dc2a2800 -- Thu Jan 14 10:40:08 2010 mtime: 0x4b4ee678:4066df00 -- Thu Jan 14 10:40:08 2010 crtime: 0x4b4ee678:e8be1b90 -- Thu Jan 14 10:40:08 2010 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 a6 92 96 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 89 5a ec 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 03 00 00 00 " (56) BLOCKS: ============================ # MDS Inconsistence? # File: `/scratch/alippip/FeGaN/HSE/1Fes.q-1/WAVECAR' Size: 596258976 Blocks: 1164584 IO Block: 2097152 regular file Device: a2f3dcdch/2733890780d Inode: 68290538 Links: 1 Access: (0644/-rw-r--r--) Uid: (11083/ alippip) Gid: (20880/ aja) Access: 2010-01-16 23:55:22.000000000 +0100 Modify: 2010-01-17 01:22:00.000000000 +0100 Change: 2010-01-17 01:22:00.000000000 +0100 Inode: 68290538 Type: regular Mode: 0644 Flags: 0x0 Generation: 441153031 Version: 0x00000013:16f63dfa User: 11083 Group: 20880 Size: 0 File ACL: 0 Directory ACL: 0 Links: 1 Blockcount: 0 Fragment: Address: 0 Number: 0 Size: 0 ctime: 0x4b4c810a:6827bb00 -- Tue Jan 12 15:02:50 2010 atime: 0x4b4c810a:dc2a2800 -- Tue Jan 12 15:02:50 2010 mtime: 0x4b4c810a:6827bb00 -- Tue Jan 12 15:02:50 2010 crtime: 0x4b4c810a:57071d28 -- Tue Jan 12 15:02:50 2010 Size of extra inode fields: 28 Extended attributes stored in inode body: lov = "d0 0b d1 0b 01 00 00 00 ea 07 12 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 10 00 01 00 00 00 ae dc eb 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 " (56) BLOCKS:
_______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
