Hi Jean-Piere, I managed to get the plug-in loaded with guestfs tools, but I could not read the files, so I went back to my basic ntfs mount test without guestmount and I could also not read the files!
The plug-in is located at: /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000013.so without the plug-in I get the "unsupported reparse point" messages, with the plug-in I do not get these messages, but I am still unable to read the files. :( I added the getfattr -h -e hex -n system.ntfs_reparse_data of a sample file as requested and the syslog messages. https://paste.debian.net/hidden/4d358e9e/ Could you please help me out further? Thank you in advance! Kind regards, Jelle de Jong lvcreate --snapshot --name sr7-disk2-snapshot-copy --size 50G /dev/lvm1-vol/sr7-disk2 lvchange -ay /dev/lvm1-vol/sr7-disk2-snapshot-copy blkid /dev/lvm1-vol/sr7-disk2-snapshot-copy kpartx -avg /dev/lvm1-vol/sr7-disk2-snapshot-copy blkid /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 mount -o ro -t ntfs-3g /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 /mnt/sr7-sdb2 Jan 17 11:04:14 backup ntfs-3g[5032]: Version 2016.2.22AR.1 integrated FUSE 28 Jan 17 11:04:14 backup ntfs-3g[5032]: Mounted /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 (Read-Only, label "DATA", NTFS 3.1) Jan 17 11:04:14 backup ntfs-3g[5032]: Cmdline options: ro Jan 17 11:04:14 backup ntfs-3g[5032]: Mount options: ro,allow_other,nonempty,relatime,fsname=/dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2,blkdev,blksize=4096 Jan 17 11:04:14 backup ntfs-3g[5032]: Ownership and permissions disabled, configuration type 7 Jan 17 11:04:33 backup ntfs-3g[5032]: Failed to open a dedup stream last try was System Volume Information/Dedup/ChunkStore/{0DECAE8D-71D2-4BDE-8798-530201C72D8D}.ddp/Stream/00120000.00000002.ccc Jan 17 11:04:55 backup ntfs-3g[5032]: Failed to open a dedup stream last try was System Volume Information/Dedup/ChunkStore/{0DECAE8D-71D2-4BDE-8798-530201C72D8D}.ddp/Stream/00120000.00000002.ccc Jan 17 11:04:55 backup ntfs-3g[5032]: Failed to open a dedup stream last try was System Volume Information/Dedup/ChunkStore/{0DECAE8D-71D2-4BDE-8798-530201C72D8D}.ddp/Stream/00120000.00000002.ccc Jan 17 11:04:57 backup ntfs-3g[5032]: Failed to open a dedup stream last try was System Volume Information/Dedup/ChunkStore/{0DECAE8D-71D2-4BDE-8798-530201C72D8D}.ddp/Stream/00120000.00000002.ccc Jan 17 11:04:57 backup ntfs-3g[5032]: Failed to open a dedup stream last try was System Volume Information/Dedup/ChunkStore/{0DECAE8D-71D2-4BDE-8798-530201C72D8D}.ddp/Stream/00120000.00000002.ccc root@backup:~# getfattr -h -e hex -n system.ntfs_reparse_data /mnt/sr7-sdb2/ALGEMEEN/2009-12-17\ Index\ mappenstructuur.txt getfattr: Removing leading '/' from absolute path names # file: mnt/sr7-sdb2/ALGEMEEN/2009-12-17 Index mappenstructuur.txt system.ntfs_reparse_data=0x1300008000010000020100010b0000000400000004006000030000000400640003000000040068000600000008006c00090000001000740005000000080084000600000008008c000a0000002000d40008000000400094000000000000000000050000000800f400000000000c0000000000000000000000000000008daeec0dd271de4b8798530201c72d8d60003fd1bb66d20127190000000012002719000000001200b08c8b0005000000010000004804000088010000000000009427b7d5fcd18238484f1121abc9175a202e08000000000000000000000000009f238a585b38f16276213e2cc9e63d3769232008d45ba70a03f02e356e463c680000000000000000d31118e8 On 10/01/17 17:45, Jean-Pierre André wrote: > Hi again, > > Jelle de Jong wrote: >> Dear Jean-Pierre André, >> >> root@backup:~# ls -hal >> /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000013.so >> -rw-r--r-- 1 root root 16K Jan 10 13:34 >> /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000013.so >> >> How do I know if ntfs-3g is using the plug-in? > > The plugin is dynamically loaded when you first access > a deduplicated file. This is recorded in the syslog. > > Note : you should probably make it executable (e.g. by chmod 755) > >> >> lvcreate --snapshot --name sr7-disk2-snapshot-copy --size 50G >> /dev/lvm1-vol/sr7-disk2 >> lvchange -ay /dev/lvm1-vol/sr7-disk2-snapshot-copy >> blkid /dev/lvm1-vol/sr7-disk2-snapshot-copy >> kpartx -avg /dev/lvm1-vol/sr7-disk2-snapshot-copy >> blkid /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 >> mount -o ro -t ntfs-3g >> /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 /mnt/sr7-sdb2 >> ls -hal /mnt/sr7-sdb2/ALGEMEEN/ | grep "unsupported reparse point" >> >> Shows no more unsupported reparse point! > > This might be a good indication that the plugin is used. > > Did you check whether the files are readable ? > >> umount /mnt/sr7-sdb2/ >> kpartx -dv /dev/lvm1-vol/sr7-disk2-snapshot-copy >> lvchange -an /dev/lvm1-vol/sr7-disk2-snapshot-copy >> lvremove /dev/lvm1-vol/sr7-disk2-snapshot-copy >> >> root@backup:~# fgrep ntfs-3g /var/log/syslog >> Jan 10 16:14:28 backup ntfs-3g[13082]: Version 2016.2.22AR.1 integrated >> FUSE 28 >> Jan 10 16:14:28 backup ntfs-3g[13082]: Mounted >> /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 (Read-Only, label >> "DATA", NTFS 3.1) >> Jan 10 16:14:28 backup ntfs-3g[13082]: Cmdline options: ro >> Jan 10 16:14:28 backup ntfs-3g[13082]: Mount options: >> ro,allow_other,nonempty,relatime,fsname=/dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2,blkdev,blksize=4096 >> >> >> Jan 10 16:14:28 backup ntfs-3g[13082]: Ownership and permissions >> disabled, configuration type 7 >> Jan 10 16:23:32 backup ntfs-3g[13082]: Unmounting > > In this syslog excerpt I do not see the plugin loading, > did you access a deduplicated file before unmounting ? > >> /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 (DATA) >> >> However when using with the virt-filesystems and guestmount tools it >> does not work: >> >> root@backup:~# lvcreate --snapshot --name sr7-disk2-snapshot-copy --size >> 50G /dev/lvm1-vol/sr7-disk2 >> root@backup:~# lvchange -ay /dev/lvm1-vol/sr7-disk2-snapshot-copy >> >> root@backup:~# blkid /dev/lvm1-vol/sr7-disk2-snapshot-copy >> /dev/lvm1-vol/sr7-disk2-snapshot-copy: >> PTUUID="8d00ec46-cb6d-457f-bfc8-703089c83fb9" PTTYPE="gpt" >> >> root@backup:~# virt-filesystems -a /dev/lvm1-vol/sr7-disk2-snapshot-copy >> /dev/sda2 >> >> root@backup:~# guestmount --ro -a /dev/lvm1-vol/sr7-disk2-snapshot-copy >> -m /dev/sda2 /mnt/sr7-sda2 >> >> root@backup:~# ls -hal /mnt/sr7-sda2/ALGEMEEN/ | grep "unsupported >> reparse point" >> lrwxrwxrwx 1 root root 26 May 19 2008 080514.Index I Directory >> algemeen.xls -> unsupported reparse point >> lrwxrwxrwx 1 root root 26 Dec 17 2009 2009-12-17 Index >> mappenstructuur.txt -> unsupported reparse point >> lrwxrwxrwx 1 root root 26 May 2 2013 ber_folders -> unsupported >> reparse point >> >> # verbose output: >> root@backup:~# guestmount -vvvv --ro -a >> /dev/lvm1-vol/sr7-disk2-snapshot-copy -m /dev/sda2 /mnt/sr7-sda2 >> >> http://paste.debian.net/hidden/be1c989f/ >> >> I will sent an email to libgues...@redhat.com to ask what they think. > > Indeed, as some extra layer could come across, but first > check you can actually read files from a plain partition. > > Regards > > Jean-Pierre > >> >> Kind regards, >> >> Jelle de Jong >> >> On 10/01/17 12:44, Jean-Pierre André wrote: >>> Jelle de Jong wrote: >>>> Dear Jean-Pierre, >>>> >>>> We created a test environment with Windows 2016 with data >>>> deduplication on. >>>> >>>> I upgraded the backup server to install ntfs-3g 2016.2.22AR.1. I tried >>>> to mount the volume to see if I could read the files, but they show up >>>> as unsupported reparse point. >>>> >>>> I listed the Dedup/ChunkStore in the following pastebin: >>>> http://paste.debian.net/hidden/ca51ee46/ >>>> >>>> I tried to use the ntfs-plugin-80000013.so but I am not sure if it is >>>> being used, the bellow is not working so far? >>> >>> Apparently, the expected location on Debian is >>> /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000013.so >>> but you are getting libntfs-3g from /lib/x86_64-linux-gnu >>> maybe there is a symlink. Anyway the same directory is >>> expected (check possible errors in your syslog). >>> >>> If you get errors, please only mount as read-only until >>> the issue is solved, choose a sample file of moderate size >>> (say 100KB), and post its reparse data, which you can >>> get by : >>> >>> getfattr -h -e hex -n system.ntfs_reparse_data your-sample-file >>> >>> Regards >>> >>> Jean-Pierre >> > > ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot _______________________________________________ ntfs-3g-devel mailing list ntfs-3g-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ntfs-3g-devel
