Hi again,
Please retry with :
http://jp-andre.pagesperso-orange.fr/dedup124-beta.zip
I had to take the number of index entries from another
record. Up to now, both locations showed the same value,
and I do not know the specific meaning of each. The change
should fix your latest case, and it does
Dear Jean-Pierre,
Hereby the full stream directory: /mnt/sr7-sdb2/System\ Volume\
Information/Dedup/ChunkStore/\{0DECAE8D-71D2-4BDE-8798-530201C72D8D\}.ddp/Stream/
# f66ede437b46789891bcddc2ab424cfe stream.data.full.dir.tar.gz
https://powermail.nu/nextcloud/index.php/s/JfGOU6O9isWLtMl
I did
Jelle de Jong wrote:
> Dear Jean-Pierre,
>
> I can now read the "algemeen.txt" file, thank you!
>
> However I still got an stream error on an other file.
You have a very interesting configuration for testing
corner situations. I would not be able to get such a
rich testbed without your
Hi,
Please try
http://jp-andre.pagesperso-orange.fr/dedup123-beta.zip
Regards
Jean-Pierre
Jean-Pierre André wrote:
> Hi,
>
> I see what is happening here : this file "algemeen.txt"
> is recorded the traditional way (like mine), not the
> way most of your files are recorded. So I have to
Beste Jean-Pierre,
#getfattr -h -e hex -n system.ntfs_reparse_data ...
#dd if=/dev/mapper/.. skip=30817428 bs=4096 count=1 | od -t x1
#and the other commands outputs:
https://powermail.nu/nextcloud/index.php/s/HwzpBqaIzOyZedg
# stream.data.full.0019.00010002.gz:
Hi Jean-Pierre,
When trying to read algemeen.txt I get a reproducible "Bad stream for
offset" (I got a few more files with the same issue)
# ntfsinfo -fvi 0 /dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2
http://paste.debian.net/plainh/486b1a01
I feel we may be almost there (support for data
Dear Jean-Pierre,
I am still testing the dedup plugin, I have issues with rdiff-backup
that the checksum of the source and destination are not the same, but
this can be an issue with rdiff-backup.
However I did get these messages, but I do not know if they are related
to the dedup plugin?
[ Repeating, forgot to cc to the list ]
Jean-Pierre André wrote:
> Hi,
>
> There was a bug in the index location, which in bad conditions
> could lead to an endless loop in the indexed search. So I have
> fixed the bug, and protected against a corrupted index leading
> to a similar loop.
>
> With
Hi Jean-Pierre,
# output: md5sum *.gz
https://powermail.nu/nextcloud/index.php/s/jxler2rZOqBdpr2
879499f9187b0f590ae92460f4949dfd stream.data.full.dir.tar.gz
a8fc902613486e332898f92aba26c61f reparse-tags.gz
Kind regards,
Jelle de Jong
On 23/02/17 14:24, Jean-Pierre André wrote:
> Hi,
>
>
Hi,
Can you also post the md5 (or sha1, or ...) of the big
file. The connection is frequently interrupted, and I
cannot rely on the downloaded file without a check.
Jean-Pierre
Jelle de Jong wrote:
> Hi Jean-Pierre,
>
> Thank you!
>
> The reparse-tags.gz file:
>
Hi Jean-Pierre,
Thank you!
The reparse-tags.gz file:
https://powermail.nu/nextcloud/index.php/s/fS6Y6bpzoMgPiZ0
Generated by running: getfattr -e hex -n system.ntfs_reparse_data -R
/mnt/sr7-sdb2/ 2> /dev/null | grep ntfs_reparse_data | gzip >
/root/reparse-tags.gz
Kind regards,
Jelle de
Hi,
Jelle de Jong wrote:
> Dear Jean-Pierre,
>
> I thought version 1.2.1 of the plug-in was working so I took it further
> into production, but during backups with rdiff-backup and guestmount it
> created a 100% cpu load in qemu process that stayed there for days until
> I killed them, I tested
Dear Jean-Pierre,
I thought version 1.2.1 of the plug-in was working so I took it further
into production, but during backups with rdiff-backup and guestmount it
created a 100% cpu load in qemu process that stayed there for days until
I killed them, I tested this twice. So I went back to a
Hi,
Jelle de Jong wrote:
> Hi Jean-Pierre,
>
> If we have to switch to Windows 2012 and thereby having an environment
> similar to yours then we can switch to an other Windows version.
I do not have any Windows Server, and my analysis
and tests are based on an unofficial deduplication
package
Hi Jean-Pierre,
If we have to switch to Windows 2012 and thereby having an environment
similar to yours then we can switch to an other Windows version.
We are running out of disk space here so if switching Windows versions
makes the process of having data deduplication working easer then me
Dear Jean-Pierre,
No luck so far, I hope I provide the needed debug information as if:
# the file test, syslog and streams generation:
http://paste.debian.net/plainh/d495e075
# the stream.data.full.0012.0001.gz file:
https://powermail.nu/nextcloud/index.php/s/OA0iRf9yKYkc5IL
# the
Hi again,
Jelle de Jong wrote:
> Hi Jean-Pierre,
>
> Don't know if this is related to the bug you found.
>
> But I am getting scrambled data, one moment the file is empty then it
> has data and the file sizes are not the same when copied:
Probably the same bug, though difficult to tell for sure.
Hi Jean-Pierre,
In case you are wondering:
I am using data deduplication in Windows 2016 for my test environment
iso:
SW_DVD9_Win_Svr_STD_Core_and_DataCtr_Core_2016_64Bit_English_-2_MLF_X21-22843.ISO
Kind regards,
Jelle de Jong
On 09/02/17 11:41, Jean-Pierre André wrote:
> Hi,
>
> Jelle de
Hi Jean-Pierre,
Don't know if this is related to the bug you found.
But I am getting scrambled data, one moment the file is empty then it
has data and the file sizes are not the same when copied:
root@backup:~# ls -hal "/mnt/sr7-sdb2/ALGEMEEN/DSC_1319.JPG"
-r-xr-xr-x 1 root root 2.4M Feb 5
Hi,
Jelle de Jong wrote:
> Hi Jean-Pierre,
>
> Thank you!
>
> The new plug-in seems to work for now, I am moving it into testing phase
> with-in our production back-up scripts.
Please wait a few hours, I have found a bug which
I have fixed. I am currently inserting your data
into my test base in
Hi Jean-Pierre,
Thank you!
The new plug-in seems to work for now, I am moving it into testing phase
with-in our production back-up scripts.
Will you release the source code eventually, would like to write a blog
post about how to add the support.
What do you think the changes are of the
Hi,
Can you please make a try with :
http://jp-andre.pagesperso-orange.fr/dedup120-beta.zip
This is experimental and based on assumptions which have
to be clarified, but it should work in your environment.
Regards
Jean-Pierre
Jelle de Jong wrote:
> Dear Jean-Piere,
>
> The stream.data.full.gz
Hi,
The needed data appears to be in the expected file, but
at a very unexpected location. So I am landing into
unknown territory and I need some time to investigate.
I do not need more data for now, you can allow the
file system to be updated again, and we will restart
from the beginning when I
Dear Jean-Piere,
The stream.data.full.gz file:
https://powermail.nu/owncloud/index.php/s/6Y0WXs7WQclpOBM
# attempt to compile searchseq.c:
http://paste.debian.net/plainh/49252e03/
# grep and other info how I generated the stream.data.full.gz file:
http://paste.debian.net/plainh/34a9c9ec
Again
Hi,
Jelle de Jong wrote:
Hi Jean-Piere,
The requested stream.data.gz file:
https://powermail.nu/nextcloud/index.php/s/QmbQLnrLZneIScT
Well, this is unexpected : the data does not match.
I assume it has been relocated, but I have no idea
where it could be. This situation does not occur in
my
Hi again,
A consistency check has failed, there is some unexpected
data in your Stream file. Can you post an excerpt :
dd if=FILE bs=512 skip=133396 count=2 | gzip > stream.data.gz
(FILE being the one with name 0019.0001.ccc whose
inode number is 2801748).
Regards
Jean-Pierre
Jelle de
Hi Jean-Pierre,
Thank you!
The requested information: http://paste.debian.net/hidden/bfcfff7c/
The behaviour is with with plain mount:
mount -o ro -t ntfs-3g
/dev/mapper/lvm1--vol-sr7--disk2--snapshot--copy2 /mnt/sr7-sdb2
I figured out how to load your awesome plugin into the guestmount
Hi,
Jelle de Jong wrote:
> Dear Jean-Pierre,
>
> I could read the files for maybe one day, I tried to get it into
> production but then it didn't work anymore, going back to my base test
> mounting the volume without guestmount, so with just mount I get the
> following:
Do you mean that the
Hi again,
Jelle de Jong wrote:
> Dear Jean-Pierre,
>
> Thank you! I can read the files!
Great !
> On 18/01/17 15:20, Jean-Pierre André wrote:
>> Now, I have updated it again, so please redo the same.
>> If it still fails, please post all the file names which
>> appear in the directory "Stream",
Dear Jean-Pierre,
Thank you! I can read the files!
On 18/01/17 15:20, Jean-Pierre André wrote:
> Now, I have updated it again, so please redo the same.
> If it still fails, please post all the file names which
> appear in the directory "Stream", so that I can see which
> one got into the way.
Dear Jean-Piere,
Thank you! Here is the requested data:
http://paste.debian.net/plain/909296
I updated the plug-in by wget
http://jp-andre.pagesperso-orange.fr/dedup.zip the file name was the
same, so I hope the plugin was updated, the date stamp looked from the
16th..
-rwxr-xr-x 1 root
Hi,
Jelle de Jong wrote:
Hi Jean-Piere,
I managed to get the plug-in loaded with guestfs tools, but I could not
read the files, so I went back to my basic ntfs mount test without
guestmount and I could also not read the files!
The plug-in is located at:
Hi Jean-Piere,
I managed to get the plug-in loaded with guestfs tools, but I could not
read the files, so I went back to my basic ntfs mount test without
guestmount and I could also not read the files!
The plug-in is located at:
/usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-8013.so
Hi again,
Jelle de Jong wrote:
> Dear Jean-Pierre André,
>
> root@backup:~# ls -hal
> /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-8013.so
> -rw-r--r-- 1 root root 16K Jan 10 13:34
> /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-8013.so
>
> How do I know if ntfs-3g is using the plug-in?
Dear Jean-Pierre André,
root@backup:~# ls -hal
/usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-8013.so
-rw-r--r-- 1 root root 16K Jan 10 13:34
/usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-8013.so
How do I know if ntfs-3g is using the plug-in?
lvcreate --snapshot --name
Jelle de Jong wrote:
> Dear Jean-Pierre,
>
> We created a test environment with Windows 2016 with data deduplication on.
>
> I upgraded the backup server to install ntfs-3g 2016.2.22AR.1. I tried
> to mount the volume to see if I could read the files, but they show up
> as unsupported reparse
Dear Jean-Pierre,
We created a test environment with Windows 2016 with data deduplication on.
I upgraded the backup server to install ntfs-3g 2016.2.22AR.1. I tried
to mount the volume to see if I could read the files, but they show up
as unsupported reparse point.
I listed the
Dear Jean-Pierre,
We created a test environment with Windows 2016 with data deduplication on.
I upgraded the backup server to install ntfs-3g 2016.2.22AR.1. I tried
to mount the volume to see if I could read the files, but they show up
as unsupported reparse point.
I listed the
38 matches
Mail list logo
