When I run 'BackupPC_migrateV3toV4' (v4.3.0), I get occasional errors
of form:
BackupPC_migrateV3toV4: can't read attribute file
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib
Plus an associated error:
bpc_attrib_dirRead: got unreasonable file name length 852354
Similarly if I try to read the attrib file directly using BackupPC_attribPrint,
I get:
BackupPC_attribPrint: cannot read attrib file
<path-to-file>/f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib
HOWEVER, if I use the v3.1 version of BackupPC_attribPrint, the attrib file
prints out just fine!!!
SO, the issue seems to be with how v4.x reads attrib files
And none of the filenames are longer than 255 characters...
For example the longest is:
fcache_http%253A%252F%252Fwww.swap.com%252Fi%252FM%252FAMIfv95PqwhrAhpZvHMI9wTeAMmp74SepSA1FcgE-HwOBvARxlhxJ2MNyBqHSNkxbLWiKa50yAM6dEAP7CA_DpByvhW4MB4wp6KPcmAzKpcUSgAliHCnZ4OTQ8NbA3xOUfehqKnpdFXq-xHdSJ3aU09RXP-0pfnFVDH9YnkSDLTv8IeTU3tbAvE-1000%254080.jpg
In other cases, I get the same error even though the longest filename is less
than 100 chars. So that is not the issue...
NOTE: that the error is rare -- I migrated about 2 million pool files repeated
across 100 backups... yet I only encountered about a dozen "unreadable" attrib
files
Also, the "got unreasonable file name length" error is always associated with
the "can't read attribute file" error (and vice-versa)
I tried to troubleshoot, but the problem seems to be in the
BackupPC::XS:Attrib read C-code...
----------------------------------------------------------------------------
Note, if I run BackupPC_migrateV3toV4 with the -v (verbose)
flag, it shows that the missing attributes are
update_v3_dir name = fhttp, path
=./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp
BackupPC_migrateV3toV4: can't read attribute file
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Ft.rmncdn.com%252Flogos%252Fl%252Fpetsmart.com-coupons.jpg
(type 0, size 2532, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fimg.rakuten.com%252FPIC%252F58575288%252F0%252F1%252F250%252F58575288.jpg
(type 0, size 19143, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fi.walmartimages.com%252Fi%252Fp%252F00%252F66%252F05%252F59%252F00%252F0066055900810_500X500.jpg
(type 0, size 22726, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Ft.rmncdn.com%252Flogos%252Fl%252Fjosbank.com-coupons.jpg
(type 0, size 5587, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fimages.lowes.com%252Fproduct%252Fconverted%252F032664%252F032664579417lg.jpg
(type 0, size 12927, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fs.shld.net%252Fis%252Fimage%252FSears%252Fspin_prod_635817701
(type 0, size 66235, ...)
update_v3_dir: adding missing attributes for
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fimg.rakuten.com%252FPIC%252F976201%252F0%252F1%252F250%252F976201.jpg
(type 0, size 4928, ...)
...
update_v3_dir(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp):
got file
cache_http%3A%2F%2Fdyn-images.hsn.com%2Fis%2Fimage%2FHomeShoppingNetwork%2F6931945w%3F%24pd500%24
cache_http%3A%2F%2Fdyn-images.hsn.com%2Fis%2Fimage%2FHomeShoppingNetwork%2F6931945w%3F%24pd500%24:
path3 = /var/lib/backuppc/cpool/9/c/0/9c0badf6e91e4834393525f7dca1291d, path4
= /var/lib/backuppc/cpool/c4/0a/c50b575ae872ebc62e93136669a6affb
cache_http%3A%2F%2Fdyn-images.hsn.com%2Fis%2Fimage%2FHomeShoppingNetwork%2F6931945w%3F%24pd500%24:
already in pool4 /var/lib/backuppc/cpool/c4/0a/c50b575ae872ebc62e93136669a6affb
update_v3_dir(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp):
got file
cache_http%3A%2F%2Fi.walmartimages.com%2Fi%2Fp%2F00%2F66%2F05%2F59%2F00%2F0066055900842_500X500.jpg
cache_http%3A%2F%2Fi.walmartimages.com%2Fi%2Fp%2F00%2F66%2F05%2F59%2F00%2F0066055900842_500X500.jpg:
path3 = /var/lib/backuppc/cpool/4/3/2/4320755a49efb20bbca206e4fea57140, path4
= /var/lib/backuppc/cpool/36/5c/365d25fafa8bab93200931f961ba006a
cache_http%3A%2F%2Fi.walmartimages.com%2Fi%2Fp%2F00%2F66%2F05%2F59%2F00%2F0066055900842_500X500.jpg:
already in pool4 /var/lib/backuppc/cpool/36/5c/365d25fafa8bab93200931f961ba006a
update_v3_dir(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp):
got file
cache_http%3A%2F%2Fwww.homedepot.com%2Fcatalog%2FproductImages%2F400%2Ff6%2Ff68dc10a-9826-4920-9443-e6e94267bdc5_400.jpg
cache_http%3A%2F%2Fwww.homedepot.com%2Fcatalog%2FproductImages%2F400%2Ff6%2Ff68dc10a-9826-4920-9443-e6e94267bdc5_400.jpg:
path3 = /var/lib/backuppc/cpool/8/4/8/848474d80d20998fc6dc0106da7d8bcb, path4
= /var/lib/backuppc/cpool/76/8c/768ce17979646081730d6e3015a8e860
cache_http%3A%2F%2Fwww.homedepot.com%2Fcatalog%2FproductImages%2F400%2Ff6%2Ff68dc10a-9826-4920-9443-e6e94267bdc5_400.jpg:
already in pool4 /var/lib/backuppc/cpool/76/8c/768ce17979646081730d6e3015a8e860
update_v3_dir(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp):
got file
cache_http%3A%2F%2Fs.shld.net%2Fis%2Fimage%2FSears%2Fspin_prod_205203801
cache_http%3A%2F%2Fs.shld.net%2Fis%2Fimage%2FSears%2Fspin_prod_205203801:
path3 = /var/lib/backuppc/cpool/e/a/2/ea20aed6df7caa746052d227d194a395, path4 =
/var/lib/backuppc/cpool/a4/5a/a55aea37959c7707ba00eef7d2934fa7
cache_http%3A%2F%2Fs.shld.net%2Fis%2Fimage%2FSears%2Fspin_prod_205203801:
already in pool4 /var/lib/backuppc/cpool/a4/5a/a55aea37959c7707ba00eef7d2934fa7
...
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib);
dirPath = ./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp,
attribFilePath = attrib, attribFileName = attrib
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib,
0, 3) -> 3
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file
cache_http%3A%2F%2FImg1.targetimg1.com%2Fwcsstore%2FTargetSAS%2Fimg%2Fp%2F10%2F53%2F10538612_121011143000.jpg:
type = 0, mode = 0100664, uid/gid = 1023/1023, size = 22996
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file
cache_http%3A%2F%2FImg1.targetimg1.com%2Fwcsstore%2FTargetSAS%2Fimg%2Fp%2F14%2F11%2F14114751_120901083000.jpg:
type = 0, mode = 0100664, uid/gid = 1023/1023, size = 33314
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file
cache_http%3A%2F%2FImg1.targetimg1.com%2Fwcsstore%2FTargetSAS%2Fimg%2Fp%2F14%2F49%2F14497532_201308071322.jpg:
type = 0, mode = 0100664, uid/gid = 1023/1023, size = 22974
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file
cache_http%3A%2F%2FRSK.imageg.net%2Fgraphics%2Fproduct_images%2FpRS1-14168351w345.jpg:
type = 0, mode = 0100664, uid/gid = 1023/1023, size = 5130
...
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file 2Fcatalog%2FproductImages%2F400%2Ff2%: type = 50, mode = 0106,
uid/gid = 102/50, size = 56
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file 9881-4081-af82-563087973728_400.jpg: type = 318, mode = 0122,
uid/gid = 3759/5368, size = 97
bpc_attrib_dirRead(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
Got v3 file
ttp%3A%2F%2Fwww.homedepot.com%2Fcatalog%2FproductImages%2F400%2Ff6%2Ff68dc10a-9826-4920-9443-e6e94267bdc:
type = 53, mode = 0137, uid/gid = 52/48, size = 46
bpc_attrib_dirRead: got unreasonable file name length 852354
bpc_fileZIO_close(3)
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Ft.rmncdn.com%252Flogos%252Fl%252Fpetsmart.com-coupons.jpg,
0, 3) -> 3
bpc_fileZIO_close(3)
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fimg.rakuten.com%252FPIC%252F58575288%252F0%252F1%252F250%252F58575288.jpg,
0, 3) -> 3
bpc_fileZIO_close(3)
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fi.walmartimages.com%252Fi%252Fp%252F00%252F66%252F05%252F59%252F00%252F0066055900810_500X500.jpg,
0, 3) -> 3
bpc_fileZIO_close(3)
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Ft.rmncdn.com%252Flogos%252Fl%252Fjosbank.com-coupons.jpg,
0, 3) -> 3
bpc_fileZIO_close(3)
bpc_fileZIO_open(./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fimages.lowes.com%252Fproduct%252Fconverted%252F032664%252F032664579417lg.jpg,
0, 3) -> 3
bpc_fileZIO_close(3)
...
bpc_poolRefDeltaUpdate(4701cf85d5f922941ae927be601cc7c3, 1), count now 1
bpc_attrib_dirWrite(/var/lib/backuppc/pc/droidy.good/204.v4/./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib):
dirPath = /var/lib/backuppc/pc/droidy.good/204.v4/./f%2fd
ata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp,
attribFileName = attrib, baseAttribFileName = attrib
bpc_path_create(/var/lib/backuppc/pc/droidy.good/204.v4/./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp)
Wrote file
cache_http%3A%2F%2Fimg.rakuten.com%2FPIC%2F50986808%2F0%2F1%2F250%2F50986808.jpg:
type = 0, mode = 0100444, uid/gid = 490/490, size = 5984, inode = 219079,
nlinks = 0, digest = 0x90e9d0..., bufUsed = 4
Wrote file
cache_http%3A%2F%2Fwww.deepdiscount.com%2Fresources%2Fdeepdiscount%2Fimages%2Fproducts%2Fprocessed%2F757%2F9781416505044.detail.1.jpg:
type = 0, mode = 0100444, uid/gid = 490/490, size = 3538, inode = 219058,
nlinks = 0, digest = 0x006410..., bufUsed = 123
Wrote file
cache_http%3A%2F%2Fimages.bestbuy.com%2FBestBuy_US%2Fimages%2Fproducts%2F9071%2F9071056_sb.jpg:
type = 0, mode = 0100444, uid/gid = 490/490, size = 28820, inode = 218993,
nlinks = 0, digest = 0x86c311..., bufUsed = 296
Wrote file
cache_http%3A%2F%2Fs.shld.net%2Fis%2Fimage%2FSears%2Fspin_prod_205203801: type
= 0, mode = 0100444, uid/gid = 490/490, size = 8375, inode = 218980, nlinks =
0, digest = 0xa55aea..., bufUsed = 430
Wrote file
cache_http%3A%2F%2Fwww.homedepot.com%2Fcatalog%2FproductImages%2F400%2F31%2F314a5156-d9ee-471a-ab27-29af6957a044_400.jpg:
type = 0, mode = 0100444, uid/gid = 490/490, size = 4986, inode = 219023,
nlinks = 0, digest = 0x1e39f2..., bufUsed = 541
Wrote file cache_http%3A%2F%2Fak.buy.com%2FPI%2F0%2F500%2F30121214.jpg:
type = 0, mode = 0100664, uid/gid = 1023/1023, size = 49345, inode = 219066,
nlinks = 0, digest = 0x82b41c..., bufUsed = 700
...
write_file_flush: writing 16219 bytes to pool
bpc_poolWrite_write: digest is 6c5f70ca59a4b21cc749031c25589dc8, v3 is
4723fb67a914c50d915bcad8d72fce28
bpc_fileZIO_open(/var/lib/backuppc/cpool/26922.905.0, 1, 3) -> 3
bpc_fileZIO_close(3)
No match... adding /var/lib/backuppc/cpool/26922.905.0 to pool (digest =
6c5f70ca59a4b21cc749031c25589dc8)
bpc_path_create(/var/lib/backuppc/cpool/6c/5e)
bpc_poolWrite_addToPool: link
/var/lib/backuppc/cpool/6c/5e/6c5f70ca59a4b21cc749031c25589dc8 ->
/var/lib/backuppc/cpool/26922.905.0 (linkOk = 1, statOk = 1, ino =
32832550/32832550)
bpc_attrib_dirWrite: created new attrib file
/var/lib/backuppc/pc/droidy.good/204.v4/./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/attrib_6c5f70ca59a4b21cc749031c25589dc8
bpc_attrib_dirWrite: new attrib digest = 0x6c5f70..., oldDigest =
0x0000...
bpc_poolRefDeltaUpdate(6c5f70ca59a4b21cc749031c25589dc8, 1), count now 1
update_v3_dir name =
fcache_http%253A%252F%252Fak.buy.com%252FPI%252F0%252F250%252F204175032.jpg,
path =
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252Fak.buy.com%252FPI%252F0%252F250%252F204175032.jpg
update_v3_dir name =
fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F10%252F53%252F10538612_121011143000.jpg,
path =
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F10%252F53%252F10538612_121011143000.jpg
update_v3_dir name =
fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F14%252F11%252F14114751_120901083000.jpg,
path =
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F14%252F11%252F14114751_120901083000.jpg
update_v3_dir name =
fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F14%252F49%252F14497532_201308071322.jpg,
path =
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252FImg1.targetimg1.com%252Fwcsstore%252FTargetSAS%252Fimg%252Fp%252F14%252F49%252F14497532_201308071322.jpg
update_v3_dir name =
fcache_http%253A%252F%252FRSK.imageg.net%252Fgraphics%252Fproduct_images%252FpRS1-14168351w345.jpg,
path =
./f%2fdata/fmedia/f0/fAndroid/fdata/fcom.ebay.redlaser/fcache/fhttp/fcache_http%253A%252F%252FRSK.imageg.net%252Fgraphics%252Fproduct_images%252FpRS1-14168351w345.jpg
...
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
