So after some longer pause I looked into this (and into Python) again
and noticed that dirs_in is indeed a list, instead of a hash
(dictionary), so do_add_file() will inefficiently search through all
200.000+ entries instead of doing a fast hash-lookup. Changing the three
occurrences of dirs_in to a hash speeds up the first full backup of the
test case from about 75 minutes to about 5 minutes; fprops creation only
takes about one minute now instead of 70 minutes. Attached is a patch -
could you review it?

The incremental backup is taking very long (still). Maybe there's
another problem yet (or the hash patch has worsened the incremental case
:)


** Attachment added: "Patch for turning dirs_in from a list to a hash"
   http://librarian.launchpad.net/7578555/sbd-dirs_in-as-hash.diff

-- 
sbackup is very slow when working on many files
https://bugs.launchpad.net/bugs/102577
You received this bug notification because you are a member of Ubuntu
Bugs, which is the bug contact for Ubuntu.

-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to