[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
** Changed in: glib Status: Unknown => Fix Released -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/glib/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Would still be good to backport to the LTS if we know what changed resolved the issue ** Changed in: glib2.0 (Ubuntu) Status: Triaged => Fix Released ** Bug watch added: gitlab.gnome.org/GNOME/glib/issues #1688 https://gitlab.gnome.org/GNOME/glib/issues/1688 ** Also affects: glib via https://gitlab.gnome.org/GNOME/glib/issues/1688 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/glib/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Issue may get closed. Solved with upgrading to Ubuntu 19.04. Nevertheless thanks for your help. -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/glib2.0/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Thanks! ** Changed in: glib2.0 (Ubuntu) Status: New => Confirmed ** Changed in: glib2.0 (Ubuntu) Status: Confirmed => Triaged -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/glib2.0/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
As you proposed: https://gitlab.gnome.org/GNOME/glib/issues/1688 -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/glib2.0/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Thank you for the detail, if 'gio' also has the issue then it's a lower level issue and not a nautilus problem, reassigning. That's also probably an upstream issue and would be worth reporting on https://gitlab.gnome.org/GNOME/glib ** Package changed: nautilus (Ubuntu) => glib2.0 (Ubuntu) ** Changed in: glib2.0 (Ubuntu) Status: Incomplete => New -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to glib2.0 in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/glib2.0/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
By the way, due to freezing issues with copying many small files last august, I was forced to change fstab. The cifs/smb version is now 2.0: //ip-address/home /mnt/cifs_nas_home cifs uid=florian,gid=florian,credentials=/home/florian/.smbcredentials,dir_mode=0700,vers=2.0 0 0 Restrictions to the .exe speed drop exception: If the .exe-file already exists in the destination, replacing is as slow as coping iso files (7 MB/s) Same behaviour with gio copy. Because of the replacement issue above I repeated the measurements with following approach: - test file size 8 GB - only upload - fast copies are repeated 3 times and averaged performance chosen (only if no freak value) - slow copies are repeated 3 times too but aborted after ca. 20 seconds Results Tool/CMDtypeending performance (in MB/s) nautiluscopyiso ~ 7 nautilusrepl. iso ~ 7 nautiluscopyexe ~ 110 nautilusrepl. exe ~ 7 gio copycopyiso ~ 7 gio copyrepl. iso ~ 7 gio copycopyexe ~ 110 gio copyrepl. exe ~ 7 cp copyiso ~ 75 cp repl. iso ~ 110 cp copyexe ~ 110 cp repl. exe ~ 110 Commands gio copy -pT /home/florian/testfile-upload-8gb.[iso/exe] /mnt/cifs_nas_media_flo/testfile-upload-8gb.[iso/exe] time cp -T /home/florian/testfile-upload-8gb.[iso/exe] /mnt/cifs_nas_media_flo/testfile-upload-8gb.[iso/exe] Annotation: Because "cp" has no progress function, the less accurate time command is used. Through comparing "gio copy -pT" and "time gio copy -pT", I translated "cp" time results to performance. Very first copy issue This part needs to be observed more closely. Resetting cifs mount (umount, mount) appears to help for a few 8 GB copies. But after a few it starts fast but drops hard down to 7 MB/s after 4 GB transmitted. After some more beginning and cancelling copies it stays at 7 MB/s permanently. Summary: - massive speed drop with upload copy is only observed with "nautilus" and "gio copy", not "cp", although the last one has also a weird behaviour, but that's probably another matter - the very first copy issue needs closer observation - speed drop is depending on file ending, ".iso" is always slow, ".exe" only if replacing existing file -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to nautilus in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nautilus/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Thank you for looking into this problem. What I observed additionally: * the very first upload copy with nautilus is normal maximum speed (~110 MB/s) * then every upload copy is about 7 MB/s * if I change the file ending to ".exe" and upload, I get maximum speed! Results to your requested data: 1st cp: time cp -T /home/florian/upload.iso /mnt/cifs_nas_media_flo/upload.iso real1m21,701s user0m0,054s sys 0m4,832s 2nd cp: time cp -T /home/florian/upload.iso /mnt/cifs_nas_media_flo/upload.iso real1m23,342s user0m0,059s sys 0m4,879s => so maximum speed (8GB need ca. 80 seconds) 1st gio copy: gio copy -pT /home/florian/upload.iso /mnt/cifs_nas_media_flo/upload.iso Transferred 114,8 MB out of 8,0 GB (6,8 MB/s)^C 2nd gio copy with ".exe" file ending: gio copy -pT /home/florian/upload.exe /mnt/cifs_nas_media_flo/upload.exe Transferred 8,0 GB out of 8,0 GB (115,0 MB/s) So all this speed drop is somehow linked to the file ending. What could interfere just because of different file endings? And why are only nautilus and gio copy affected and not all copy utilities? -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to nautilus in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nautilus/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Thank you for your bug report, what are the performances if you use "cp" from the command line and if you use "gio copy"? Those are probably closer things to compare nautilus to than rsync/dd which don't have the same purpose ** Changed in: nautilus (Ubuntu) Importance: Undecided => Low ** Changed in: nautilus (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to nautilus in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nautilus/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
Some additional performance measurements with dd... speed test with /dev/zero upload/write: dd if=/dev/zero of=/mnt/cifs_media/test.iso bs=10M count=400 400+0 records in 400+0 records out 4194304000 bytes (4,2 GB, 3,9 GiB) copied, 40,4893 s, 104 MB/s download/read: dd if=/mnt/cifs_media/test.iso of=/dev/zero bs=10M 400+0 records in 400+0 records out 4194304000 bytes (4,2 GB, 3,9 GiB) copied, 37,393 s, 112 MB/s More practical up- and download speeds upload: dd if=/home/me/file.iso of=/mnt/cifs_media/file.iso bs=10M 767+1 records in 767+1 records out 8048736256 bytes (8,0 GB, 7,5 GiB) copied, 93,209 s, 86,4 MB/s download: dd if=/mnt/cifs_media/file.iso of=/home/me/file2.iso bs=10M 767+1 records in 767+1 records out 8048736256 bytes (8,0 GB, 7,5 GiB) copied, 81,2462 s, 99,1 MB/s So cifs and other underlying systems and hardware seem to be capable to use maximum speed. But more important, if I lower bs, the speed drops down really hard. Upload with bs=... - Default (512) -> 830 kB/s - 4096 -> 6,2 MB/s So maybe the file managers and rsync or their underlying systems are using these small bs? -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to nautilus in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nautilus/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
[Bug 1782535] Re: cifs - poor upload speed with nautilus compared to rsync
** Tags added: bionic -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to nautilus in Ubuntu. https://bugs.launchpad.net/bugs/1782535 Title: cifs - poor upload speed with nautilus compared to rsync To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nautilus/+bug/1782535/+subscriptions -- desktop-bugs mailing list desktop-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/desktop-bugs
