[Bug 197762] Re: file transfers on USB disk are very slow

2010-04-20 Thread Shawn Reist
I have been following this post for some time.

I have installed Debian Lenny and started using that as a primary system 
and the Ubuntu system I have I tinker with.

Call me a rebel or such.. but I have noticed differences on how the 
systems' (Ubuntu and Debian) handle file transfers.

I am not a super geek and can't devote a lot of time to tracking down 
the differences.

One thing I have noticed is that Ubuntu does not write some of the 
configuration files for USB devices. . .or that some of the utilities 
required to read the USB information can't retrieve anything because the 
required files do not exist.  there are increasing wait periods or data 
written/read from a USB device, something in the wait states. . . 
someone with more technical familiarity needs to look at these.

As far as I can see there are several issues, but without some help or 
guidance I can't give more information. Most people from what I see are 
quoting the same fixes over and over; it is or has become a circular 
enigma. Specific data has to be collected from a range of systems in a 
specific order and collated/sorted through.

Shawn.

-- 
file transfers on USB flash key (pendrive) or USB HDD are slowing down with time
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread rom85
this problem lasts for me since 8.04 when i just started using linux. i
have it by now and none of the proposed solutions helped

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread uvaio
2.6.31-16-generic #53-Ubuntu x86_64 Did not fix anything for me ;o(

I did some further testing and the problem appears to be related to per
file transfer and also to USB stick you use.

I did test with 
1. Kingston micro SD HC 8GB memory card using with mini usb card reader.
trasfered about 500MB of 700MB file then speed decreased to very very low 
almost stopped.
2. Kingston 8GB Traveler USB memory stick 
Transfered 700 MB file quickly but in the very end it took 2 minutes to 
complete transfer even it shown all 700MB copied.
Then I tried 3 files of 700MB each in batch copy. And result is 
interesting. Overall speed was linearly decreasing from about 20MB/s to final 4 
MB/s. After each about 700MB of transfer it got in about 2 minutes wait. Like 
copied 700, then progress didn't move for a while at all, copied another 700MB 
and then progress stayed at 1.4GB for another about 2-3 minutes. then last file 
transfered and waited again at the end.
I think the overall speed (I guess measured as average) may be decreasing as 
result of waiting at the end of file transfer.
I think it's doing the same thing with both memory cards it just does happen 
after different amount of data transfered.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread sbec67
I also did some Tests...
Copying file to a MP3 Player ( FS MSDOS ) i had similar Problems as described 
above.
Copying Files to a external USB Hardisc ( FS EXT3 ) I don't see such problems.
Maybe the coses come from different File Systems ?

Regards Sbec

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Angelos Vlassopoulos
I have been following this bug report for a long time now and here is
some advice to the people that have only recently begun to post here.

This bug has hundreds of postings and no reasonable person could
possible read all of them in order to start fixing something.

Through time it has become obvious that this is not one single bug. It
is very possible that there several bugs that each leads to reduced
speed under different circumstances.

If you read several comments back, you will discover that some people
tried to fix this bug, but they were unable to reproduce it. Apparently
it is not a Dolphin or Nautilus issue and in any case you should start
excluding stuff so that you can find the heart of the problem.

So, many postings earlier there was an agreement that people should stop
posting to this bug. Instead, people should start new bug reports and
post specific data that could be useful to bug fixers.

The best way to provide bug fixers with useful data is to follow the
instructions that appear here.

https://help.ubuntu.com/community/DiskPerformance

If you have the time and you want to help, please conduct some tests and
test your theory about what affects the USB performance. If you think
you discover something, please post a new bug report.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Digital5700
sbec67: The difference isn't the file systems, it's that hard drives are
treated differently to USB sticks. As I wrote before... copying to
external drives gives me 15MB/s sustained.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Jeff Wallace
I can concur with Digital5700.  My 1TB external drive has no performance
issues, but my 8GB flash drive has trouble getting a 700MB file onto it in
a reasonable amount of time.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Carlos M
After playing around with the US mount options in my jaunty 64, I still
see this issue.

In my case, I think this is the result of using ubuntu on an NTFS USB drive: If 
I copy and delete large files (4-8GB) in Jaunty, the USB drive gets fragmented 
(expectedly so).  If I plug this device to my Windows box, it is defragmented 
by default (in vista or 7).
When I use Jaunty again to copy large files, I don't see this problem again.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Botond Szász
I have done some quick testing. I formatted my Kingston DataTraveler G2
16GB drive as a FAT32, FAT32 (lba), EXT2, EXT3 disk one at a time and
tried copying over a file little over 1GB in size. I monitored the
actual disk operations with dstat.

What I have found is that the first 100 - 200MB for which the copying
speed is normal, does not actually get written to the disk. Up to the
point when Nautilus reports that 100 - 200MB is copied, dstat shows that
no writing takes place - which is (let's say) OK, because of the
caching. After this the operation starts to slow down and at this same
time data start to get written to the disk but with an incredibly slow
pace ( 100KB/s). If I do not cancel the operation Nautilus starts to
become unresponsive (dims out then back in -  because of compiz).

This is what dstat shows (this is for the test with EXT3 but others are
similar):

bote...@kryzisworx:~$ dstat -D sdb1
total-cpu-usage --dsk/sdb1- -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
 14   5  64  16   0   0| 147B   32k|   0 0 |2485B   16k|1000  2158 
 12   4  83   0   0   0|   0 0 |2473B 2763B|   0 0 | 813  1504 
 10   4  85   0   0   0|   0 0 |1447B 1574B|   0 0 | 863  1561 
 12   3  84   0   0   0|   0 0 |5631B 4587B|   0 0 | 749  1463 
  5   4  89   0   1   0|   0 0 |4600B 4273B|   0 0 | 814  1255 
  8   7  83   2   0   0|   0 0 |2068B 3283B|   0 0 | 877  1733 
 11   4  84   0   0   0|   0 0 |3703B 4359B|   0 0 |1015  1751 
 14   6  41  37   2   0|8192B0 |2015B 3422B|   0 0 |1235  2340 
 12  16  43  27   1   1|   0 0 |3336B 4627B|   0 0 |1595  2560 
 15  14  30  40   0   0|   0 0 |1398B 1492B|   0 0 |1456  2945 
 15  14  36  34   0   1|   0 0 |1267B  915B|   0 0 |1472  2756 
 15  15  39  29   0   1|4096B0 | 569B  712B|   0 0 |1449  2680 
 15  18  26  40   0   0|   0 0 | 132B  168B|   0 0 |1550  2943 
 18  14  24  43   0   0|   052k| 673B  985B|   0 0 |1391  2520 
 11   8   2  79   1   0|   0  1920k| 144B  746B|   0 0 | 967  1751 
 11   5   0  83   1   0|   0  4224k|2211B 2500B|   0 0 |1085  1960 
  8   9   0  81   1   0|   0  4100k| 234B  504B|   0 0 |1178  2133 
 10   4   0  85   0   0|   0  2020k| 964B  778B|   0 0 | 866  1538 
  7   7   0  85   0   0|   028k| 764B 1410B|   0 0 | 785  1475 
  6   7  27  59   0   0|   0   568k|1354B 1696B|   0 0 | 963  1605 
 13   8   8  70   1   1|   052k|1579B 1925B|   0 0 |1236  2144 
 13   4   0  83   0   0|   056k|1811B 3758B|   0 0 | 829  1473 
 10   5   0  84   1   1|   080k|1700B 3975B|  32k   80k| 900  1508 
total-cpu-usage --dsk/sdb1- -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
  9   7   0  84   0   0|   088k|2122B 3456B|   0 0 | 953  1539 
  8   7   0  84   0   0|   056k| 546B  731B|   0 0 | 845  1478 
 11   8   0  80   0   0|   040k|  12k   17k|   0 0 |1018  1631 
 13   3   0  83   0   0|   060k|4218B   12k|   0 0 |1027  1861 
 12   3   0  84   1   0|   028k|1230B 3793B|   0 0 | 835  1534 
 13   5   0  82   0   0|  16k   28k| 277B 1018B|   0 0 | 925  1702 
 11   4  25  61   0   0|   0   200k|1316B 2976B|   0 0 | 850  1475 
 11   6   3  80   1   1|   036k|1485B 3581B|   0 0 | 863  1566 
 11   6   0  82   0   0|   060k|2372B 4931B|  32k0 | 913  1399 
 10   6   0  85   1   0|   040k| 283B  873B|   0 0 | 871  1475 
 15   3   0  82   0   0|  96k   20k|3311B  374B|   0 0 | 933  1697 
 10   2   0  86   1   0|   028k| 196B  250B|   0 0 | 762  1414 
 12   5   0  83   0   0|   024k|2192B 3740B|   0 0 | 887  1699 
 16   3   0  81   0   0|   036k|1864B 2708B|   0 0 | 943  1743 
 16   4   0  79   1   0|   092k|1986B 3804B|   0 0 | 982  1772 
 12   6   0  82   0   0| 128k   52k|1181B 2004B|   028k|1048  1744 
 12   7   0  81   0   0|   064k|2174B 2626B|  32k0 | 829  1395 
  9   5   0  86   0   0|   0   116k|2371B 2166B|   0 0 | 859  1642 
 12   5  20  64   1   0|   0   148k|1583B 2729B|   0 0 |1061  1801 
 11   3   0  86   0   0|   0   100k| 320B  293B|   0 0 | 790  1427 
 14   7   0  79   0   0|   0   912k| 670B 1285B|   0 0 | 878  1749 
 12   6   0  80   1   0|1784k   20k| 451B 1504B|   0 0 |1024  2260 ^C
bote...@kryzisworx:~$

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Botond Szász
One more thing...

I don't know if this is related, but whenever I try to Safely remove
the disk I always got this error:

Unable to stop drive

Error detaching: helper exited with exit code 1: sense buffer empty
Error SYNCHRONIZE CACHE for /dev/sdb: Success
start stop unit: transport: Host_status=0x07 [DID_ERROR]
Driver_status=0x00 [DRIVER_OK, SUGGEST_OK]

Error STOP UNIT for /dev/sdb: No such file or directory

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-14 Thread Theodore Ts'o
Botond,

Again, I would ask that you take a look at the procedures found here:

https://help.ubuntu.com/community/DiskPerformance

... and then open another bug, complete with details of kernel version,
dstat -D dev when doing a dd if=/dev/zero of=dev bs=32k, and then
the output of dmesg | grep usb so we can see the usb-related messages,
etc.

I just did my own testing, using a 2.6.32-git6 based kernel (so it has a
lot of freshly merged ext4 improvements), and what I can see when
copying a large file to an Aptiva 2GB USB stick (purchased from
Microcenter; identifies as a Sandisk device via lsusb -v), is a slowdown
when doing a cp bigfile /mnt, when copying to ext2 and ext3, sometimes
to a crawl (4k/second according to dstat), but when a I do dd
if=/dev/zero of=/dev/sdc, I see 6MB/sec.  I see the same 6MB/sec while
mke2fs is zeroing out the inode table, and if I copy the large file
using ext4, I see 6MB/sec (very rarely it drops down to 3-5MB/sec, but
only for a second).   When the same USB stick is formatted using vfat, I
see a wide range of write bandwidths, from 3-6MB/sec, with an average of
maybe 4-5 MB/sec.   My hardware is a Lenovo T400 with 4GB of memory, and
the writes to the disk start showing up with dstat after at most a 1
second after I hit the return key to initiate the cp from the shell
prompt.

So as you can see, these are very different results than what you have
gotten.   I get very similar (although perhaps slightly degraded)
results as far as write speends are concerned when I mount the ext2 or
ext3 file system using ext4 by the way.  And I can consistently
replicate these results, which indicates that at least on my system, raw
sequential writes (i.e., via dd if=/dev/zero ...) are 6MB/sec, and using
the ext4 file system driver gets me close the same raw sequential write
rate, regardless of whether the file system is formatted using ext2,
ext3, or ext4 (although things are a bit worse when extents are
disabled).   I am getting perhaps 75-80% of the raw write speed when
using vfat to a USB stick, consistently over writing a 1GB file to a 2GB
USB stick.   With ext2 and ext3, I lost patience before the file copy
completed, but after 10 seconds or so with ext2, and perhaps 30 seconds
with ext3, the write speeds as reported by dstat -D had dropped down to
4-8 kb/sec, and it would stay there for a few minutes, and then suddenly
pop back up to around 3-4 mb/sec, only to later (after some time had
passed) drop back down to 4-8 kb/sec.

The bottom line is that everyone is reporting slightly different
symptoms, and so opening separate bug reports, with detailed information
is the only hope of figuring out what is going on.   I am going to posit
that some people are losing because of bad interactions between the
kernel and their USB controller (which should show up when they see bad
results with raw writes to the device).   Others may be seeing
interesting interactions between the write order and size of the writes
by a particular file system driver and their particular USB stick.
Depending on the sophistication of the flash controller on the USB
stick, the USB stick may handle small (4k) writes much less efficiently
than large (64k to 128k) writes, especially if the writes are random
access as opposed to sequential in nature.  Note that the requirements
for writing large jpegs in a digital camera (what many of the really
cheap flash controllers were originally optimized for) are quite
different from those needed for a general-purpose file system.

I don't have time to much more in the way of detailed analysis,
unfortunately (especially since at least with my USB stick and ext4,
things were hunky-dory :-).  If I had the time I would next try a
different collection of USB sticks, and different kernels, including the
default karmic kernel, to see if my results stayed the same while
varying one variable at a time.   That is, doing an exhaustive series of
tests following the scientific method, which hopefully most folks
learned in their high school science classes.   If someone does have the
time to do this work, I'd suggest opening a new bug (since Launchpad is
really slow with large bugs, and there's a lot of noise in this bug
already), and after you do this large series of tests, with the
information I've suggested here and in the Wiki, post a pointer to the
new bug in this bug report, and I'll promise to take a look at it.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-13 Thread sbec67
i have the same problem here 
read this: http://ubuntuforums.org/showthread.php?t=1306333

people are getting angry... 
i think this Problem should be fixed with a Bug Fix and not within next release 


Kind regards
Sbec

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-10 Thread mlx
Latest kernel update (2.6.31-16-generic #53-Ubuntu x86_64) fixed my
problem.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-10 Thread Filofel
2.6.31-16-generic #53-Ubuntu x86_64 fixed my problem too.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-09 Thread Filofel
Same problem here copying 100MB from the disk to an USB key using
Nautilus (drag n drop from Nautilus to Nautilus).

During the copy, the gnome desktop is mostly frozen, the copy progress bar only 
appears after after *minutes* and once appeared, is hardly refreshed at all 
before the end of the copy. 
During that time, the desktop is totally unresponsive.
Karmic 2.6.31-15 and 16.

OTOH, reading from the key writing to the disk is perfectly normal, both
in term of speed and behavior of the progress bar, desktopn etc. All
cache effect has being eliminated (the data copied was not already in
the cache).

I never saw anything comparable under Jaunty same hardware (key
included).

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-07 Thread uvaio
I see this bug is very old but still here and painful for many people, is there 
anything we can do? provide some more info? is there anyone looking at it? Was 
this problem understood already?
I think priority should be risen, what should we do when we need to take larger 
file on USB? what is workaround? to use different OS for this purpose? Isn't 
issue that make people think to bin Ubuntu good reason to give higher priority 
than medium?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-07 Thread mlx
I think the bug along with the reports needs to be split into:
kernel issues - when even reading from/writing to the block device with 
hdparm/dd is unreasonably slow
block filesystem issues - testing the above works,but copying files to/from 
the filesystem (preferably from something not impacted by random unexpected 
slowdowns, such as tmpfs) using CLI (cp/mv) is slow
VFS/DE issues - the above works ok but using the gnome/kde is slow for 
whatever reason - KIO/GVFS bugs, choosing wrong block sizes, etc.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-03 Thread boratsuckdev
I am using Karmicl, kernel 2.6.31 -15 -generic on my laptop. The time
that takes to transfer files to my USB drives takes almost 20 times more
than it used to take in Jaunty. Sometimes after waiting for a long time
of transfering it will simply give a error message or the file will
simply will not get transferred. Tried to transfer a 700MB (90 mins) avi
file, i had to wait for almost 20 minutes for it to get transferred and
an average speed of 200 kpbs was the maximum achieved. same complaints
as the person aboveplz help

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-12-02 Thread Roozbeh Gholizadeh
Anything new on this bug?
i am having this issue with my usb :
Bus 001 Device 007: ID 058f:6387 Alcor Micro Corp. Transcend JetFlash Flash 
Drive

copying 170mg file after 70% tends to slow down.using krusador and also natilus.
i am willing to provide any other info if required.

using ubuntu 9.10 kernel 2.6.31-15-generic

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-26 Thread Shawn Reist
I do not see this option in karmic

Carlos M wrote:
 Sergey
 Once the USB thumbdrive is mounted, you can right-click on its desktop icon 
 and select Properties.  From there you will see the Volume tab and specify 
 the mount options
 Carlos M



-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-26 Thread Sergey V. Udaltsov
I do not see this option in karmic, either

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-25 Thread Sergey V. Udaltsov
Carlos, where did you find USB-Properties-Volume-Mount menu?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-25 Thread Carlos M
Sergey
Once the USB thumbdrive is mounted, you can right-click on its desktop icon and 
select Properties.  From there you will see the Volume tab and specify the 
mount options
Carlos M

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-22 Thread Carlos M
From what I googled, it appears the 'noatime' option implies
'nodiratime' as well.  I was able to specify this option in the
USB-Properties-Volume-Mount options.  It seemed to work when I
transfered two 4.2GB movies but I'll keep an eye on it -- I'm not sure
it's fixed in my case.  Also, this issue is showing up in other distro's
as well (fedora, arch linux, opensuse).  Just google 'usb file copy very
slow'.  Some users in these posts think it's a kernel issue, but I don't
know enough to say for sure.  Coincidentally, I have 2 x64 machines -
one with 8.10 (older box with the original installation) and one with
9.04 (newer box with all the latest updates).  Interestingly enough,
I've never seen this issue in the 8.10 box and I've been running both of
them for months.

Carlos M

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-22 Thread mlx
@ Luis (#198): can you please post/link to the changes made to fstab? I
have no lines in fstab for USB drives, as DeviceKit is supposed to take
care of that.

@everyone having problems and still following: how many of you tried to
bypass the filesystem by using dd or hdparm -t?

Running Karmic amd64, I'm having ridiculously slow speeds just reading from 
3.5 HDD over USB (in the 3-8 MB/s range), right after bootup, using hdparm -t 
or dd'ing from to /dev/null:
$ sudo dd if=/dev/sdb  of=/dev/null count=1024 bs=32k
1024+0 records in
1024+0 records out
33554432 bytes (34 MB) copied, 7,03421 s, 4,8 MB/s
$ sudo hdparm -t /dev/sdb

/dev/sdb:
 Timing buffered disk reads:   18 MB in  3.29 seconds =   5.47 MB/sec

Hardware is Intel ICH8, the same gives me over 12MiB/s in Windows NT 5.2
and Hardy i386. The hard drive puts over 40 MiB/s over
ExpressCard-eSATA Silicon Image SiI 3132

** Attachment added: dmesg.log
   http://launchpadlibrarian.net/35947788/dmesg.log

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-21 Thread Shawn Reist

** Attachment added: Data sheet.ods
   http://launchpadlibrarian.net/35911171/Data%20sheet.ods

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-21 Thread Shawn Reist
Thanks Ulrich,

I have started to log items and placed the data in a ODS file posted
above. Message and attachment did not go through together.

I started with data being written to a .txt file to home directory. . .
changed to the /dev/shm directory so data written to the file would not
conflict with the data captured for the USB stick.

three sheets... labelled with hours, min and seconds of running time
(machine uptime)

uname -a
Linux icabaud 2.6.31-14-generic #48-Ubuntu SMP Fri Oct 16 14:04:26 UTC 2009 
i686 GNU/Linux

System
Computer Supermicro P4D6C+

1. Dual Intel® Xeon® processors 1.5 GHz
2. Intel® 860 Chipset
3. 512MB 600/800MHz RDRAM
4. 1x Intel® 82559 10/100 Ethernet Controller
5. Adaptec AIC-7899W Dual-Channel Ultra160 SCSI
6. 2 x 64-bit PCI expansion slots
7. 4xAGP Pro slot, nVidia GeForce FX 5500 AGP video card
8. Award® BIOS
  DATED yes...
data sheet.ods

Sheet 1
. . .  is aprox 3 - 5 days, ONLY A GUESS... FORGOT HOW LONG THE SYSTEM WAS 
RUNNING before I had to do a reboot. due to instability problems with capturing 
data when trying to set the delay. . . eventually left with the standard 1 
second capture so 1 line = one second .. appended CONKY with $timeup
600s = 10 minutes aprox

Sheet 2
just after a reboot, 5 minutes 30 seconds aprox.

Sheet 3
after reboot 2 hours 20 seconds aprox.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-20 Thread Luis Lobo
I had this problem, and after reading all this comments, i decided to
give it a try to the reconfiguration of fstab

I went from 4 MB to a steady 30MB (this is the REAL max throughput of a
USB device in USB 2.0)

It worked perfectly. Also, setting my SATA Ports to use 32 bit and it
made it a little better.

Setting noatime,nodiratime to the mount options in /etc/fstab solves
the problem for me atleast

Ubuntu 64 here:
Linux lap-lub-lnx 2.6.31-15-generic #50-Ubuntu SMP Tue Nov 10 14:53:52 UTC 2009 
x86_64 GNU/Linux
hardware: Intel Core 2 Duo (Centrino 2)

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-18 Thread Ulrich Lukas
Dear Shawn,


dstat does essentially that.

Default is one line of output every second, which means the output
equals the MiB/sec throughput of your device.


Try dstat -D sda,sdb. You can also adjust the delay; see the manual page.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread Bais
At this moment, the only way to survive at this bug is open an ftp or sftp
connection in local host and copy files with filezilla or similar client
O_O.

It's an absurd solution, I know, but the only one that not freeze my
work.

by BAIS

2009/11/8 Dexter pogany.tamas+...@gmail.com
pogany.tamas%2b...@gmail.com

 Bug confirmed on Karmic Koala

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of a duplicate bug.

 Status in GVFS: Invalid
 Status in “gvfs” package in Ubuntu: Invalid
 Status in “linux” package in Ubuntu: Triaged

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)



-- 
by BAIS

FreeFAX:  +39 04921064377

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread rom85
2 BAIS:
this doesn't help for my situation also. when copying by filezilla first 50mb 
are copied quite fast, but after that great slowdown as if it was copied from 
hdd.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread Shawn Reist
I will agree the FTP does not work for me either.

the best thing for myself was to do a reboot. transfers are good for the 
first hour or two... then get mediocre and after a day possibly two... 
abysmal.


rom85 wrote:
 2 BAIS:
 this doesn't help for my situation also. when copying by filezilla first 50mb 
 are copied quite fast, but after that great slowdown as if it was copied from 
 hdd.



-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread Denis Hamann
I have the same problem, but rebooting doesnt help me.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread Bais
Strange I used this method for gigas and gigas and I continued to work well,
I have kubuntu 9.04 daily updated.
I'm using server kernel, I don't know why :) Probably for some application
I've installed for testing.

I have a dream... this software on linux --
www.killprog.com Killcopy ! best file manager , pause, anti crash,
buffer tuning, bandwidth,
different configuration for differente kind of devices... all in 1 little
program... parallel copy, queue... other is teracopy but kill copy rocks. If
I was a programmer I make it on linuxbox.

I will test on a scp / ftp session and I will post my results.

by BAIS

2009/11/17 Shawn Reist icab...@shaw.ca

 I will agree the FTP does not work for me either.

 the best thing for myself was to do a reboot. transfers are good for the
 first hour or two... then get mediocre and after a day possibly two...
 abysmal.


 rom85 wrote:
  2 BAIS:
  this doesn't help for my situation also. when copying by filezilla first
 50mb are copied quite fast, but after that great slowdown as if it was
 copied from hdd.
 
 

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of a duplicate bug.

 Status in GVFS: Invalid
 Status in “gvfs” package in Ubuntu: Invalid
 Status in “linux” package in Ubuntu: Triaged

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)



-- 
by BAIS

FreeFAX:  +39 04921064377

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-11-17 Thread Shawn Reist
I asked this some where but maybe not here...

I can't program, but is it possible to gather data via a script that 
would put data into a sort of quasi time line format with certain data 
appended to it..

i.e

start copy.

time  bytes written  rate
.
time  bytes written  rate
.
.
.

end time total bytes written

maybe one could set the program to be variable for time say 10,  30, 60. 
. second intervals

other data append at the end,  the modules used, Uname -a... and 
computer information..

like I said I can't program... would need lots of help.. but for an
idea...?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-08 Thread Dexter
Bug confirmed on Karmic Koala

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-11-04 Thread rom85
I have tried several PCs. They were based upon Intel chipsets such as G33/31, 
i865, i915, i945 all with integrated video used. All of them had Celeron 
proccessors on board, 512MM of RAM and SATA 80GB drives. Tested versions of 
Ubuntu were 8.10, 9.04 and 9.10. None of them worked good, talking about USB 
speeds. I've tried different combinations, playing with enabling/disabling Usb 
Legacy Support in BIOS, setting pci=noapc pci=routeirq and elevator 
parameters in grub's configuration.  These were some tricks discussed on 
forums. None of these experiments helped on any of the machines. The symptoms 
were: when copying files to flash drive the speed decreases from about 24BMps 
at start (according to speed indicator either in Nautilus or MC) to almost 
1MBps-200-300kbps, than the progress freezes (doesn't answer for escape key or 
Cancel) as long as system starts hanging also, while CPU load isn't high at 
all. When you copy small files up to 50-150MB it's all right, written quite 
fast, but films are impossible to write as 1,4GB is a hard task. When you watch 
the copy-progress bar it's either moving fast or stopping for some time, than 
again. Even if copying is finished in a program I can see that usb stick is 
working for some time more indicating that with a lamp on it.
For those willing to say to buy a new flash drive - they are workable and well 
and of different manufacturers and USB 2.0 is enabled in BIOS.
Sincerely see further for bug fixing. I will supply all necessary information 
if requested.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-31 Thread Sebastien Bacher
those comments are not constructive could you restain from adding such
notes there?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-10-31 Thread Shawn Reist
Hello,

I am not a programmer and not that versed on how things in Linux work;
still quite Green.

Can a program be made to monitor a file transfer. i.e. track the
progress.  there is something that is happening in the background.

The best file transfers I have is just after a reboot of the computer...
then things go slowly down hill.

I have noticed I can have a good transfer for 1/2 the file then there is
a pause and the rest of the transfer process is jerky/spurts of data
written/transferred, the process takes longer to complete as the
concurrent transfer packets or amount of data is slower/smaller.

Is it possible to have a packet sniffer for file transfers and it would
log the rate of the transfer packet size modules being used or errors
logged and have a time stamp. there has to be something that we just
don't see if a user pulls the logs manually or does a lsusb, df,
hdparm, . . .

one would think that a time chart or sequenced time line of the event
would help point in the direction of the problem logically?. 

yes?

no?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-30 Thread Sigmund Baginov
** Tags added: karmic

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-10-30 Thread jamesnmandy
LOL, same patch applied here, having something as basc as USB communications
breaking down essentially breaks the entire OS for most people, i really
wanted Ubuntu to be my last OS but this bug killed it

On Thu, Oct 29, 2009 at 10:53 PM, Ulrich Lukas 
stellplatz-nr@datenparkplatz.de wrote:

 Martin and Murz,

 maybe you can get help if you open up an individual, detailed bug
 report.

 Given that this 184-message bug report is over one and a half year old,
 I'm afraid adding comments here does not help.

 This bugfix works, I've just tested it:

 http://www.microsoft.com/windows/windows-7/default.aspx

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in GVFS: Invalid
 Status in “gvfs” package in Ubuntu: Invalid
 Status in “linux” package in Ubuntu: Triaged

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)


-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-29 Thread Martin Scharrer
I also suffer from this bug. The transfer speed seems to start high and then 
falls to kb/s after a short while, see below.
This happens with nautilus, dd, and rsync, etc. 

$ rsync -aP * /media/usbmedibig --stats
sending incremental file list
file1
367,481,854 100%   10.67MB/s0:00:32 (xfr#1, to-chk=14/15)
file2
367,362,570 100%2.18MB/s0:02:40 (xfr#2, to-chk=13/15)
file3
367,235,908 100%1.35MB/s0:04:19 (xfr#3, to-chk=12/15)
file4
125,108,224  33%  551.88kB/s0:07:20  ^C

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-10-29 Thread Ulrich Lukas
Martin and Murz,

maybe you can get help if you open up an individual, detailed bug
report.

Given that this 184-message bug report is over one and a half year old,
I'm afraid adding comments here does not help.

This bugfix works, I've just tested it:

http://www.microsoft.com/windows/windows-7/default.aspx

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-27 Thread Murz
Confirm this problem in Kubuntu Karmic RC amd64 fresh install: transfering a 
big file (more that 600 mb) to the USB disk is very slow and get about 100% of 
CPU usage (on AMD Athlon(tm) 7550 Dual-Core Processor with 4gb of RAM) all the 
copying time.
Can I help with some additional debug info?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-26 Thread Sebastien Bacher
 trying to rsync a windows 7 install dvd

the issue seems different from a speed one, you should open a new bug
rather than commenting there...

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-26 Thread Mikael Frykholm
I got the same slowness when trying dd to the same stick.  It was fast
at first and gradually got slower (according to kill -USR1 dd) and ended
up at about 300k/s.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-24 Thread Mikael Frykholm
I got this in dmesg when trying to rsync a windows 7 install dvd to a 4G flash 
drive:
[227761.643001] INFO: task pdflush:19635 blocked for more than 120 seconds.
[227761.643010] echo 0  /proc/sys/kernel/hung_task_timeout_secs disables 
this message.
[227761.643016] pdflush   D  0 19635  2 0x
[227761.643029]  8801189f9d20 0046  
00015880
[227761.643040]  88001af35e70 00015880 00015880 
00015880
[227761.643050]  00015880 88001af35e70 00015880 
00015880
[227761.643060] Call Trace:
[227761.643078]  [815291bd] __down_read+0x8d/0xc6
[227761.643088]  [81528589] down_read+0x19/0x20
[227761.643097]  [81120ed5] sync_supers+0x75/0xe0
[227761.643107]  [810e2615] wb_kupdate+0x35/0x140
[227761.643116]  [810e411e] __pdflush+0x13e/0x260
[227761.643125]  [810e4240] ? pdflush+0x0/0x50
[227761.643133]  [810e4288] pdflush+0x48/0x50
[227761.643141]  [810e25e0] ? wb_kupdate+0x0/0x140
[227761.643149]  [810e4240] ? pdflush+0x0/0x50
[227761.643159]  [81078746] kthread+0xa6/0xb0
[227761.643168]  [810130ea] child_rip+0xa/0x20
[227761.643176]  [810786a0] ? kthread+0x0/0xb0
[227761.643183]  [810130e0] ? child_rip+0x0/0x20

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-24 Thread Mikael Frykholm
I can reproduce this every time, please tell me what kind of debug info
you need.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-10 Thread lebb
In Karmic transfering a file to the USB disk it is a slight bit faster
compared to Jaunty, but moving a big file it is still painfully slow.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-02 Thread Tim Gardner
There are 2 changes in recent Karmic kernels that should help:

2.6.31-10.35:
  * [Config] Set default I/O scheduler to DEADLINE
CFQ seems to have some load related problems which are often exacerbated by 
sreadahead.
- LP: #381300

2.6.31-11.38
  * sched: Disable NEW_FAIR_SLEEPERS for now
- LP: #436342

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-10-02 Thread Leann Ogasawara
** Changed in: linux (Ubuntu)
   Importance: Undecided = Medium

** Changed in: linux (Ubuntu)
   Status: Confirmed = Triaged

** Changed in: linux (Ubuntu)
 Assignee: Ubuntu Kernel Team (ubuntu-kernel-team) = (unassigned)

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-09-01 Thread Ace Suares
Luckily, the extermely slow USB transfer rate gives me ample time to
enjoy the 173 comments in this bug report.

Whoooppeee!

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-08-02 Thread Sergey V. Udaltsov
Same issue with Corsaire Voyager Mini 16G. Works reasonably fast under
WinVista

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-07-15 Thread Theodore Ts'o
On Tue, Jul 14, 2009 at 08:45:56PM -0700, Ron Brogden wrote:
 Theodore, if I may ask you - are you just another random Linux user
 here or are you actually officially associated with Ubuntu in a
 support role?  I see that you are associated with IBM, have written
 some file system utilities and appear to be connected with kernel
 development but am unsure your role here with respects to this bug.

I'm a linux kernel developer, and yes, I'm the maintaining of the ext4
filesystem and e2fsprogs.  I started paying attention to this problem
because someone sent a note to the LKML (Linux Kernel Mailiung List)
complaining that kernel developers don't pay attention to Ubuntu bugs.

Keep in mind most Ubuntu users get Ubuntu for free, and pay no support fees; so 
it's not surprising that you will see very few Ubuntu support personnel paying 
attention to bugs like this one.  So at some level, the Ubuntu user community 
and Canonical has a choice to make.  If they
are willing to let users just whine and whine and whine and _not_ help us by 
running experiments and opening separate bugs for each problem, and give full 
information (and we will provide them with explicit instructions on how to run 
those experiments), fine.  We can just go
back to ignoring Ubuntu launchpad as being totally, completely, worthless for 
actually fixing bugs.  It can just be a place toxic sewer pit for users to 
whine, and if Canonical wants to pay someone to
try to extract useful information (lots of luck; theres very little here) after 
the fact, they can go right ahead.  We'll just file Ubuntu into the there's no 
intelligent life here category, and ignore pleas for help on LKML when people 
ask developers to pay attention to Launchpad bugs.

Alternatively, if the goal is to have one part of the community helping
another, then the users have to be helpful.  That means doing research
before filing bugs, and filing separate bugs for separate issues.
Launchpad fails miserably when there are more than 80 comments; it's
slow and painful to use.  So I am trying to see if we can salvage the
Launchpad culture so it can be useful, but ultimately, maybe it's a
losing battle, and we should give up.

 Obviously most folks have no idea why their USB transfers are slow
 but they know something is up.  It should be no surprise that they
 post unclear bug reports since there is no real way for them to tell
 whether their file manager, the kernel or some other bit of software
 is the cause.  All they know is something is wrong and for those
 that dual boot, it does not happen with Windows (not my situation
 but it is far from uncommon).  Of course this is frustrating for the
 bug fixer but then the response should be a request for hardware
 that displays the problem at the very least (which I believe has
 been offered here).

The problem is that we need to separate out the reports.  When something
is as vague as disk transfers are slow, there's a extremely high
probability that there may be multiple things going on. Some people
might be having genuine hardware problems; others might be having
filesystem issues.  Eric's (epv's) problem *might* be the classic
ext3/fsync stalled write problem --- I can't tell, because _he_ hasn't
filed a separate bug report and given information about his problem.

Do you really expect a car mechanic to fix all problem descriptions of
the form my car is hard to start simultaneously?  They all have the
same symptoms, so *obviously* they must have same root cause.  NOT.

 Since you are apparently a file system expert, how about writing a
 quick utility that gives out the details you think would be
 pertinent for assessing file transfer speeds over USB?  This could
 then be used as a benchmark and hopefully show once and for all
 where the bottleneck is occuring.  Presumably hacking the cp source
 (or dd or whatever) to add in some timing information is not a huge
 undertaking.

The 'dd' program already provides this information.  For example, like
this:

sudo dd if=/dev/sdXX of=/dev/null bs=32k count=32k

But we have people whining on this bug about how they are GUI persons
only, and don't have time to do any research on the bug.  If all they
are doing is whining, then maybe they should really go to Windows or
MacOS.  Or they should get a paid support contract from some Linux
distribution where someone can be paid to hold their hands.  There's No
Such Thing As A Free Lunch, you know.

 If you are not associated with Ubuntu support and are not actually offering 
 help then why are you polluting this bug report further than it already is?

This bug report is already hopeless; the original bug report was against
Ubuntu 8.04, over a year ago and two releases ago.  Which is why I
suggest people who are really serious about solving the problem open
fresh bug reports, with full and complete detail.  They should not
assume that just because they have a similar problem, the hardware
information submitted by someone else 12 

RE: [Bug 197762] Re: file transfers on USB disk are very slow

2009-07-15 Thread kulight
I've just remembered why the user base of Linux is so small

I do actually expect my mechanic to find and fix what's wrong with my car when 
I just tell him it won't start
And I don’t care if it's the engine the battery or the radiator
You have to understand that most users have no idea where the problem is coming 
from or if its two separate ones
They are just using the system and see the problems

-Original Message-
From: boun...@canonical.com [mailto:boun...@canonical.com] On Behalf Of 
Theodore Ts'o
Sent: Wednesday, July 15, 2009 4:43 PM
To: kuli...@afikim.org.il
Subject: [Bug 197762] Re: file transfers on USB disk are very slow

On Tue, Jul 14, 2009 at 08:45:56PM -0700, Ron Brogden wrote:
 Theodore, if I may ask you - are you just another random Linux user
 here or are you actually officially associated with Ubuntu in a
 support role?  I see that you are associated with IBM, have written
 some file system utilities and appear to be connected with kernel
 development but am unsure your role here with respects to this bug.

I'm a linux kernel developer, and yes, I'm the maintaining of the ext4
filesystem and e2fsprogs.  I started paying attention to this problem
because someone sent a note to the LKML (Linux Kernel Mailiung List)
complaining that kernel developers don't pay attention to Ubuntu bugs.

Keep in mind most Ubuntu users get Ubuntu for free, and pay no support fees; so 
it's not surprising that you will see very few Ubuntu support personnel paying 
attention to bugs like this one.  So at some level, the Ubuntu user community 
and Canonical has a choice to make.  If they
are willing to let users just whine and whine and whine and _not_ help us by 
running experiments and opening separate bugs for each problem, and give full 
information (and we will provide them with explicit instructions on how to run 
those experiments), fine.  We can just go
back to ignoring Ubuntu launchpad as being totally, completely, worthless for 
actually fixing bugs.  It can just be a place toxic sewer pit for users to 
whine, and if Canonical wants to pay someone to
try to extract useful information (lots of luck; theres very little here) after 
the fact, they can go right ahead.  We'll just file Ubuntu into the there's no 
intelligent life here category, and ignore pleas for help on LKML when people 
ask developers to pay attention to Launchpad bugs.

Alternatively, if the goal is to have one part of the community helping
another, then the users have to be helpful.  That means doing research
before filing bugs, and filing separate bugs for separate issues.
Launchpad fails miserably when there are more than 80 comments; it's
slow and painful to use.  So I am trying to see if we can salvage the
Launchpad culture so it can be useful, but ultimately, maybe it's a
losing battle, and we should give up.

 Obviously most folks have no idea why their USB transfers are slow
 but they know something is up.  It should be no surprise that they
 post unclear bug reports since there is no real way for them to tell
 whether their file manager, the kernel or some other bit of software
 is the cause.  All they know is something is wrong and for those
 that dual boot, it does not happen with Windows (not my situation
 but it is far from uncommon).  Of course this is frustrating for the
 bug fixer but then the response should be a request for hardware
 that displays the problem at the very least (which I believe has
 been offered here).

The problem is that we need to separate out the reports.  When something
is as vague as disk transfers are slow, there's a extremely high
probability that there may be multiple things going on. Some people
might be having genuine hardware problems; others might be having
filesystem issues.  Eric's (epv's) problem *might* be the classic
ext3/fsync stalled write problem --- I can't tell, because _he_ hasn't
filed a separate bug report and given information about his problem.

Do you really expect a car mechanic to fix all problem descriptions of
the form my car is hard to start simultaneously?  They all have the
same symptoms, so *obviously* they must have same root cause.  NOT.

 Since you are apparently a file system expert, how about writing a
 quick utility that gives out the details you think would be
 pertinent for assessing file transfer speeds over USB?  This could
 then be used as a benchmark and hopefully show once and for all
 where the bottleneck is occuring.  Presumably hacking the cp source
 (or dd or whatever) to add in some timing information is not a huge
 undertaking.

The 'dd' program already provides this information.  For example, like
this:

sudo dd if=/dev/sdXX of=/dev/null bs=32k count=32k

But we have people whining on this bug about how they are GUI persons
only, and don't have time to do any research on the bug.  If all they
are doing is whining, then maybe they should really go to Windows or
MacOS.  Or they should get a paid support contract from some Linux

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-07-15 Thread Night64
Well, my linux support fix my problem, even when I can't explain what is the
problem. But I pay for it!
Canonical have a nice and not very pricey support service, maybe you could
hire them.

Linux: Because rebooting is for adding new hardware.


On Wed, Jul 15, 2009 at 8:33 AM, kulight kuli...@afikim.org.il wrote:

 I've just remembered why the user base of Linux is so small

 I do actually expect my mechanic to find and fix what's wrong with my car
 when I just tell him it won't start
 And I don’t care if it's the engine the battery or the radiator
 You have to understand that most users have no idea where the problem is
 coming from or if its two separate ones
 They are just using the system and see the problems

 -Original Message-
 From: boun...@canonical.com [mailto:boun...@canonical.com] On Behalf Of
 Theodore Ts'o
 Sent: Wednesday, July 15, 2009 4:43 PM
 To: kuli...@afikim.org.il
 Subject: [Bug 197762] Re: file transfers on USB disk are very slow

 On Tue, Jul 14, 2009 at 08:45:56PM -0700, Ron Brogden wrote:
  Theodore, if I may ask you - are you just another random Linux user
  here or are you actually officially associated with Ubuntu in a
  support role?  I see that you are associated with IBM, have written
  some file system utilities and appear to be connected with kernel
  development but am unsure your role here with respects to this bug.

 I'm a linux kernel developer, and yes, I'm the maintaining of the ext4
 filesystem and e2fsprogs.  I started paying attention to this problem
 because someone sent a note to the LKML (Linux Kernel Mailiung List)
 complaining that kernel developers don't pay attention to Ubuntu bugs.

 Keep in mind most Ubuntu users get Ubuntu for free, and pay no support
 fees; so it's not surprising that you will see very few Ubuntu support
 personnel paying attention to bugs like this one.  So at some level, the
 Ubuntu user community and Canonical has a choice to make.  If they
 are willing to let users just whine and whine and whine and _not_ help us
 by running experiments and opening separate bugs for each problem, and give
 full information (and we will provide them with explicit instructions on how
 to run those experiments), fine.  We can just go
 back to ignoring Ubuntu launchpad as being totally, completely, worthless
 for actually fixing bugs.  It can just be a place toxic sewer pit for users
 to whine, and if Canonical wants to pay someone to
 try to extract useful information (lots of luck; theres very little here)
 after the fact, they can go right ahead.  We'll just file Ubuntu into the
 there's no intelligent life here category, and ignore pleas for help on
 LKML when people ask developers to pay attention to Launchpad bugs.

 Alternatively, if the goal is to have one part of the community helping
 another, then the users have to be helpful.  That means doing research
 before filing bugs, and filing separate bugs for separate issues.
 Launchpad fails miserably when there are more than 80 comments; it's
 slow and painful to use.  So I am trying to see if we can salvage the
 Launchpad culture so it can be useful, but ultimately, maybe it's a
 losing battle, and we should give up.

  Obviously most folks have no idea why their USB transfers are slow
  but they know something is up.  It should be no surprise that they
  post unclear bug reports since there is no real way for them to tell
  whether their file manager, the kernel or some other bit of software
  is the cause.  All they know is something is wrong and for those
  that dual boot, it does not happen with Windows (not my situation
  but it is far from uncommon).  Of course this is frustrating for the
  bug fixer but then the response should be a request for hardware
  that displays the problem at the very least (which I believe has
  been offered here).

 The problem is that we need to separate out the reports.  When something
 is as vague as disk transfers are slow, there's a extremely high
 probability that there may be multiple things going on. Some people
 might be having genuine hardware problems; others might be having
 filesystem issues.  Eric's (epv's) problem *might* be the classic
 ext3/fsync stalled write problem --- I can't tell, because _he_ hasn't
 filed a separate bug report and given information about his problem.

 Do you really expect a car mechanic to fix all problem descriptions of
 the form my car is hard to start simultaneously?  They all have the
 same symptoms, so *obviously* they must have same root cause.  NOT.

  Since you are apparently a file system expert, how about writing a
  quick utility that gives out the details you think would be
  pertinent for assessing file transfer speeds over USB?  This could
  then be used as a benchmark and hopefully show once and for all
  where the bottleneck is occuring.  Presumably hacking the cp source
  (or dd or whatever) to add in some timing information is not a huge
  undertaking.

 The 'dd

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-07-15 Thread Theodore Ts'o
On Wed, Jul 15, 2009 at 11:33:07AM -, kulight wrote:
 I've just remembered why the user base of Linux is so small
 
 I do actually expect my mechanic to find and fix what's wrong with
 my car when I just tell him it won't start And I don’t care if it's
 the engine the battery or the radiator You have to understand that
 most users have no idea where the problem is coming from or if its
 two separate ones They are just using the system and see the
 problems

Ah, but (a) you pay your mechanic, and (b) you bring your car in, and
don't expect him to fix it over the phone or over an web board.

There are plenty of services for which you can get pay-for-service for
Linux.  For the right price, I've been flown into New York City to
work at a large financial institution or even into a classified
machine room at a major defense contractor.

But the difference with Ubuntu Launchpad is that no one pays any money
and they somehow expect gold-plated support.  Sorry, for free support,
you have to expect a certain amount of self service.  It's still a
way better deal than you will get anywhere else --- but if you wan the
quality of service you get when you drive the car to your dealer, then
you will have to (a) pay the bug fixer, and (b) let the bug fixer have
direct access to your machine.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-07-14 Thread epv
 (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo 
/media/disk/bar

 If the time is really in seconds as you seem to suggest it is
 interesting I'd say. On the other hand, if what you describe is due the
 low performance of the underlying device then it is expected behaviour
 (the low performance of the device might be due to a bug though).

# (cp /dev/zero /media/disk/bigfile ); sleep 10; time echo foo 
/media/disk/bar

real0m5.647s
user0m0.000s
sys 0m0.004s

# time echo foo  /media/disk/foo2

real0m3.534s
user0m0.000s
sys 0m0.000s
# time echo foo  /media/disk/foo3

real0m4.589s
user0m0.000s
sys 0m0.000s
# time echo foo  /media/disk/foo3

real0m16.913s
user0m0.000s
sys 0m0.000s

Imagine that! I wasn't lying.


 The reports of Fast at
 first, then slowing down are of course because of the buffer cache
 making it look like it's initially fast but access to the underlying
 device is always very slow, whether you are writing to it with gvfs, cp,
 dd, buffer, or whatever.

Yes, and?

and so the arguments of it's fast at first, then gets slow from naive users 
are
spurious, which I'm sure you realized. 

 In addition, it's only writes that are slow, and they're vastly slower
 than could be explained by a crappy USB device- in my case around 100 -
 200 kbytes/sec on a device that under a Hardy install writes at several
 mbytes/sec.

 If Hardy was fine then you should open a new bug report with the proper
 details (once again, see [1] or Theodore's comments).

There has been a lot of unhelpful or misguided information posted to this bug,
but be careful not to discount the good with the bad. It's fairly clear you 
either
don't believe there's a problem or aren't interested in it, which is fine, but 
it
might be both more helpful and more civil to just say so, rather than being rude
to people who are trying to help with whatever means they have available.

eric


** Attachment added: iostat output during cp /dev/zero /media/disk/bigfile
   http://launchpadlibrarian.net/29027766/iostat-output

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-07-14 Thread jamesnmandy
This is completely not flamebait, promise, I have been doing nothing but
bragging on the latest build of Ubuntu, but I loaded Windows 7 back on this
same exact machine, only difference was the OS, and suddenly I get transfer
speeds of 25Mb/s or higher consistently even on extremely large transfers.
On Ubuntu 9.04 it would never get above 15Mb/s and would quickly drop to
nearly half of that and eventually stop altogether if the transfer was a
very large one that had to be sustained.  My point is, for all the nay
sayers who say it's people's hardwareit's not, unless it's that Ubuntu
is not playing nice with certain hardware configurations.  This is obviously
the case, but it is not a hardware issue at all when a simple change of the
OS completely fixes the issue.

On Tue, Jul 14, 2009 at 6:58 PM, epv epvubu...@limpoc.com wrote:

  (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo 
 /media/disk/bar

  If the time is really in seconds as you seem to suggest it is
  interesting I'd say. On the other hand, if what you describe is due the
  low performance of the underlying device then it is expected behaviour
  (the low performance of the device might be due to a bug though).

 # (cp /dev/zero /media/disk/bigfile ); sleep 10; time echo foo 
 /media/disk/bar

 real0m5.647s
 user0m0.000s
 sys 0m0.004s

 # time echo foo  /media/disk/foo2

 real0m3.534s
 user0m0.000s
 sys 0m0.000s
 # time echo foo  /media/disk/foo3

 real0m4.589s
 user0m0.000s
 sys 0m0.000s
 # time echo foo  /media/disk/foo3

 real0m16.913s
 user0m0.000s
 sys 0m0.000s

 Imagine that! I wasn't lying.


  The reports of Fast at
  first, then slowing down are of course because of the buffer cache
  making it look like it's initially fast but access to the underlying
  device is always very slow, whether you are writing to it with gvfs, cp,
  dd, buffer, or whatever.
 
 Yes, and?

 and so the arguments of it's fast at first, then gets slow from naive
 users are
 spurious, which I'm sure you realized.

  In addition, it's only writes that are slow, and they're vastly slower
  than could be explained by a crappy USB device- in my case around 100 -
  200 kbytes/sec on a device that under a Hardy install writes at several
  mbytes/sec.
 
  If Hardy was fine then you should open a new bug report with the proper
  details (once again, see [1] or Theodore's comments).

 There has been a lot of unhelpful or misguided information posted to this
 bug,
 but be careful not to discount the good with the bad. It's fairly clear you
 either
 don't believe there's a problem or aren't interested in it, which is fine,
 but it
 might be both more helpful and more civil to just say so, rather than being
 rude
 to people who are trying to help with whatever means they have available.

 eric


 ** Attachment added: iostat output during cp /dev/zero
 /media/disk/bigfile
   http://launchpadlibrarian.net/29027766/iostat-output

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in gvfs: Invalid
 Status in “gvfs” package in Ubuntu: Invalid
 Status in “linux” package in Ubuntu: Confirmed

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)


-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-07-14 Thread Theodore Ts'o
Eric,

The problem is that your problem may be very different from other
peoples' problem.   First of all, in your test, you are continually
dirtying the page cache with cp /dev/zero /mnt/bigfile.This brings
in filesystem effects, and VM effects, and so it's hard to tell what is
actually going on.   Without a lot of instrumentation, and knowing
exactly the state of memory, and when the filesystem might be doing a
commit, it's hard to say exactly what might be going on.   You also
haven't given us the kernel bootup messages (dmesg output after the
system boots), as well as the type of device that you are using, the
lsusb output, etc., etc., etc.You haven't told us how much memory
there is in the system.

And certainly the test which you did (cp /dev/zero /media/disk/bigfile
); sleep 10 ; time echo foo  /media/disk/test is not one that we can
replicate on Windows, so the assertion that something is wrong is also
not something which is immediately obvious given the very limited amount
of information you have given.   Maybe it's *somewhere* in this bug
report, bug this is why it is really not useful to mingle multiple
users' problems in one bug report.

If you want to open a separate bug report, give lots of details, and be
willing to work with people who can suggest specific, repeatable
experiments that examine one aspect of the system at a time, then we can
try to see if there's something unusual.   If you just want to whine
about how horrible Ubuntu or Linux is, then keep on doing what you're
doing here.   It's not going to lead to anything useful though.   But if
you are really interested in being constructive, we need your help in
giving us something useful in terms of enough information so we can find
the root cause of a problem, and then try to solve it.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-07-14 Thread Theodore Ts'o
jamesnmandy,

For someone who 'does not have the time to file a proper bug report',
you seem to have plenty of time to write notes complaining about the
bug.   Seriously --- if you aren't willing to help determine the problem
--- and you like GUI solutions --- maybe you should just go back to
Windows.   You may find that you have even less responsiveness to your
bug reports, unless you pay $$$ to Microsoft, but hey, if it makes you
happier, you should switch.

The problem could be with Nautilus (the gui file manager); or it could
be with the device driver; or it could be with the ext3 filesystem issue
where some process was triggering fsync calls.   If you aren't willing
to figure out why it's no fast enough for you, and you aren't willing to
lift your little finger to help us figure out why; then please, don't
complain --- you're clearly unhappy, and perhaps moving to Vista will
make you happy.   And at the end of the day, it's better for you to be
happy than to have you bitter and complaining --- really, trust me, in
the end you'll be happier to stop kvetching about Linux.   It's simply
not productive for anyone, least of all yourself.

On the other hand, if you are willing to learn a few things, and spend a
bit of time, then maybe using Linux will be more rewarding for you ---
and again, in the long time you will probably be happier.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-07-14 Thread epv
On Wed, Jul 15, 2009 at 01:55:49AM -, Theodore Ts'o wrote:  
 Eric, 
   
 The problem is that your problem may be very different from other 
 peoples' problem.   First of all, in your test, you are continually   
 dirtying the page cache with cp /dev/zero /mnt/bigfile.This brings  
 in filesystem effects, and VM effects, and so it's hard to tell what is   
 actually going on.

I was showing the results of the test that Simon propoesed a few posts  
earlier. Sorry I didn't attribute my reply properly. It was in response to  
the following:   

Simon Holm Th\370gersen  wrote on 2009-06-09:   
 It should literally be something as simple as the following   
 (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo  /media/disk/bar  
 If the time is really in seconds as you seem to suggest it is 
 interesting I'd say.  

Anyway I did also attach iostat output from during the test.


 And certainly the test which you did (cp /dev/zero /media/disk/bigfile   
 ); sleep 10 ; time echo foo  /media/disk/test is not one that we can   
 replicate on Windows, so the assertion that something is wrong is also
 not something which is immediately obvious given the very limited amount  
 of information you have given.   Maybe it's *somewhere* in this bug   
 report, bug this is why it is really not useful to mingle multiple
 users' problems in one bug report.

I'm not sure what to tell you about it not being repeatable on Windows, as  
I don't use it. But I think it would be silly to restrict debugging efforts 
to only those that can be repeated in Microsoft operating systems, 
especially since it may well turn out to be a VM system issue. 
I agree that this particular bug report has degenerated into nonsense and
I'll be leaving it alone henceforth.

 [ ... ] you just want to whine
 about how horrible Ubuntu or Linux is, then keep on doing what you're 
 doing here.   It's not going to lead to anything useful though.   But if  

Maybe you're mistaking me for someone else. I haven't engaged in any
bashing of Ubuntu or Linux. Fwiw i've commercially deployed thousands of
Ubuntu systems with great success.  
  

oao,
eric

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-06-25 Thread Angelos Vlassopoulos
I ran some tests and found out that my USB flash disk is significantly
slower when it is formatted as FAT32, compared to ext3.

I have created a new bug, which can be found here:

https://bugs.launchpad.net/ubuntu/+bug/392089

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-24 Thread Ulrich Lukas
Who wants my Hardware?


Since I can't use my USB drive (I cancelled the last attempt to copy
6GiB after more than one hour and less than 10%):


Whoever wants to do further testing or bugfixing:

You get my 16-GiB USB pen drive for for free! I can send it to you
worldwide in a cushioned envelope.

Just write me an e-mail with your name and adress. The subject line must
contain the word bug (because of my spam filter).

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-11 Thread Simon Holm Thøgersen
ons, 10 06 2009 kl. 22:38 +, skrev jamesnmandy: 
 Hiding behind a proper bug request gets us nowhere.

And you posting useless information in this bug does?

 It's not working like it is supposed to and that's painfully obvious.

And it should be painfully obvious by now that the issue cannot be fixed
if nobody can provide sufficient information to solve the problem.
Capisce?

I really don't want to be rude, but how do you expect anyone to fix a
problem this vaguely described? It is not like we can reproduce it with
our own hardware, on the contrary it works as expected. It is not
exactly easy to tell that the BIOS should be upgraded to fix the problem
like in [1].

So send us your hardware, provide root ssh access to the hardware with
or give us a proper report. It is not like it should be too difficult to
follow the troubleshooting steps of [2] or simply shut up.

 I can tell you my same exact hardware works multitudes better in terms of
 USB performance running the other OS.  Not sure what a bug report has to do
 with that, it's a fact.

It is a good first step to know the hardware doesn't suck, then we can
move on to the next in [2].

And I sympathize with you and others not being tech savy and just want
your OS to work, but unless you actually pay for support or someone to
look at your problem you should respect that there is only so much you
can expect of people using their spare time to support you.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-11 Thread Simon Holm Thøgersen
[1] https://bugs.launchpad.net/ubuntu/+bug/334914/comments/30
[2] https://help.ubuntu.com/community/DiskPerformance

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-10 Thread Simon Holm Thøgersen
man, 08 06 2009 kl. 20:14 +, skrev epv:
 This isn't normal behavior. Obviously it behaves fine while all writes
 are going to buffer cache, but once it tries to write it out to the
 device, wait times on the partition shoot up to 30sec or more, and all
 processes trying to touch the usb disk block practically forever.

If other processes get completely starved due to the writeout then there
is probably something in the VM, file system or I/O scheduler that needs
to be fixed. You would have to make a convincing argument, though, like
providing a very simple usecase. It should literally be something as
simple as the following

(cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo  /media/disk/bar

If the time is really in seconds as you seem to suggest it is
interesting I'd say. On the other hand, if what you describe is due the
low performance of the underlying device then it is expected behaviour
(the low performance of the device might be due to a bug though).

 Sysstat shows it as 100% busy continuously.

'It' being the underlying device? That is what you would expect.

 The reports of Fast at
 first, then slowing down are of course because of the buffer cache
 making it look like it's initially fast but access to the underlying
 device is always very slow, whether you are writing to it with gvfs, cp,
 dd, buffer, or whatever.

Yes, and?

 In addition, it's only writes that are slow, and they're vastly slower
 than could be explained by a crappy USB device- in my case around 100 -
 200 kbytes/sec on a device that under a Hardy install writes at several
 mbytes/sec.

If Hardy was fine then you should open a new bug report with the proper
details (once again, see [1] or Theodore's comments).

[1] https://help.ubuntu.com/community/DiskPerformance

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-10 Thread jamesnmandy
Hiding behind a proper bug request gets us nowhere.  Additionally, I do
not have the time to do the research to figure out how to even begin to
file a proper bug report.  I'm one of thoseyou know, former Windows
users, who do everything with a GUI and if there's not a double click or
next-next-finish wizard to do it, then it's not going to happen with me
and my machine.  I am what you would call the average user, average joe, who
just wants it to work like it's supposed to.  It's not working like it is
supposed to and that's painfully obvious.  I can tell you my same exact
hardware works multitudes better in terms of USB performance running the
other OS.  Not sure what a bug report has to do with that, it's a fact.  I
suppose you want average joe to show you how the software is messed up.  I'm
game for that as long as you make error logging and reporting an automated
thing.  Then you would not have to rely on people like me who obviously
don't know as much as yourself to find and implement bug fixes.

Thanks for your support.


2009/6/9 Simon Holm Thøgersen o...@cs.aau.dk

 man, 08 06 2009 kl. 20:14 +, skrev epv:
  This isn't normal behavior. Obviously it behaves fine while all writes
  are going to buffer cache, but once it tries to write it out to the
  device, wait times on the partition shoot up to 30sec or more, and all
  processes trying to touch the usb disk block practically forever.

 If other processes get completely starved due to the writeout then there
 is probably something in the VM, file system or I/O scheduler that needs
 to be fixed. You would have to make a convincing argument, though, like
 providing a very simple usecase. It should literally be something as
 simple as the following

 (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo  /media/disk/bar

 If the time is really in seconds as you seem to suggest it is
 interesting I'd say. On the other hand, if what you describe is due the
 low performance of the underlying device then it is expected behaviour
 (the low performance of the device might be due to a bug though).

  Sysstat shows it as 100% busy continuously.

 'It' being the underlying device? That is what you would expect.

  The reports of Fast at
  first, then slowing down are of course because of the buffer cache
  making it look like it's initially fast but access to the underlying
  device is always very slow, whether you are writing to it with gvfs, cp,
  dd, buffer, or whatever.

 Yes, and?

  In addition, it's only writes that are slow, and they're vastly slower
  than could be explained by a crappy USB device- in my case around 100 -
  200 kbytes/sec on a device that under a Hardy install writes at several
  mbytes/sec.

 If Hardy was fine then you should open a new bug report with the proper
 details (once again, see [1] or Theodore's comments).

 [1] https://help.ubuntu.com/community/DiskPerformance

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in gvfs: Invalid
 Status in “gvfs” source package in Ubuntu: Invalid
 Status in “linux” source package in Ubuntu: Confirmed

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)


-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-09 Thread jamesnmandy
Not sure if this has been mentioned or not, but I noticed today that
performance is much much better when copying directories to directories vs.
copying a file to a directory.  For example, I had a directory on my
desktop, with three subdirectories, each with two files in them.  When I
right-click copy and then right-click paste on to my external USB HDD to a
particular directory the file transfer speed stays at 15MBps +/- instead of
the usual starting at 15MBps and tapering off to 5MBps or less and
eventually just stopping altogether.  The total size of the main directory
being copied was just over 36GB.  Each of the three subdirectories contained
a 10-12GB file and a smaller 60kb file each.

I just thought it was odd that the file and directory structure affected the
file transfer performance and wanted to share.

On Mon, Jun 8, 2009 at 9:54 PM, jamesnmandy jamesnma...@gmail.com
wrote:

 There's no way all these people are seeing this behaviour because they all
 have vastly different yet commonly crappy hardware.  The same exact
 hardware works great under the other OS.  It's 100% a *nix issue and it's
 100% in the software.  That's painfully obvious.  I wish this would get
 fixed really soon, I recently went back to the other OS and it itself has
 many stability issues that Ubuntu does not have, so I promptly switched back
 to 9.04.  But this USB bug needs to be straightened out because it greatly
 affects the usability of the OS in today's USB age.


 On Mon, Jun 8, 2009 at 4:14 PM, epv epvubu...@limpoc.com wrote:

 This isn't normal behavior. Obviously it behaves fine while all writes
 are going to buffer cache, but once it tries to write it out to the
 device, wait times on the partition shoot up to 30sec or more, and all
 processes trying to touch the usb disk block practically forever.
 Sysstat shows it as 100% busy continuously. The reports of Fast at
 first, then slowing down are of course because of the buffer cache
 making it look like it's initially fast but access to the underlying
 device is always very slow, whether you are writing to it with gvfs, cp,
 dd, buffer, or whatever.

 The usb storage device *is* being claimed by ehci, not uhci, which I
 initially suspected was the problem. (btw the decision to compile the
 uhci-hcd and ehci-hcd drivers rather than leave them as modules, I
 think, is a bad one, since it eliminates the possibility of removing
 uhci-hcd to force ehci-hcd to claim a driver, as is sometimes necessary)

 In addition, it's only writes that are slow, and they're vastly slower
 than could be explained by a crappy USB device- in my case around 100 -
 200 kbytes/sec on a device that under a Hardy install writes at several
 mbytes/sec.

 In my case this is happening on an lenovo X61 (intel) 2.6.28-11-generic.

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in gvfs: Invalid
 Status in “gvfs” source package in Ubuntu: Invalid
 Status in “linux” source package in Ubuntu: Confirmed

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)




-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-09 Thread Simon Holm Thøgersen
 On Mon, Jun 8, 2009 at 9:54 PM, jamesnmandy jamesnma...@gmail.com
 wrote:
 
  There's no way all these people are seeing this behaviour because they all
  have vastly different yet commonly crappy hardware.  The same exact
  hardware works great under the other OS.  It's 100% a *nix issue and it's
  100% in the software.  That's painfully obvious.

Stop thinking that Nautilus is a good indicator of speed already damnit!
It is possible that you and other users really get buggily slow
performance, but I assure that there is just as many in this thread that
experience no other bugs than themselves interpretting Nautilus wrong.

And since you didn't notice, there is nothing to solve as there haven't
been supplied sufficient information to diagnose a bug.

If you've got hardware that performs significantly better with Windows
or different kernels then file a proper bug.

  I wish this would get fixed really soon, I recently went back to the other
  OS and it itself has many stability issues that Ubuntu does not
  have, so I promptly switched back to 9.04.

And I wish all you people got a clue as how to make a useful bug report
really soon, but it seems like I'll have to go back to dreaming.

 Not sure if this has been mentioned or not, but I noticed today that
 performance is much much better when copying directories to directories vs.
 copying a file to a directory.  For example, I had a directory on my
 desktop, with three subdirectories, each with two files in them.  When I
 right-click copy and then right-click paste on to my external USB HDD to a
 particular directory the file transfer speed stays at 15MBps +/- instead of
 the usual starting at 15MBps and tapering off to 5MBps or less and
 eventually just stopping altogether.  The total size of the main directory
 being copied was just over 36GB.  Each of the three subdirectories contained
 a 10-12GB file and a smaller 60kb file each.

Are these dstat numbers? Anyway, file a proper bug if you want progress.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-06-08 Thread epv
This isn't normal behavior. Obviously it behaves fine while all writes
are going to buffer cache, but once it tries to write it out to the
device, wait times on the partition shoot up to 30sec or more, and all
processes trying to touch the usb disk block practically forever.
Sysstat shows it as 100% busy continuously. The reports of Fast at
first, then slowing down are of course because of the buffer cache
making it look like it's initially fast but access to the underlying
device is always very slow, whether you are writing to it with gvfs, cp,
dd, buffer, or whatever.

The usb storage device *is* being claimed by ehci, not uhci, which I
initially suspected was the problem. (btw the decision to compile the
uhci-hcd and ehci-hcd drivers rather than leave them as modules, I
think, is a bad one, since it eliminates the possibility of removing
uhci-hcd to force ehci-hcd to claim a driver, as is sometimes necessary)

In addition, it's only writes that are slow, and they're vastly slower
than could be explained by a crappy USB device- in my case around 100 -
200 kbytes/sec on a device that under a Hardy install writes at several
mbytes/sec.

In my case this is happening on an lenovo X61 (intel) 2.6.28-11-generic.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-06-08 Thread jamesnmandy
There's no way all these people are seeing this behaviour because they all
have vastly different yet commonly crappy hardware.  The same exact
hardware works great under the other OS.  It's 100% a *nix issue and it's
100% in the software.  That's painfully obvious.  I wish this would get
fixed really soon, I recently went back to the other OS and it itself has
many stability issues that Ubuntu does not have, so I promptly switched back
to 9.04.  But this USB bug needs to be straightened out because it greatly
affects the usability of the OS in today's USB age.

On Mon, Jun 8, 2009 at 4:14 PM, epv epvubu...@limpoc.com wrote:

 This isn't normal behavior. Obviously it behaves fine while all writes
 are going to buffer cache, but once it tries to write it out to the
 device, wait times on the partition shoot up to 30sec or more, and all
 processes trying to touch the usb disk block practically forever.
 Sysstat shows it as 100% busy continuously. The reports of Fast at
 first, then slowing down are of course because of the buffer cache
 making it look like it's initially fast but access to the underlying
 device is always very slow, whether you are writing to it with gvfs, cp,
 dd, buffer, or whatever.

 The usb storage device *is* being claimed by ehci, not uhci, which I
 initially suspected was the problem. (btw the decision to compile the
 uhci-hcd and ehci-hcd drivers rather than leave them as modules, I
 think, is a bad one, since it eliminates the possibility of removing
 uhci-hcd to force ehci-hcd to claim a driver, as is sometimes necessary)

 In addition, it's only writes that are slow, and they're vastly slower
 than could be explained by a crappy USB device- in my case around 100 -
 200 kbytes/sec on a device that under a Hardy install writes at several
 mbytes/sec.

 In my case this is happening on an lenovo X61 (intel) 2.6.28-11-generic.

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in gvfs: Invalid
 Status in “gvfs” source package in Ubuntu: Invalid
 Status in “linux” source package in Ubuntu: Confirmed

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)


-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread MVDHR
I can reproduce on my Ubuntu 9.04 64 bit so far.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Simon Holm Thøgersen
MVDHR,

and why should we care? This bug has been open for a year and 50 people
have commented here, so news would be that the problem actually went
away. You give no information that helps further debug the issue, please
read https://help.ubuntu.com/community/DiskPerformance and diagnose your
problem according to the tips given there before posting anything
further. And please, please, please open a new bug once you've followed
through with that page since it actively hurts when people hi-jacks
other peoples bugs for what might be a completely different issue.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Night64
Testing with a Kingston DataTraveler on 2.6.27-14-generic x86_64 Ubuntu
9.04.

copying from /dev/zero

robe...@roberto-desktop:~$ dd if=/dev/zero of=/media/KINGSTON16/test-file bs=512
1038321+0 registros entrando
1038321+0 registros saindo
531620352 byte (532 MB) copiados, 18,2775 s, 29,1 MB/s

A few minutes later

3275058+0 registros entrando
3275058+0 registros saindo
1676829696 byte (1,7 GB) copiados, 265,338 s, 6,3 MB/s

Later, speed consistently droping.

3856803+0 registros entrando
3856803+0 registros saindo
1974683136 byte (2,0 GB) copiados, 402,468 s, 4,9 MB/s

5799921+0 registros entrando
5799921+0 registros saindo
2969559552 byte (3,0 GB) copiados, 1029,97 s, 2,9 MB/s


So far, I had the same results from everybody. But yesterday a friend used his 
iPod to copy 3.9 GiBi of data from my hard drive... And was blazing fast! I 
didn't have the time at the moment to do tests with his hardware, but later I 
noticed that the iPod had two different lines in dmesg:
[81601.496620] usbcore: registered new interface driver usb-storage
[81601.496716] USB Mass Storage support registered.



** Attachment added: dmesg from Pen drive.
   http://launchpadlibrarian.net/26989331/dmesg.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Night64

** Attachment added: dmesg from blazing fast ipod
   http://launchpadlibrarian.net/26989377/dmesgipod.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Theodore Ts'o
Night64:

No, you're using usb-storage device driver for both the pendrive and the
ipod.The messages that you quoted as coming from the ipod just means
that the usb-storage module had gotten unloaded, and when it was loaded
as a module, it prints those lines to the kernel log.   The fact that
things were fast going to the ipod and variable when you write to the
your USB flash device tends to indicate that the problem is specific to
the flash device; it might just be that the flash device is sometimes
slower because writing to flash can be slower sometimes,  and it might
be exacerbated by the FAT filesystem, which is never known as a speed
demon.

Note that this might not be true for other users on this bug report ---
which is why I've suggested everyone file separate bug reports.   People
using Ubuntu 8.10 might possibly have been using the Low Performance USB
storage driver, which Canonical inexplicably configured into older
Ubuntu kernels.   Anyone using that will definitely see massive
performance problems --- and this has been known for ages.  (Another
reason why many kernel developers aren't happy trying to clear up
Ubuntu-specific bugs)   In any case, this kernel configuration bug
doesn't seem to be a problem for Ubuntu 9.04; libusual.ko doesn't appear
to be built any more, which is a Very Good Thing.   Some users from a
year ago who might have been using the low performance USB driver might
have a very different problem than yours --- which is why it's better
for each user to open separate bug reports.

Remember that most of the people with the experience and knowledge to
help are volunteers.  If Ubuntu users continue to make life difficult,
kernel developers will simply stop volunteering to wade through the
cesspit of Ubuntu launchpad bugs

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Simon Holm Thøgersen
Night64,

flash devices are slow and the only reason the transfer appears to be
fast at the beginning is that data is written to OS memory and then
later to disk. Use dstat to monitor disk performance as explained on
https://help.ubuntu.com/community/DiskPerformance, And open new bug
reports please (though not in this case since your device is just slow,
unless you can demonstrate better performance using Windows everything
is as expected).

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Night64
Thanks for the info, Ts'o. But your comment about libusual caught my eye. In
Ubuntu 9.04 this module still shows up, right?

[81601.434729] usbcore: registered new interface driver libusual

Linux: Because rebooting is for adding new hardware.
Sent from Brasilia, DF, Brazil


On Wed, May 20, 2009 at 5:32 PM, Theodore Ts'o ty...@mit.edu wrote:

 Night64:

 No, you're using usb-storage device driver for both the pendrive and the
 ipod.The messages that you quoted as coming from the ipod just means
 that the usb-storage module had gotten unloaded, and when it was loaded
 as a module, it prints those lines to the kernel log.   The fact that
 things were fast going to the ipod and variable when you write to the
 your USB flash device tends to indicate that the problem is specific to
 the flash device; it might just be that the flash device is sometimes
 slower because writing to flash can be slower sometimes,  and it might
 be exacerbated by the FAT filesystem, which is never known as a speed
 demon.

 Note that this might not be true for other users on this bug report ---
 which is why I've suggested everyone file separate bug reports.   People
 using Ubuntu 8.10 might possibly have been using the Low Performance USB
 storage driver, which Canonical inexplicably configured into older
 Ubuntu kernels.   Anyone using that will definitely see massive
 performance problems --- and this has been known for ages.  (Another
 reason why many kernel developers aren't happy trying to clear up
 Ubuntu-specific bugs)   In any case, this kernel configuration bug
 doesn't seem to be a problem for Ubuntu 9.04; libusual.ko doesn't appear
 to be built any more, which is a Very Good Thing.   Some users from a
 year ago who might have been using the low performance USB driver might
 have a very different problem than yours --- which is why it's better
 for each user to open separate bug reports.

 Remember that most of the people with the experience and knowledge to
 help are volunteers.  If Ubuntu users continue to make life difficult,
 kernel developers will simply stop volunteering to wade through the
 cesspit of Ubuntu launchpad bugs

 --
 file transfers on USB disk are very slow
 https://bugs.launchpad.net/bugs/197762
 You received this bug notification because you are a direct subscriber
 of the bug.

 Status in gvfs: Invalid
 Status in “gvfs” source package in Ubuntu: Invalid
 Status in “linux” source package in Ubuntu: Confirmed

 Bug description:
 When transferring large files (800meg) or even medium-size files (200meg),
 the transfer rate decreases constantly. It starts at around 4meg/sec and
 goes down to even less than 800kb/s. When I cancel the download and start it
 over again, the transfer rate comes back up to 4meg/sec.
 I am using Nautilus on Ubuntu 8.04 (hardy heron)


-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs

Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-05-20 Thread Theodore Ts'o
On Wed, May 20, 2009 at 08:48:34PM -, Night64 wrote:
 Thanks for the info, Ts'o. But your comment about libusual caught my eye. In
 Ubuntu 9.04 this module still shows up, right?
 
 [81601.434729] usbcore: registered new interface driver libusual

Oops, sorry, that's what I get for not checking the driver names more
closely.  libusual is mostly harmless; it's the mapping function that
arbitrates between ub and usb-storage drivers.  The USB low
performance device driver is ub.ko, normally found in,
kernel/drivers/block/ub.ko:

% find /lib/modules -name ub.ko 
/lib/modules/2.6.27-9-generic/kernel/drivers/block/ub.ko
/lib/modules/2.6.28-11-generic/kernel/drivers/block/ub.ko

You really, really, *really* want to avoid using the low performance
USB driver at all costs.  Fortunately at least with modern kernels
libusual defaults to trying to prefer the usb-storage driver.  I'm not
sure of the time frame, but a while ago, some distributions were
defaulting to using the ub driver, and *boy* was that a disaster.

The ub driver is useful in embedded devices where you might not want
to have the full USB stack (udev, hal, etc.), but I'm not sure why it
anyone would want it to use it on a normal system

Simon's observation is quite right, some flash devices are just slow.
Note that 1x flash devices will only write at 150k/s.  A 16x
device will write at 2.4 MB/s.  And this is assuming the filesystem
doesn't get in the way.  This is the speed rating used by Compact
Flash or Secure Digital (CF or SD) cards.  USB sticks generally don't
have speed ratings at all, and depending on what you've purchased,
they could be quite slow indeed.  Note that with SD cards, sometimes
the high speeds advertised (i.e., 150x) may not apply at all unless
you have special hardware --- or sometimes the manufacturers are just
lying.  But given that there do exist 1x flash devices that only
write at 150k/s should be a warning that some flash devices Are Just
Slow.  Hence my request that people who are really interested in
debugging this should use USB hard drives, and not USB flash devices
--- there's no way for us on the other side to know whether you are
using a high quality or low-quality flash device, and so the speed
problem could just be normal operation.

In general, sometimes small writes will seem to go fast, because they
get cached in memory.  But just because the write operation seems to
have completed doesn't mean that it's really done, or that it's safe
to remove the flash device.  So when you see an LED on a USB stick
flashing, that's a sign that it's still writing out.  If you write a
very large file, eventually there's no more memory available, and so
now the slow write speed becomes visible to the user.

So this is why I'm becoming more and more convinced that we should
just nuke this bug from orbit and start over.  Naive users who don't
understand this, can often see normal system performance, and report a
me too!, and this just gums up the works.

There ***may*** be a real bug hiding in here somewhere, by some users.
Or it culd be a configuration bug; or a hardware bug.  But there are
too many users who are saying, I'm seeing this too!, when in fact
they may just be seeing normal system behaviour.

- Ted

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Neil Burlock
I did have a long list of tests to attach here, but using dstat over the
last couple of hours it appears that one of my drives that is connected
via eSATA might be faulty.  Until last week when I purchased a new 640GB
I was using it (WD 500GB ext4) as my desktop drive and prior to that as
my server drive.

I got the following from a transfer test of the 500GB WD drive:

2906193920 bytes (2.9 GB) copied, 62.6089 s, 46.4 MB/s

Which seems OK.  However in my tests I've found that the eSATA slowdown
is occurring only when reading from this particular drive, not when
writing to it.  I've tested several other WD drives, none of which are
showing any slowdowns in reading or writing over eSATA.  For now, eSATA
is off the hook as being involved in this problem and I will dispose of
the 500GB drive once I've got the rest of my data off it.

I'll begin testing USB and network transfers tomorrow.  Potentially,
this drive could have been involved in a lot of the performance problems
since much of my copying is from flash to desktop to server and back in
the reverse order.  I'll need to do more testing.

In the meantime, I can't thank you enough Theodore Ts'o for explaining
that performance test and dstat.  I wish someone had suggested it a year
ago...

I've attached a copy of the dstat from reading the 500GB drive for
reference.

** Attachment added: dstat from what is likely a faulty 500GB drive (sdb3)
   http://launchpadlibrarian.net/26928395/dstat.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Ulrich Lukas
System running Ubuntu Jaunty AMD64, vanilla 2.6.29.1. KDE4.2, two
terminal windows, no other graphical applications.

I created two test files of identical size with random data and copied to the 
USB pendrive, once on a freshly rebooted system, and once after I first 
experienced a slowdown while copying some other files to the pendrive and 
deleting them again; doing a sync after each copy.
A second terminal window ran dstat -D sda,sdb both times.

( Preparation:
dd if=/dev/urandom of=/var/tmp/850-MiB-testfile.A bs=1M count=850
dd if=/dev/urandom of=/var/tmp/850-MiB-testfile.B bs=1M count=850
reboot )

First run after reboot:
(/dev/sdb1 mounted on /media/pendrive)
cp /var/tmp/850-MiB-testfile.A /media/pendrive

Second run after the first slowdowns were observed during copying of other 
files and deleting them again:
cp /var/tmp/850-MiB-testfile.B /media/pendrive

The output results of dstat -D sda,sdb are attached.

First run,  approx. 16 MiB/sec constant:  dstat-D.OK.850-MiB-random-
data.txt

Second run with slowdown:  dstat-D.slow.850-MiB-random-data.txt


I'm sorry, I couldn't figure out what causes the slowdown after a while.

I'm doing some more tests tomorrow, with other kernel versions
and with a borrowed USB harddisk.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Ulrich Lukas

** Attachment added: Output of dstat -D sda,sdb, showing expected performance
   http://launchpadlibrarian.net/26929198/dstat-D.OK.850-MiB-random-data.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Ulrich Lukas

** Attachment added: Output of dstat -D sda,sdb, showing slowdown
   http://launchpadlibrarian.net/26929209/dstat-D.slow.850-MiB-random-data.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Theodore Ts'o
Ulrich --- if you have time to try to do more tests, may I gently
suggest that you start a new Launchpad bug?Drop a pointer from in
this launchpad bug number to the new one, but let's do all of the
experimentation on a new launchpad bug.   There are a couple of reasons
for this:

(1)  Launchpad has horrific scalability problems, and it's painfully
slow to find new entries on this Launchpad entry, since it has so many
comments already.

(2)  It's not clear everyone on this bug is sufferring from the same
bug.   They may have similar symptoms, but that doesn't mean it is the
same bug.   It's actually **highly** confusing to have many people
glomming on with a me, too!! comment, giving a very tiny amount of
information, but not actually giving a full description of what they are
seeing.   In fact, the tiny amounts of data may be horribly misleading,
because they may be seeing a different bug.

(3) As a result, many kernel developers on LKML don't spend a lot of
time on Launchpad bugs; the bug reporting is ___so___ ___bad___ that
it's just too frustrating and time-consuming for them.   And
unfortunately, Canonical has a fairly limited kernel team, and it takes
them a lot of time try to synthesize a good bug report from a lousy one.
In fact, someone recently posted this bug report on LKML, and what it
mostly got was a vent from someone complaining how useless most Ubuntu
bugs were.  (Well, it also got me interested enough to actually take a
look, but I've gotten inured to how lousy Ubuntu bug reporting
infrastructure is for large bugs, as well as mostly uninformative bug
reports.)

So if we do have one or more people who have the time and energy to do
some real bug reporting (which takes real work), may suggest that each
person open a separate bug, and each bug, give (a) full details about
what kernel version, including whether it is a Ubuntu kernel or a
mainline kernel, (b) full details about your hardware version, including
which disks are hooked up which way (i.e., eSATA, USB, SATA, PATA,
etc.), and (c) exhaustive details about how you ran your test case,
whether or not is repeatable, etc.   Also note that it is an instance of
Launchpad bug #197762, and that anybody else who wants to glom on with a
me, too is kindly asked to put that remark in the #197762
cesspit^H^H^H^H^H^H^H^Htop-level bug, and not in the new bug report,
which we can hopefully keep specific to your situation.

I would again suggest that you try doing multiple tests:

1)  Copying one file from one disk to another
2)  Copying from /dev/zero to file on the disk
3)  Copying from /dev/zero to the raw disk device (yes, this will blow away 
your filesystem; hopefully you have scratch devices)

The ideal bug reporter will have multiple devices that can be attached
via different hardware interfaces (i.e., eSATA, USB, maybe a spare SATA
port), so we can try to rule out hardware attachment problems.

If someone is willing to do all of that, I'm more than willing to try to
drill down as far as I can; although if it turns out to be a USB
problem, I'll need to call in help from a USB developer  but with a
well constructed bug report, that shouldn't be a problem; I should be
able to overcome LKML prejudices about lousy Launchpad bugs (no really,
this one is different; we've kept it clean and professional, and there's
plenty of information --- and we have a technically cluefull user who is
willing to work with you and run experiments until the problem can be
solved)

More generally, maybe someone with the time can start a Wiki page on
debugging filesystem performance problems, maybe on the Ubuntu wiki
somewhere, or on ext4.wiki.kernel.org.There are plenty of tools like
that people can use for debugging performance problems, beyond just
dstat.   Other tools include blktrace, sar, iostat, vmstat, and many
others.   Launchpad is really a lousy place to have these discussions; a
wiki or a forum topic is really much better.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Robert Fekete
Hi, I am experiencing a similar problem on a fresh jaunty install when copying 
files to an USB hdd. I do not even need to 
transfer large files, transferring around a few mp3-s kills the transfer rate 
in a few seconds. 

Theodore-- I will try to get some time and start collecting the info you
requested in your previous comment.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-19 Thread Simon Holm Thøgersen
So, I believe I am the one Theodore refered to as venting how the
useless Ubuntu bug reports are. While they really are, I also really
want to help.

So, following Theodore's suggestion I've started
https://help.ubuntu.com/community/DiskPerformance on the Ubuntu Wiki. It
is pretty basic right now, mostly repeating what Theodore already wrote
here. Let's follow this from here (or rather in separate bug reports as
Leann and Theodore have already advocated) and expand it according to
common patterns of the reports.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-18 Thread Neil Burlock
No, it's not Ubuntu specific and Canonical didn't cause it.

Right now I'm copying between two SATA drives, connected to my PC via
eSATA.  So far a lousy 600MB has been copied and I'm already down to
5MB/s and falling.

Here is what I know about the problem:

It affects ALL hardware.

It affects ALL file copying connections to varying degrees: USB,
network, SATA/eSATA.

In some instances, it also affects multitasking, all but locking the
computer up despite little to no CPU use in System Monitor.

There are no error logs, messages or anything else that occur when the
problem is happening.

In my experience, if you test for the problem and nothing seems to be
wrong, then that's because you aren't copying enough data, you don't
know how fast your hardware should be copying files, or you are lucky
enough to only be subtly affected that time.  Try copying more multi-
gigabytes of data, several times and see if you can't get wildly
different durations for the same data size.  As I state above, all
hardware I have tested is affected to varying degrees, some hardware
shows minor performance degradation over time, some hardware is all but
useless for file copying.

If you ask me, it's either the scheduler (GUI lockups with no CPU usage
makes me think this) or whatever performs the actual file copy process.
It's definitely not a USB problem because it affects network copying
too.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-18 Thread Theodore Ts'o
For people who are seeing this --- try booting the kernel with the
mem= command line option and see if this makes a difference.  For
example if you have 4 gigs of memory, try using mem=1G; if you have a
gig of memory, try using mem=512M.   Does this change how big the file
needs to be before you start seeing the slowdown?

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-18 Thread Theodore Ts'o
Something else to try; I would suggest using dstat with the -D option
(i.e, dstat -D sda,sdb) or iostat 1 (although I find dstat to be a bit
more user friendly) to measure I/O transfer rates.   I would recommend
using dd if=/dev/zero of=/media/disk/test.img bs=32k to measure the
transfer rates, and I would *not* recommend using a flash based device
because they can show a lot of variance all by themselves.So please,
use some kind of HDD.

Speaking personally, I've been doing a rather huge amounts of copying of
files back and forth between disks, using ext4, in the 30-40 gigabyte
range, and I've not noticed anything like this.   This could be
filesystem related, or related to the page writeback algorithms, and so
something else to try would be to try dd'ing to a raw disk, and see if
you see the slowdown.   For me, using a 2.6.30-rc5 and the ext4
filesystem, I've done many, *many* copies of data using rsync -axH to
copy over entire filesystems (for doing things like testing fsck
speedups between ext4 and ext3) and I've noticed a problem.   I normally
have a window open running dstat -D sda,sdb, so I can get dynamic
output like this once a second:

total-cpu-usage --dsk/sdb-dsk/sdc-- -net/total- ---paging-- 
---system--
usr sys idl wai hiq siq| read  writ: read  writ| recv  send|  in   out | int   
csw 
 19  26  42  11   0   2|   016M:  15M0 |   0 0 |   0 0 |2081  
9176 
 20  24  41  13   0   2|   016M:  15M0 |   0 0 |   0 0 |2092  
9287 
 18  24  42  14   0   1|   012M:  14M0 |   0 0 |   0 0 |2003  
8987 

Note that filesystem activity can make a huge difference.  When copying
files around, there's enough seeks going on that in practice I can only
read or write 16 megabytes/second.   If I do a dd if=/dev/zero
of=/scratch/zero.img bs=32k, I get this:

total-cpu-usage --dsk/sdb-- -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
  3  10  57  28   0   1|   057M|   0 0 |   0 0 | 746  1268 
  4  27  43  25   0   2|4096B   58M|   0 0 |   0 0 |1065   951 
  4  21  44  30   0   1|   060M|   0 0 |   0 0 | 701   396 
  5  23  50  20   0   2|   061M|   0 0 |   0 0 | 718   288 

Here's what I get if I do dd if=/dev/zero of=/dev/closure/scratch
bs=32k

total-cpu-usage --dsk/sdb-- -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
 11  13  47  27   0   1|   061M|   0 0 |   0 0 | 740  1327 
  3  15  49  32   0   1|   061M|   0 0 |   0 0 | 522   249 
  2  10  50  37   0   1|   061M|   0 0 |   0 0 | 476   246 
  6  14  49  30   0   1|   061M|   0 0 |   0 0 | 544   260 
  3  12  49  35   0   1|   061M|  60B   60B|   0 0 | 558   260 

And here's what I get if I format /dev/closure/scratch as ext3 instead
of ext4, and then do dd if=/dev/zero of=/scratch/zero.img bs=32k:

usr sys idl wai hiq siq| read  writ| recv  send|  in   out | int   csw 
  5  19  17  57   0   1|4096B   47M|   0 0 |   0 0 | 637   503 
  6  15   0  77   0   1|   052M|   0 0 |   0 0 | 608   611 
  5   1   0  94   0   1|   051M|   0 0 |   0 0 | 385   450 

So when people complain about slow disk performance, you really need to
control variables.   All I can say is that on a Thinkpad X61s, using
SATA disks, USB disks, and SATA disks over a SATA/PATA/SATA bridge
(horrific hardware kludge in when you use disks in the Ultrabay slot ---
don't ask) I've not seen the problem are complaining about.

Note that if you are doing copies when there are other programs going on
in the background, including programs like firefox triggering off
fsync()'s this can also affect performance numbers.   So what's really
needed are people who are willing to spend a lot of time drilling down
into why the performance is dropping, and by controlling variables; I
recommend using a scratch filesystems and scratch disks that you don't
mind reformatting so you can do multiple repeatable experiments, and to
do it on a system that isn't running anything else in the background.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-18 Thread Neil Burlock
Theodore, thanks for the info.

I don't have a lot of time this morning before work, but I was able to
run one test which illustrates the problem.  In the attached dstat
output, I copied 3.4GB between two eSATA HDD.  It started off fast (as
usual), but by the time the copy finished the dialog was showing about
5.5MB/s.

I'll look into it more later today.

** Attachment added: dstat.txt
   http://launchpadlibrarian.net/26910849/dstat.txt

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-18 Thread Neil Burlock
Forgot to mention, that dstat is for the destination drive only.  I'm
also not seeing as much of a slowdown if I copy from the source to the
internal drive, then to the destination drive.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-17 Thread psypher
I wil have to disagree with about ram. busy trying to clone my root
partition with dd to a usb hard drive. booted with jaunty 32bit live cd
and started the process with dd if=/dev/sda3 of=/media/disk/image.img
conv=sync,noerror bs=64K. 1st 10GB flew by at 25-30MB/s then started
slowing down to 10MB/s till about 25GB and then crawls at 3MB/s. stopped
it around 53GB after about 5 hours and tried turning off USB legacy
emulation in the BIOS as suggested by some other posts. started the
process again and the EXACT same thing happened.  ram usage is not a
factor at all:

  total   used   free sharedbuffers 
cached
Mem:   309564812434521852196  0 763720 264116
-/+ buffers/cache: 2156162880032
Swap:  1638588  01638588

rebooted to switch the sata hard drive to ahci. could not boot ubuntu at
all so thats not a workaround. had the same issue on my desktop. not
sure how you are supposed to get any ubuntu booted in ahci mode.

also tried manually mounting the usb drive and also made no difference.
in fact i have tried this when i was still running hardy and it made no
difference then. so as far as I am concerned there is no workaround for
this problem at all. started the clone last night at 11:30 and is still
running now at 9:30 and is only on 63GB. shocking.

This issue has been plaguing us since hardy and is frankly embarrassing for OSS 
and Ubuntu.
This is not a medium bug IMO but should be marked as CRITICAL. Need to do 
emergency clone of a hard drive you cannot expect someone to wait 12 hours for 
something that should take 1 or 2 This bug was logged a year ago. what can be 
done to fix it finally???

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-17 Thread psypher
backup is now at 64GB and has slowed down to 500KB/s and I will have to
stop it.

Usb is now officially a completely useless backup tool on linux.

just stopped it, dd claims 65GB has been copied avg 1.5MB/s

like to mention that this has always been a very intermittent issue.
sometimes works fine mostly does not. doing this dd image has been the
most reliable way to reproduce the problem.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-17 Thread Sebastian Riebel
Hello,

this bug isn't ubuntu specific I think.

I can reproduce this problem with Debian 3.1/4.0/5.0 and linux 2.6.29 too.
Can you try it with Ubuntu 6.06 again? There doesn't affects me this problem...

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-08 Thread Kurt De Smet
Hi Lucas,

I noticed everything goes fine until the memory gets full, then starts
the swapping and the slowdown. It's like the memory is used as buffer,
when that runs out it uses the virtual memory on the HD. No problem with
small sizes that fit the memory but when you select 100 GB at once ...
then the HD starts writing to itself fairly rapidly. When AHCI was
enabled the memory gets used to but strangely enough it does not use the
virtual memory (NCQ?). As you stated the NCQ may prevents the HD from
playing with itself. It may not be the main problem (that's why I didn't
file a bug) but I'm fairly sure some people have IDE selected or only
have IDE in their BIOS. I only thought it was worth mentioning how I
solved my problem because I read very similar stories to mine here. It
could be good to know if they are using a PATA or SATA drive as source.
Once you filter those out you can narrow down to the real problem.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-07 Thread Kurt De Smet
I had the same problem, needed to backup 200+ GB to a USB HD due to a
hardware upgrade. Then I remembered the board had a strange bios reset
recently (hence the upgrade) so I checked and set the bios SATA
configuration back from IDE to AHCI (My mobo has 3 possible settings
IDE, RAID and AHCI). Now it's supper silent (no more swapping to disk)
and a steady transfer rate (+/- 27 MB/sec).

This is the solution that helped me, and hopefully some others.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


Re: [Bug 197762] Re: file transfers on USB disk are very slow

2009-05-07 Thread Ulrich Lukas
Hi Kurt,


albeit the AHCI-mode enables the use of Native Command Queueing (NCQ)
for some mainboards, I somehow doubt that this has to do with the USB
issue. Especially because of the swapping you reported which IMO has
nothing to do with the USB speed issues reported before.

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-05-04 Thread Pavol Klačanský
Same problem here, I have Thinkpad T500, starting speed was about 15
MB/s and at the end only about 3 MB/s, size of transfered file is 3,2 GB

dist: jaunty 64 bit

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


[Bug 197762] Re: file transfers on USB disk are very slow

2009-04-22 Thread Sebastian Riebel
** Changed in: linux (Ubuntu)
   Status: Incomplete = Confirmed

-- 
file transfers on USB disk are very slow
https://bugs.launchpad.net/bugs/197762
You received this bug notification because you are a member of Ubuntu
Desktop Bugs, which is a bug assignee.

-- 
desktop-bugs mailing list
desktop-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/desktop-bugs


  1   2   >