Re: [Bug 197762] Re: file transfers on USB disk are very slow
I can concur with Digital5700. My 1TB external drive has no performance issues, but my 8GB flash drive has trouble getting a 700MB file onto it in a reasonable amount of time. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
I do not see this option in karmic Carlos M wrote: Sergey Once the USB thumbdrive is mounted, you can right-click on its desktop icon and select Properties. From there you will see the Volume tab and specify the mount options Carlos M -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
** Attachment added: Data sheet.ods http://launchpadlibrarian.net/35911171/Data%20sheet.ods -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Dear Shawn, dstat does essentially that. Default is one line of output every second, which means the output equals the MiB/sec throughput of your device. Try dstat -D sda,sdb. You can also adjust the delay; see the manual page. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
At this moment, the only way to survive at this bug is open an ftp or sftp connection in local host and copy files with filezilla or similar client O_O. It's an absurd solution, I know, but the only one that not freeze my work. by BAIS 2009/11/8 Dexter pogany.tamas+...@gmail.com pogany.tamas%2b...@gmail.com Bug confirmed on Karmic Koala -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of a duplicate bug. Status in GVFS: Invalid Status in “gvfs” package in Ubuntu: Invalid Status in “linux” package in Ubuntu: Triaged Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- by BAIS FreeFAX: +39 04921064377 -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
I will agree the FTP does not work for me either. the best thing for myself was to do a reboot. transfers are good for the first hour or two... then get mediocre and after a day possibly two... abysmal. rom85 wrote: 2 BAIS: this doesn't help for my situation also. when copying by filezilla first 50mb are copied quite fast, but after that great slowdown as if it was copied from hdd. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Strange I used this method for gigas and gigas and I continued to work well, I have kubuntu 9.04 daily updated. I'm using server kernel, I don't know why :) Probably for some application I've installed for testing. I have a dream... this software on linux -- www.killprog.com Killcopy ! best file manager , pause, anti crash, buffer tuning, bandwidth, different configuration for differente kind of devices... all in 1 little program... parallel copy, queue... other is teracopy but kill copy rocks. If I was a programmer I make it on linuxbox. I will test on a scp / ftp session and I will post my results. by BAIS 2009/11/17 Shawn Reist icab...@shaw.ca I will agree the FTP does not work for me either. the best thing for myself was to do a reboot. transfers are good for the first hour or two... then get mediocre and after a day possibly two... abysmal. rom85 wrote: 2 BAIS: this doesn't help for my situation also. when copying by filezilla first 50mb are copied quite fast, but after that great slowdown as if it was copied from hdd. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of a duplicate bug. Status in GVFS: Invalid Status in “gvfs” package in Ubuntu: Invalid Status in “linux” package in Ubuntu: Triaged Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- by BAIS FreeFAX: +39 04921064377 -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
I asked this some where but maybe not here... I can't program, but is it possible to gather data via a script that would put data into a sort of quasi time line format with certain data appended to it.. i.e start copy. time bytes written rate . time bytes written rate . . . end time total bytes written maybe one could set the program to be variable for time say 10, 30, 60. . second intervals other data append at the end, the modules used, Uname -a... and computer information.. like I said I can't program... would need lots of help.. but for an idea...? -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Hello, I am not a programmer and not that versed on how things in Linux work; still quite Green. Can a program be made to monitor a file transfer. i.e. track the progress. there is something that is happening in the background. The best file transfers I have is just after a reboot of the computer... then things go slowly down hill. I have noticed I can have a good transfer for 1/2 the file then there is a pause and the rest of the transfer process is jerky/spurts of data written/transferred, the process takes longer to complete as the concurrent transfer packets or amount of data is slower/smaller. Is it possible to have a packet sniffer for file transfers and it would log the rate of the transfer packet size modules being used or errors logged and have a time stamp. there has to be something that we just don't see if a user pulls the logs manually or does a lsusb, df, hdparm, . . . one would think that a time chart or sequenced time line of the event would help point in the direction of the problem logically?. yes? no? -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
LOL, same patch applied here, having something as basc as USB communications breaking down essentially breaks the entire OS for most people, i really wanted Ubuntu to be my last OS but this bug killed it On Thu, Oct 29, 2009 at 10:53 PM, Ulrich Lukas stellplatz-nr@datenparkplatz.de wrote: Martin and Murz, maybe you can get help if you open up an individual, detailed bug report. Given that this 184-message bug report is over one and a half year old, I'm afraid adding comments here does not help. This bugfix works, I've just tested it: http://www.microsoft.com/windows/windows-7/default.aspx -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in GVFS: Invalid Status in “gvfs” package in Ubuntu: Invalid Status in “linux” package in Ubuntu: Triaged Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Martin and Murz, maybe you can get help if you open up an individual, detailed bug report. Given that this 184-message bug report is over one and a half year old, I'm afraid adding comments here does not help. This bugfix works, I've just tested it: http://www.microsoft.com/windows/windows-7/default.aspx -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
RE: [Bug 197762] Re: file transfers on USB disk are very slow
I've just remembered why the user base of Linux is so small I do actually expect my mechanic to find and fix what's wrong with my car when I just tell him it won't start And I don’t care if it's the engine the battery or the radiator You have to understand that most users have no idea where the problem is coming from or if its two separate ones They are just using the system and see the problems -Original Message- From: boun...@canonical.com [mailto:boun...@canonical.com] On Behalf Of Theodore Ts'o Sent: Wednesday, July 15, 2009 4:43 PM To: kuli...@afikim.org.il Subject: [Bug 197762] Re: file transfers on USB disk are very slow On Tue, Jul 14, 2009 at 08:45:56PM -0700, Ron Brogden wrote: Theodore, if I may ask you - are you just another random Linux user here or are you actually officially associated with Ubuntu in a support role? I see that you are associated with IBM, have written some file system utilities and appear to be connected with kernel development but am unsure your role here with respects to this bug. I'm a linux kernel developer, and yes, I'm the maintaining of the ext4 filesystem and e2fsprogs. I started paying attention to this problem because someone sent a note to the LKML (Linux Kernel Mailiung List) complaining that kernel developers don't pay attention to Ubuntu bugs. Keep in mind most Ubuntu users get Ubuntu for free, and pay no support fees; so it's not surprising that you will see very few Ubuntu support personnel paying attention to bugs like this one. So at some level, the Ubuntu user community and Canonical has a choice to make. If they are willing to let users just whine and whine and whine and _not_ help us by running experiments and opening separate bugs for each problem, and give full information (and we will provide them with explicit instructions on how to run those experiments), fine. We can just go back to ignoring Ubuntu launchpad as being totally, completely, worthless for actually fixing bugs. It can just be a place toxic sewer pit for users to whine, and if Canonical wants to pay someone to try to extract useful information (lots of luck; theres very little here) after the fact, they can go right ahead. We'll just file Ubuntu into the there's no intelligent life here category, and ignore pleas for help on LKML when people ask developers to pay attention to Launchpad bugs. Alternatively, if the goal is to have one part of the community helping another, then the users have to be helpful. That means doing research before filing bugs, and filing separate bugs for separate issues. Launchpad fails miserably when there are more than 80 comments; it's slow and painful to use. So I am trying to see if we can salvage the Launchpad culture so it can be useful, but ultimately, maybe it's a losing battle, and we should give up. Obviously most folks have no idea why their USB transfers are slow but they know something is up. It should be no surprise that they post unclear bug reports since there is no real way for them to tell whether their file manager, the kernel or some other bit of software is the cause. All they know is something is wrong and for those that dual boot, it does not happen with Windows (not my situation but it is far from uncommon). Of course this is frustrating for the bug fixer but then the response should be a request for hardware that displays the problem at the very least (which I believe has been offered here). The problem is that we need to separate out the reports. When something is as vague as disk transfers are slow, there's a extremely high probability that there may be multiple things going on. Some people might be having genuine hardware problems; others might be having filesystem issues. Eric's (epv's) problem *might* be the classic ext3/fsync stalled write problem --- I can't tell, because _he_ hasn't filed a separate bug report and given information about his problem. Do you really expect a car mechanic to fix all problem descriptions of the form my car is hard to start simultaneously? They all have the same symptoms, so *obviously* they must have same root cause. NOT. Since you are apparently a file system expert, how about writing a quick utility that gives out the details you think would be pertinent for assessing file transfer speeds over USB? This could then be used as a benchmark and hopefully show once and for all where the bottleneck is occuring. Presumably hacking the cp source (or dd or whatever) to add in some timing information is not a huge undertaking. The 'dd' program already provides this information. For example, like this: sudo dd if=/dev/sdXX of=/dev/null bs=32k count=32k But we have people whining on this bug about how they are GUI persons only, and don't have time to do any research on the bug. If all they are doing is whining, then maybe they should really go to Windows or MacOS. Or they should get a paid support contract from some Linux
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Well, my linux support fix my problem, even when I can't explain what is the problem. But I pay for it! Canonical have a nice and not very pricey support service, maybe you could hire them. Linux: Because rebooting is for adding new hardware. On Wed, Jul 15, 2009 at 8:33 AM, kulight kuli...@afikim.org.il wrote: I've just remembered why the user base of Linux is so small I do actually expect my mechanic to find and fix what's wrong with my car when I just tell him it won't start And I don’t care if it's the engine the battery or the radiator You have to understand that most users have no idea where the problem is coming from or if its two separate ones They are just using the system and see the problems -Original Message- From: boun...@canonical.com [mailto:boun...@canonical.com] On Behalf Of Theodore Ts'o Sent: Wednesday, July 15, 2009 4:43 PM To: kuli...@afikim.org.il Subject: [Bug 197762] Re: file transfers on USB disk are very slow On Tue, Jul 14, 2009 at 08:45:56PM -0700, Ron Brogden wrote: Theodore, if I may ask you - are you just another random Linux user here or are you actually officially associated with Ubuntu in a support role? I see that you are associated with IBM, have written some file system utilities and appear to be connected with kernel development but am unsure your role here with respects to this bug. I'm a linux kernel developer, and yes, I'm the maintaining of the ext4 filesystem and e2fsprogs. I started paying attention to this problem because someone sent a note to the LKML (Linux Kernel Mailiung List) complaining that kernel developers don't pay attention to Ubuntu bugs. Keep in mind most Ubuntu users get Ubuntu for free, and pay no support fees; so it's not surprising that you will see very few Ubuntu support personnel paying attention to bugs like this one. So at some level, the Ubuntu user community and Canonical has a choice to make. If they are willing to let users just whine and whine and whine and _not_ help us by running experiments and opening separate bugs for each problem, and give full information (and we will provide them with explicit instructions on how to run those experiments), fine. We can just go back to ignoring Ubuntu launchpad as being totally, completely, worthless for actually fixing bugs. It can just be a place toxic sewer pit for users to whine, and if Canonical wants to pay someone to try to extract useful information (lots of luck; theres very little here) after the fact, they can go right ahead. We'll just file Ubuntu into the there's no intelligent life here category, and ignore pleas for help on LKML when people ask developers to pay attention to Launchpad bugs. Alternatively, if the goal is to have one part of the community helping another, then the users have to be helpful. That means doing research before filing bugs, and filing separate bugs for separate issues. Launchpad fails miserably when there are more than 80 comments; it's slow and painful to use. So I am trying to see if we can salvage the Launchpad culture so it can be useful, but ultimately, maybe it's a losing battle, and we should give up. Obviously most folks have no idea why their USB transfers are slow but they know something is up. It should be no surprise that they post unclear bug reports since there is no real way for them to tell whether their file manager, the kernel or some other bit of software is the cause. All they know is something is wrong and for those that dual boot, it does not happen with Windows (not my situation but it is far from uncommon). Of course this is frustrating for the bug fixer but then the response should be a request for hardware that displays the problem at the very least (which I believe has been offered here). The problem is that we need to separate out the reports. When something is as vague as disk transfers are slow, there's a extremely high probability that there may be multiple things going on. Some people might be having genuine hardware problems; others might be having filesystem issues. Eric's (epv's) problem *might* be the classic ext3/fsync stalled write problem --- I can't tell, because _he_ hasn't filed a separate bug report and given information about his problem. Do you really expect a car mechanic to fix all problem descriptions of the form my car is hard to start simultaneously? They all have the same symptoms, so *obviously* they must have same root cause. NOT. Since you are apparently a file system expert, how about writing a quick utility that gives out the details you think would be pertinent for assessing file transfer speeds over USB? This could then be used as a benchmark and hopefully show once and for all where the bottleneck is occuring. Presumably hacking the cp source (or dd or whatever) to add in some timing information is not a huge undertaking. The 'dd
Re: [Bug 197762] Re: file transfers on USB disk are very slow
On Wed, Jul 15, 2009 at 11:33:07AM -, kulight wrote: I've just remembered why the user base of Linux is so small I do actually expect my mechanic to find and fix what's wrong with my car when I just tell him it won't start And I don’t care if it's the engine the battery or the radiator You have to understand that most users have no idea where the problem is coming from or if its two separate ones They are just using the system and see the problems Ah, but (a) you pay your mechanic, and (b) you bring your car in, and don't expect him to fix it over the phone or over an web board. There are plenty of services for which you can get pay-for-service for Linux. For the right price, I've been flown into New York City to work at a large financial institution or even into a classified machine room at a major defense contractor. But the difference with Ubuntu Launchpad is that no one pays any money and they somehow expect gold-plated support. Sorry, for free support, you have to expect a certain amount of self service. It's still a way better deal than you will get anywhere else --- but if you wan the quality of service you get when you drive the car to your dealer, then you will have to (a) pay the bug fixer, and (b) let the bug fixer have direct access to your machine. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
This is completely not flamebait, promise, I have been doing nothing but bragging on the latest build of Ubuntu, but I loaded Windows 7 back on this same exact machine, only difference was the OS, and suddenly I get transfer speeds of 25Mb/s or higher consistently even on extremely large transfers. On Ubuntu 9.04 it would never get above 15Mb/s and would quickly drop to nearly half of that and eventually stop altogether if the transfer was a very large one that had to be sustained. My point is, for all the nay sayers who say it's people's hardwareit's not, unless it's that Ubuntu is not playing nice with certain hardware configurations. This is obviously the case, but it is not a hardware issue at all when a simple change of the OS completely fixes the issue. On Tue, Jul 14, 2009 at 6:58 PM, epv epvubu...@limpoc.com wrote: (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo /media/disk/bar If the time is really in seconds as you seem to suggest it is interesting I'd say. On the other hand, if what you describe is due the low performance of the underlying device then it is expected behaviour (the low performance of the device might be due to a bug though). # (cp /dev/zero /media/disk/bigfile ); sleep 10; time echo foo /media/disk/bar real0m5.647s user0m0.000s sys 0m0.004s # time echo foo /media/disk/foo2 real0m3.534s user0m0.000s sys 0m0.000s # time echo foo /media/disk/foo3 real0m4.589s user0m0.000s sys 0m0.000s # time echo foo /media/disk/foo3 real0m16.913s user0m0.000s sys 0m0.000s Imagine that! I wasn't lying. The reports of Fast at first, then slowing down are of course because of the buffer cache making it look like it's initially fast but access to the underlying device is always very slow, whether you are writing to it with gvfs, cp, dd, buffer, or whatever. Yes, and? and so the arguments of it's fast at first, then gets slow from naive users are spurious, which I'm sure you realized. In addition, it's only writes that are slow, and they're vastly slower than could be explained by a crappy USB device- in my case around 100 - 200 kbytes/sec on a device that under a Hardy install writes at several mbytes/sec. If Hardy was fine then you should open a new bug report with the proper details (once again, see [1] or Theodore's comments). There has been a lot of unhelpful or misguided information posted to this bug, but be careful not to discount the good with the bad. It's fairly clear you either don't believe there's a problem or aren't interested in it, which is fine, but it might be both more helpful and more civil to just say so, rather than being rude to people who are trying to help with whatever means they have available. eric ** Attachment added: iostat output during cp /dev/zero /media/disk/bigfile http://launchpadlibrarian.net/29027766/iostat-output -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in gvfs: Invalid Status in “gvfs” package in Ubuntu: Invalid Status in “linux” package in Ubuntu: Confirmed Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Who wants my Hardware? Since I can't use my USB drive (I cancelled the last attempt to copy 6GiB after more than one hour and less than 10%): Whoever wants to do further testing or bugfixing: You get my 16-GiB USB pen drive for for free! I can send it to you worldwide in a cushioned envelope. Just write me an e-mail with your name and adress. The subject line must contain the word bug (because of my spam filter). -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
ons, 10 06 2009 kl. 22:38 +, skrev jamesnmandy: Hiding behind a proper bug request gets us nowhere. And you posting useless information in this bug does? It's not working like it is supposed to and that's painfully obvious. And it should be painfully obvious by now that the issue cannot be fixed if nobody can provide sufficient information to solve the problem. Capisce? I really don't want to be rude, but how do you expect anyone to fix a problem this vaguely described? It is not like we can reproduce it with our own hardware, on the contrary it works as expected. It is not exactly easy to tell that the BIOS should be upgraded to fix the problem like in [1]. So send us your hardware, provide root ssh access to the hardware with or give us a proper report. It is not like it should be too difficult to follow the troubleshooting steps of [2] or simply shut up. I can tell you my same exact hardware works multitudes better in terms of USB performance running the other OS. Not sure what a bug report has to do with that, it's a fact. It is a good first step to know the hardware doesn't suck, then we can move on to the next in [2]. And I sympathize with you and others not being tech savy and just want your OS to work, but unless you actually pay for support or someone to look at your problem you should respect that there is only so much you can expect of people using their spare time to support you. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
[1] https://bugs.launchpad.net/ubuntu/+bug/334914/comments/30 [2] https://help.ubuntu.com/community/DiskPerformance -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Hiding behind a proper bug request gets us nowhere. Additionally, I do not have the time to do the research to figure out how to even begin to file a proper bug report. I'm one of thoseyou know, former Windows users, who do everything with a GUI and if there's not a double click or next-next-finish wizard to do it, then it's not going to happen with me and my machine. I am what you would call the average user, average joe, who just wants it to work like it's supposed to. It's not working like it is supposed to and that's painfully obvious. I can tell you my same exact hardware works multitudes better in terms of USB performance running the other OS. Not sure what a bug report has to do with that, it's a fact. I suppose you want average joe to show you how the software is messed up. I'm game for that as long as you make error logging and reporting an automated thing. Then you would not have to rely on people like me who obviously don't know as much as yourself to find and implement bug fixes. Thanks for your support. 2009/6/9 Simon Holm Thøgersen o...@cs.aau.dk man, 08 06 2009 kl. 20:14 +, skrev epv: This isn't normal behavior. Obviously it behaves fine while all writes are going to buffer cache, but once it tries to write it out to the device, wait times on the partition shoot up to 30sec or more, and all processes trying to touch the usb disk block practically forever. If other processes get completely starved due to the writeout then there is probably something in the VM, file system or I/O scheduler that needs to be fixed. You would have to make a convincing argument, though, like providing a very simple usecase. It should literally be something as simple as the following (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo /media/disk/bar If the time is really in seconds as you seem to suggest it is interesting I'd say. On the other hand, if what you describe is due the low performance of the underlying device then it is expected behaviour (the low performance of the device might be due to a bug though). Sysstat shows it as 100% busy continuously. 'It' being the underlying device? That is what you would expect. The reports of Fast at first, then slowing down are of course because of the buffer cache making it look like it's initially fast but access to the underlying device is always very slow, whether you are writing to it with gvfs, cp, dd, buffer, or whatever. Yes, and? In addition, it's only writes that are slow, and they're vastly slower than could be explained by a crappy USB device- in my case around 100 - 200 kbytes/sec on a device that under a Hardy install writes at several mbytes/sec. If Hardy was fine then you should open a new bug report with the proper details (once again, see [1] or Theodore's comments). [1] https://help.ubuntu.com/community/DiskPerformance -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in gvfs: Invalid Status in “gvfs” source package in Ubuntu: Invalid Status in “linux” source package in Ubuntu: Confirmed Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Not sure if this has been mentioned or not, but I noticed today that performance is much much better when copying directories to directories vs. copying a file to a directory. For example, I had a directory on my desktop, with three subdirectories, each with two files in them. When I right-click copy and then right-click paste on to my external USB HDD to a particular directory the file transfer speed stays at 15MBps +/- instead of the usual starting at 15MBps and tapering off to 5MBps or less and eventually just stopping altogether. The total size of the main directory being copied was just over 36GB. Each of the three subdirectories contained a 10-12GB file and a smaller 60kb file each. I just thought it was odd that the file and directory structure affected the file transfer performance and wanted to share. On Mon, Jun 8, 2009 at 9:54 PM, jamesnmandy jamesnma...@gmail.com wrote: There's no way all these people are seeing this behaviour because they all have vastly different yet commonly crappy hardware. The same exact hardware works great under the other OS. It's 100% a *nix issue and it's 100% in the software. That's painfully obvious. I wish this would get fixed really soon, I recently went back to the other OS and it itself has many stability issues that Ubuntu does not have, so I promptly switched back to 9.04. But this USB bug needs to be straightened out because it greatly affects the usability of the OS in today's USB age. On Mon, Jun 8, 2009 at 4:14 PM, epv epvubu...@limpoc.com wrote: This isn't normal behavior. Obviously it behaves fine while all writes are going to buffer cache, but once it tries to write it out to the device, wait times on the partition shoot up to 30sec or more, and all processes trying to touch the usb disk block practically forever. Sysstat shows it as 100% busy continuously. The reports of Fast at first, then slowing down are of course because of the buffer cache making it look like it's initially fast but access to the underlying device is always very slow, whether you are writing to it with gvfs, cp, dd, buffer, or whatever. The usb storage device *is* being claimed by ehci, not uhci, which I initially suspected was the problem. (btw the decision to compile the uhci-hcd and ehci-hcd drivers rather than leave them as modules, I think, is a bad one, since it eliminates the possibility of removing uhci-hcd to force ehci-hcd to claim a driver, as is sometimes necessary) In addition, it's only writes that are slow, and they're vastly slower than could be explained by a crappy USB device- in my case around 100 - 200 kbytes/sec on a device that under a Hardy install writes at several mbytes/sec. In my case this is happening on an lenovo X61 (intel) 2.6.28-11-generic. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in gvfs: Invalid Status in “gvfs” source package in Ubuntu: Invalid Status in “linux” source package in Ubuntu: Confirmed Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
man, 08 06 2009 kl. 20:14 +, skrev epv: This isn't normal behavior. Obviously it behaves fine while all writes are going to buffer cache, but once it tries to write it out to the device, wait times on the partition shoot up to 30sec or more, and all processes trying to touch the usb disk block practically forever. If other processes get completely starved due to the writeout then there is probably something in the VM, file system or I/O scheduler that needs to be fixed. You would have to make a convincing argument, though, like providing a very simple usecase. It should literally be something as simple as the following (cp bigfile /media/disk/ ) ; sleep 10 ; time echo foo /media/disk/bar If the time is really in seconds as you seem to suggest it is interesting I'd say. On the other hand, if what you describe is due the low performance of the underlying device then it is expected behaviour (the low performance of the device might be due to a bug though). Sysstat shows it as 100% busy continuously. 'It' being the underlying device? That is what you would expect. The reports of Fast at first, then slowing down are of course because of the buffer cache making it look like it's initially fast but access to the underlying device is always very slow, whether you are writing to it with gvfs, cp, dd, buffer, or whatever. Yes, and? In addition, it's only writes that are slow, and they're vastly slower than could be explained by a crappy USB device- in my case around 100 - 200 kbytes/sec on a device that under a Hardy install writes at several mbytes/sec. If Hardy was fine then you should open a new bug report with the proper details (once again, see [1] or Theodore's comments). [1] https://help.ubuntu.com/community/DiskPerformance -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
On Mon, Jun 8, 2009 at 9:54 PM, jamesnmandy jamesnma...@gmail.com wrote: There's no way all these people are seeing this behaviour because they all have vastly different yet commonly crappy hardware. The same exact hardware works great under the other OS. It's 100% a *nix issue and it's 100% in the software. That's painfully obvious. Stop thinking that Nautilus is a good indicator of speed already damnit! It is possible that you and other users really get buggily slow performance, but I assure that there is just as many in this thread that experience no other bugs than themselves interpretting Nautilus wrong. And since you didn't notice, there is nothing to solve as there haven't been supplied sufficient information to diagnose a bug. If you've got hardware that performs significantly better with Windows or different kernels then file a proper bug. I wish this would get fixed really soon, I recently went back to the other OS and it itself has many stability issues that Ubuntu does not have, so I promptly switched back to 9.04. And I wish all you people got a clue as how to make a useful bug report really soon, but it seems like I'll have to go back to dreaming. Not sure if this has been mentioned or not, but I noticed today that performance is much much better when copying directories to directories vs. copying a file to a directory. For example, I had a directory on my desktop, with three subdirectories, each with two files in them. When I right-click copy and then right-click paste on to my external USB HDD to a particular directory the file transfer speed stays at 15MBps +/- instead of the usual starting at 15MBps and tapering off to 5MBps or less and eventually just stopping altogether. The total size of the main directory being copied was just over 36GB. Each of the three subdirectories contained a 10-12GB file and a smaller 60kb file each. Are these dstat numbers? Anyway, file a proper bug if you want progress. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
There's no way all these people are seeing this behaviour because they all have vastly different yet commonly crappy hardware. The same exact hardware works great under the other OS. It's 100% a *nix issue and it's 100% in the software. That's painfully obvious. I wish this would get fixed really soon, I recently went back to the other OS and it itself has many stability issues that Ubuntu does not have, so I promptly switched back to 9.04. But this USB bug needs to be straightened out because it greatly affects the usability of the OS in today's USB age. On Mon, Jun 8, 2009 at 4:14 PM, epv epvubu...@limpoc.com wrote: This isn't normal behavior. Obviously it behaves fine while all writes are going to buffer cache, but once it tries to write it out to the device, wait times on the partition shoot up to 30sec or more, and all processes trying to touch the usb disk block practically forever. Sysstat shows it as 100% busy continuously. The reports of Fast at first, then slowing down are of course because of the buffer cache making it look like it's initially fast but access to the underlying device is always very slow, whether you are writing to it with gvfs, cp, dd, buffer, or whatever. The usb storage device *is* being claimed by ehci, not uhci, which I initially suspected was the problem. (btw the decision to compile the uhci-hcd and ehci-hcd drivers rather than leave them as modules, I think, is a bad one, since it eliminates the possibility of removing uhci-hcd to force ehci-hcd to claim a driver, as is sometimes necessary) In addition, it's only writes that are slow, and they're vastly slower than could be explained by a crappy USB device- in my case around 100 - 200 kbytes/sec on a device that under a Hardy install writes at several mbytes/sec. In my case this is happening on an lenovo X61 (intel) 2.6.28-11-generic. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in gvfs: Invalid Status in “gvfs” source package in Ubuntu: Invalid Status in “linux” source package in Ubuntu: Confirmed Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Thanks for the info, Ts'o. But your comment about libusual caught my eye. In Ubuntu 9.04 this module still shows up, right? [81601.434729] usbcore: registered new interface driver libusual Linux: Because rebooting is for adding new hardware. Sent from Brasilia, DF, Brazil On Wed, May 20, 2009 at 5:32 PM, Theodore Ts'o ty...@mit.edu wrote: Night64: No, you're using usb-storage device driver for both the pendrive and the ipod.The messages that you quoted as coming from the ipod just means that the usb-storage module had gotten unloaded, and when it was loaded as a module, it prints those lines to the kernel log. The fact that things were fast going to the ipod and variable when you write to the your USB flash device tends to indicate that the problem is specific to the flash device; it might just be that the flash device is sometimes slower because writing to flash can be slower sometimes, and it might be exacerbated by the FAT filesystem, which is never known as a speed demon. Note that this might not be true for other users on this bug report --- which is why I've suggested everyone file separate bug reports. People using Ubuntu 8.10 might possibly have been using the Low Performance USB storage driver, which Canonical inexplicably configured into older Ubuntu kernels. Anyone using that will definitely see massive performance problems --- and this has been known for ages. (Another reason why many kernel developers aren't happy trying to clear up Ubuntu-specific bugs) In any case, this kernel configuration bug doesn't seem to be a problem for Ubuntu 9.04; libusual.ko doesn't appear to be built any more, which is a Very Good Thing. Some users from a year ago who might have been using the low performance USB driver might have a very different problem than yours --- which is why it's better for each user to open separate bug reports. Remember that most of the people with the experience and knowledge to help are volunteers. If Ubuntu users continue to make life difficult, kernel developers will simply stop volunteering to wade through the cesspit of Ubuntu launchpad bugs -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a direct subscriber of the bug. Status in gvfs: Invalid Status in “gvfs” source package in Ubuntu: Invalid Status in “linux” source package in Ubuntu: Confirmed Bug description: When transferring large files (800meg) or even medium-size files (200meg), the transfer rate decreases constantly. It starts at around 4meg/sec and goes down to even less than 800kb/s. When I cancel the download and start it over again, the transfer rate comes back up to 4meg/sec. I am using Nautilus on Ubuntu 8.04 (hardy heron) -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
On Wed, May 20, 2009 at 08:48:34PM -, Night64 wrote: Thanks for the info, Ts'o. But your comment about libusual caught my eye. In Ubuntu 9.04 this module still shows up, right? [81601.434729] usbcore: registered new interface driver libusual Oops, sorry, that's what I get for not checking the driver names more closely. libusual is mostly harmless; it's the mapping function that arbitrates between ub and usb-storage drivers. The USB low performance device driver is ub.ko, normally found in, kernel/drivers/block/ub.ko: % find /lib/modules -name ub.ko /lib/modules/2.6.27-9-generic/kernel/drivers/block/ub.ko /lib/modules/2.6.28-11-generic/kernel/drivers/block/ub.ko You really, really, *really* want to avoid using the low performance USB driver at all costs. Fortunately at least with modern kernels libusual defaults to trying to prefer the usb-storage driver. I'm not sure of the time frame, but a while ago, some distributions were defaulting to using the ub driver, and *boy* was that a disaster. The ub driver is useful in embedded devices where you might not want to have the full USB stack (udev, hal, etc.), but I'm not sure why it anyone would want it to use it on a normal system Simon's observation is quite right, some flash devices are just slow. Note that 1x flash devices will only write at 150k/s. A 16x device will write at 2.4 MB/s. And this is assuming the filesystem doesn't get in the way. This is the speed rating used by Compact Flash or Secure Digital (CF or SD) cards. USB sticks generally don't have speed ratings at all, and depending on what you've purchased, they could be quite slow indeed. Note that with SD cards, sometimes the high speeds advertised (i.e., 150x) may not apply at all unless you have special hardware --- or sometimes the manufacturers are just lying. But given that there do exist 1x flash devices that only write at 150k/s should be a warning that some flash devices Are Just Slow. Hence my request that people who are really interested in debugging this should use USB hard drives, and not USB flash devices --- there's no way for us on the other side to know whether you are using a high quality or low-quality flash device, and so the speed problem could just be normal operation. In general, sometimes small writes will seem to go fast, because they get cached in memory. But just because the write operation seems to have completed doesn't mean that it's really done, or that it's safe to remove the flash device. So when you see an LED on a USB stick flashing, that's a sign that it's still writing out. If you write a very large file, eventually there's no more memory available, and so now the slow write speed becomes visible to the user. So this is why I'm becoming more and more convinced that we should just nuke this bug from orbit and start over. Naive users who don't understand this, can often see normal system performance, and report a me too!, and this just gums up the works. There ***may*** be a real bug hiding in here somewhere, by some users. Or it culd be a configuration bug; or a hardware bug. But there are too many users who are saying, I'm seeing this too!, when in fact they may just be seeing normal system behaviour. - Ted -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Hi Kurt, albeit the AHCI-mode enables the use of Native Command Queueing (NCQ) for some mainboards, I somehow doubt that this has to do with the USB issue. Especially because of the swapping you reported which IMO has nothing to do with the USB speed issues reported before. -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
Alright, then it eases my mind. I had kinda lost track of this issue over time with the 100 comments, I guess. Thanks! -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 197762] Re: file transfers on USB disk are very slow
nicolas314 wrote: I just checked on the linux-usb mailing-lists, there is absolutely nothing on that topic. [...] What are the next steps? Well - how about opening a thread then ;-) Can you do this? -- file transfers on USB disk are very slow https://bugs.launchpad.net/bugs/197762 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
