[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
I've now installed the updated FPGA bitfiles on my VE, and this does indeed appear to fix the problems I've been seeing. Thanks! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Ok, we have managed to fix the problem at the IO FPGA level. The updated bitfile will be release on the next VE CD (end of this year), in the meantime interested parties may contact ARM Support in order to get the fix. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
The lock up was caused by SMSC RX FIFO underruns caused by maginal timing issue between SMSC and USB host controller. The hack is enforcing additional wait cycle between accesses. Unfortunately it affects all peripherals, thus the performance penalty. What you observe is, I guess, situation when buffers are getting filled with data from Ethernet and are flushed to USB mass storage device and the host controller driver is taking over the bus, reducing SMSC traffic. Maybe you could use Streamline to see what is going on there :-) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 673820] Re: Ethernet dies during large file transfers on vexpress
On Tue, Aug 23, 2011 at 10:29 AM, Paweł Moll pawel.m...@arm.com wrote: The lock up was caused by SMSC RX FIFO underruns caused by maginal timing issue between SMSC and USB host controller. The hack is enforcing additional wait cycle between accesses. Unfortunately it affects all peripherals, thus the performance penalty. Comments! and/or proper symbolic names for those magic numbers would be good for a final patch, of course :) Do you believe the patch is a fix for this particular issue, or will it just reduce the probability (and hence frequency) of problems? Note that in either case the smsc911x driver is still believed to have problems of its own, like incorrect FIFO skipping on bad packets, and some SMP safety issues. Cheers ---Dave -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
RE: [Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Comments! and/or proper symbolic names for those magic numbers would be good for a final patch, of course :) I thought I made this clear - there will be no final patch :-) The entity responsible for SMC configuration is Boot Monitor. This patch is just a hack to confirm (or deny) my theory. Do you believe the patch is a fix for this particular issue, or will it just reduce the probability (and hence frequency) of problems? This hack is a work-around rather than a fix as it is probably too expensive in terms of I/O performance. We may be able to fix it properly on IO FPGA level. No promises, terms and conditions apply ;-) Note that in either case the smsc911x driver is still believed to have problems of its own, like incorrect FIFO skipping on bad packets, and some SMP safety issues. No argument here. Even more - the driver can (and should) detect the problematic situation and perform soft reset to recover. So there are plenty of opportunities for improvements. This doesn't change the fact that (widely defined) hardware behaves incorrectly in this case. Paweł -- IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Could anyone give this patch a go? It's just a hack (if I'm right this will have to go to Boot Monitor, not kernel), but it may improve Ethernet stability, potentially at some cost of performance loss. Anyway - let me know. ** Patch added: ve-eth.patch https://bugs.launchpad.net/linux-linaro/+bug/673820/+attachment/2299695/+files/ve-eth.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Hi Pawel, I ran my network tests 10x without any failures, so this patch helps a lot. (The tests would usually fail the first time.) One question, what is this patch actually doing, preventing the transfer lock-up or recovering from a locked up transfer? The reason I ask is the transfer rate goes to 0 several times during the tests, but recovers each time. Either way this is definitely an improvement over the current situation. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 673820] Re: Ethernet dies during large file transfers on vexpress
On Tue, Jun 28, 2011 at 04:05:57PM -, Ulrich Weigand wrote: I'm running into this issue with failing network connections on vexpress while trying to run the GDB testsuite in remote mode ... Has there been any progress on this bug in the meantime? I don't believe so. Taking the network down and bringing it up again gets things working again, and it's possible to automate this with a simple script. That won't work for all uses though. AFAIK, the underlying cause remains a problem with the smsc911x network driver but unfortunately I think that nobody has identified or fixed it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
I'm running into this issue with failing network connections on vexpress while trying to run the GDB testsuite in remote mode ... Has there been any progress on this bug in the meantime? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress To manage notifications about this bug go to: https://bugs.launchpad.net/linux-linaro/+bug/673820/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Just to be sure, I checked the platform data flags for the vexpress and the SMSC911X_USE_32BIT flag is set. static struct smsc911x_platform_config v2m_eth_config = { .flags = SMSC911X_USE_32BIT, .irq_polarity = SMSC911X_IRQ_POLARITY_ACTIVE_HIGH, .irq_type = SMSC911X_IRQ_TYPE_PUSH_PULL, .phy_interface = PHY_INTERFACE_MODE_MII, }; -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
We should raise this with the relevant upstream developer(s). The general feeling seems to be that this is almost certainly a driver issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
needs a device driver fix, which will not be handled by linaro-linux project. ** Changed in: linux-linaro Status: Confirmed = Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
** Changed in: linux-linaro-vexpress (Ubuntu) Status: Confirmed = Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
smdkv310 board uses a smsc9215 ethernet controller. I had similar problem with large file transfers on smdkv310 board (using smsc911x driver). But if SMSC911X_USE_32BIT flag is added to the driver's platform data flags, large file transfers did work. I will debug the issue with 16BIT register/fifo writes on smdkv310 board. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Setting the priority high. ** Changed in: linux-linaro Importance: Undecided = High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
As said above it rather looks like the SMP problems in the smsc driver. Now, frankly speaking, I totally forgot about this issue, and it looks that I won't have chance to look into it in the nearest time. But, as we have ARM Landing Team now (allegedly ;-) maybe this bug should be assigned to them? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Can we close this by saying it is a hw issue? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Hey Paweł, would you know who to raise this bug to within ARM? We currently don't have people dedicated to vexpress specific bugs in Linaro, and we're looking from some help from BSP folks on your side :-) Thanks! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Well, I feel it will end on my desk anyway ;-) I can't commit to any dates right now, but I've put this on my list and let you keep you informed. Of course I'll have to reproduce it here... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Ok; I think dmart and Will Deacon were discussing this bug on IRC earlier and planned getting together tomorrow to see whether they could do something about smc911x.c. 12:02 wildea01 I had a brief dig in the smsc9118 driver and found a bunch of problems [...] 12:03 wildea01 (off the top of my head): (1) There's a must-be-one bit in one of the control registers that is 0 out of reset and we don't write it 12:03 wildea01 (2) There are read-after-read, read-after-write etc minimum delays that the driver doesn't honour 12:03 wildea01 (3) the fifo fast forward function is called with number of bytes instead of number of words (or the other way around, can't remember) 12:04 wildea01 (4) the locking is done too low-level (i.e. around the register accessors) which gives scope for deadlock if the caller holds other locks 12:05 wildea01 they're the main things I can remember [...] 12:05 wildea01 I remember having to add some locks to the NAPI poll handler to make it play nice with the IRQ handler [...] 12:06 wildea01 on top of this, the hardware could be broken too 12:06 dmart mattman had a pretty reliable testcase for this ... I can repost it to linaro-dev if anyone is interested 12:06 wildea01 I started writing a new driver so I could at least validate the hardware but I didn't get very far because I had other stuff to do [...] 12:11 lool wildea01, dmart: I'm not sure who will work on this bug; I don't see anybody working on bugs which affect vexpress these days because we don't have an ARM LT; if it affects Samsung, we could try to mention it there 12:11 wildea01 I have a hunch that the problem is related to receiving bad data from the network / flow control 12:11 lool wildea01, dmart, davidgiluk: If any of you has the bandwidth to work on it, that would be good :-) 12:11 davidgiluk lool: I don't have physical access to any of the boards 12:12 wildea01 dmart: I can look at this tomorrow with you if you like but after that I doubt I'll have any time ** Changed in: linux-linaro Assignee: (unassigned) = Paweł Moll (pawel-moll) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
This needs be assigned to KWG or vexpress landing team. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
We don't have a vexpress landing team; could we escalate this to ARM? Matt, any good contact to forward this to? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Probably the best place to start would be with: pawel.m...@arm.com -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
** Changed in: linux-linaro-vexpress (Ubuntu) Status: New = Confirmed ** Changed in: linux-linaro Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Matt: Is this still broken in Natty (2.6.37 kernel)? ** Also affects: linux-linaro-vexpress (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 673820] Re: Ethernet dies during large file transfers on vexpress
Yes, this still fails in 2.6.37-rc4. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/673820 Title: Ethernet dies during large file transfers on vexpress -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs