Re: [SOLVED] PROBLEM: Alpha SMP Low Outbound Bandwidth
On Monday 28 May 2001 13:45, Jay Thorne wrote: > Problem solved, thanks to the rawhide patch from Richard Henderson > ([EMAIL PROTECTED]) posted on Sunday. Performance is ~10megs/second both > directions, using tulip, de4x5 or via-rhine. Well Done, Richard. > > Using 2.4.4-ac15 it works fine. I'm now trying 2.4.5 > > Andrea, 2.4.5aa1 oopses just after probing the scsi cards. I've tried > the 2.4.4 series aa patches and had similar failure on boot. > > Its too fast to see the error, so I'm building a serial console version > to capture it. Is an easy way to tell an alpha to stop dead so I can > copy the oops? try adding 'console=ttyS0,9600 console=tty0' to the comand line args passed to the kernel at boot time. if you are using SRM and aboot, 'b -fl i' followed by the 'l' command, then a 'b' command. regards, --George - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[SOLVED] PROBLEM: Alpha SMP Low Outbound Bandwidth
Problem solved, thanks to the rawhide patch from Richard Henderson ([EMAIL PROTECTED]) posted on Sunday. Performance is ~10megs/second both directions, using tulip, de4x5 or via-rhine. Using 2.4.4-ac15 it works fine. I'm now trying 2.4.5 Andrea, 2.4.5aa1 oopses just after probing the scsi cards. I've tried the 2.4.4 series aa patches and had similar failure on boot. Its too fast to see the error, so I'm building a serial console version to capture it. Is an easy way to tell an alpha to stop dead so I can copy the oops? On 25 May 2001 23:16:34 -0400, George France wrote: > Hello Andrea, > > Jay, if the problem still exist in 2.4.5-pre6aa1 (please try the new kernel), > then I will have tech op's check this on Tuesday (Monday is a US holiday). > We should be able to duplicate this in the hardware lab and find the problem > with a logic analyser. > > Best Regards, > > > --George > > On Friday 25 May 2001 20:51, Andrea Arcangeli wrote: > > On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: > > > But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough > > > that anyone with an alpha running SMP can test it. Note that this > > > > My smp alpha box drives a single tulip over 12MB/sec in full duplex > > using tcp without any problem at all. So I definitely cannot reproduce. > > You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not > > tried it yet you can consider also using egcs 1.1.2 as compiler just in > > case. > > > > You may also want to keep an eye on the VM, on alpha I see very weird > > things happening. > > > > Andrea > > - > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to [EMAIL PROTECTED] > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ -- -- Jay Thorne Manager, Systems & Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
[SOLVED] PROBLEM: Alpha SMP Low Outbound Bandwidth
Problem solved, thanks to the rawhide patch from Richard Henderson ([EMAIL PROTECTED]) posted on Sunday. Performance is ~10megs/second both directions, using tulip, de4x5 or via-rhine. Using 2.4.4-ac15 it works fine. I'm now trying 2.4.5 Andrea, 2.4.5aa1 oopses just after probing the scsi cards. I've tried the 2.4.4 series aa patches and had similar failure on boot. Its too fast to see the error, so I'm building a serial console version to capture it. Is an easy way to tell an alpha to stop dead so I can copy the oops? On 25 May 2001 23:16:34 -0400, George France wrote: Hello Andrea, Jay, if the problem still exist in 2.4.5-pre6aa1 (please try the new kernel), then I will have tech op's check this on Tuesday (Monday is a US holiday). We should be able to duplicate this in the hardware lab and find the problem with a logic analyser. Best Regards, --George On Friday 25 May 2001 20:51, Andrea Arcangeli wrote: On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough that anyone with an alpha running SMP can test it. Note that this My smp alpha box drives a single tulip over 12MB/sec in full duplex using tcp without any problem at all. So I definitely cannot reproduce. You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not tried it yet you can consider also using egcs 1.1.2 as compiler just in case. You may also want to keep an eye on the VM, on alpha I see very weird things happening. Andrea - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ -- -- Jay Thorne Manager, Systems Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: [SOLVED] PROBLEM: Alpha SMP Low Outbound Bandwidth
On Monday 28 May 2001 13:45, Jay Thorne wrote: Problem solved, thanks to the rawhide patch from Richard Henderson ([EMAIL PROTECTED]) posted on Sunday. Performance is ~10megs/second both directions, using tulip, de4x5 or via-rhine. Well Done, Richard. Using 2.4.4-ac15 it works fine. I'm now trying 2.4.5 Andrea, 2.4.5aa1 oopses just after probing the scsi cards. I've tried the 2.4.4 series aa patches and had similar failure on boot. Its too fast to see the error, so I'm building a serial console version to capture it. Is an easy way to tell an alpha to stop dead so I can copy the oops? try adding 'console=ttyS0,9600 console=tty0' to the comand line args passed to the kernel at boot time. if you are using SRM and aboot, 'b dev -fl i' followed by the 'l' command, then a 'b' command. regards, --George - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001, Jay Thorne wrote: > Netperf is a pretty good idea. Should not be a cpu bottleneck. Thats a > good thing. So pretty much the same results as wu-ftpd: Note that I used > the 466 mhz quad with a via-rhine, since the 400 locked up and was still > fscking when I started this test. > > Recv SendSend > Socket Socket Message Elapsed > Size SizeSize Time Throughput > bytes bytes bytessecs.10^6bits/sec > > To alpha 87380 16384 1638410.02 39.25 > x86 local87380 16384 163849.99 559.46 > alpha local 87380 16384 1638410.01 547.27 > alp to x86 87380 16384 1638410.01 25.77 > another x86 87380 16384 163849.99 553.67 > to same x86 87380 16384 1638410.00 82.79 > and back 87380 16384 1638410.00 93.89 What type of NIC is in the x86'es? If they are not the same, what happens if you put one of those in the alphas? (and what happens with the via-rhine if put in one of the x86'es?) Alphas don't like unaligned memory accesses (not sure how bad those are). I think that you can get some idea on the frequence of those with 'cat /proc/cpuinfo' where it should say "kernel unaligned acc" and then some numbers. If that first number keeps going up then the driver(s) or something isn't being nice. Well, just a though. Oh yes, your original message showed a value of 1646246 for kernel space unaligned accesses. Is that high? The userspace value is 0, so I assume that is high. The value for 'pc=' should give the address of where the last unaligned access took place (look it up in System.map or /proc/ksyms) Does the value grow faster when you run your netperf tests? That still doesn't explain the SMP vs UP difference. /Urban - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001, Jay Thorne wrote: Netperf is a pretty good idea. Should not be a cpu bottleneck. Thats a good thing. So pretty much the same results as wu-ftpd: Note that I used the 466 mhz quad with a via-rhine, since the 400 locked up and was still fscking when I started this test. Recv SendSend Socket Socket Message Elapsed Size SizeSize Time Throughput bytes bytes bytessecs.10^6bits/sec To alpha 87380 16384 1638410.02 39.25 x86 local87380 16384 163849.99 559.46 alpha local 87380 16384 1638410.01 547.27 alp to x86 87380 16384 1638410.01 25.77 another x86 87380 16384 163849.99 553.67 to same x86 87380 16384 1638410.00 82.79 and back 87380 16384 1638410.00 93.89 What type of NIC is in the x86'es? If they are not the same, what happens if you put one of those in the alphas? (and what happens with the via-rhine if put in one of the x86'es?) Alphas don't like unaligned memory accesses (not sure how bad those are). I think that you can get some idea on the frequence of those with 'cat /proc/cpuinfo' where it should say kernel unaligned acc and then some numbers. If that first number keeps going up then the driver(s) or something isn't being nice. Well, just a though. Oh yes, your original message showed a value of 1646246 for kernel space unaligned accesses. Is that high? The userspace value is 0, so I assume that is high. The value for 'pc=' should give the address of where the last unaligned access took place (look it up in System.map or /proc/ksyms) Does the value grow faster when you run your netperf tests? That still doesn't explain the SMP vs UP difference. /Urban - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
Hello Andrea, Jay, if the problem still exist in 2.4.5-pre6aa1 (please try the new kernel), then I will have tech op's check this on Tuesday (Monday is a US holiday). We should be able to duplicate this in the hardware lab and find the problem with a logic analyser. Best Regards, --George On Friday 25 May 2001 20:51, Andrea Arcangeli wrote: > On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: > > But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough > > that anyone with an alpha running SMP can test it. Note that this > > My smp alpha box drives a single tulip over 12MB/sec in full duplex > using tcp without any problem at all. So I definitely cannot reproduce. > You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not > tried it yet you can consider also using egcs 1.1.2 as compiler just in > case. > > You may also want to keep an eye on the VM, on alpha I see very weird > things happening. > > Andrea > - > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to [EMAIL PROTECTED] > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Fri, May 25, 2001 at 02:50:07PM -0700, Jay Thorne wrote: > [1.] One line summary of the problem: > Kernel 2.4.4 ac15 > Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards, [ description of a slowdown skipped ]. Well, it looks that you have at least something to slow down. I could not get a single packet through my tulip on Alpha from at least 2.4.4-ac11 and up. You can consider that an ultimate slowdown. I tried also a driver from http://sourceforge.net/projects/tulip/ and results are the same. This NIC, Digital DS21143 Tulip rev 65, works just fine with various earlier kernels, including assorted 2.4.3 variants. It is on 10baseT netwok - which may, or may not, be relevant here. Michal - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: > But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough > that anyone with an alpha running SMP can test it. Note that this My smp alpha box drives a single tulip over 12MB/sec in full duplex using tcp without any problem at all. So I definitely cannot reproduce. You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not tried it yet you can consider also using egcs 1.1.2 as compiler just in case. You may also want to keep an eye on the VM, on alpha I see very weird things happening. Andrea - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001 19:31:21 -0400, George France wrote: > On Friday 25 May 2001 19:05, Jay Thorne wrote: > > On 25 May 2001 18:52:33 -0400, George France wrote: > > > Hello Jay, > > > > > > I see that you are using the tulip driver. Could you try the de4x5 > > > driver?? > > > > Its worse: reports 3.1 MBs and 1.6 MBs > > wuftp is not exactly a performance benchmark, have you tried 'netperf'? > > --George While I agree with you completely that wuftpd is not exactly a performance leader, this is the simplest way to recreate a problem I was having with a much more complex setup involving apache and SMP and a whole bunch of things. I posted 2 weeks ago and got no response, I assume because everyone thought it was my software. After reducing the problem to eliminate the possibility that my code is the real problem, I'm left with a quite repeatable state. I have two nearly identical machines, one with 466 mhz cpus the other with 400mhz, and they both do the same thing. The via-rhine performs similarly to the de4x5. Netperf is a pretty good idea. Should not be a cpu bottleneck. Thats a good thing. So pretty much the same results as wu-ftpd: Note that I used the 466 mhz quad with a via-rhine, since the 400 locked up and was still fscking when I started this test. Recv SendSend Socket Socket Message Elapsed Size SizeSize Time Throughput bytes bytes bytessecs.10^6bits/sec To alpha 87380 16384 1638410.02 39.25 x86 local87380 16384 163849.99 559.46 alpha local 87380 16384 1638410.01 547.27 alp to x86 87380 16384 1638410.01 25.77 another x86 87380 16384 163849.99 553.67 to same x86 87380 16384 1638410.00 82.79 and back 87380 16384 1638410.00 93.89 But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough that anyone with an alpha running SMP can test it. Note that this software and the server in question were tested to run at 10+ megabytes per second with x86 boxes. The server is a PIII500 running 2.4.4, so its not like I'm comparing apples to oranges. The second x86 is an athlon 600. So even factoring out wuftp is not helping much here. I'm fairly convinced that something is strange because after the de4x5 test, the box locked up. So either a> I have two identically boned 4 cpu boxen or b> the interprocessor/locking/resource management has some kind of problem. Note that under uniprocessor I get near identical to x86 performance, clock for clock and no lock ups. -- -- Jay Thorne Manager, Systems & Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Friday 25 May 2001 19:05, Jay Thorne wrote: > On 25 May 2001 18:52:33 -0400, George France wrote: > > Hello Jay, > > > > I see that you are using the tulip driver. Could you try the de4x5 > > driver?? > > Its worse: reports 3.1 MBs and 1.6 MBs wuftp is not exactly a performance benchmark, have you tried 'netperf'? --George - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001 18:52:33 -0400, George France wrote: > Hello Jay, > > I see that you are using the tulip driver. Could you try the de4x5 driver?? > Its worse: reports 3.1 MBs and 1.6 MBs -- -- Jay Thorne Manager, Systems & Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
Hello Jay, I see that you are using the tulip driver. Could you try the de4x5 driver?? Best Regards, --George On Friday 25 May 2001 17:50, Jay Thorne wrote: > [1.] One line summary of the problem: > Kernel 2.4.4 ac15 > Tested with several cards and pieces of software, the outbound bandwidth > on a quad cpu alpha is 2 megabytes a second or less on a 100 mbit > switched ethernet network. Other machines on same switch do 10 or more > megabytes per second. Switch is DLink 3624, 24 port, only 12 ports in > use. > > [2.] Full description of the problem/report: > Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards, > on wuFTP, the outbound bandwidth tops out at 2 megabytes per second and > the inbound at 6 megabytes per second. Also noticeable are apparent > slowdowns or console lockups/sluggishness during the transfer. > > [3.] Keywords (i.e., modules, networking, kernel): > networking, alpha, tulip, via_rhine > > [4.] Kernel version (from /proc/version): > Linux version 2.4.4-ac15 (root@lister) (gcc version 2.96 2731 (SuSE > Linux 7.1/Alpha)) #1 SMP Thu May 24 18:41:13 PDT 2001 > > [5.] Output of Oops.. message (if applicable) with symbolic information > resolved (see Documentation/oops-tracing.txt) > > [6.] A small shell script or example program which triggers the > problem (if possible) > > Problem machine: > ncftp /tmp > put foo > foo:34.38 MB5.16 > MB/s > ncftp /tmp > get -z foo baz > baz:34.38 MB1.16 > MB/s > > other machine on same switch to same ftp server. > ncftp /home/jay > get foo > foo:34.38 MB 10.12 > MB/s > ncftp /home/jay > put -z foo baz > foo:34.38 MB9.93 > MB/s > > [7.] Environment > [7.1.] Software (add the output of the ver_linux script here) > > Linux lister 2.4.4-ac15 #1 SMP Thu May 24 18:41:13 PDT 2001 alpha > unknown > > Gnu C 2.96 > Gnu make 3.79.1 > binutils 2.10.0.33 > util-linux 2.10q > mount 2.10q > modutils 2.4.2 > e2fsprogs 1.19 > pcmcia-cs 3.1.22 > PPP2.4.0 > isdn4k-utils 3.1pre1a > Linux C Libraryso.6.1 > Dynamic linker (ldd) 2.2 > Procps 2.0.7 > Net-tools 1.57 > Kbd1.02 > Sh-utils 2.0 > Modules Loaded tulip via-rhine > > [7.2.] Processor information (from /proc/cpuinfo): > lister:/usr/src/linux # cat /proc/cpuinfo > cpu : Alpha > cpu model : EV56 > cpu variation : 7 > cpu revision: 0 > cpu serial number : > system type : Rawhide > system variation: Dodge > system revision : 0 > system serial number: NI70904KB0 > cycle frequency [Hz]: 4 > timer frequency [Hz]: 1200.00 > page size [bytes] : 8192 > phys. address bits : 40 > max. addr. space # : 127 > BogoMIPS: 738.12 > kernel unaligned acc: 1646246 > (pc=fc42a3d8,va=fc005d9b784e) > user unaligned acc : 0 (pc=0,va=0) > platform string : AlphaServer 4100 5/400 4MB > cpus detected : 4 > cpus active : 4 > cpu active mask : 000f > > [7.3.] Module information (from /proc/modules): > lister:/usr/src/linux # cat /proc/modules > tulip 59296 1 > via-rhine 16464 0 (autoclean) > > [7.4.] Loaded driver and hardware information (/proc/ioports, > /proc/iomem) > lister:/usr/src/linux # cat /proc/ioports > - : PCI IO bus 0 > -001f : dma1 > 0020-003f : pic1 > 0040-005f : timer > 0060-006f : keyboard > 0070-0080 : rtc > 0070-007f : rtc > 00a0-00bf : pic2 > 00c0-00df : dma2 > 02f8-02ff : serial(auto) > 03f8-03ff : serial(auto) > 8000-80ff : VIA Technologies, Inc. Ethernet Controller > 8000-80ff : via-rhine > 8400-847f : Digital Equipment Corporation DECchip 21140 > [FasterNet] > 8400-847f : tulip > 2-2 : PCI IO bus 1 > 28000-280ff : Symbios Logic Inc. (formerly NCR) 53c810 > 28000-2807f : ncr53c8xx > 29000-290fe : qlogicisp > lister:/usr/src/linux # cat /proc/iomem > - : PCI mem bus 0 > -07ff : HAE0 > 0220-0223 : Digital Equipment Corporation DECchip 21140 > [FasterNet] > 0224-0224 : S3 Inc. 86c764/765 [Trio32/64/64V+] > 0225-0225 : VIA Technologies, Inc. Ethernet Controller > 0226-022600ff : VIA Technologies, Inc. Ethernet Controller > 0226-022600ff : via-rhine > 02261000-0226107f : Digital Equipment Corporation DECchip 21140 >
PROBLEM: Alpha SMP Low Outbound Bandwidth
[1.] One line summary of the problem:
Kernel 2.4.4 ac15
Tested with several cards and pieces of software, the outbound bandwidth
on a quad cpu alpha is 2 megabytes a second or less on a 100 mbit
switched ethernet network. Other machines on same switch do 10 or more
megabytes per second. Switch is DLink 3624, 24 port, only 12 ports in
use.
[2.] Full description of the problem/report:
Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards,
on wuFTP, the outbound bandwidth tops out at 2 megabytes per second and
the inbound at 6 megabytes per second. Also noticeable are apparent
slowdowns or console lockups/sluggishness during the transfer.
[3.] Keywords (i.e., modules, networking, kernel):
networking, alpha, tulip, via_rhine
[4.] Kernel version (from /proc/version):
Linux version 2.4.4-ac15 (root@lister) (gcc version 2.96 2731 (SuSE
Linux 7.1/Alpha)) #1 SMP Thu May 24 18:41:13 PDT 2001
[5.] Output of Oops.. message (if applicable) with symbolic information
resolved (see Documentation/oops-tracing.txt)
[6.] A small shell script or example program which triggers the
problem (if possible)
Problem machine:
ncftp /tmp > put foo
foo:34.38 MB5.16
MB/s
ncftp /tmp > get -z foo baz
baz:34.38 MB1.16
MB/s
other machine on same switch to same ftp server.
ncftp /home/jay > get foo
foo:34.38 MB 10.12
MB/s
ncftp /home/jay > put -z foo baz
foo:34.38 MB9.93
MB/s
[7.] Environment
[7.1.] Software (add the output of the ver_linux script here)
Linux lister 2.4.4-ac15 #1 SMP Thu May 24 18:41:13 PDT 2001 alpha
unknown
Gnu C 2.96
Gnu make 3.79.1
binutils 2.10.0.33
util-linux 2.10q
mount 2.10q
modutils 2.4.2
e2fsprogs 1.19
pcmcia-cs 3.1.22
PPP2.4.0
isdn4k-utils 3.1pre1a
Linux C Libraryso.6.1
Dynamic linker (ldd) 2.2
Procps 2.0.7
Net-tools 1.57
Kbd1.02
Sh-utils 2.0
Modules Loaded tulip via-rhine
[7.2.] Processor information (from /proc/cpuinfo):
lister:/usr/src/linux # cat /proc/cpuinfo
cpu : Alpha
cpu model : EV56
cpu variation : 7
cpu revision: 0
cpu serial number :
system type : Rawhide
system variation: Dodge
system revision : 0
system serial number: NI70904KB0
cycle frequency [Hz]: 4
timer frequency [Hz]: 1200.00
page size [bytes] : 8192
phys. address bits : 40
max. addr. space # : 127
BogoMIPS: 738.12
kernel unaligned acc: 1646246
(pc=fc42a3d8,va=fc005d9b784e)
user unaligned acc : 0 (pc=0,va=0)
platform string : AlphaServer 4100 5/400 4MB
cpus detected : 4
cpus active : 4
cpu active mask : 000f
[7.3.] Module information (from /proc/modules):
lister:/usr/src/linux # cat /proc/modules
tulip 59296 1
via-rhine 16464 0 (autoclean)
[7.4.] Loaded driver and hardware information (/proc/ioports,
/proc/iomem)
lister:/usr/src/linux # cat /proc/ioports
- : PCI IO bus 0
-001f : dma1
0020-003f : pic1
0040-005f : timer
0060-006f : keyboard
0070-0080 : rtc
0070-007f : rtc
00a0-00bf : pic2
00c0-00df : dma2
02f8-02ff : serial(auto)
03f8-03ff : serial(auto)
8000-80ff : VIA Technologies, Inc. Ethernet Controller
8000-80ff : via-rhine
8400-847f : Digital Equipment Corporation DECchip 21140
[FasterNet]
8400-847f : tulip
2-2 : PCI IO bus 1
28000-280ff : Symbios Logic Inc. (formerly NCR) 53c810
28000-2807f : ncr53c8xx
29000-290fe : qlogicisp
lister:/usr/src/linux # cat /proc/iomem
- : PCI mem bus 0
-07ff : HAE0
0220-0223 : Digital Equipment Corporation DECchip 21140
[FasterNet]
0224-0224 : S3 Inc. 86c764/765 [Trio32/64/64V+]
0225-0225 : VIA Technologies, Inc. Ethernet Controller
0226-022600ff : VIA Technologies, Inc. Ethernet Controller
0226-022600ff : via-rhine
02261000-0226107f : Digital Equipment Corporation DECchip 21140
[FasterNet]
02261000-0226107f : tulip
2-2 : PCI mem bus 1
2-207ff : HAE0
20220-2022000ff : Symbios Logic Inc. (formerly NCR) 53c810
[7.5.] PCI information ('lspci -vvv' as root)
lister:/usr/src/linux # lspci -vvv
00:01.0 Non-VGA unclassified device: Intel Corporation 82375EB (rev 05)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr-
PROBLEM: Alpha SMP Low Outbound Bandwidth
[1.] One line summary of the problem:
Kernel 2.4.4 ac15
Tested with several cards and pieces of software, the outbound bandwidth
on a quad cpu alpha is 2 megabytes a second or less on a 100 mbit
switched ethernet network. Other machines on same switch do 10 or more
megabytes per second. Switch is DLink 3624, 24 port, only 12 ports in
use.
[2.] Full description of the problem/report:
Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards,
on wuFTP, the outbound bandwidth tops out at 2 megabytes per second and
the inbound at 6 megabytes per second. Also noticeable are apparent
slowdowns or console lockups/sluggishness during the transfer.
[3.] Keywords (i.e., modules, networking, kernel):
networking, alpha, tulip, via_rhine
[4.] Kernel version (from /proc/version):
Linux version 2.4.4-ac15 (root@lister) (gcc version 2.96 2731 (SuSE
Linux 7.1/Alpha)) #1 SMP Thu May 24 18:41:13 PDT 2001
[5.] Output of Oops.. message (if applicable) with symbolic information
resolved (see Documentation/oops-tracing.txt)
[6.] A small shell script or example program which triggers the
problem (if possible)
Problem machine:
ncftp /tmp put foo
foo:34.38 MB5.16
MB/s
ncftp /tmp get -z foo baz
baz:34.38 MB1.16
MB/s
other machine on same switch to same ftp server.
ncftp /home/jay get foo
foo:34.38 MB 10.12
MB/s
ncftp /home/jay put -z foo baz
foo:34.38 MB9.93
MB/s
[7.] Environment
[7.1.] Software (add the output of the ver_linux script here)
Linux lister 2.4.4-ac15 #1 SMP Thu May 24 18:41:13 PDT 2001 alpha
unknown
Gnu C 2.96
Gnu make 3.79.1
binutils 2.10.0.33
util-linux 2.10q
mount 2.10q
modutils 2.4.2
e2fsprogs 1.19
pcmcia-cs 3.1.22
PPP2.4.0
isdn4k-utils 3.1pre1a
Linux C Libraryso.6.1
Dynamic linker (ldd) 2.2
Procps 2.0.7
Net-tools 1.57
Kbd1.02
Sh-utils 2.0
Modules Loaded tulip via-rhine
[7.2.] Processor information (from /proc/cpuinfo):
lister:/usr/src/linux # cat /proc/cpuinfo
cpu : Alpha
cpu model : EV56
cpu variation : 7
cpu revision: 0
cpu serial number :
system type : Rawhide
system variation: Dodge
system revision : 0
system serial number: NI70904KB0
cycle frequency [Hz]: 4
timer frequency [Hz]: 1200.00
page size [bytes] : 8192
phys. address bits : 40
max. addr. space # : 127
BogoMIPS: 738.12
kernel unaligned acc: 1646246
(pc=fc42a3d8,va=fc005d9b784e)
user unaligned acc : 0 (pc=0,va=0)
platform string : AlphaServer 4100 5/400 4MB
cpus detected : 4
cpus active : 4
cpu active mask : 000f
[7.3.] Module information (from /proc/modules):
lister:/usr/src/linux # cat /proc/modules
tulip 59296 1
via-rhine 16464 0 (autoclean)
[7.4.] Loaded driver and hardware information (/proc/ioports,
/proc/iomem)
lister:/usr/src/linux # cat /proc/ioports
- : PCI IO bus 0
-001f : dma1
0020-003f : pic1
0040-005f : timer
0060-006f : keyboard
0070-0080 : rtc
0070-007f : rtc
00a0-00bf : pic2
00c0-00df : dma2
02f8-02ff : serial(auto)
03f8-03ff : serial(auto)
8000-80ff : VIA Technologies, Inc. Ethernet Controller
8000-80ff : via-rhine
8400-847f : Digital Equipment Corporation DECchip 21140
[FasterNet]
8400-847f : tulip
2-2 : PCI IO bus 1
28000-280ff : Symbios Logic Inc. (formerly NCR) 53c810
28000-2807f : ncr53c8xx
29000-290fe : qlogicisp
lister:/usr/src/linux # cat /proc/iomem
- : PCI mem bus 0
-07ff : HAE0
0220-0223 : Digital Equipment Corporation DECchip 21140
[FasterNet]
0224-0224 : S3 Inc. 86c764/765 [Trio32/64/64V+]
0225-0225 : VIA Technologies, Inc. Ethernet Controller
0226-022600ff : VIA Technologies, Inc. Ethernet Controller
0226-022600ff : via-rhine
02261000-0226107f : Digital Equipment Corporation DECchip 21140
[FasterNet]
02261000-0226107f : tulip
2-2 : PCI mem bus 1
2-207ff : HAE0
20220-2022000ff : Symbios Logic Inc. (formerly NCR) 53c810
[7.5.] PCI information ('lspci -vvv' as root)
lister:/usr/src/linux # lspci -vvv
00:01.0 Non-VGA unclassified device: Intel Corporation 82375EB (rev 05)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr-
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
Hello Jay, I see that you are using the tulip driver. Could you try the de4x5 driver?? Best Regards, --George On Friday 25 May 2001 17:50, Jay Thorne wrote: [1.] One line summary of the problem: Kernel 2.4.4 ac15 Tested with several cards and pieces of software, the outbound bandwidth on a quad cpu alpha is 2 megabytes a second or less on a 100 mbit switched ethernet network. Other machines on same switch do 10 or more megabytes per second. Switch is DLink 3624, 24 port, only 12 ports in use. [2.] Full description of the problem/report: Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards, on wuFTP, the outbound bandwidth tops out at 2 megabytes per second and the inbound at 6 megabytes per second. Also noticeable are apparent slowdowns or console lockups/sluggishness during the transfer. [3.] Keywords (i.e., modules, networking, kernel): networking, alpha, tulip, via_rhine [4.] Kernel version (from /proc/version): Linux version 2.4.4-ac15 (root@lister) (gcc version 2.96 2731 (SuSE Linux 7.1/Alpha)) #1 SMP Thu May 24 18:41:13 PDT 2001 [5.] Output of Oops.. message (if applicable) with symbolic information resolved (see Documentation/oops-tracing.txt) [6.] A small shell script or example program which triggers the problem (if possible) Problem machine: ncftp /tmp put foo foo:34.38 MB5.16 MB/s ncftp /tmp get -z foo baz baz:34.38 MB1.16 MB/s other machine on same switch to same ftp server. ncftp /home/jay get foo foo:34.38 MB 10.12 MB/s ncftp /home/jay put -z foo baz foo:34.38 MB9.93 MB/s [7.] Environment [7.1.] Software (add the output of the ver_linux script here) Linux lister 2.4.4-ac15 #1 SMP Thu May 24 18:41:13 PDT 2001 alpha unknown Gnu C 2.96 Gnu make 3.79.1 binutils 2.10.0.33 util-linux 2.10q mount 2.10q modutils 2.4.2 e2fsprogs 1.19 pcmcia-cs 3.1.22 PPP2.4.0 isdn4k-utils 3.1pre1a Linux C Libraryso.6.1 Dynamic linker (ldd) 2.2 Procps 2.0.7 Net-tools 1.57 Kbd1.02 Sh-utils 2.0 Modules Loaded tulip via-rhine [7.2.] Processor information (from /proc/cpuinfo): lister:/usr/src/linux # cat /proc/cpuinfo cpu : Alpha cpu model : EV56 cpu variation : 7 cpu revision: 0 cpu serial number : system type : Rawhide system variation: Dodge system revision : 0 system serial number: NI70904KB0 cycle frequency [Hz]: 4 timer frequency [Hz]: 1200.00 page size [bytes] : 8192 phys. address bits : 40 max. addr. space # : 127 BogoMIPS: 738.12 kernel unaligned acc: 1646246 (pc=fc42a3d8,va=fc005d9b784e) user unaligned acc : 0 (pc=0,va=0) platform string : AlphaServer 4100 5/400 4MB cpus detected : 4 cpus active : 4 cpu active mask : 000f [7.3.] Module information (from /proc/modules): lister:/usr/src/linux # cat /proc/modules tulip 59296 1 via-rhine 16464 0 (autoclean) [7.4.] Loaded driver and hardware information (/proc/ioports, /proc/iomem) lister:/usr/src/linux # cat /proc/ioports - : PCI IO bus 0 -001f : dma1 0020-003f : pic1 0040-005f : timer 0060-006f : keyboard 0070-0080 : rtc 0070-007f : rtc 00a0-00bf : pic2 00c0-00df : dma2 02f8-02ff : serial(auto) 03f8-03ff : serial(auto) 8000-80ff : VIA Technologies, Inc. Ethernet Controller 8000-80ff : via-rhine 8400-847f : Digital Equipment Corporation DECchip 21140 [FasterNet] 8400-847f : tulip 2-2 : PCI IO bus 1 28000-280ff : Symbios Logic Inc. (formerly NCR) 53c810 28000-2807f : ncr53c8xx 29000-290fe : qlogicisp lister:/usr/src/linux # cat /proc/iomem - : PCI mem bus 0 -07ff : HAE0 0220-0223 : Digital Equipment Corporation DECchip 21140 [FasterNet] 0224-0224 : S3 Inc. 86c764/765 [Trio32/64/64V+] 0225-0225 : VIA Technologies, Inc. Ethernet Controller 0226-022600ff : VIA Technologies, Inc. Ethernet Controller 0226-022600ff : via-rhine 02261000-0226107f : Digital Equipment Corporation DECchip 21140 [FasterNet] 02261000-0226107f : tulip 2-2 : PCI mem bus 1 2-207ff : HAE0
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001 18:52:33 -0400, George France wrote: Hello Jay, I see that you are using the tulip driver. Could you try the de4x5 driver?? Its worse: reports 3.1 MBs and 1.6 MBs -- -- Jay Thorne Manager, Systems Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Friday 25 May 2001 19:05, Jay Thorne wrote: On 25 May 2001 18:52:33 -0400, George France wrote: Hello Jay, I see that you are using the tulip driver. Could you try the de4x5 driver?? Its worse: reports 3.1 MBs and 1.6 MBs wuftp is not exactly a performance benchmark, have you tried 'netperf'? --George - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On 25 May 2001 19:31:21 -0400, George France wrote: On Friday 25 May 2001 19:05, Jay Thorne wrote: On 25 May 2001 18:52:33 -0400, George France wrote: Hello Jay, I see that you are using the tulip driver. Could you try the de4x5 driver?? Its worse: reports 3.1 MBs and 1.6 MBs wuftp is not exactly a performance benchmark, have you tried 'netperf'? --George While I agree with you completely that wuftpd is not exactly a performance leader, this is the simplest way to recreate a problem I was having with a much more complex setup involving apache and SMP and a whole bunch of things. I posted 2 weeks ago and got no response, I assume because everyone thought it was my software. After reducing the problem to eliminate the possibility that my code is the real problem, I'm left with a quite repeatable state. I have two nearly identical machines, one with 466 mhz cpus the other with 400mhz, and they both do the same thing. The via-rhine performs similarly to the de4x5. Netperf is a pretty good idea. Should not be a cpu bottleneck. Thats a good thing. So pretty much the same results as wu-ftpd: Note that I used the 466 mhz quad with a via-rhine, since the 400 locked up and was still fscking when I started this test. Recv SendSend Socket Socket Message Elapsed Size SizeSize Time Throughput bytes bytes bytessecs.10^6bits/sec To alpha 87380 16384 1638410.02 39.25 x86 local87380 16384 163849.99 559.46 alpha local 87380 16384 1638410.01 547.27 alp to x86 87380 16384 1638410.01 25.77 another x86 87380 16384 163849.99 553.67 to same x86 87380 16384 1638410.00 82.79 and back 87380 16384 1638410.00 93.89 But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough that anyone with an alpha running SMP can test it. Note that this software and the server in question were tested to run at 10+ megabytes per second with x86 boxes. The server is a PIII500 running 2.4.4, so its not like I'm comparing apples to oranges. The second x86 is an athlon 600. So even factoring out wuftp is not helping much here. I'm fairly convinced that something is strange because after the de4x5 test, the box locked up. So either a I have two identically boned 4 cpu boxen or b the interprocessor/locking/resource management has some kind of problem. Note that under uniprocessor I get near identical to x86 performance, clock for clock and no lock ups. -- -- Jay Thorne Manager, Systems Technology, UserFriendly Media, Inc. - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough that anyone with an alpha running SMP can test it. Note that this My smp alpha box drives a single tulip over 12MB/sec in full duplex using tcp without any problem at all. So I definitely cannot reproduce. You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not tried it yet you can consider also using egcs 1.1.2 as compiler just in case. You may also want to keep an eye on the VM, on alpha I see very weird things happening. Andrea - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
On Fri, May 25, 2001 at 02:50:07PM -0700, Jay Thorne wrote: [1.] One line summary of the problem: Kernel 2.4.4 ac15 Using a quad 400Mhz Dodge/Rawhide machine with Tulip or VIARhine cards, [ description of a slowdown skipped ]. Well, it looks that you have at least something to slow down. I could not get a single packet through my tulip on Alpha from at least 2.4.4-ac11 and up. You can consider that an ultimate slowdown. I tried also a driver from http://sourceforge.net/projects/tulip/ and results are the same. This NIC, Digital DS21143 Tulip rev 65, works just fine with various earlier kernels, including assorted 2.4.3 variants. It is on 10baseT netwok - which may, or may not, be relevant here. Michal - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
Re: PROBLEM: Alpha SMP Low Outbound Bandwidth
Hello Andrea, Jay, if the problem still exist in 2.4.5-pre6aa1 (please try the new kernel), then I will have tech op's check this on Tuesday (Monday is a US holiday). We should be able to duplicate this in the hardware lab and find the problem with a logic analyser. Best Regards, --George On Friday 25 May 2001 20:51, Andrea Arcangeli wrote: On Fri, May 25, 2001 at 05:25:03PM -0700, Jay Thorne wrote: But Wu-ftpd is an easy to set up test bench, and is ubiquitous enough that anyone with an alpha running SMP can test it. Note that this My smp alpha box drives a single tulip over 12MB/sec in full duplex using tcp without any problem at all. So I definitely cannot reproduce. You may want to try to reproduce with 2.4.5pre6aa1 btw. If you've not tried it yet you can consider also using egcs 1.1.2 as compiler just in case. You may also want to keep an eye on the VM, on alpha I see very weird things happening. Andrea - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/ - To unsubscribe from this list: send the line unsubscribe linux-kernel in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html Please read the FAQ at http://www.tux.org/lkml/
