Re: Network Performace

2003-06-25 Thread Shawn Ramsey
> That's certainly a step in the right direction :)
>
> > But something is still very
> > wrong performance wise. It has helped, but I still can't push in/out
> > nearly 100Mb/sec. (100Mb in, 100Mb out I mean). A simple FTP transfer
> > locally through the routers gigabit interface causes our internet
> > performance to plummet. I've disabled all the onboard stuff that was
> > sharing IRQs with PCI cards, but I didn't figure that was an issue,
> > didn't make a difference either way. Would the fact the gigabit is on
the
> > same PCI bus have any bearing? I would expect to at least get 100BT
> > performance even so, but I don't have any experience with gigabit
> > ethernet...
>
> The only thing I can suggest is try different PCI slots, or Gigabit cards,
> or, worst case a different system. Having NIC's on separate PCI busses (as
> opposed to both on the same PCI bus) may help it [But that's probably
going
> to need a new board etc.]

Thats what I was going to try next, but i've noticed this :

gw# netstat -I xl0 -w 1
   input  (xl0)   output
  packets  errs  bytespackets  errs  bytes colls
 7120119118416   5566 02507132 0
 6754 68498898   5649 03009719 0
 7104 98856812   5802 03004529 0
 7737199787501   6429 02994557 0
 7551169670490   5948 02761794 0

I would guess such a large number of errors per second could be causing the
interrupt usuage? From what i've been able to find such input errors are
usually caused by a bad cable, or switch...


> You don't say what Gigabit nic's your using? - I've had a lot of varied
> results with different nic's, with surprisingly cheap 10/100/1000Mbit
cards
> giving 'reasonable' performance - but get left standing for dust by other
> more expensive cards.

Its an Intel Fiber card, don't know the exact model offhand...


> The only other thing I can think of is, check the duplex/media options are
> all setup properly on the cards / switches etc. - or try forcing things to
> fdx etc.

Been there, done that, full duplex/autoselect makes no difference, but its
currently set for full/1000SX on both ends.



___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Network Performace

2003-06-25 Thread Karl Pielorz
--On 24 June 2003 17:01 -0700 Shawn Ramsey <[EMAIL PROTECTED]> wrote:

Try looking into FreeBSD's "polling" mode - i.e. interrupt free Network
cards. If your shifting a lot of small packets (such as online gaming
stuff  etc.) - you may find your milage pretty limited using standard PC
kit - as  the x86 architecture wasn't really designed for shifting lots
of small  packets around [as I've seen many a time in the past :(]
This router is routing 99% NNTP traffic, so I wouldn't think small packet
size would be it. I tried polling, and its greatly increased the amount of
"idle CPU", and Interupt is around 20% now...
That's certainly a step in the right direction :)

But something is still very
wrong performance wise. It has helped, but I still can't push in/out
nearly 100Mb/sec. (100Mb in, 100Mb out I mean). A simple FTP transfer
locally through the routers gigabit interface causes our internet
performance to plummet. I've disabled all the onboard stuff that was
sharing IRQs with PCI cards, but I didn't figure that was an issue,
didn't make a difference either way. Would the fact the gigabit is on the
same PCI bus have any bearing? I would expect to at least get 100BT
performance even so, but I don't have any experience with gigabit
ethernet...
The only thing I can suggest is try different PCI slots, or Gigabit cards, 
or, worst case a different system. Having NIC's on separate PCI busses (as 
opposed to both on the same PCI bus) may help it [But that's probably going 
to need a new board etc.]

You don't say what Gigabit nic's your using? - I've had a lot of varied 
results with different nic's, with surprisingly cheap 10/100/1000Mbit cards 
giving 'reasonable' performance - but get left standing for dust by other 
more expensive cards.

The only other thing I can think of is, check the duplex/media options are 
all setup properly on the cards / switches etc. - or try forcing things to 
fdx etc.

-Kp
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Network Performace

2003-06-24 Thread Shawn Ramsey

> > with unused USB and onboard NIC which is also not used. Should I be able
> > to push more than 100Mb sec with such a system? It is not doing anything
> > else, no NAT, one IPFW rule. OS is FreeBSD 4.7-RELEASE.
> 
> All depends how big the packets are etc. - 90% interrupt time is fairly 
> typical of x86/PC kit shoveling lots of small packets.
> 
> Try looking into FreeBSD's "polling" mode - i.e. interrupt free Network 
> cards. If your shifting a lot of small packets (such as online gaming stuff 
> etc.) - you may find your milage pretty limited using standard PC kit - as 
> the x86 architecture wasn't really designed for shifting lots of small 
> packets around [as I've seen many a time in the past :(]

This router is routing 99% NNTP traffic, so I wouldn't think small packet
size would be it. I tried polling, and its greatly increased the amount of
"idle CPU", and Interupt is around 20% now... But something is still very
wrong performance wise. It has helped, but I still can't push in/out nearly
100Mb/sec. (100Mb in, 100Mb out I mean). A simple FTP transfer locally
through the routers gigabit interface causes our internet performance to
plummet. I've disabled all the onboard stuff that was sharing IRQs with PCI
cards, but I didn't figure that was an issue, didn't make a difference either way.
Would the fact the gigabit is on the same PCI bus have any bearing? I would
expect to at least get 100BT performance even so, but I don't have any
experience with gigabit ethernet...



 
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"


Re: Network Performace

2003-06-24 Thread Karl Pielorz


--On 23 June 2003 18:12 -0700 Shawn Ramsey <[EMAIL PROTECTED]> wrote:

I am having some issues with network performance and am wondering if
anyone has any suggestions... the box in question has 2 100BT interfaces,
and an Intel (em driver) fiber Gigabit. The Gigabit connects to a switch,
and the two fast-e are WAN connections to our ISP(s). This box seems to
be using an awful lot of CPU cycles relative to the traffic it is
pushing, which is around 65-70Mb inbound, and 20-30 Mb/outbound(on
average), which seems to be about its limit. This is an Athlon XP 1500
box, 256MB RAM, top shows 90+% interrupt usage, CPU usually has about
5-10% idle. Gigabit is on a 32-bit bus, and Gigabit is on an IRQ shared
with unused USB and onboard NIC which is also not used. Should I be able
to push more than 100Mb sec with such a system? It is not doing anything
else, no NAT, one IPFW rule. OS is FreeBSD 4.7-RELEASE.
All depends how big the packets are etc. - 90% interrupt time is fairly 
typical of x86/PC kit shoveling lots of small packets.

Try looking into FreeBSD's "polling" mode - i.e. interrupt free Network 
cards. If your shifting a lot of small packets (such as online gaming stuff 
etc.) - you may find your milage pretty limited using standard PC kit - as 
the x86 architecture wasn't really designed for shifting lots of small 
packets around [as I've seen many a time in the past :(]

-Kp
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "[EMAIL PROTECTED]"