FreeBSD MySQL still WAY slower than Linux

2005-06-27 Thread Steve Roome
On Mon Jul 20, (I was reading the web archive) Mark Kirkwood wrote:
 With respect to Mysql performance, I would suspect threading or
 threading/kernel interaction as the culprit. (That reminds me, I
 don't recall seeing the original poster re-doing the tests with
 6.0-CURRENT - that would be interesting).

Sorry for not getting back sooner.

I posted these results and anything else that went with this thread to
the freebsd-performance mailing list.

-current proved a slightly better performer for us, but not enough to
bring it even close to the performance we get with gentoo.

Off the top of my head the select key benchmarks were ROUGHLY:

FreeBSD 5.various + MySQL 4.various: ROUGHLY 16k queries/second
FreeBSD 6.0-current + MySQL 4.1.12 : ROUGHLY 18k queries/second
Gentoo-something + MySQL 4.1.something : ROUGHLY 30k queries/second.

The exact figures were posted to performance- (6.0 tests) and stable-
(gentoo vs. freebsd 5.x).

Good luck to anyone who can manage to get MySQL to perform as well on
FreeBSD as Linux, we've been right out of luck so far and that's
really not advocating FreeBSD very well, which is what I'd rather be
doing.

Steve
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: FreeBSD MySQL still WAY slower than Linux

2005-06-18 Thread Steve Roome
I've posted a longer reply, with a trimmed cc list on the -performance
mailing list if anyone is still interested and I'll leave it off
-stable as it's probably become somewhat off topic now.

Sadly, I don't think simply having an async FS is going to solve our
problem though. :(

Ta,

Steve Roome

For refernce:
On Fri, Jun 17, 2005 at 09:28:54AM -0400, David Sze wrote:
 At 05:15 PM 16/06/2005 +0100, Steve Roome wrote this to All:
 It turns out that the problem was the same thing everyone usually points 
 the finger at, but no one actually mentioned this time:  Linux mounts its 
 partitions async by default.  I don't have the exact numbers in front of me 
 right now, but these were the ballpark figures (I'm not going to separate 
 out results for all of the different threading libraries for FreeBSD 
 because the deltas weren't huge):

...
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: FreeBSD MySQL still WAY slower than Linux

2005-06-17 Thread Steve Roome
Thank you all for your suggestions on this thread, here's a brief
breakdown of most of the ideas from people:

Billy Newsom: COMPILER, DISK, MYSQLVERSION
Daniel Eischen: +/-HTT, Thread scopes
Greg Lehey: MALLOC
Guy Helmer: PREEMPTIVE, vfs.read_max
Jon Dama: David Xu's Thrds, Ptmalloc, cpu affinity, sched+hwcacheing
Kris Kennaway: +/-HTT
Robert Watson: Thread scopes, LIBTHR/Linuxthr on 5 and 6?, LOCKING,
   HTT, SMP/UP
Thomas Hurst: FreeBSD-current, Don't overload mysql!
Vladimir Chukharev: COMPILEOPTS, TABLETYPES
Xin Li: PROFILE, HTT insignificant

The bad news is that I've not managed to get very far at all lately as
MySQL has been crashing too much to even stop and test stuff
elsewhere.

The good news though, is that the Mysql folks have agreed to setup
tests to profile mysql on identical hardware running FreeBSD and Linux
with an aim to find out exactly where the problem really is. They
reckon they'll spend at least two weeks trying to find out why Linux
is so much faster - if they do this right I'd be surprised if we can't
improve things quite a lot.

Also, it'd be good if any of you who still have an interest in this
could add any ideas or suggestions that may help *them* with their
testing. If so, just get in touch with me asap before they get too
stuck into anything that might prove fruitless.

Here's hoping we can get MySQL running as well on FreeBSD as it ought
to.

Thanks again everyone,

Steve Roome
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


FreeBSD MySQL still WAY slower than Linux

2005-06-10 Thread Steve Roome
 select_index10  21  3   15724.96
 
 # FreeBSD 5.4-STABLE SMP, Hand-built 4.1.12, libkse system scope (dynamic)
 [EMAIL PROTECTED] 7 0 % foreach f (1 2 3 4 5) 
 {/data/supersmack-1.3/bin/super-smack select-key.smack 50 1000|grep 
 select_index}
 select_index10  22  0   15792.41
 select_index10  8   0   15718.67
 select_index10  4   0   15837.49
 select_index10  5   0   15834.15
 select_index10  3   0   15892.31
 
 # FreeBSD 5.4-STABLE SMP, Hand-built 4.1.12, LinuxThreads
 [EMAIL PROTECTED] 3 0 % foreach f (1 2 3 4 5) 
 {/data/supersmack-1.3/bin/super-smack select-key.smack 50 1000|grep 
 select_index}
 select_index10  2   0   17709.35
 select_index10  2   0   17701.14
 select_index10  1   0   17758.04
 select_index10  1   0   17829.17
 select_index10  9   0   17557.00
 
 # Gentoo Linux 2005.0, Hand-built 4.1.12, NPTL
 [EMAIL PROTECTED] 1 0 % foreach f (1 2 3 4 5) 
 {/data/supersmack-1.3/bin/super-smack select-key.smack 50 1000|grep 
 select_index}
 select_index10  0   0   34420.06
 select_index10  2   0   34034.52
 select_index10  4   0   33236.42
 select_index10  3   0   33210.14
 select_index10  1   0   34610.75


Thanks in advance for anyone that has a clue on this, and has anyone
figured out why FreeBSD is just so amazingly slow compared to Linux.

(That's not meant as flamebait, it just is.)

Steve Roome
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Makeworld is dying...

2000-09-18 Thread Steve Roome

On Sun, Sep 17, 2000 at 04:00:06PM +0930, Greg Lehey wrote:
 What you *should* do before sending out a reply like this is to check
 whether it's really in the FAQ or not.  It is
 (http://www.freebsd.org/FAQ/troubleshoot.html#AEN1570):

There's a lot of people who are quick to step up to the podium and
proclaim that all these signal elevens are caused by bad RAM, or bad
RAM settings. It *could* be a pointer arithmetic problem.

The FAQ ought to comment on this, and from recent personal experience,
the number of people who respond to these just quoting the FAQ gets
more annoying each time, mainly because it's something that doesn't
need to be said on the mailing lists... again.

In this case, it is possibly bad hardware, so maybes it's a fair call,
then again it can be caused by, e.g. freaky optimizations in gcc...

So could we change the text (something like, but better worded than
the following) in the FAQ, e.g. :

Q: My programs occasionally die with Signal 11 ( or 10 ).

A: Signal 11 errors are caused when your process has attempted to
   access memory which the operating system has not granted it access
   to.

   This could be caused by a number of different circumstances :

a) Most likely, if you're developing it yourself it's buggy
code. (We've all been there!)

b) If it's a problem with part of the base FreeBSD system,
it might be buggy code, but more often than not these problems
are found long before us general FAQ readers get to use these
bits of code.

If these problems are only affecting you, it's probably bad
hardware.

In the case of a) you can use a debugger and find the point
in the program which is attempting to access a bogus address
and then fix it. [ you probably already know this if you're
a programmer! ]

In the case of b) You need to verify the settings on your
motherboard. Checking for hardware you might be running slightly
out of spec, too fast, or mismatched hardware. Often setting
memory wait states too short will trigger random signal 11's.
An overclocked CPU will possibly also exhibit strange or similar
symptoms.

Try running some memory testing programs, or do a make buildworld
if you have the full source available for FreeBSD (after a few
successful buildworlds it's probably safe to say the hardware
is okay.). 

See the SIG11 FAQ (LINK) for more information.


That's my idea for a rough draft anyway. I'm clearly illiterate
though, please don't flame me for that!

Steve,



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-stable" in the body of the message



Re: The kernel freeze when initializing my ELSA MicroLink ISDN/PCI ...

2000-08-21 Thread Steve Roome

On Fri, Aug 18, 2000 at 08:23:17PM +0200, Matthieu Pasini wrote:
 Hello ,
 I compiled the kernel with the following code inside :
 
 options  ELSA_QS1PCI
 device isic0
 pseudo-device "i4bq921"
 pseudo-device "i4bq931"
 pseudo-device "i4b"
 pseudo-device "i4btrc" 4
 pseudo-device "i4bctl"
 pseudo-device "i4brbch" 4
 pseudo-device "i4btel" 4
 pseudo-device "i4bipr" 4
 pseudo-device "i4bisppp" 4
 pseudo-device sppp4
 options IPR_VJ
 **
 
 And the kernel freeze when it reach the initialization of the card ..., it says me :
 ***
 isic0: ELSA Microlink ISDN/PCI port . 
 isic0: Error, IPAC version 2 unknow 
 Fatal trap 12 : page fault while in kernel mode ...
 ***
 And it asks me for reboot.
 The problem is the same in 4.0-stable and in 4.1-stable.
 If anyone have had the same problem as me or if anyone know more about what's 
happening, please mail me ...

Look for patches on the mailing list.

There's some minor changes that need to be done in /sys/i4b/layer1
(they're very minor really!), I can't be sure if they'll get rid
of the panic, but they'll sort out the IPAC version 2 unknown, and
I beleive they stop the panic too.

I spend some of these weekend helping someone out with this problem,
and frankly I've seen the patches, applied the patches and still
can't quite figure out why no-one has merged them in.

So if you get the patches, send-pr the changes and hopefully someone
will commit them to the tree, or alternatively, if it's a new -stable
you might want to get an easier set of patches from someone who's
managed to get it into the tree and has access to the box still.

Steve

P.S. I've cc'd the guy who has a copy of the patch, so if you can't 
find it ask him. Sorry to hassle you Simon.


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-stable" in the body of the message



Re: make buildworld: building strip fails.

2000-05-30 Thread Steve Roome

On Sun, May 28, 2000 at 09:55:21AM -0700, Cy Schubert - ITSD Open Systems Group wrote:
 Same here.  I did the same using a CVSup from Saturday May 27 @ 04:15 
 PDT on four machines.  Everything went smooth.  My only complaint is 
 that FreeBSD is getting too big.  On my P120 at home 3.4 used to 
 buildworld in 4.5 hours now with 4.0 it took 7.75 hours, while my 
 desktop system and Kerberos servers (333 MHz PII's) at work a 3.4 
 buildworld took 1.5 hours while building 4.0 world now took 2.25 hours. 
  But I guess that's the price of progress.

This is random guess that I can't check up on at the moment because I
don't have a 4.0 system at work, but I kernel compiles don't use -pipe
by default on 4.0. This of course may be due to them not being needed,
so take this with a pinch of salt.

Of course, on the other hand it might speed up your compiles a lot if
my hunch is right. But it is just a hunch.

Steve


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-stable" in the body of the message



Re: 4-stable won't boot

2000-05-25 Thread Steve Roome

On Wed, May 24, 2000 at 08:35:55PM -0700, Mike Smith wrote:
  Hello,
  
  I just did a cvsup to RELENG_4 about noon EST today (Wed), built world,
  installed a new kernel, and rebooted.  now, when I boot, I get the
  following:
 ...
  Mounting root from ufs:/dev/ad0s3a
  no such device 'ad'
 
 Sounds like you left the 'ad' device out of your new kernel config.  Bad 
 idea. 8)

For what it's worth, I had similar problems recently as well, although
I was getting ata_master: timeout waiting for command (from memory),
however I did have the ad device, and the problem seemed to be related
to some sort of conflict that appeared only when I had one of the
following also in the kernel :

options AUTO_EOI_1
options AUTO_EOI_2
device pcm
device pcf

I've not narrowed it down much yet, but suffice it to say that I got
almost the same problem described above, but which automagically fixed
itself once I took out the above 4 lines.

I doubt it's anything to do with this, but I thought I'd mention it in
case someone following this thread knows why this might happen.

I will look into it further once I've got the time to recompile another
20+ kernels and test them.

Steve


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-stable" in the body of the message



Re: Transparent proxies and fetch

2000-05-25 Thread Steve Roome

On Thu, May 25, 2000 at 11:00:18AM +1000, Joe Shevland wrote:
 when building ports. Someone wrote in asking whether our ISP has implemented a
 transparent proxy. Unfortunately I culled my mail folder so I can't respond
 directly, but the poster was on the money (the ISP grabs any port 80 requests
 and stuffs them into the proxy instead).
 
 My question now is how do I work around this issue? I've tried setting the
 HTTP_PROXY variable but this just makes the 'make install' of the ports fail
 very quickly:

In my limited experience calling the ISP and talking to them about it
can work. I don't know if it will help, but you might be able to get
them to remove the divert for you. The ISP I was with did that for me,
on the other hand, you could always change ISP to someone who lets the
customer decide when to use a proxy.

Then again, someone might have a better solution, but IMHO I think
it's quite rude of ISP's to divert your traffic without letting you
know about it, imagine how you'd feel if they started diverting all
your outgoing port23 connections and archiving everything that went
down that line.

Others may feel differently about it though! And it's becoming far too
standard a practice now, so maybe we're supposed to move with the
times and accept it? I dunno!

Steve Roome


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-stable" in the body of the message