Re: Known MMAP() race conditions ... ?

1999-08-21 Thread Matthew Dillon

:On Thu, 8 Jul 1999, The Hermit Hacker wrote:
:> Three weeks ago, I, and a few other INN administrators, posted about
:> FreeBSD -STABLE's inability to run the newest INN code, due to MMAP() race
:> conditions...essentially, after X hours of run time, on a heavily loaded
:> INN server, the whole thing locks up solid.
:> 
:> At that time, Matt pop'd up and stated that he knew of *at least* 6 MMAP()
:> related race conditions that he was hoping to be able to get fixed "within
:> a week"...that would have been two weeks ago.
:
:Maybe I missed that (I'm only on -stable, not -current), but what's the
:current situation concerning this issue?
:
:Can I dare running the newest INN on -STABLE / -CURRENT or do you still
:experience these problems?
:
:Gerald
:-- 
:Gerald "Jerry" [EMAIL PROTECTED] http://www.dbai.tuwien.ac.at/~pfeifer/

I've had fixes for CURRENT in the commit queue for a week but they haven't
gone in yet.  Once they get put in we will be able to backport the
interesting parts to STABLE.  There isn't much I can do about it without
commit privs.

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message



Re: Known MMAP() race conditions ... ?

1999-08-21 Thread Gerald Pfeifer

On Thu, 8 Jul 1999, The Hermit Hacker wrote:
> Three weeks ago, I, and a few other INN administrators, posted about
> FreeBSD -STABLE's inability to run the newest INN code, due to MMAP() race
> conditions...essentially, after X hours of run time, on a heavily loaded
> INN server, the whole thing locks up solid.
> 
> At that time, Matt pop'd up and stated that he knew of *at least* 6 MMAP()
> related race conditions that he was hoping to be able to get fixed "within
> a week"...that would have been two weeks ago.

Maybe I missed that (I'm only on -stable, not -current), but what's the
current situation concerning this issue?

Can I dare running the newest INN on -STABLE / -CURRENT or do you still
experience these problems?

Gerald
-- 
Gerald "Jerry" [EMAIL PROTECTED] http://www.dbai.tuwien.ac.at/~pfeifer/




To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message



Re: Known MMAP() race conditions ... ?

1999-07-08 Thread The Hermit Hacker


I wish to make one thing perfectly clear here, or, rather, a couple of
things.  None of this thread was started as a 'slam session' against
*anyone* out there...

To those that have responded privately that "they are experiencing the
problem too", without a better way of saying it...that helps absolutely
noone.  If you are experiencing the same problem, voice it to the list.
Right now, there are only a few of us that I know of, and, compared to the
"grand scheme of things", that isn't even a pebble on a beach.

Personally, I'm at a disadvantage to debug this, as my baby is 2.5k
kilometers away from me :(  She's on a serial console, through a
portmaster, that doesn't appear to have any way of allow me to break into
DDB...but, even so, I'm spending as much time as possible following
directions from those that appear to want to do more then just tell me to
run Linux for an INN server *sigh* 

A few weeks ago, one admin posted a quick C program that, if you ran and
ctl-c'd from it several times, would cause the machine to hang...can
someone resend that out?  I'll use it on my machine at home to test
4.0-CURRENT, and I have a machine at the offiec running 3.2-STABLE to test
on...


On Thu, 8 Jul 1999, Doug wrote:

> On Thu, 8 Jul 1999, The Hermit Hacker wrote:
> 
> > right now, at work, I'm enjoying a 4 way battle.  Me, fighting to bring in
> > FreeBSD to replace some of our Solaris boxes.  A friend of mine, fighting
> > to bring in Linux to replace some of our Solaris boxes.  My boss fighting
> > against both of us to keep Solaris "because its what we've always used".
> 
>   If it makes you feel any better, I'm in exactly the same position
> and losing my battle because of NFS and SMP issues. We just got two more
> intel boxes to work with on this project, one is already set up for linux
> (making a total of two), when I asked my boss about the other one he said
> he's not sure yet what he wants to do with it. 
> 
>   There was a similar thread to this one instigated by me a few
> weeks ago. I got the same, "well run stuff that runs good on freebsd
> instead" response. My problem is that my project parameters are set by my
> boss (and reality) and require smp and nfs that work at least as well as
> linux'. They don't, so I'm losing my battle.
> 
> Doug (who has to go ktrace amd again because it just fell over while my
> boss was testing it)
> -- 
> On account of being a democracy and run by the people, we are the only
> nation in the world that has to keep a government four years, no matter
> what it does.
> -- Will Rogers
> 

Marc G. Fournier   ICQ#7615664   IRC Nick: Scrappy
Systems Administrator @ hub.org 
primary: [EMAIL PROTECTED]   secondary: scrappy@{freebsd|postgresql}.org 




To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message



Re: Known MMAP() race conditions ... ?

1999-07-08 Thread Doug

On Thu, 8 Jul 1999, The Hermit Hacker wrote:

> right now, at work, I'm enjoying a 4 way battle.  Me, fighting to bring in
> FreeBSD to replace some of our Solaris boxes.  A friend of mine, fighting
> to bring in Linux to replace some of our Solaris boxes.  My boss fighting
> against both of us to keep Solaris "because its what we've always used".

If it makes you feel any better, I'm in exactly the same position
and losing my battle because of NFS and SMP issues. We just got two more
intel boxes to work with on this project, one is already set up for linux
(making a total of two), when I asked my boss about the other one he said
he's not sure yet what he wants to do with it. 

There was a similar thread to this one instigated by me a few
weeks ago. I got the same, "well run stuff that runs good on freebsd
instead" response. My problem is that my project parameters are set by my
boss (and reality) and require smp and nfs that work at least as well as
linux'. They don't, so I'm losing my battle.

Doug (who has to go ktrace amd again because it just fell over while my
boss was testing it)
-- 
On account of being a democracy and run by the people, we are the only
nation in the world that has to keep a government four years, no matter
what it does.
-- Will Rogers



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message



Re: Known MMAP() race conditions ... ?

1999-07-08 Thread Matthew Dillon

:At that time, Matt pop'd up and stated that he knew of *at least* 6 MMAP()
:related race conditions that he was hoping to be able to get fixed "within
:a week"...that would have been two weeks ago.

I think I was talking about mmap w/ NFS.

Under FreeBSD-current I know of two problems ( though I could be
forgetting some ) - there is a problem when a lot of pages get dirtied
that can cause a low-memory deadlock to occur, and I believe there is a
problem when mlock() or madvise() is used though I haven't reproduced
it yet.

Under FreeBSD-stable there are a number of additional, but minor problems
related to visibility of non-zero garbage after file EOF in an mmap(),
but these would have no effect on INN.

What we need to know is why the machines are locking up.  The usual
way to figure this out is to compile the kernel up with DDB and then
when it locks up ctl-alt-esc on the console to get the DDB prompt,
and do a 'ps' to see what the procsses are blocked in.

If the problem is the dirty-page problem, there are ways around it
(basically by syncing more often).

-Matt
Matthew Dillon 
<[EMAIL PROTECTED]>

:Thanks...
:
:Marc G. Fournier   ICQ#7615664   IRC Nick: Scrappy
:Systems Administrator @ hub.org 



To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message



Re: Known MMAP() race conditions ... ?

1999-07-08 Thread Pierre Beyssac

On Thu, Jul 08, 1999 at 10:18:35AM -0300, The Hermit Hacker wrote:
> The newest INN does not have this option, MMAP() is a requirement for
> it...

Sorry, I didn't know that. Too bad, then.

> ah, okay, so you are saying that FreeBSD shouldn't be demonstrated using
> software that taxes/tweaks bugs in it?

Exactly. If you want to show the strengths of a system, it just
doesn't make sense to rely on its weaker parts.

> Boy, does that sound like a quick
> road to problems... Management: but, when you sold us on this operating
> system, it was perfectly stable.  Me: ya, well, I picked and choose the
> software I ran for the demo, sorry...

I didn't say you have to lie about your choice.

> Right now, my 'fight' is weak, since all my friend has to do is point out
> that 'the MMAP() issue isn't an issue under Linux'...and, as far as I'm

Linux has other -- IMHO more annoying -- issues, so I think your
friend had better stop bragging.

> My opinion on the Linux vs *BSD issue is, and always has been, that *BSD
> makes the better *server*...we have very strong networking code, a very
> stable kernel and a sane development model...but this MMAP() issue really
> hurts :(

I think everyone agrees. Now, the problem is that it's not an easy
thing to fix, or it would already be fixed.
-- 
Pierre Beyssac  [EMAIL PROTECTED]


To Unsubscribe: send mail to [EMAIL PROTECTED]
with "unsubscribe freebsd-current" in the body of the message