RE: Allocation Unit (Cluster) Size Question

2002-06-20 Thread Webb, Andy

You might consider the book Scaling Microsoft Exchange 2000: Create and Optimize 
High-Performance Exchange Messaging Systems by Pierre Bijaoui from Comp^h^h^h^hHP.

There are also a couple MEC presentations around that he did that dive into this 
pretty thoroughly.

Correct tuning of your disks can result in up to a 4x I/O delta.  Now, not all of this 
is done in stripe size; part of it is in the RAID level you choose and the number of 
spindles.  You may find that just adding a couple more spindles makes more difference 
than any chunk/stripe size changes.

Don't focus as much on the exchange database drive though.  Most of the activity there 
is reads and they're cached pretty efficiently by the OS.  You can note that the EDB 
file grows in 1MB chunks, so perhaps that's a reasonable number to work with.  If you 
want to impact perceivable performance, tune the log drives to improve the synchronous 
write performance.

Also note that if you're bottleneck is not the drives, no amount of I/O improvement 
will change the user experience.  In other words, if your existing disks support N I/O 
operations per second and your users are only driving it to N/4, improving to 2N makes 
no difference to the users.

===
Andy Webb[EMAIL PROTECTED]  www.swinc.com
Simpler-Webb, Inc.   Austin, TX512-322-0071
-- Eating XXX Chili at Texas Chili Parlor since 1989 --
=== 


-Original Message-
From: Martin, Jon [mailto:[EMAIL PROTECTED]]
Posted At: Monday, June 17, 2002 11:57 AM
Posted To: Microsoft Exchange
Conversation: Allocation Unit (Cluster) Size Question
Subject: Allocation Unit (Cluster) Size Question


Exchange writes to the database in 4k pages. This being the case, does it
not make sense to format database drives in 4k Allocation Units (clusters)?
And beyond that, since my RAID controller gives me the ability to control
the stripe size, shouldn't make this 4k also? Get everyone (database, OS and
hardware) in 4k harmony, so to speak.

On a similar track regarding transaction logs, if we have valid information
as to the average size of messages in our system, would there be a
performance boost by configuring the transaction log drive to use clusters
and stripes close to (but a little bigger) that the average message size?

Or, do I have no clue as to how these things work (always a possibility)?

Thanks . . .

_
List posting FAQ:   http://www.swinc.com/resource/exch_faq.htm
Archives:   http://www.swynk.com/sitesearch/search.asp
To unsubscribe: mailto:[EMAIL PROTECTED]
Exchange List admin:[EMAIL PROTECTED]

_
List posting FAQ:   http://www.swinc.com/resource/exch_faq.htm
Archives:   http://www.swynk.com/sitesearch/search.asp
To unsubscribe: mailto:[EMAIL PROTECTED]
Exchange List admin:[EMAIL PROTECTED]



RE: Allocation Unit (Cluster) Size Question

2002-06-20 Thread Martin, Jon

I don't use the word much, but this is an awesome book. Tweakers  nit
pickers will have months of fun implementing the millions of useful
recommendations in this book. In the same way that you should not trust a
default Windows implementation to be secure, you should not trust it to be
optimized for performance, either. This book tells you why, and how to get
the most from your hardware  OS.
And the answer to the original question is: I was close. Keep the write size
(4k for Exchange db), cluster (allocation unit) size and RAID stripe size in
sync. What I was not thinking of is the RAID stripe size applies to the
amount of data written in one contiguous chunk to each disk in the array.
There is a corollary number to plug into the equations - the stripe width,
which is the number of drives in the array which data is written to. So if I
read this correctly, you would want the RAID stripe size to be 4k divided by
the stripe width. Keeping it simple, if you had four drives in a RAID 0
array, the correct stripe size to match the 4k Exchange database writes
would be 1k. The fact no one would run Exchange in RAID 0, and that you
would really have eight drives in a RAID 0/1 array does not change the
optimum stripe size in this example.
Additional performance? Sure. Enough to re-config a production box? Probably
not, unless you have a high degree of tolerance for risk and pain. Good to
know for new boxes, though.
Now if we can just get someone to spend a bunch of time testing this all out
in their lab, and report back.


 -Original Message-
From:   Martin, Jon  
Sent:   Monday, June 17, 2002 4:17 PM
To: Exchange Discussions
Subject:RE: Allocation Unit (Cluster) Size Question

Already on order. Thanks.

Jon

-Original Message-
From: Ray Zorz [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 4:12 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question

Then get the Curt Aubley book mentioned previously.

-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]] On Behalf Of Martin, Jon
Sent: Monday, June 17, 2002 4:01 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question


Actually, my boss prefers that I get the most out of the money he spends
on hardware and software. When I ask a group of knowledgeable folks a
question concerning a little documented but potentially useful way to
increase system performance, my boss sees that as a useful expenditure
of my time. Trading shots with someone who has indicated she really
doesn't know the answer probably would not meet his idea 'useful
expenditure of time', but he will probably get over it.

-Original Message-
From: Baker, Jennifer [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 2:37 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question

If performance is really an issue maybe you should consider different
hardware configurations. For instance, RAID 0+1 instead of RAID5, use
more disks in your RAID array to spread the data access, faster disks,
higher end controllers with more R/W cache, etc.

To worry about negligible performance (probably  .01%) increases while
investing actual productive time probably means you need your boss to
assign you more work. Unless, of course the time you spend measuring all
the differences in performance while tweaking your system with
different configurations actually translates to no extra cost.

-Original Message-
From: Martin, Jon [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 12:55 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question


Uh, if I understand you correctly, you are not much interested in
tweaking a few easy (during system installation, anyways) settings to
optimize (at no extra cost) the performance of your system.

Jon

-Original Message-
From: Baker, Jennifer [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 11:32 AM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question

If I understand you correctly, you are talking about some nit-picky
settings that probably will have very little, if any, affect on
performance.

-Original Message-
From: Martin, Jon [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 9:57 AM
To: Exchange Discussions
Subject: Allocation Unit (Cluster) Size Question


Exchange writes to the database in 4k pages. This being the case, does
it not make sense to format database drives in 4k Allocation Units
(clusters)? And beyond that, since my RAID controller gives me the
ability to control the stripe size, shouldn't make this 4k also? Get
everyone (database, OS and
hardware) in 4k harmony, so to speak.

On a similar track regarding transaction logs, if we have valid
information as to the average size of messages in our system, would
there be a performance boost by configuring the transaction log drive to
use clusters and stripes close to (but a little bigger

RE: Allocation Unit (Cluster) Size Question

2002-06-18 Thread Chris Jordan

This topic seems to arise every other year or so since early in Exchange
4.0. There is a heated debate on e-mail, with no-one really proving
anything. Then it all goes quiet.

At least this time we seem to have two valid approaches for those that want
to bother. A book by Curt Aubley and a website at Tricord.

I agree with Ed. I would like someone with more time than most of us have,
go out and investigate this in a real-world situation. Then report back
here, there and everywhere (MEC) to let the rest of us know whether we were
right or not in not worrying about it.

Cheers, Chris

-Original Message-
From: Ed Crowley [mailto:[EMAIL PROTECTED]]
Sent: 18 June 2002 05:01
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question


I would recommend that you beat this to death in the lab and then
present your findings at the MEC.  I would truly be interested (no
sarcasm, really) if there were any significant difference.

Ed Crowley MCSE+Internet MVP kcCC+I
Tech Consultant
hp Services
Protecting the world from PSTs and Bricked Backups!


-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]] On Behalf Of Martin, Jon
Sent: Monday, June 17, 2002 4:01 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question


Actually, my boss prefers that I get the most out of the money he spends
on hardware and software. When I ask a group of knowledgeable folks a
question concerning a little documented but potentially useful way to
increase system performance, my boss sees that as a useful expenditure
of my time. Trading shots with someone who has indicated she really
doesn't know the answer probably would not meet his idea 'useful
expenditure of time', but he will probably get over it.

-Original Message-
From: Baker, Jennifer [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 2:37 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question

If performance is really an issue maybe you should consider different
hardware configurations. For instance, RAID 0+1 instead of RAID5, use
more disks in your RAID array to spread the data access, faster disks,
higher end controllers with more R/W cache, etc.

To worry about negligible performance (probably  .01%) increases while
investing actual productive time probably means you need your boss to
assign you more work. Unless, of course the time you spend measuring all
the differences in performance while tweaking your system with
different configurations actually translates to no extra cost.

-Original Message-
From: Martin, Jon [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 12:55 PM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question


Uh, if I understand you correctly, you are not much interested in
tweaking a few easy (during system installation, anyways) settings to
optimize (at no extra cost) the performance of your system.

Jon

-Original Message-
From: Baker, Jennifer [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 11:32 AM
To: Exchange Discussions
Subject: RE: Allocation Unit (Cluster) Size Question

If I understand you correctly, you are talking about some nit-picky
settings that probably will have very little, if any, affect on
performance.

-Original Message-
From: Martin, Jon [mailto:[EMAIL PROTECTED]]
Sent: Monday, June 17, 2002 9:57 AM
To: Exchange Discussions
Subject: Allocation Unit (Cluster) Size Question


Exchange writes to the database in 4k pages. This being the case, does
it not make sense to format database drives in 4k Allocation Units
(clusters)? And beyond that, since my RAID controller gives me the
ability to control the stripe size, shouldn't make this 4k also? Get
everyone (database, OS and
hardware) in 4k harmony, so to speak.

On a similar track regarding transaction logs, if we have valid
information as to the average size of messages in our system, would
there be a performance boost by configuring the transaction log drive to
use clusters and stripes close to (but a little bigger) that the average
message size?

Or, do I have no clue as to how these things work (always a
possibility)?

Thanks . . .

_
List posting FAQ:   http://www.swinc.com/resource/exch_faq.htm
Archives:   http://www.swynk.com/sitesearch/search.asp
To unsubscribe: mailto:[EMAIL PROTECTED]
Exchange List admin:[EMAIL PROTECTED]

_
List posting FAQ:   http://www.swinc.com/resource/exch_faq.htm
Archives:   http://www.swynk.com/sitesearch/search.asp
To unsubscribe: mailto:[EMAIL PROTECTED]
Exchange List admin:[EMAIL PROTECTED]

_
List posting FAQ:   http://www.swinc.com/resource/exch_faq.htm
Archives:   http://www.swynk.com/sitesearch/search.asp
To unsubscribe