On Sunday 14 October 2007 06:40:58 nordi wrote:
> I wrote:
> > Ian, you should modify all tests to use the same 
> > language settings everywhere, because otherwise the results are pure 
> > bogus.
> The question is: Should we use POSIX or UTF8? If we use POSIX the 
> results are somehow unrealistic, because everyone uses UTF8 nowadays. If 
> we use UTF8, we cannot compare to older systems that do not support it.

Anyone else got any feelings on this?  Obviously we need to set it to 
something consistent.

My feeling is that I should set it to "en_US.UTF-8".  Rationale:

* Every (modern) install should support en_US.UTF-8.

* Like nordi said, benchmarking with settings no-one uses is going to
  be unrealistic; for example, say there was a machine with hardware
  UTF support (it could happen) -- then if the tests were run as POSIX
  they wouldn't show the improvement.

The big drawback, as nordi said, is that you lose consistency with pre-Unicode 
systems.  Or do you?  It's the old benchmarking problem of what it is that 
you're trying to measure.  If you're measuring kernel performance, then you 
should always use POSIX, to remove the effect of things like the shell.  But 
if you're measuring system performance -- which is what UnixBench is really 
designed for -- then you should use the system's default settings, so you 
measure what the system really does.  After all, Unicode systems *really do* 
go slower than ASCII systems, and the test results should reflect that.

Ian
-- 
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to