[Ukfreebsd] Benchmarks

[Robert Watson]

On Wed, 26 Nov 2008, O'Connor, Kevin wrote:

> It’s not often these days we see FreeBSD tested against Linux and Solaris so 
> I thought this might be of interest (Also the list is a bit quiet so I 
> didn’t think people would mind the noise)
> 
> I’m not sure I agree with the test methodology but we don’t come out to 
> badly.
> 
> http://www.phoronix.com/scan.php?page=article&item=os_threeway_2008&num=1

I would hesitate to use the word "methodology" to describe any performance 
measurement that doesn't mention the employment of statisics in analyzing the 
results :-).  A useful starting point would be to have them run each of those 
tests multiple times and see how the distributions of results compare instead 
of the results of a single run, since experience suggess that there can be 
significant variation between runs for some of these benchmarks and that 
simple comparison of mean performance for a single run can be misleading.  Not 
that I object to good FreeBSD performance results, of course :-).

Robert N M Watson
Computer Laboratory
University of Cambridge

> 
> 
> 
> Kevin
> 
> 
> 
> 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 
> This e-mail and any files transmitted with it are confidential and intended
> solely for the use of the individual or entity to whom they are addressed.
> If you have received this e-mail in error please notify the originator of the message. 
> 
> Any views expressed in this message are those of the individual sender,
> except where the sender specifies and with authority, states them to be
> the views of Merseyside Fire & Rescue Service, (MFRS).
> 
> Incoming and outgoing emails may be monitored in line with current legislation.
> 
> Steps have been taken to ensure that this email and attachments are 
> free from any virus.  In keeping with good computing practice the 
> recipient should ensure they are actually virus free.
> 
> http://www.merseyfire.gov.uk/
> 
> 
>