[Shootout-list] fannkuch (timer resolution; HZ=1000?)

John Skaller skaller@users.sourceforge.net
Wed, 25 May 2005 03:33:05 +1000


On Mon, 2005-05-23 at 17:26 +0300, Einar Karttunen wrote:

> If we measure per-benchmark startup times then it will be likely that
> either A or B will be punished. Thus the best way seems to be using hello
> for the startup time.

The 'best way(tm)' is to include the startup time in the result.
For low n, this will punish some systems (eg Java). For high
n it will reward some systems (eg Java) when the startup costs
bear fruit (eg Java JIT operation).

The real problem is that CRAPS concentrates on the times for
high n -- the hello test being the exception. Perhaps it should
have a higher weight :)

-- 
John Skaller, skaller at users.sf.net
PO Box 401 Glebe, NSW 2037, Australia Ph:61-2-96600850 
Download Felix here: http://felix.sf.net