[Shootout-list] Many tests cheat

Brent Fulgham bfulg@pacbell.net
Tue, 2 Nov 2004 11:56:07 -0800 (PST)


--- Isaac Gouy <igouy2@yahoo.com> wrote:

> > The benchmark obviously must be changed so the IO
> > speed isn't relevant -- right now several 
> > benchmarks measure nothing else.
> 
> IO speed isn't relevant because...?
> 

It's certainly relevant, but some tests (like the hash
test) really measure IO speed rather than the speed of
storing and retrieving data in a 'hash' table.

It would be nice if each test measured some specific
aspect of a language.

Most of the tests do, but there are a few examples
where we missed the mark.

-Brent