[Shootout-list] Many tests cheat
Brent Fulgham
bfulg@pacbell.net
Tue, 2 Nov 2004 11:56:07 -0800 (PST)
--- Isaac Gouy <igouy2@yahoo.com> wrote:
> > The benchmark obviously must be changed so the IO
> > speed isn't relevant -- right now several
> > benchmarks measure nothing else.
>
> IO speed isn't relevant because...?
>
It's certainly relevant, but some tests (like the hash
test) really measure IO speed rather than the speed of
storing and retrieving data in a 'hash' table.
It would be nice if each test measured some specific
aspect of a language.
Most of the tests do, but there are a few examples
where we missed the mark.
-Brent